-- Logs begin at Sat 2022-10-29 20:01:15 UTC, end at Sat 2022-10-29 22:25:37 UTC. -- Oct 29 20:35:33.714713 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 20:35:33.723924 ncdv-master-1 devstack@n-api.service[122457]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 20:35:33 2022] *** Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: nodename: ncdv-master-1 Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: machine: x86_64 Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: clock source: unix Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: pcre jit disabled Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: detected number of CPU cores: 4 Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: current working directory: / Oct 29 20:35:33.725921 ncdv-master-1 devstack@n-api.service[122457]: detected binary path: /usr/bin/uwsgi-core Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: your processes number limit is 47680 Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: your memory page size is 4096 bytes Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: detected max file descriptor number: 2048 Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: lock engine: pthread robust mutexes Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: thunder lock: enabled Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 20:35:33.726566 ncdv-master-1 devstack@n-api.service[122457]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 20:35:33.770135 ncdv-master-1 devstack@n-api.service[122457]: Python main interpreter initialized at 0x557abc78f9c0 Oct 29 20:35:33.770135 ncdv-master-1 devstack@n-api.service[122457]: python threads support enabled Oct 29 20:35:33.770135 ncdv-master-1 devstack@n-api.service[122457]: your server socket listen backlog is limited to 100 connections Oct 29 20:35:33.770135 ncdv-master-1 devstack@n-api.service[122457]: your mercy for graceful operations on workers is 90 seconds Oct 29 20:35:33.770453 ncdv-master-1 devstack@n-api.service[122457]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 20:35:33.770533 ncdv-master-1 devstack@n-api.service[122457]: *** Operational MODE: preforking *** Oct 29 20:35:33.770766 ncdv-master-1 devstack@n-api.service[122457]: *** uWSGI is running in multiple interpreter mode *** Oct 29 20:35:33.770766 ncdv-master-1 devstack@n-api.service[122457]: spawned uWSGI master process (pid: 122457) Oct 29 20:35:33.770944 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 20:35:33.771982 ncdv-master-1 devstack@n-api.service[122457]: spawned uWSGI worker 1 (pid: 122458, cores: 1) Oct 29 20:35:33.771982 ncdv-master-1 devstack@n-api.service[122457]: spawned uWSGI worker 2 (pid: 122459, cores: 1) Oct 29 20:35:33.771982 ncdv-master-1 devstack@n-api.service[122457]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 20:35:35.063510 ncdv-master-1 devstack@n-api.service[122459]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 20:35:35.064443 ncdv-master-1 devstack@n-api.service[122458]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 20:35:35.740147 ncdv-master-1 devstack@n-api.service[122458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:35:35.740147 ncdv-master-1 devstack@n-api.service[122458]: from cryptography.utils import int_from_bytes Oct 29 20:35:35.740468 ncdv-master-1 devstack@n-api.service[122458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:35:35.740468 ncdv-master-1 devstack@n-api.service[122458]: from cryptography.utils import int_from_bytes Oct 29 20:35:35.740647 ncdv-master-1 devstack@n-api.service[122459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:35:35.740647 ncdv-master-1 devstack@n-api.service[122459]: from cryptography.utils import int_from_bytes Oct 29 20:35:35.740765 ncdv-master-1 devstack@n-api.service[122459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:35:35.740765 ncdv-master-1 devstack@n-api.service[122459]: from cryptography.utils import int_from_bytes Oct 29 20:35:38.295711 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 20:35:38.296290 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 20:35:38.297054 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 20:35:38.297416 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 20:35:38.297696 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 20:35:38.298082 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.298409 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.298730 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.299049 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.299156 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 20:35:38.299508 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 20:35:38.299588 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.299667 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.299850 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 20:35:38.299959 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.300223 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 20:35:38.300321 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.300457 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 20:35:38.304101 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304231 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304318 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304389 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304456 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304520 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304591 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304677 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304745 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304821 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304894 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.304960 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305039 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305105 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305168 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305168 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305294 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305358 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305433 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305433 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305586 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305653 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305716 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305804 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305871 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305936 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.305999 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306063 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306127 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306198 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306263 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306327 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306389 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306452 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306530 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306607 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306674 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306743 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306808 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306871 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.306951 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.307258 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.307352 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.307509 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.307722 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.307839 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.307926 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.308132 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.308219 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.308485 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.308586 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.308820 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.308949 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.309134 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.309258 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.309443 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.309579 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.309825 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.309910 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.310142 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.310285 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.310466 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.310555 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.310758 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.310856 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.311078 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.311175 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.311398 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.311488 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.311857 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.311945 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.312165 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.312254 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.312471 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.312568 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.312778 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.312873 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313097 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313190 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313399 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313507 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313740 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313827 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.313991 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.314085 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.314298 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.314396 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.314621 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.314710 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.314945 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315032 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315245 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315340 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315507 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315594 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315758 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.315854 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316077 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316176 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316407 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316496 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316652 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316739 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.316954 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.317042 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.317271 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.317357 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.317614 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.317716 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.317922 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318009 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318172 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318265 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318420 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318518 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318738 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.318833 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319058 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319148 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319369 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319464 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319673 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319760 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.319978 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320079 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320281 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320378 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320587 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320726 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320892 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.320978 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.321195 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.321285 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.321519 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.321627 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.321839 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.321927 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.322149 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.322254 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.322468 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.322555 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.322833 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.322926 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.323143 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.323240 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.323450 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.323572 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.323757 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.323852 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324079 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324166 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324404 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324502 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324710 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324806 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.324962 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.325063 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.325264 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.325352 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.325592 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.325698 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.325916 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326010 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326223 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326312 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326535 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326631 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326840 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.326930 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.327142 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.327229 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.327474 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.327572 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.327722 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.327822 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328020 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328116 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328361 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328466 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328667 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328754 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.328972 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329059 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329277 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329366 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329608 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329709 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329908 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.329997 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.330209 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.330296 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.330508 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.330593 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.330812 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.330899 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.331115 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.331204 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.331417 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.331510 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.331719 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.331816 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.332016 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.335477 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.335477 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.335662 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.335745 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.335824 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.335987 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336072 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336157 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336283 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336371 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336460 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336559 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336640 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336718 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336796 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336887 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.336969 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337056 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337146 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337232 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337312 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337390 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337485 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337629 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337734 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337817 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.337902 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338023 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338121 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338209 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338289 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338366 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338467 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338548 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338636 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338717 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338795 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338881 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.338962 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339039 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339127 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339207 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339207 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339348 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339425 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339503 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339585 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339661 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339738 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339815 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339902 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.339990 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.340077 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.340157 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.340284 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.340410 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.340630 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.340744 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.340920 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.341012 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.341221 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.341325 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.341601 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.341728 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.341919 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.342018 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.342237 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.342325 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.342541 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.342638 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.343375 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.343469 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.343687 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.343773 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.344004 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:35:38.344102 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.344312 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.344398 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.344624 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.344712 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.344935 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.345023 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.345256 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.345343 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.345597 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.345699 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.345932 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346020 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346246 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346372 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346556 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346658 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346868 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.346976 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.347175 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.347269 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.347487 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.347573 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.347795 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.347891 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.348101 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.348196 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.348416 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.348503 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.348728 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.348816 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.349054 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.349141 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.349372 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.349493 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.349711 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.349800 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350027 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350116 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350333 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350428 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350643 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350737 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.350954 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351041 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351266 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351399 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351575 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351662 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351887 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.351973 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.352207 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.352302 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.352522 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.352610 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.352848 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.352979 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.353161 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.353276 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.353497 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.353616 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.353797 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.353888 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.354106 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.354196 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.354415 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.354501 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.354750 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.354857 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.355063 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.355153 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.355386 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.355474 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.355701 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.355787 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356013 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356102 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356335 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356423 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356646 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356735 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.356955 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357043 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357262 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357349 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357590 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357701 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357897 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.357991 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.358203 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.358291 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.358564 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.359176 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.359394 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.359484 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.359705 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.359830 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.360017 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.360115 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.360324 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.360414 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.360691 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.360778 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361001 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361098 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361301 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361390 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361630 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361722 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.361934 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362024 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362238 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362325 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362537 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362623 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362848 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.362936 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.363155 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.363242 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.363461 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.363554 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.363777 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.363865 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364081 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364167 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364388 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364499 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364692 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364782 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.364997 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.365096 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.365297 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.365401 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.365633 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.365723 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.365938 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366027 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366241 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366377 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366552 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366639 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366854 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.366940 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.367156 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.367253 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.367472 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.367566 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.367773 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.367859 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368077 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368175 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368386 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368475 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368691 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368781 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.368997 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.369086 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.369312 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.369401 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.369643 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.369734 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.369948 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370043 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370253 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370352 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370556 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370643 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370859 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.370949 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.371166 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.371254 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.371469 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.371553 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.371770 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.371866 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372071 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372159 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372373 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372472 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372675 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372762 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.372975 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.373062 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.373276 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.373372 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.373602 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.373692 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.373905 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374004 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374246 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374347 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374550 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374638 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374850 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.374938 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.375148 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.375245 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.375447 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.375542 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.375748 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.375882 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376067 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376158 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376370 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376501 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376669 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376757 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.376967 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.377056 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.377265 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.377360 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.377625 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.377718 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.377928 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378025 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378266 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378355 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378575 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378661 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378897 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.378986 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.379206 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.379294 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.379516 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.379612 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.379825 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.379912 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.380131 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.380228 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.380431 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.380528 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.380735 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.380828 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.381041 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.381129 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.381357 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.381472 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.381692 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.381791 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382007 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382095 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382314 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382417 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382632 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382719 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.382937 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383025 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383246 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383341 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383552 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383647 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383858 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.383945 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.384180 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.384271 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.384491 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.384591 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.384806 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.384894 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.385115 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.385202 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.385419 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.385558 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.385752 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.385841 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.386056 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.386152 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.386366 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.386536 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.386680 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.386859 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387005 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387169 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387339 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387486 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387647 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387796 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.387957 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.388113 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.388277 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.388418 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.388589 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.388740 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.388900 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.389054 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.389209 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.389370 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.389537 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.389708 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.389867 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390039 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390182 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390362 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390478 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390691 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390781 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.390997 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.391085 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.391306 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.391401 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.391622 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.391710 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.391928 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392025 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392234 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392332 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392538 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392626 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392839 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.392938 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.393139 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.393240 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.393443 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.393580 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.393774 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.393863 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394078 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394175 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394382 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394477 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394681 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394769 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.394991 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.395087 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.395297 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.395387 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.395594 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.395680 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.395894 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396028 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396194 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396281 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396511 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396602 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396821 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.396964 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.397124 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.397211 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.397438 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.397547 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.397761 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.397886 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398064 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398151 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398374 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398469 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398682 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398769 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.398982 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399070 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399282 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399380 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399581 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399741 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399891 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.399977 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.400202 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.400300 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.400499 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.400595 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.400808 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.400902 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.401115 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.401215 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.401415 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.401552 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.401746 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.401867 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402050 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402231 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402355 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402561 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402672 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402869 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.402970 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.403180 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.403268 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.403497 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.403584 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.403853 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.404072 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.404162 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.404406 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.404494 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.404724 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.404838 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.405044 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.405133 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.405865 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.405985 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.406187 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.406318 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.406491 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.406654 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.406800 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.406992 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.407111 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.407306 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.407615 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.407711 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.407925 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408013 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408232 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408319 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408538 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408634 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408848 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.408936 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.409153 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.409326 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.409477 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.409606 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.409787 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.409917 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.410096 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.410210 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.411929 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412091 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412179 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412327 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412412 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412412 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412570 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412660 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412753 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412841 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.412921 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413000 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413079 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413166 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413247 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413327 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413406 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413531 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413614 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413716 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413847 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.413936 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.414151 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.414239 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.414455 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.414533 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.414759 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.414834 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.415420 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.415559 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.415678 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.415792 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.415908 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416028 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416119 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416199 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416276 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416387 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416551 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416713 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.416855 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417028 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417172 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417336 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417425 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417669 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417793 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.417981 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.418078 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.418290 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.418415 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.418595 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.418743 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.418906 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.419099 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.419215 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.419404 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.419525 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.419709 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.419835 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420031 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420140 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420335 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420448 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420638 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420755 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.420940 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.421113 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.421802 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.421927 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.422110 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.422235 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.422416 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.422538 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.422725 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.422824 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423031 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423129 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423336 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423433 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423640 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423738 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.423940 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424035 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424243 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424338 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424541 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424649 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424852 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.424940 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.425156 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.425245 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.425485 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.425590 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.425775 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.425863 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426074 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426211 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426373 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426469 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426672 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426768 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.426978 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427086 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427278 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427386 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427583 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427673 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427882 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.427970 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.428182 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.428276 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.428478 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.428565 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.428790 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.428876 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.429094 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.429189 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.429395 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.429522 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.429728 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.429816 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430032 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430121 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430333 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430418 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430634 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430741 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.430938 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431035 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431235 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431322 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431532 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431632 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431828 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.431923 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.432149 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.432236 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.432433 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.432537 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.432730 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.432817 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433036 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433123 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433334 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433433 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433662 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433750 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.433964 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434051 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434303 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434402 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434605 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434698 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434904 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.434993 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.435203 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.435291 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.435501 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.435588 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.435802 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.435896 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.436120 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.436209 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.436425 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.436514 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.436746 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.436846 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437049 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437163 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437347 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437503 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437682 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437771 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.437994 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.438123 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.438293 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.438379 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.438597 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.438684 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.438919 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439008 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439232 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439320 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439537 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439633 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439846 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.439934 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.440154 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.440241 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.440451 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.440564 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.440776 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.440870 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441067 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441155 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441373 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441502 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441697 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441830 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.441996 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.442087 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.442300 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.442409 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.442610 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.442699 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.442915 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.443049 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.443234 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.443362 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.443555 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.443674 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.443878 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444039 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444182 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444347 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444488 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444657 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444794 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.444963 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.445097 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.445266 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.445402 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.445615 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.445732 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.445924 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446024 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446230 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446317 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446536 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446630 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446839 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.446928 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.447156 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.447243 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.447460 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.447555 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.447778 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.447891 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.448081 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.448203 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.448388 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.448513 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.448709 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.448818 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449012 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449128 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449311 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449437 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449640 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449770 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.449940 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.450082 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.450245 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.450386 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.450544 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.450802 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.450968 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451112 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451303 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451444 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451612 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451700 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451912 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.451999 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.452231 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.452332 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.452614 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.452718 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.452936 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453025 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453241 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453339 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453566 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453668 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453869 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.453986 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.454189 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.454289 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.454492 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.454580 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.454814 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.454903 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.455167 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.455261 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.455469 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.455558 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.455777 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.455865 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456098 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456195 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456398 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456486 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456699 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456793 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.456998 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.457087 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.457315 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.457405 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.457642 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.457751 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.457960 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.458049 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.458326 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.458438 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.458633 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.458722 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.458953 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459049 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459273 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459360 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459631 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459725 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459897 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.459995 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.460202 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.460292 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.460524 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.460613 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.460845 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.460941 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.461156 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.461286 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.461480 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.461571 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.461786 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.461974 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.462106 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.462299 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.462426 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.462615 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.462743 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.462935 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.463026 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.463264 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.463465 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.463573 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.463801 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.463891 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.464124 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.464211 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.464434 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.464521 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.464755 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.464844 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.465074 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.465169 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.465379 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.465499 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.465716 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.465805 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466027 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466114 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466334 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466432 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466641 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466731 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.466945 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.467032 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.467271 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.467387 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.467577 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.467686 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.468385 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.468485 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.468711 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.468808 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469011 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469100 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469322 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469425 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469655 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469758 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.469959 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470046 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470263 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470350 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470566 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470655 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470886 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.470974 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.471186 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.471291 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.471509 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.471604 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.471815 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.471904 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.472132 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.472219 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.472448 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.472548 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.472750 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.472845 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.473067 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.473154 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.473370 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.473483 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.473711 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.473800 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474013 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474115 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474314 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474402 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474633 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474719 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.474944 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475045 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475249 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475335 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475556 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475644 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475867 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.475963 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.476172 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.476267 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.476478 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.476615 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.476787 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.476888 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.477095 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.477183 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.477398 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.477519 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.477726 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.477816 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478031 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478134 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478331 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478426 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478637 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478726 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.478944 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479032 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479245 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479333 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479546 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479633 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479844 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.479930 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.480145 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.480231 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.480441 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.480529 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.480739 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.480826 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.481039 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.481140 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.481356 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.481443 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.481698 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.481796 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482018 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482123 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482325 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482413 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482624 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482719 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.482923 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.483022 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.483222 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.483314 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.483582 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.484172 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.484386 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.484487 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.484693 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.484788 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485003 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485089 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485315 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485404 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485653 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485744 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.485968 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.486182 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.486278 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.486512 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.486600 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.486824 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.486921 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.487134 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.487232 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.487451 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.487546 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.487760 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.487854 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488071 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488174 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488378 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488465 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488686 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488772 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.488996 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.489204 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.489291 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.489560 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.489717 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.489873 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.490044 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.490182 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.490372 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.490475 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.490708 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.490796 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491026 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491129 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491341 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491429 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491653 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491753 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.491958 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492047 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492264 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492351 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492588 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492752 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492905 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.492992 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.493219 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.493316 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.493566 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.493657 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.493880 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.493970 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.494190 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.494276 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.494500 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.494589 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.494809 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.494896 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.495158 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.495261 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.495469 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.495556 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.495767 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.495853 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496075 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496174 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496384 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496470 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496690 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496839 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.496999 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.497096 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.497306 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.497395 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.497640 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.497740 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.497949 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.498120 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.498253 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.498343 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.498561 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.498769 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.498866 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.499089 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.499191 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.499445 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.499534 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.499774 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.499874 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.500104 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.500192 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.500409 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.500503 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.500717 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.500813 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501027 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501114 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501338 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501564 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501670 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501879 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.501980 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.502210 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.502297 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.502531 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.502631 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.502854 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.502941 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.503159 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.503248 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.503463 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.503568 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.503779 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.503866 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.504078 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.504176 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.504378 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.504604 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.504693 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.504949 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505036 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505252 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505353 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505619 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505718 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505893 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.505991 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.506194 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.506295 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.506506 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.506592 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.506807 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.506894 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.507118 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.507335 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.507424 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.507681 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.507767 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.507997 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.508092 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.508313 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.508403 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.508619 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.508706 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.508928 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509023 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509233 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509321 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509561 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509652 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509873 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.509974 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.510175 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.510261 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.510488 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.510582 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.510792 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.510896 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511090 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511191 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511390 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511477 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511691 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511790 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.511992 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512078 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512288 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512381 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512587 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512675 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512881 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.512967 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.513188 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.513284 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.513509 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.513599 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.513815 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.513902 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.514116 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.514203 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.514424 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.514516 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.514762 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.514867 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.515068 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.515156 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.515369 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.515522 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.515703 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.515975 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.516061 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.516274 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.516368 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.516578 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.516665 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.516874 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517007 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517181 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517270 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517528 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517620 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517843 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.517931 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.518146 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.518242 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.518463 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.518561 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.518770 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.518859 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.519068 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.519302 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.519390 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.519637 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.519725 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.519958 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520054 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520265 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520351 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520573 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520667 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520898 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.520993 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.521203 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.521289 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.521536 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.521753 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.521922 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.522082 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.522170 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.522396 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.522483 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.522722 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.522821 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523030 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523116 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523337 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523430 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523636 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523724 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.523934 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524022 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524236 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524322 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524539 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524626 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524840 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.524926 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.525142 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.525229 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.525446 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.525553 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.525771 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.525857 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.526075 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.526174 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.526392 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.526733 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.527051 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.527264 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.527361 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.527675 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.527990 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.528425 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.528763 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.529092 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.529193 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.529415 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.529535 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.529762 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.529857 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.530078 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.530184 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.530898 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.530995 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.531223 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.531386 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.531569 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.531711 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.531894 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.532020 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.532216 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.532534 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.532708 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.532856 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.533030 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.533170 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.533356 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.533655 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.533833 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.534037 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.534197 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.534395 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.534534 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.534723 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.534871 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.535040 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.535179 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.535359 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.535501 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.535669 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.535813 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.536004 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.536344 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.536683 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.536914 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.537013 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.537235 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.537371 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.537563 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.537697 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.537873 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538018 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538185 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538342 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538496 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538638 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538810 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.538953 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.539119 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.539254 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.539424 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.539560 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.539730 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.539866 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540037 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540173 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540343 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540488 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540690 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540820 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.540973 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541105 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541238 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541370 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541576 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541665 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541851 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.541979 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.542141 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.542232 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.542446 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.542536 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.542749 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.542838 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543051 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543148 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543351 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543435 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543649 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543744 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.543950 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544050 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544252 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544340 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544550 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544638 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544851 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.544960 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.545147 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.545241 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.545448 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.545568 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.545772 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.545871 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.546123 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.546224 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.546426 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.546514 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.546727 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.546834 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547032 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547138 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547333 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547422 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547635 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547725 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.547937 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548025 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548238 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548342 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548547 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548661 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548872 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.548968 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.549202 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.549289 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.549533 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.549626 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.549847 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.549935 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.550154 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.550255 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.550460 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.550547 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.550766 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.550854 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.551085 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.551182 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.551404 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.551499 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.551705 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.551792 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552007 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552103 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552334 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552422 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552639 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552728 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.552948 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.553039 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.553257 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.553343 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.553600 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.553691 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.553909 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554000 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554213 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554301 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554544 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554634 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554856 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.554954 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.555166 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.555254 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.555484 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.555572 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.555795 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.555886 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.556106 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.556202 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.556419 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.556522 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.556729 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.556817 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.557054 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.557141 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.557364 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.557486 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.557701 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.557800 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558005 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558093 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558312 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558410 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558628 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558738 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.558942 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559031 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559249 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559338 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559557 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559644 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559870 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.559965 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.560181 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.560270 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.560505 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.560595 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.560744 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 20:35:38.560832 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.561122 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.561445 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.561816 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.562157 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.562469 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.562809 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.563137 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.563450 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.563759 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.564061 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:35:38.564302 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 20:35:38.627247 ncdv-master-1 devstack@n-api.service[122458]: INFO dbcounter [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Registered counter for database nova_api Oct 29 20:35:38.629303 ncdv-master-1 devstack@n-api.service[122459]: INFO dbcounter [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Registered counter for database nova_api Oct 29 20:35:38.647768 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_db.sqlalchemy.engines [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.649376 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_db.sqlalchemy.engines [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.654550 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writer thread running {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.656350 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writer thread running {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.713007 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.context [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=122458) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 20:35:38.713676 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.context [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=122459) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 20:35:38.716833 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_concurrency.lockutils [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:35:38.717316 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_concurrency.lockutils [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:35:38.717551 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:35:38.718655 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:35:38.719503 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_concurrency.lockutils [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:35:38.720311 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:35:38.720405 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_concurrency.lockutils [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:35:38.720786 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_concurrency.lockutils [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:35:38.721093 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:35:38.721566 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:35:38.722814 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_concurrency.lockutils [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:35:38.723563 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:35:38.724897 ncdv-master-1 devstack@n-api.service[122458]: INFO dbcounter [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Registered counter for database nova_cell0 Oct 29 20:35:38.725623 ncdv-master-1 devstack@n-api.service[122459]: INFO dbcounter [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Registered counter for database nova_cell0 Oct 29 20:35:38.729022 ncdv-master-1 devstack@n-api.service[122458]: INFO dbcounter [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Registered counter for database nova_cell1 Oct 29 20:35:38.729709 ncdv-master-1 devstack@n-api.service[122459]: INFO dbcounter [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Registered counter for database nova_cell1 Oct 29 20:35:38.736890 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_db.sqlalchemy.engines [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.740043 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_db.sqlalchemy.engines [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.740655 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_db.sqlalchemy.engines [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.742892 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_db.sqlalchemy.engines [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.747077 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writer thread running {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.747193 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writer thread running {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.748455 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writer thread running {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.883065 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writer thread running {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.891564 ncdv-master-1 devstack@n-api.service[122458]: INFO dbcounter [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Registered counter for database nova_cell0 Oct 29 20:35:38.893329 ncdv-master-1 devstack@n-api.service[122459]: INFO dbcounter [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Registered counter for database nova_cell0 Oct 29 20:35:38.900512 ncdv-master-1 devstack@n-api.service[122458]: DEBUG oslo_db.sqlalchemy.engines [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.904050 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_db.sqlalchemy.engines [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:35:38.905265 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writer thread running {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:38.909155 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writer thread running {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:35:39.360880 ncdv-master-1 devstack@n-api.service[122458]: WARNING keystonemiddleware.auth_token [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:35:39.362346 ncdv-master-1 devstack@n-api.service[122459]: WARNING keystonemiddleware.auth_token [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:35:39.368149 ncdv-master-1 devstack@n-api.service[122458]: WARNING keystonemiddleware.auth_token [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:35:39.369651 ncdv-master-1 devstack@n-api.service[122459]: WARNING keystonemiddleware.auth_token [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:35:39.590852 ncdv-master-1 devstack@n-api.service[122458]: WARNING keystonemiddleware.auth_token [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:35:39.594031 ncdv-master-1 devstack@n-api.service[122459]: WARNING keystonemiddleware.auth_token [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:35:39.596857 ncdv-master-1 devstack@n-api.service[122458]: WARNING keystonemiddleware.auth_token [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:35:39.599971 ncdv-master-1 devstack@n-api.service[122459]: WARNING keystonemiddleware.auth_token [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:35:39.602108 ncdv-master-1 devstack@n-api.service[122458]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557abc78f9c0 pid: 122458 (default app) Oct 29 20:35:39.604167 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:35:39.605244 ncdv-master-1 devstack@n-api.service[122459]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557abc78f9c0 pid: 122459 (default app) Oct 29 20:35:39.605362 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e640b7ee-2cbf-49cd-831f-2a02568aea4d None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001691 Oct 29 20:35:39.605749 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Sat Oct 29 20:35:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:06.957851 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:06.959040 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Oct 29 20:37:06.959451 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:06.970764 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_api:SELECT=3 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:06.971729 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_cell0:SELECT=3 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:06.973155 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_cell1:SELECT=3 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:06.973918 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:07.824868 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-a2495a8d-6b4c-4302-96a9-361306667595 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:07.856650 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-a2495a8d-6b4c-4302-96a9-361306667595 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891107 Oct 29 20:37:07.858071 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 20:37:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:10.796002 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:10.797009 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-66466ba4-7e60-4f6c-9d67-cd1faac94663 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 29 20:37:10.797396 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:11.236660 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-cfbdea11-f1d5-41e6-9d8b-02d09bbb8b62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:11.285695 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-cfbdea11-f1d5-41e6-9d8b-02d09bbb8b62 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481550 Oct 29 20:37:11.286260 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:11.300673 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_api:SELECT=3 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:11.301085 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_cell0:SELECT=3 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:11.302091 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_cell1:SELECT=3 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:11.302857 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:11.508797 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-7e7cbee6-6251-4bf2-9cdd-a052f1dfa101 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:11.575127 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-7e7cbee6-6251-4bf2-9cdd-a052f1dfa101 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280113 Oct 29 20:37:11.577543 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 29 20:37:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:14.511086 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-cfbdea11-f1d5-41e6-9d8b-02d09bbb8b62 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:14.512191 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-cfbdea11-f1d5-41e6-9d8b-02d09bbb8b62 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 29 20:37:14.520063 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:15.404743 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-27b4ba90-297e-444b-bdee-46712fadb04a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "ram": 512}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:15.454357 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-27b4ba90-297e-444b-bdee-46712fadb04a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.926781 Oct 29 20:37:15.455556 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:15.490850 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-8cb1a06f-4eb2-4edb-8ea3-1ee3f01adc5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:15.566499 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-8cb1a06f-4eb2-4edb-8ea3-1ee3f01adc5c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094528 Oct 29 20:37:15.583652 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 29 20:37:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:18.739208 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-27b4ba90-297e-444b-bdee-46712fadb04a admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:18.739689 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-27b4ba90-297e-444b-bdee-46712fadb04a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 29 20:37:18.745053 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:19.226707 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-0b07931b-3f9a-4d8a-868d-7a85935d058f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:19.246052 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-0b07931b-3f9a-4d8a-868d-7a85935d058f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499498 Oct 29 20:37:19.246606 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:19.259419 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-078a15ab-76c6-46e7-994c-9fe2fe556b6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:19.289295 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-078a15ab-76c6-46e7-994c-9fe2fe556b6b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033547 Oct 29 20:37:19.301482 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 29 20:37:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:22.421057 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-0b07931b-3f9a-4d8a-868d-7a85935d058f admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:22.422107 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-0b07931b-3f9a-4d8a-868d-7a85935d058f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 29 20:37:22.422512 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:22.848364 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-906ff5a1-14e1-44db-8ce8-a2e810c8b53d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "ram": 2048, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "disk": 10}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:22.869367 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-906ff5a1-14e1-44db-8ce8-a2e810c8b53d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440816 Oct 29 20:37:22.869982 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:22.882952 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-784d6ae7-deca-4b6f-83a2-86d53f9cb08f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:22.910715 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-784d6ae7-deca-4b6f-83a2-86d53f9cb08f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031619 Oct 29 20:37:22.911308 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 29 20:37:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:37:25.847326 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-906ff5a1-14e1-44db-8ce8-a2e810c8b53d admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:25.849191 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-906ff5a1-14e1-44db-8ce8-a2e810c8b53d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Oct 29 20:37:25.855013 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:26.322573 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-7743b166-6876-4da4-81f4-6387975e2e2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "ds4G", "ram": 4096, "vcpus": 4}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:26.343211 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-7743b166-6876-4da4-81f4-6387975e2e2b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486839 Oct 29 20:37:26.344077 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:26.356372 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-30228360-8152-4718-9c16-257875eb64bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:26.381791 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-30228360-8152-4718-9c16-257875eb64bc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029207 Oct 29 20:37:26.382546 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Sat Oct 29 20:37:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:29.363210 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-7743b166-6876-4da4-81f4-6387975e2e2b admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:29.364143 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-7743b166-6876-4da4-81f4-6387975e2e2b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 29 20:37:29.364541 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:37:29.815321 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-51896a5e-2836-40ba-9f4f-59440829ce07 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:29.840467 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-51896a5e-2836-40ba-9f4f-59440829ce07 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469633 Oct 29 20:37:29.841014 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 20:37:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:37:32.781641 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-7743b166-6876-4da4-81f4-6387975e2e2b admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:32.783222 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-7743b166-6876-4da4-81f4-6387975e2e2b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Oct 29 20:37:32.783876 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:33.252677 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-6148d1e1-35af-4b23-822f-0983d4f979ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:33.287437 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-6148d1e1-35af-4b23-822f-0983d4f979ec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.494074 Oct 29 20:37:33.288450 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:33.301635 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-983d4325-ea9d-4f01-8f9f-59a832f75355 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:33.343217 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-983d4325-ea9d-4f01-8f9f-59a832f75355 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045309 Oct 29 20:37:33.343880 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 29 20:37:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:36.479625 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-6148d1e1-35af-4b23-822f-0983d4f979ec admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:36.480688 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-6148d1e1-35af-4b23-822f-0983d4f979ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Oct 29 20:37:36.481094 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:36.882954 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-123235cd-c811-4973-a192-2238cd4995f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small"}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:36.901670 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-123235cd-c811-4973-a192-2238cd4995f1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413649 Oct 29 20:37:36.902342 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:37:36.915001 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-b86a1aa6-9dd3-4f22-8c27-150e762de107 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:36.938585 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-b86a1aa6-9dd3-4f22-8c27-150e762de107 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027503 Oct 29 20:37:36.939158 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 29 20:37:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:39.897958 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-123235cd-c811-4973-a192-2238cd4995f1 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:39.899609 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-123235cd-c811-4973-a192-2238cd4995f1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Oct 29 20:37:39.900011 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:40.343981 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-676cfc12-0e3d-4f11-8634-3a09fde1785c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "disk": 40, "name": "m1.medium", "swap": 0, "vcpus": 2}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:40.368368 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-676cfc12-0e3d-4f11-8634-3a09fde1785c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.459880 Oct 29 20:37:40.368915 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:40.381371 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-74cb975f-6f07-4fd7-8a74-64acaf4889ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:40.386486 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:40.416022 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-74cb975f-6f07-4fd7-8a74-64acaf4889ac admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038453 Oct 29 20:37:40.435805 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 29 20:37:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:37:43.418909 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-676cfc12-0e3d-4f11-8634-3a09fde1785c admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:43.419965 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-676cfc12-0e3d-4f11-8634-3a09fde1785c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 29 20:37:43.420366 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:43.874253 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-7cf8e20b-0789-4cec-9123-ee10872e8bc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:43.897568 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-7cf8e20b-0789-4cec-9123-ee10872e8bc1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471113 Oct 29 20:37:43.898705 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:37:43.911213 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-aeca4173-1734-4887-a3b2-a82fc8ade4b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:43.921919 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:37:43.950107 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-aeca4173-1734-4887-a3b2-a82fc8ade4b5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042687 Oct 29 20:37:43.951315 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 29 20:37:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:37:46.991206 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-7cf8e20b-0789-4cec-9123-ee10872e8bc1 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:37:46.992211 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-7cf8e20b-0789-4cec-9123-ee10872e8bc1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 29 20:37:46.992906 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:37:47.456632 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-03bd8f82-cd10-4f67-9f6f-805995af15cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "ram": 16384, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:47.481031 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-03bd8f82-cd10-4f67-9f6f-805995af15cf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.482162 Oct 29 20:37:47.481627 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Sat Oct 29 20:37:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:37:47.494015 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-b8588c71-78fb-45ac-94f2-731f1a67200f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:37:47.523073 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-b8588c71-78fb-45ac-94f2-731f1a67200f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032903 Oct 29 20:37:47.524219 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Sat Oct 29 20:37:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:38:07.104725 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-03bd8f82-cd10-4f67-9f6f-805995af15cf admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:07.105781 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-03bd8f82-cd10-4f67-9f6f-805995af15cf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 29 20:38:07.106706 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:07.117443 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:38:07.499097 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-5c940bb9-2854-4cc4-b731-530fdf5491bb admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:07.517638 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-5c940bb9-2854-4cc4-b731-530fdf5491bb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404728 Oct 29 20:38:07.518173 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 20:38:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:38:09.398308 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-03bd8f82-cd10-4f67-9f6f-805995af15cf admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:09.399316 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-03bd8f82-cd10-4f67-9f6f-805995af15cf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 29 20:38:09.399741 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:10.008901 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-235e5b93-4053-43db-ab1a-b638e0f5f88e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:10.014925 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.wsgi [None req-235e5b93-4053-43db-ab1a-b638e0f5f88e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-235e5b93-4053-43db-ab1a-b638e0f5f88e admin admin] Request method failure captured: Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Accept: application/json Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Accept-Encoding: gzip, deflate Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Connection: keep-alive Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Content-Length: 0 Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Host: 10.222.0.36 Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Openstack-Api-Version: compute 2.92 Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: Openstack-System-Scope: None Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: User-Agent: python-novaclient Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Auth-Token: gAAAAABjXY8xpkN1_cuduBkTdbImuzXUNvmK-QyANMoBjYPa3QienuISSXiFRnSM8pVeak44aKWm__xilgeZL7lYCI7FZEZHM9651qL6yuJo2snhGsvVDLXjNg1OXYXp1bI1hF8JKicw5zADQGcN3NJUI0kC5yxT1ffxUyGMzlHgpxrt2ZDz1GI Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Domain-Id: None Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Domain-Name: None Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Identity-Status: Confirmed Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Is-Admin-Project: True Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Domain-Id: default Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Domain-Name: Default Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Name: admin Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Role: reader,admin,member Oct 29 20:38:10.025780 ncdv-master-1 devstack@n-api.service[122458]: X-Roles: reader,admin,member Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant: admin Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant-Name: admin Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-User: admin Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-User-Domain-Id: default Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-User-Domain-Name: Default Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-User-Id: 6e799a80f6b7425fbcda2c5fd254c3e6 Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: X-User-Name: admin Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: method: > Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: exception: Flavor 42 could not be found. Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: action_args: {'id': '42'} Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:38:10.027498 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:10.028495 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.029961 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-235e5b93-4053-43db-ab1a-b638e0f5f88e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=122458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:38:10.031278 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-235e5b93-4053-43db-ab1a-b638e0f5f88e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396071 Oct 29 20:38:10.031278 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:38:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:10.036933 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-a5b7c468-5070-47f9-b630-15ff59382c37 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:10.041163 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:38:10.062271 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-a5b7c468-5070-47f9-b630-15ff59382c37 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028832 Oct 29 20:38:10.062802 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 29 20:38:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:38:10.076254 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-bb56182e-62ec-4f24-b0d3-46e34c971d1a admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:10.097645 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-bb56182e-62ec-4f24-b0d3-46e34c971d1a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028635 Oct 29 20:38:10.098184 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 29 20:38:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:38:10.108820 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-eef13697-50c6-4d8a-849e-bcde561f00eb admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:10.114358 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.wsgi [None req-eef13697-50c6-4d8a-849e-bcde561f00eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-eef13697-50c6-4d8a-849e-bcde561f00eb admin admin] Request method failure captured: Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Accept: application/json Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Accept-Encoding: gzip, deflate Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Connection: keep-alive Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Content-Length: 0 Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Host: 10.222.0.36 Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Openstack-Api-Version: compute 2.92 Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: Openstack-System-Scope: None Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: User-Agent: python-novaclient Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Auth-Token: gAAAAABjXY8xpkN1_cuduBkTdbImuzXUNvmK-QyANMoBjYPa3QienuISSXiFRnSM8pVeak44aKWm__xilgeZL7lYCI7FZEZHM9651qL6yuJo2snhGsvVDLXjNg1OXYXp1bI1hF8JKicw5zADQGcN3NJUI0kC5yxT1ffxUyGMzlHgpxrt2ZDz1GI Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Domain-Id: None Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Domain-Name: None Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Identity-Status: Confirmed Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Is-Admin-Project: True Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Domain-Id: default Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Domain-Name: Default Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Name: admin Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Role: reader,admin,member Oct 29 20:38:10.117603 ncdv-master-1 devstack@n-api.service[122459]: X-Roles: reader,admin,member Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant: admin Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant-Name: admin Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-User: admin Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-User-Domain-Id: default Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-User-Domain-Name: Default Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-User-Id: 6e799a80f6b7425fbcda2c5fd254c3e6 Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: X-User-Name: admin Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: method: > Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: exception: Flavor 42 could not be found. Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: action_args: {'id': '42'} Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:38:10.119119 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:10.120058 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:10.121199 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-eef13697-50c6-4d8a-849e-bcde561f00eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=122459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:38:10.123372 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-eef13697-50c6-4d8a-849e-bcde561f00eb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014898 Oct 29 20:38:10.123372 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:38:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:11.887130 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-bb56182e-62ec-4f24-b0d3-46e34c971d1a admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:11.888166 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-bb56182e-62ec-4f24-b0d3-46e34c971d1a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 29 20:38:11.888567 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:38:12.418900 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-e0eacb89-6411-4099-9d87-d5d1b36b5476 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:12.423934 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.wsgi [None req-e0eacb89-6411-4099-9d87-d5d1b36b5476 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-e0eacb89-6411-4099-9d87-d5d1b36b5476 admin admin] Request method failure captured: Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Accept: application/json Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Accept-Encoding: gzip, deflate Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Connection: keep-alive Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Content-Length: 0 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Host: 10.222.0.36 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Openstack-Api-Version: compute 2.92 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: Openstack-System-Scope: None Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: User-Agent: python-novaclient Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Auth-Token: gAAAAABjXY8zHmAsoRXgVFFJmvr06lJnyN5chpy_38-vtiOz31q2LLz99kTlkLapGdP5YZyXog9kweB2r6kIBRQX8FjjvmnmDDexyTItxJi3IMygbeZSOjVEmgisTEUax_qRlW66Kp03rOolPwLLdiJ_6uSi-5yBZrMEvlolURBcISylB993bD8 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Domain-Id: None Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Domain-Name: None Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Identity-Status: Confirmed Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Is-Admin-Project: True Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Domain-Id: default Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Domain-Name: Default Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Name: admin Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Role: reader,admin,member Oct 29 20:38:12.425423 ncdv-master-1 devstack@n-api.service[122459]: X-Roles: reader,admin,member Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant: admin Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant-Name: admin Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-User: admin Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-User-Domain-Id: default Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-User-Domain-Name: Default Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-User-Id: 6e799a80f6b7425fbcda2c5fd254c3e6 Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: X-User-Name: admin Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: method: > Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: exception: Flavor 84 could not be found. Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: action_args: {'id': '84'} Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:38:12.426878 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:12.427644 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.428721 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-e0eacb89-6411-4099-9d87-d5d1b36b5476 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=122459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:38:12.429772 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-e0eacb89-6411-4099-9d87-d5d1b36b5476 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392695 Oct 29 20:38:12.429772 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:38:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:12.436668 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-541b9f10-42ac-4805-a055-3ad081583c25 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:12.451892 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-541b9f10-42ac-4805-a055-3ad081583c25 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018828 Oct 29 20:38:12.452415 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 29 20:38:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:38:12.461653 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-f8b3c605-a682-429e-ab78-a967256f78db admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:12.477301 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-f8b3c605-a682-429e-ab78-a967256f78db admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019103 Oct 29 20:38:12.477840 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 29 20:38:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:38:12.487318 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-d000237b-f9eb-41a1-8183-184b2c44f43f admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:12.492309 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.wsgi [None req-d000237b-f9eb-41a1-8183-184b2c44f43f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-d000237b-f9eb-41a1-8183-184b2c44f43f admin admin] Request method failure captured: Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Accept: application/json Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Accept-Encoding: gzip, deflate Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Connection: keep-alive Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Content-Length: 0 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Host: 10.222.0.36 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Openstack-Api-Version: compute 2.92 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: Openstack-System-Scope: None Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: User-Agent: python-novaclient Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Auth-Token: gAAAAABjXY8zHmAsoRXgVFFJmvr06lJnyN5chpy_38-vtiOz31q2LLz99kTlkLapGdP5YZyXog9kweB2r6kIBRQX8FjjvmnmDDexyTItxJi3IMygbeZSOjVEmgisTEUax_qRlW66Kp03rOolPwLLdiJ_6uSi-5yBZrMEvlolURBcISylB993bD8 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Domain-Id: None Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Domain-Name: None Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Identity-Status: Confirmed Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Is-Admin-Project: True Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Domain-Id: default Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Domain-Name: Default Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Name: admin Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Role: reader,admin,member Oct 29 20:38:12.493839 ncdv-master-1 devstack@n-api.service[122458]: X-Roles: reader,admin,member Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant: admin Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant-Name: admin Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-User: admin Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-User-Domain-Id: default Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-User-Domain-Name: Default Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-User-Id: 6e799a80f6b7425fbcda2c5fd254c3e6 Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: X-User-Name: admin Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: method: > Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: exception: Flavor 84 could not be found. Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: action_args: {'id': '84'} Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:38:12.495379 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:12.496248 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:12.497552 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-d000237b-f9eb-41a1-8183-184b2c44f43f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=122458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:38:12.498760 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-d000237b-f9eb-41a1-8183-184b2c44f43f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011531 Oct 29 20:38:12.498760 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:38:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:14.279557 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-f8b3c605-a682-429e-ab78-a967256f78db admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:14.280600 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-f8b3c605-a682-429e-ab78-a967256f78db admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 29 20:38:14.280989 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:14.816990 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-951a1b12-f2db-44d2-9cfa-84f0569051d7 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:14.822883 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.wsgi [None req-951a1b12-f2db-44d2-9cfa-84f0569051d7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-951a1b12-f2db-44d2-9cfa-84f0569051d7 admin admin] Request method failure captured: Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Accept: application/json Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Accept-Encoding: gzip, deflate Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Connection: keep-alive Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Content-Length: 0 Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Host: 10.222.0.36 Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Openstack-Api-Version: compute 2.92 Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: Openstack-System-Scope: None Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: User-Agent: python-novaclient Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Auth-Token: gAAAAABjXY82tNXvETajsydyRirpmjJ1KT--F6T0LhfiwYkk9VFa8hk-vXZd3B8Vp8aEInGYIj_mcTNBRuh_SHOsscg2zz7mBMAaXFLc8BX6K-vIfSvZxoLYRWXk-aWNMFNLcZVMV3x3cPYCcS7XdZ1LsoHZlWbJyI_yBZVEp00-42hxzVsLoOg Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Domain-Id: None Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Domain-Name: None Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Identity-Status: Confirmed Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Is-Admin-Project: True Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Domain-Id: default Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Domain-Name: Default Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Project-Name: admin Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Role: reader,admin,member Oct 29 20:38:14.824354 ncdv-master-1 devstack@n-api.service[122458]: X-Roles: reader,admin,member Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant: admin Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-Tenant-Name: admin Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-User: admin Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-User-Domain-Id: default Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-User-Domain-Name: Default Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-User-Id: 6e799a80f6b7425fbcda2c5fd254c3e6 Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: X-User-Name: admin Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: method: > Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: exception: Flavor 451 could not be found. Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: action_args: {'id': '451'} Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:38:14.825939 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:14.826885 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.828269 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-951a1b12-f2db-44d2-9cfa-84f0569051d7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=122458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:38:14.829618 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-951a1b12-f2db-44d2-9cfa-84f0569051d7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395056 Oct 29 20:38:14.829618 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:38:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:14.835624 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-8ea473a4-759a-4f58-bd9a-d282e1b3b6a3 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:14.850433 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-8ea473a4-759a-4f58-bd9a-d282e1b3b6a3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018442 Oct 29 20:38:14.850947 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 29 20:38:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:38:14.860817 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:14.877018 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019441 Oct 29 20:38:14.877596 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Sat Oct 29 20:38:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:38:14.887054 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-cf48f5c2-2619-44cc-b3e0-3d2f4f0a3107 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:14.892563 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.wsgi [None req-cf48f5c2-2619-44cc-b3e0-3d2f4f0a3107 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-cf48f5c2-2619-44cc-b3e0-3d2f4f0a3107 admin admin] Request method failure captured: Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Accept: application/json Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Accept-Encoding: gzip, deflate Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Connection: keep-alive Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Content-Length: 0 Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Host: 10.222.0.36 Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Openstack-Api-Version: compute 2.92 Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: Openstack-System-Scope: None Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: User-Agent: python-novaclient Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Auth-Token: gAAAAABjXY82tNXvETajsydyRirpmjJ1KT--F6T0LhfiwYkk9VFa8hk-vXZd3B8Vp8aEInGYIj_mcTNBRuh_SHOsscg2zz7mBMAaXFLc8BX6K-vIfSvZxoLYRWXk-aWNMFNLcZVMV3x3cPYCcS7XdZ1LsoHZlWbJyI_yBZVEp00-42hxzVsLoOg Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Domain-Id: None Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Domain-Name: None Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Identity-Status: Confirmed Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Is-Admin-Project: True Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Domain-Id: default Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Domain-Name: Default Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Project-Name: admin Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Role: reader,admin,member Oct 29 20:38:14.894108 ncdv-master-1 devstack@n-api.service[122459]: X-Roles: reader,admin,member Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad2388a030f2411ea168c9f7f66bcfb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant: admin Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant-Id: ad2388a030f2411ea168c9f7f66bcfb0 Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-Tenant-Name: admin Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-User: admin Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-User-Domain-Id: default Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-User-Domain-Name: Default Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-User-Id: 6e799a80f6b7425fbcda2c5fd254c3e6 Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: X-User-Name: admin Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: method: > Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: exception: Flavor 451 could not be found. Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: action_args: {'id': '451'} Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:38:14.895681 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:14.897799 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: ERROR nova.api.openstack.wsgi Oct 29 20:38:14.899184 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-cf48f5c2-2619-44cc-b3e0-3d2f4f0a3107 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=122459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:38:14.900413 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-cf48f5c2-2619-44cc-b3e0-3d2f4f0a3107 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012043 Oct 29 20:38:14.900413 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:38:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:38:16.657724 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:16.658759 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 29 20:38:16.659149 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:17.190858 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-e6ef6ead-6d00-4aa9-8cf3-174d8bce71cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:38:17.211255 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-e6ef6ead-6d00-4aa9-8cf3-174d8bce71cb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404330 Oct 29 20:38:17.211521 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 29 20:38:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:38:18.986965 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:18.987967 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 29 20:38:18.988354 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:19.518385 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-23c178b6-3f33-4bc2-bee7-ccd53e924640 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:38:19.536403 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-23c178b6-3f33-4bc2-bee7-ccd53e924640 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403271 Oct 29 20:38:19.536931 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 29 20:38:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:38:21.290306 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:21.291306 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 29 20:38:21.291695 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:21.821421 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-fbae47a2-0152-4f7b-adc1-51b9a72e8baf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:38:21.839784 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-fbae47a2-0152-4f7b-adc1-51b9a72e8baf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402739 Oct 29 20:38:21.840973 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 29 20:38:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:38:23.608703 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:23.609742 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 29 20:38:23.610137 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:24.141351 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-214c4838-901f-49d1-a38f-9b1bede11a91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:38:24.160434 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-214c4838-901f-49d1-a38f-9b1bede11a91 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402761 Oct 29 20:38:24.160989 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Sat Oct 29 20:38:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:38:25.942667 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:25.943679 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 29 20:38:25.944073 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:38:26.469740 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-58241ae5-42dc-4d37-b443-e462e39648fb admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:38:26.490195 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-58241ae5-42dc-4d37-b443-e462e39648fb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402283 Oct 29 20:38:26.490723 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Sat Oct 29 20:38:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:39:31.275581 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:39:31.276588 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-e1e330b7-05d6-49ab-8925-033687f6c42e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 29 20:39:31.276986 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Sat Oct 29 20:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:39:31.284910 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:39:31.675443 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-a375533f-0816-4504-88ed-5f3e5f2925d3 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:39:31.698174 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-a375533f-0816-4504-88ed-5f3e5f2925d3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414716 Oct 29 20:39:31.698721 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 20:39:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:39:31.720922 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_api:SELECT=14 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:39:31.724739 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-c93fe3ac-f7ff-41d5-b156-92ff0470c0da admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:39:31.731964 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-c93fe3ac-f7ff-41d5-b156-92ff0470c0da admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012456 Oct 29 20:39:31.732475 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Sat Oct 29 20:39:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:39:31.744123 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-6966bd5c-02a9-476d-b74f-6bedbc6ad3d3 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:39:31.752335 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-6966bd5c-02a9-476d-b74f-6bedbc6ad3d3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012033 Oct 29 20:39:31.752838 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Sat Oct 29 20:39:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:39:31.764783 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-50a4eedb-4c0b-424a-a80e-722f70145572 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:39:31.771756 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-50a4eedb-4c0b-424a-a80e-722f70145572 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011194 Oct 29 20:39:31.772253 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Sat Oct 29 20:39:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:39:31.783325 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-653e1d5a-41bd-4f34-bc44-667d0ed6c4af admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:39:31.790674 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-653e1d5a-41bd-4f34-bc44-667d0ed6c4af admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010905 Oct 29 20:39:31.791166 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Sat Oct 29 20:39:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:45:06.594679 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-50a4eedb-4c0b-424a-a80e-722f70145572 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:45:06.595668 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-50a4eedb-4c0b-424a-a80e-722f70145572 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 29 20:45:06.596057 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:45:06.745276 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_api:SELECT=6 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:06.886375 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:45:06.891250 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:45:06.891733 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:45:06.892167 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:45:06.892888 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:45:06.893335 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:45:06.893781 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:45:06.931529 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-d2eb4cdc-e201-438c-ba94-0c71a6f52bb5 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.187564 Oct 29 20:45:06.932077 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:45:06 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:45:08.531047 ncdv-master-1 devstack@n-api.service[122458]: DEBUG nova.api.openstack.wsgi [None req-50a4eedb-4c0b-424a-a80e-722f70145572 admin admin] Calling method '>' {{(pid=122458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:45:08.532044 ncdv-master-1 devstack@n-api.service[122458]: INFO nova.api.openstack.requestlog [None req-50a4eedb-4c0b-424a-a80e-722f70145572 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 29 20:45:08.532434 ncdv-master-1 devstack@n-api.service[122458]: [pid: 122458|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Sat Oct 29 20:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:45:08.726777 ncdv-master-1 devstack@n-api.service[122459]: DEBUG nova.api.openstack.wsgi [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Calling method '>' {{(pid=122459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:45:08.730196 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:45:08.730673 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:45:08.731101 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:45:08.731935 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:45:08.732386 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:45:08.732801 ncdv-master-1 devstack@n-api.service[122459]: DEBUG oslo_concurrency.lockutils [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:45:08.755595 ncdv-master-1 devstack@n-api.service[122459]: INFO nova.api.openstack.requestlog [None req-28a24e3a-9685-4125-bbde-c3c2cefef2ba admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.079283 Oct 29 20:45:08.756068 ncdv-master-1 devstack@n-api.service[122459]: [pid: 122459|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:45:08 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:45:55.291309 ncdv-master-1 devstack@n-api.service[122457]: Sat Oct 29 20:45:55 2022 - graceful shutdown triggered... Oct 29 20:45:55.292117 ncdv-master-1 devstack@n-api.service[122458]: Gracefully killing worker 1 (pid: 122458)... Oct 29 20:45:55.291718 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 20:45:55.293087 ncdv-master-1 devstack@n-api.service[122459]: Gracefully killing worker 2 (pid: 122459)... Oct 29 20:45:55.425710 ncdv-master-1 devstack@n-api.service[122458]: DEBUG dbcounter [-] [122458] Writing DB stats nova_api:SELECT=4 {{(pid=122458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:55.427752 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_cell0:SELECT=4 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:55.428480 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_cell1:SELECT=4 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:55.429063 ncdv-master-1 devstack@n-api.service[122459]: DEBUG dbcounter [-] [122459] Writing DB stats nova_api:SELECT=8 {{(pid=122459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:45:56.291713 ncdv-master-1 devstack@n-api.service[122457]: worker 1 buried after 1 seconds Oct 29 20:45:56.291713 ncdv-master-1 devstack@n-api.service[122457]: worker 2 buried after 1 seconds Oct 29 20:45:56.291713 ncdv-master-1 devstack@n-api.service[122457]: goodbye to uWSGI. Oct 29 20:45:56.293309 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 29 20:45:56.293947 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 20:45:56.296791 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 20:45:56.335708 ncdv-master-1 devstack@n-api.service[138871]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 20:45:56.338380 ncdv-master-1 devstack@n-api.service[138871]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 20:45:56 2022] *** Oct 29 20:45:56.338575 ncdv-master-1 devstack@n-api.service[138871]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 20:45:56.338770 ncdv-master-1 devstack@n-api.service[138871]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 20:45:56.338948 ncdv-master-1 devstack@n-api.service[138871]: nodename: ncdv-master-1 Oct 29 20:45:56.339113 ncdv-master-1 devstack@n-api.service[138871]: machine: x86_64 Oct 29 20:45:56.339277 ncdv-master-1 devstack@n-api.service[138871]: clock source: unix Oct 29 20:45:56.339447 ncdv-master-1 devstack@n-api.service[138871]: pcre jit disabled Oct 29 20:45:56.339609 ncdv-master-1 devstack@n-api.service[138871]: detected number of CPU cores: 4 Oct 29 20:45:56.339785 ncdv-master-1 devstack@n-api.service[138871]: current working directory: / Oct 29 20:45:56.339955 ncdv-master-1 devstack@n-api.service[138871]: detected binary path: /usr/bin/uwsgi-core Oct 29 20:45:56.340123 ncdv-master-1 devstack@n-api.service[138871]: your processes number limit is 47680 Oct 29 20:45:56.340286 ncdv-master-1 devstack@n-api.service[138871]: your memory page size is 4096 bytes Oct 29 20:45:56.340449 ncdv-master-1 devstack@n-api.service[138871]: detected max file descriptor number: 2048 Oct 29 20:45:56.340611 ncdv-master-1 devstack@n-api.service[138871]: lock engine: pthread robust mutexes Oct 29 20:45:56.340951 ncdv-master-1 devstack@n-api.service[138871]: thunder lock: enabled Oct 29 20:45:56.341320 ncdv-master-1 devstack@n-api.service[138871]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 20:45:56.341616 ncdv-master-1 devstack@n-api.service[138871]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 20:45:56.386095 ncdv-master-1 devstack@n-api.service[138871]: Python main interpreter initialized at 0x557c0bfc69c0 Oct 29 20:45:56.386325 ncdv-master-1 devstack@n-api.service[138871]: python threads support enabled Oct 29 20:45:56.386487 ncdv-master-1 devstack@n-api.service[138871]: your server socket listen backlog is limited to 100 connections Oct 29 20:45:56.386487 ncdv-master-1 devstack@n-api.service[138871]: your mercy for graceful operations on workers is 90 seconds Oct 29 20:45:56.386803 ncdv-master-1 devstack@n-api.service[138871]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 20:45:56.386911 ncdv-master-1 devstack@n-api.service[138871]: *** Operational MODE: preforking *** Oct 29 20:45:56.387170 ncdv-master-1 devstack@n-api.service[138871]: *** uWSGI is running in multiple interpreter mode *** Oct 29 20:45:56.387170 ncdv-master-1 devstack@n-api.service[138871]: spawned uWSGI master process (pid: 138871) Oct 29 20:45:56.387363 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 20:45:56.395574 ncdv-master-1 devstack@n-api.service[138871]: spawned uWSGI worker 1 (pid: 138884, cores: 1) Oct 29 20:45:56.395574 ncdv-master-1 devstack@n-api.service[138871]: spawned uWSGI worker 2 (pid: 138885, cores: 1) Oct 29 20:45:56.395574 ncdv-master-1 devstack@n-api.service[138871]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 20:45:57.709357 ncdv-master-1 devstack@n-api.service[138884]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 20:45:57.721816 ncdv-master-1 devstack@n-api.service[138885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 20:45:58.480665 ncdv-master-1 devstack@n-api.service[138884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:45:58.480665 ncdv-master-1 devstack@n-api.service[138884]: from cryptography.utils import int_from_bytes Oct 29 20:45:58.481010 ncdv-master-1 devstack@n-api.service[138884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:45:58.481010 ncdv-master-1 devstack@n-api.service[138884]: from cryptography.utils import int_from_bytes Oct 29 20:45:58.488210 ncdv-master-1 devstack@n-api.service[138885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:45:58.488210 ncdv-master-1 devstack@n-api.service[138885]: from cryptography.utils import int_from_bytes Oct 29 20:45:58.488550 ncdv-master-1 devstack@n-api.service[138885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 20:45:58.488550 ncdv-master-1 devstack@n-api.service[138885]: from cryptography.utils import int_from_bytes Oct 29 20:46:00.940408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 20:46:00.941247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 20:46:00.941364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 20:46:00.941775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 20:46:00.941918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 20:46:00.942014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 20:46:00.942014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 20:46:00.942168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 20:46:00.942247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.942341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 20:46:00.942497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.942612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 20:46:00.942829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.942978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.943157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.943283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.943496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.943597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.943816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.943934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.944161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.944266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.944470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.944572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.944833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.944961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.945058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.945242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.945406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.945539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.945747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.945865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.946087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.946190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.946401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.946536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.946719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.946831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.947045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.947149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.947357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.947457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.947687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.947793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.948003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.948120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.948339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.948508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.948654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.948966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.949186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.949307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.949527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.949642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.949849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.949957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.950182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.950396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.950524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.950627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.950838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.950953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.951160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.951274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.951490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.951595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.951807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.951907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.952141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.952286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.952462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.952564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.952846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.953053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.953211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.953353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.953552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.953684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.953894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.954007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.954265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.954367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.954594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.954696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.954923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.955991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.956215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.956307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.956542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.956691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.956853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.956958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.957170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.957271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.957503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.957613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.957828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.957932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.958139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.958342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.958433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.958526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.958694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.958820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.959969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.960909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.961131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.961243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.961437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.961703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.961819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.961948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.962070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.962194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.962363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.962486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.962687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.963057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.963325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.963515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.963678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.963834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.963992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.964143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.964294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.964451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.964595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.964744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.964897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.965132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.965289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.965442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.965643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.965794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.965944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.966095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.969541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.970939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.971972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.972940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.973927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.974928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.975004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.975440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.975649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.975649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.975959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.976113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.976257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.976431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.976590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.976756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.976902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.977066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.977220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.977389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.977631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.977793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.977946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.978098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.978243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.978400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.978554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.978716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.978868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.979990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.980683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.980851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.981000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.981219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.981378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.981548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.981710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.981858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.982011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.982189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.982404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.982557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.982710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.982865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.983922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.984068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.984229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.984500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.985154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.985307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.985512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.985679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.985832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.985984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.986137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.986293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.986458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.986603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.986748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.986913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.987071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.987226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.987454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.987641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.987800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.987946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.988090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.988250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.988406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.988559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.988720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.988885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.989036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 20:46:00.989197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.989392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.989578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.989774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.989932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.990086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.990275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.990927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.991085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.991235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.991405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.991565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.991720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.991873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.992919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.993065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.993216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.993385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.993613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.993763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.993915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.994104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.994273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.994430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.994592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.994783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.994945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.995099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.995246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.995390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.995564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.995718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.995871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.996990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.997142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.997371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.997546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.997717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.997865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.998925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.999070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.999232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.999385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.999550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.999703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:00.999927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.000091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.000237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.000391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.001082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.001243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.001390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.001650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.001801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.001954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.002107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.002274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.002474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.002634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.002787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.002932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.003076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.003227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.003380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.003540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.003692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.003845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.004924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.005087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.005319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.005514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.005668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.005823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.005968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.006120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.006274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.006430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.006575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.006718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.006870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.007022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.007181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.007336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.007533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.007713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.007867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.008925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.009143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.009293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.009436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.009629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.009783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.009984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.010138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.010290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.010454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.010599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.011287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.011455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.011610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.011787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.011945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.012986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.013144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.013390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.013586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.013742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.013887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.014955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.015167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.015167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.015459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.015604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.015748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.015892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.016962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.017212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.017369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.017557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.017710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.017870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.018017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.018162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.018305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.018590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.018752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.018912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.019065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.019228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.019381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.019534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.019680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.019877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.020080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.020270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.020428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.020581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.020743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.021331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.021674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.021825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.021995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.022142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.022341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.022494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.022646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.022800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.022946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.023098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.023261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.023417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.023562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.023713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.023867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.024998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.025144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.025298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.025444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.025612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.025770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.025937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.026083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.026247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.026412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.026558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.026702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.026855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.027960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.028114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.028258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.028412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.028567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.028720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.028874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.029021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.029174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.029326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.029581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.029737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.029896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.030106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.030267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.030414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.030568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.030713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.030857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.031020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.032307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.032476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.032638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.032793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.032947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.033092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.033330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.033527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.033769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.033961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.034128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.034283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.034435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.034593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.034738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.034888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.035956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.036115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.036267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.036433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.036578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.036730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.036881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.037976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.038129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.038282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.038436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.038581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.038725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.038876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.039995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.040184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.040336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.040482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.040627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.040811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.040975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.041122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.041303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.042358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.042538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.042697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.042844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.042988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.043141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.043286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.043431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.043588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.043735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.043888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.044985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.045131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.045275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.045432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.045604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.045768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.045915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.046147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.046309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.046521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.046680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.046835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.047537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.047685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.047840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.047996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.048142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.048295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.048295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.048578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.048736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.048882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.049964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.050110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.050309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.050459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.050615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.050762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.050917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.051072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.051226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.051456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.051623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.051769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.052038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.052664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.052820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.052986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.053142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.053289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.053562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.053742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.053905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.054980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.055126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.055273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.055417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.055562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.055731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.055886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.056930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.057083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.057236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.057381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.057567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.057735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.057735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.058070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.058235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.058397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.058544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.058756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.058756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.059052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.059207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.059364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.059558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.059725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.059870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.060024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.060177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.060373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.060535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.060756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.060916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.061063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.061319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.061529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.061703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.061859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.062052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.062312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.063944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.064099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.064258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.064449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.064598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.064767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.064924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.065080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.065227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.065381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.065563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.065715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.065868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.066095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.066243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.066390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.066542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.066700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.066855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.067016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.067170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.067316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.067538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.067694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.067856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.068314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.068469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.068616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.068761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.068917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.069084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.069241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.069652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.069652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.069951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.070097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.070252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.070441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.070595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.070742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.070895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.071970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.072118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.072350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.072979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.073151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.073300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.073477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.073660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.073916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.074070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.074217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.074370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.074597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.074758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.074905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.075958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.076998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.077191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.077353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.077567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.077721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.077867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.078034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.078238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.078397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.078543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.078747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.078899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.079974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.080138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.080301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.080447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.080645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.080797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.080959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.081122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.081282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.081443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.081624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.081858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.082023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.082184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.082356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.082510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.083161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.083338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.083504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.083660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.083820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.084087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.084257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.084426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.084596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.084762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.084935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.085090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.085250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.085418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.085634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.085800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.085952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.086111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.086264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.086431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.086592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.086746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.086911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.087083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.087236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.087402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.087564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.087725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.087927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.088082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.088245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.088398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.088550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.088701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.088854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.089014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.089187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.089341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.089514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.089673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.090008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.090285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.090483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.090716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.090912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.091114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.091309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.091514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.091718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.091928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.092121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.092315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.092508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.092760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.093419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.093696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.094481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.094640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.094808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.094971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.095135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.095296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.095462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.095623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.095785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.095939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.096092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.096245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.096396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.096557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.096720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.096874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.097033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.097187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.097348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.097559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.097734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.097896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.098056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.098210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.098369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.098528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.098752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.098908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.099067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.099227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.099419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.099596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.099757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.099918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.100078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.100238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.100398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.100606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.100808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.100974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.101136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.101288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.101442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.102623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.102795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.102949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.104128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.104296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.104479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.104735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.104906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.105109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.105287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.105442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.105635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.105790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.105996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.106171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.106326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.106479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.106648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.106809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.106969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.107130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.107290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.107290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.107594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.107749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.107900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.108928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.109217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.109431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.110106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.110272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.110432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.110593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.110757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.110984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.111152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.111152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.111450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.111603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.111763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.111980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.112168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.112324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.112483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.112483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.112773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.112977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.113081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.113235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.113694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.113820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.113947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.114081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.114422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.114422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.114649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.114880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.115916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.116954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.117962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.118806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.119997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.120113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.120235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.120358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.120489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.120863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.121933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.122995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.123130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.123263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.123398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.123812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.123939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.124054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.124176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.124415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.124631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.124752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.124884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.125993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.126937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.127949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.128867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.129965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.130919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.131939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.132880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.133031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.133031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.134127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.134247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.134388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.134612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.134869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.135884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.136950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.137945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.138106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.138253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.138411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.138565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.138720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.138877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.139997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.140151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.140430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.141775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.142016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.142187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.142400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.142561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.142722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.143464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.143631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.144318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.144893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.145299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.146366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.147029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.151539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.151746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.151914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.152075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.152244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.152472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.152630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.152630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.152942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.153990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.154616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.154780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.155044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.155206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.155361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.155514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.155694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.155958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.156130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.156958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.157123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.157278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.157278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.157608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.157777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.157941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.158096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.158249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.158402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.158564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.158725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.158899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.159061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.159224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.159387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.159551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.159706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.159867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.160030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.160198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.160361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.160513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.160673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.160906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.161124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.161406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.161726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.161895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.162057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.162220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.162374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.162374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.163305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.163465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.163632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.163786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.163949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.164110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.164567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.164754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.166372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.167035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.167349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.168831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.169524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.170286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.170286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.170590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.170759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.170914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.171987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.172288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.172288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.172672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.172830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.172990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.173142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.173303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.173507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.173688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.173853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.174007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.174159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.174319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.174822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.174998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.175153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.175306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.175468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.175632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.175809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.175963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.176115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.176302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.176551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.176726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.177009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.177009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.177338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.177627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.177797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.177954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.178117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.178291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.178616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.178616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.178928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.179250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.179404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.179557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.179718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.179871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.180997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.181158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.181564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.181564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.181762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.181867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.181956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.182849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.183939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.184039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.184134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.184221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.184307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.184394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.184996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.185943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.186932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.187993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.188885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.189986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.190972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.191967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.192937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.193827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.194783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.195496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.195646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.195772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.195887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.196949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.197804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.198931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.199787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.200947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.201906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.202975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.203069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.203697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.203797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.203894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.203981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.204729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.205247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.205732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.205876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.205995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.206977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.207961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.208973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.209974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.210977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.211986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.212957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.213997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.214935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.215062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.215204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.215422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.215570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.215949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.216968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.217123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.217278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.217461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.217702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.217876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.218058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.218249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.219706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.219809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.219898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.219997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.220996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.221773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.222481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.222599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.222699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.222794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.222893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.222983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.223685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.224248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.224248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.224248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.224248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 20:46:01.224248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=138885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 20:46:01.277351 ncdv-master-1 devstack@n-api.service[138884]: INFO dbcounter [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Registered counter for database nova_api Oct 29 20:46:01.283712 ncdv-master-1 devstack@n-api.service[138885]: INFO dbcounter [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Registered counter for database nova_api Oct 29 20:46:01.298738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_db.sqlalchemy.engines [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.304614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_db.sqlalchemy.engines [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.305810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writer thread running {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.311232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writer thread running {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.365154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.context [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=138884) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 20:46:01.369276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:01.369963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:01.370534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.context [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=138885) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 20:46:01.372126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:01.372900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:01.373370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:01.374475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:01.374989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:01.375497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:01.376618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:01.377384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:01.377589 ncdv-master-1 devstack@n-api.service[138884]: INFO dbcounter [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Registered counter for database nova_cell0 Oct 29 20:46:01.377878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:01.379916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:01.382054 ncdv-master-1 devstack@n-api.service[138885]: INFO dbcounter [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Registered counter for database nova_cell0 Oct 29 20:46:01.382648 ncdv-master-1 devstack@n-api.service[138884]: INFO dbcounter [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Registered counter for database nova_cell1 Oct 29 20:46:01.386702 ncdv-master-1 devstack@n-api.service[138885]: INFO dbcounter [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Registered counter for database nova_cell1 Oct 29 20:46:01.395903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_db.sqlalchemy.engines [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.398360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_db.sqlalchemy.engines [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.400827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writer thread running {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.409261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writer thread running {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.410316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_db.sqlalchemy.engines [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.560188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_db.sqlalchemy.engines [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.566698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writer thread running {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.576095 ncdv-master-1 devstack@n-api.service[138885]: INFO dbcounter [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Registered counter for database nova_cell0 Oct 29 20:46:01.583853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_db.sqlalchemy.engines [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.588953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writer thread running {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.591318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writer thread running {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:01.600349 ncdv-master-1 devstack@n-api.service[138884]: INFO dbcounter [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Registered counter for database nova_cell0 Oct 29 20:46:01.607505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_db.sqlalchemy.engines [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=138884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 20:46:01.612275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writer thread running {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 20:46:02.033655 ncdv-master-1 devstack@n-api.service[138885]: WARNING keystonemiddleware.auth_token [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:46:02.041042 ncdv-master-1 devstack@n-api.service[138885]: WARNING keystonemiddleware.auth_token [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:46:02.057495 ncdv-master-1 devstack@n-api.service[138884]: WARNING keystonemiddleware.auth_token [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:46:02.065962 ncdv-master-1 devstack@n-api.service[138884]: WARNING keystonemiddleware.auth_token [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:46:02.269911 ncdv-master-1 devstack@n-api.service[138885]: WARNING keystonemiddleware.auth_token [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:46:02.276004 ncdv-master-1 devstack@n-api.service[138885]: WARNING keystonemiddleware.auth_token [None req-8145e1e2-59d9-4f06-bfca-ab78dc3daf3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:46:02.281848 ncdv-master-1 devstack@n-api.service[138885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c0bfc69c0 pid: 138885 (default app) Oct 29 20:46:02.295189 ncdv-master-1 devstack@n-api.service[138884]: WARNING keystonemiddleware.auth_token [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 20:46:02.301845 ncdv-master-1 devstack@n-api.service[138884]: WARNING keystonemiddleware.auth_token [None req-df537e3f-d768-4e9f-910b-a9489d923d7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 20:46:02.307081 ncdv-master-1 devstack@n-api.service[138884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c0bfc69c0 pid: 138884 (default app) Oct 29 20:46:45.691313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:45.693968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:45.696276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:45.698981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:46.178309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:46.182322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:46.184279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:46.189802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:47.345781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31fbeafb-9d53-4b19-8822-2401cbe63bc4 tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1077401394", "id": 1142635612, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:47.425008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31fbeafb-9d53-4b19-8822-2401cbe63bc4 tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.751621 Oct 29 20:46:47.426162 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1/1] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:46:45 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:46:47.465163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Calling method '.version_select at 0x7fa173460940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:47.480035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=138884) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 20:46:47.480894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.481448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.481901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.510135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.510592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.510983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.529658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.530326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.531554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.544730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b4942585-d53a-4ac9-8354-f169ad182182 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.374343 Oct 29 20:46:47.558360 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1208 bytes} [Sat Oct 29 20:46:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:46:47.728427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Calling method '.version_select at 0x7fa1732ee160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:47.737269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=138885) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 20:46:47.738132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.738706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.739238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.766495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.767112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.767652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.784015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.784728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.785266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.792011 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8fc4eaea-0af4-4d8f-b431-a47b09359e61 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.364338 Oct 29 20:46:47.792677 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:46:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:47.862200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa173282af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:47.865839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.866465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.867085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.867971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.868669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.869369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.914627 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b5f1c84-4e3f-41d9-bcf4-c5d765192ea6 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.354491 Oct 29 20:46:47.924329 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1128 bytes} [Sat Oct 29 20:46:47 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:47.969585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '.version_select at 0x7fa173250af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:47.971918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.972560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.973261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:47.992316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:47.993194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:47.993799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.007626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.008169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.008604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.016719 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-030c06be-09e3-46b9-87a5-22b6c217ff96 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.222789 Oct 29 20:46:48.017231 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 29 20:46:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:46:48.023211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7603ff3b-ce97-453b-b26c-bd65381d5137 tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:48.242654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7603ff3b-ce97-453b-b26c-bd65381d5137 tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1142635612/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.222909 Oct 29 20:46:48.243476 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 4/6] 10.222.0.36 () {62 vars in 1265 bytes} [Sat Oct 29 20:46:48 2022] POST /compute/v2.1/flavors/1142635612/os-extra_specs => generated 62 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:46:48.254424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b949908-3e62-4d57-8b21-d86b0c48f928 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1871921960"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:48.259429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-3b949908-3e62-4d57-8b21-d86b0c48f928 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Generated uuid 50321ae0-2b5b-49a5-8289-3a59cc534c74 for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:46:48.306216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.308608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.309279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.309969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.310960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.311611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.312549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.360346 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b949908-3e62-4d57-8b21-d86b0c48f928 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.113665 Oct 29 20:46:48.361807 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 5/7] 10.222.0.36 () {62 vars in 1205 bytes} [Sat Oct 29 20:46:48 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:46:48.368605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Calling method '.version_select at 0x7fa173198820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.371778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.372348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.373774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.376328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-529be1a9-8bfe-4acf-a4e5-f44d1fb44e47 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.450491 Oct 29 20:46:48.378910 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3/8] 10.222.0.36 () {58 vars in 1164 bytes} [Sat Oct 29 20:46:47 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:46:48.384116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa173251ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.388729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.389427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.390264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.391179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.391990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.392592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.407881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.408671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.409196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.428320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb1a9cb8-7464-4207-b4df-16d77abddbc3 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.047848 Oct 29 20:46:48.429733 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1139 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:48.434250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39c2fd99-1e62-4a16-a641-afe5e01771ee tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.476596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.477880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.478696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.483176 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-39c2fd99-1e62-4a16-a641-afe5e01771ee tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1142635612" status: 202 len: 0 microversion: 2.86 time: 0.052135 Oct 29 20:46:48.488072 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 5/10] 10.222.0.36 () {60 vars in 1202 bytes} [Sat Oct 29 20:46:48 2022] DELETE /compute/v2.1/flavors/1142635612 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:46:48.495485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2763e270-1da5-486d-a2e7-f8521203276b tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-798642919"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:48.495921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b7c92a8f-2058-42d4-b461-b709846e2f1f tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.132107 Oct 29 20:46:48.497065 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1212 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 104 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:48.506717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.508688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.509314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.509914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.511417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.512245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.512811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.580443 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-333773b1-3497-4879-b72f-1b352c11f755 tempest-AZAdminV2TestJSON-755228277 tempest-AZAdminV2TestJSON-755228277-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.079887 Oct 29 20:46:48.581761 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:48.586728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa172922940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.592923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.596335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.597237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.600571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.601076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.601578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.650747 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a11d9647-6714-418f-89fc-a2b76643ae9f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.067733 Oct 29 20:46:48.651728 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1145 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:46:48.657216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4d49a69-55d8-405b-b45b-3c73f8a2e626 tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.688837 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2763e270-1da5-486d-a2e7-f8521203276b tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.199439 Oct 29 20:46:48.696309 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 6/14] 10.222.0.36 () {62 vars in 1210 bytes} [Sat Oct 29 20:46:48 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:46:48.696452 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4d49a69-55d8-405b-b45b-3c73f8a2e626 tempest-FlavorMetadataValidation-1574232752 tempest-FlavorMetadataValidation-1574232752-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.040545 Oct 29 20:46:48.696452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 9/15] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:46:48.700399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Calling method '.version_select at 0x7fa1731b1820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.708928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.709478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.710906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07531afa-f24f-4c2b-b5c1-eddda27fbd5c tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.712900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.732339 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07531afa-f24f-4c2b-b5c1-eddda27fbd5c tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.026658 Oct 29 20:46:48.733397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 10/16] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:46:48.749129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08b2b161-7ae1-4bce-b8a5-dca5b10e3682 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:48.749313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.749707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.750166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.764161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08b2b161-7ae1-4bce-b8a5-dca5b10e3682 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.765362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08b2b161-7ae1-4bce-b8a5-dca5b10e3682 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.766274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08b2b161-7ae1-4bce-b8a5-dca5b10e3682 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.781446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.781963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.782410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.801287 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1fd443c1-3ec2-4206-8267-da0fd14f52dc tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109777 Oct 29 20:46:48.803265 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 7/17] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:48.812460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Calling method '.version_select at 0x7fa1731b1dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:48.815594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.821375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.823442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.853958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:48.855507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:48.855984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:48.863878 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12c0d267-fa68-4ac2-85cc-34114d178243 tempest-HypervisorAdminUnderV252Test-654075645 tempest-HypervisorAdminUnderV252Test-654075645-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.054973 Oct 29 20:46:48.864473 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 8/18] 10.222.0.36 () {58 vars in 1209 bytes} [Sat Oct 29 20:46:48 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:50.397718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08b2b161-7ae1-4bce-b8a5-dca5b10e3682 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.655507 Oct 29 20:46:50.406462 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 11/19] 10.222.0.36 () {62 vars in 1232 bytes} [Sat Oct 29 20:46:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:46:50.412596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f4d27fa-9eff-4bdd-b64b-c6fd2a0b9448 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:50.428613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4d27fa-9eff-4bdd-b64b-c6fd2a0b9448 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.429407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4d27fa-9eff-4bdd-b64b-c6fd2a0b9448 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.430043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4d27fa-9eff-4bdd-b64b-c6fd2a0b9448 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:50.619273 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f4d27fa-9eff-4bdd-b64b-c6fd2a0b9448 tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.209972 Oct 29 20:46:50.630937 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 12/20] 10.222.0.36 () {62 vars in 1232 bytes} [Sat Oct 29 20:46:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:46:50.637526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2dc4c7d1-7bb5-4ef2-889a-e1eccd415f6b tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:50.646725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-77568134-4fd9-4610-b279-9a6dea3451db tempest-AZAdminNegativeTestJSON-1888854267 tempest-AZAdminNegativeTestJSON-1888854267-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:50.649839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-77568134-4fd9-4610-b279-9a6dea3451db tempest-AZAdminNegativeTestJSON-1888854267 tempest-AZAdminNegativeTestJSON-1888854267-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3c663a0997af4571bf9eb8f7844c1fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3082f11e0a4607b0fb7ae84e2683da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-77568134-4fd9-4610-b279-9a6dea3451db tempest-AZAdminNegativeTestJSON-1888854267 tempest-AZAdminNegativeTestJSON-1888854267-project] Request method failure captured: Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE4sGkLUFZbUQUkPU-2CvCoHKgmInJaqbT1nVzmMQMh_FDZ-URrYRT-lS_pOSLWeO7B8A5Ccboa3eLNS-bEMwtBzizKO-9-U9IDb6nEY9wFVHJ5M5vm-7MeDAn1NUEbqrK-7chwEUCeDzj-jKsMg3Rd_o0ditwUTar5Hbw40kCkZZs Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 5f3082f11e0a4607b0fb7ae84e2683da Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1888854267 Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:46:50.654840 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f3082f11e0a4607b0fb7ae84e2683da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f3082f11e0a4607b0fb7ae84e2683da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f3082f11e0a4607b0fb7ae84e2683da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f3082f11e0a4607b0fb7ae84e2683da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AZAdminNegativeTestJSON-1888854267 Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 5f3082f11e0a4607b0fb7ae84e2683da Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1888854267 Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AZAdminNegativeTestJSON-1888854267-project Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 3c663a0997af4571bf9eb8f7844c1fe5 Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AZAdminNegativeTestJSON-1888854267-project Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 20:46:50.656091 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:46:50.656693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 20:46:50.657685 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:46:50.659752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-77568134-4fd9-4610-b279-9a6dea3451db tempest-AZAdminNegativeTestJSON-1888854267 tempest-AZAdminNegativeTestJSON-1888854267-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:46:50.661478 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-77568134-4fd9-4610-b279-9a6dea3451db tempest-AZAdminNegativeTestJSON-1888854267 tempest-AZAdminNegativeTestJSON-1888854267-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.360274 Oct 29 20:46:50.662627 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 9/21] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 20:46:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 362 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:46:50.694276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2dc4c7d1-7bb5-4ef2-889a-e1eccd415f6b tempest-AggregatesAdminTestV241-188049653 tempest-AggregatesAdminTestV241-188049653-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.061438 Oct 29 20:46:50.694964 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 13/22] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:46:50 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:50.720570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa172964b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:50.727944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.730075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.730695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:50.734458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.735114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.736226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:50.832844 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95497da0-4f60-4956-a53d-663815ec5b92 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.116408 Oct 29 20:46:50.833467 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 10/23] 10.222.0.36 () {58 vars in 1128 bytes} [Sat Oct 29 20:46:50 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:50.845447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa1728b4940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:50.851682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.853271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.853761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:50.854510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.860487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.861009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:50.934925 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1921012-e39f-43d0-8e8d-647412898920 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.093344 Oct 29 20:46:50.935540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 14/24] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:46:50 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:50.948215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa1731b1670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:50.951663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.952162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.952988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:50.958733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:50.961858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:50.963609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:51.002251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8723d73-c139-46f1-8cf5-25bbc8db057e tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1693344338", "name": "tempest-test_aggregate-607804211"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:51.054182 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d01683b8-1a7c-43de-9c50-c1f579439208 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.108900 Oct 29 20:46:51.062302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 11/25] 10.222.0.36 () {58 vars in 1128 bytes} [Sat Oct 29 20:46:50 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:51.070484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa1728f9b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:51.082094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:51.082804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:51.083386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:51.118269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-f8723d73-c139-46f1-8cf5-25bbc8db057e tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 59dc30ea-2bc3-4a39-906a-fc43d391316a for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:46:51.129144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:51.133520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:51.134105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:51.212923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8723d73-c139-46f1-8cf5-25bbc8db057e tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.214287 Oct 29 20:46:51.213845 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 15/26] 10.222.0.36 () {60 vars in 1165 bytes} [Sat Oct 29 20:46:50 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:46:51.241158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89d9a02e-0345-4547-8992-20770abcaa76 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:51.271485 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b93ba898-8047-43f2-bf51-5fdde8ef9485 tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 332 microversion: 2.1 time: 0.207998 Oct 29 20:46:51.281210 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 12/27] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 20:46:51 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 332 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:51.292609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Calling method '.version_select at 0x7fa1728f9a60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:51.292859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-89d9a02e-0345-4547-8992-20770abcaa76 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.055234 Oct 29 20:46:51.294119 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 16/28] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:46:51 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:51.310372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7efb387-89f3-4228-81aa-1df5a6ed7378 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:51.324521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:51.325247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:51.325737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:51.336035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7efb387-89f3-4228-81aa-1df5a6ed7378 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:51.337687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7efb387-89f3-4228-81aa-1df5a6ed7378 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:51.338279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7efb387-89f3-4228-81aa-1df5a6ed7378 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:51.367730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:51.368226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:51.368666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:51.391016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1329a525-3f5c-46d8-9b3b-c40ee819bd6f tempest-HostsAdminTestJSON-1326009468 tempest-HostsAdminTestJSON-1326009468-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 332 microversion: 2.1 time: 0.104303 Oct 29 20:46:51.400845 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 20:46:51 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:51.635288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7efb387-89f3-4228-81aa-1df5a6ed7378 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.329862 Oct 29 20:46:51.636294 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 17/30] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:46:51 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:53.588145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1655131688", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "availability_zone": "tempest-test_az-1693344338"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:53.672323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:53.683918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:53.684389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:53.685207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:53.685716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:53.686149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:55.498499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:46:55.852221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:46:55.852656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:46:55.853143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:46:55.853712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:46:55.854143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:46:55.888021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:55.889381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:55.891079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:55.891963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:55.895071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:55.897254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:55.963059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Getting quotas for project 6706fd16973b41ea83ae718611e5eb61. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:46:55.974177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Getting quotas for user 0f3ff78fa0ca434aadb4bce26fc36882 and project 6706fd16973b41ea83ae718611e5eb61. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:46:55.991495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:46:55.996288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:46:56.106123 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98c5927d-5799-476b-8825-fd8c3798daf5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.612893 Oct 29 20:46:56.107080 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 14/31] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:46:56.118176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-13a6a5c2-3aed-4085-a152-5b3bb8dfd45e tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:56.118993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-13a6a5c2-3aed-4085-a152-5b3bb8dfd45e tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:46:57.714866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-13a6a5c2-3aed-4085-a152-5b3bb8dfd45e tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:46:57.736328 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-13a6a5c2-3aed-4085-a152-5b3bb8dfd45e tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1243 microversion: 2.1 time: 1.622216 Oct 29 20:46:57.736852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:46:56 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1243 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:46:57.920159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c64cabca-f91b-4948-9415-fab99845cb9f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:57.931746 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c64cabca-f91b-4948-9415-fab99845cb9f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.629235 Oct 29 20:46:57.933179 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:46:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:46:58.263771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a0de4ce-a08d-4b20-b257-c07fea6fa956 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1765321521", "id": 839638491, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:58.296732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a0de4ce-a08d-4b20-b257-c07fea6fa956 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.353378 Oct 29 20:46:58.307555 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 19/34] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:46:57 2022] POST /compute/v2.1/flavors => generated 422 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:58.312052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64605b83-824a-4c69-adfe-0412bcb3ac88 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:58.330401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64605b83-824a-4c69-adfe-0412bcb3ac88 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022723 Oct 29 20:46:58.333627 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 16/35] 10.222.0.36 () {58 vars in 1182 bytes} [Sat Oct 29 20:46:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:46:58.341736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a7a36d6d-0b70-4e98-9fc2-11cc59eb1498 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-766764005", "id": 1910888487, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:58.354763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:46:58.379921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a7a36d6d-0b70-4e98-9fc2-11cc59eb1498 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.042442 Oct 29 20:46:58.381048 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 20/36] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:46:58 2022] POST /compute/v2.1/flavors => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:46:58.393237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1fde7396-e2e8-41a1-b690-88cf49f4d457 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:58.406915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1fde7396-e2e8-41a1-b690-88cf49f4d457 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017833 Oct 29 20:46:58.408015 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 17/37] 10.222.0.36 () {58 vars in 1182 bytes} [Sat Oct 29 20:46:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:46:58.424034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-848440c4-4c27-4e16-993a-dca487ef8640 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Action: 'create', calling method: .version_select at 0x7fa17281f430>, body: {"keypair": {"name": "tempest-keypair-189153438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+djnXuE1Dj6K2PRB5xqzL0fW5RWYhLGjfbK1cmDGpICt1VvNcVCZvesNosaYkc25N6iN7e/uhP8EHCLa4p+p6arzRzL2nytHOXCyTJWOozb4Am3x60LdjOMIvg/fXL4A=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:46:58.462503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-848440c4-4c27-4e16-993a-dca487ef8640 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Getting quotas for project 6d30b30d07b045bb9a79cc3668a15242. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:46:58.476227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-848440c4-4c27-4e16-993a-dca487ef8640 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Getting quotas for user b9f2e85461844c6db1e27a0b5d084362 and project 6d30b30d07b045bb9a79cc3668a15242. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:46:58.530876 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-848440c4-4c27-4e16-993a-dca487ef8640 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112918 Oct 29 20:46:58.531479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 21/38] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:46:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:46:58.760108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:46:58.760729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:46:58.797141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:58.797597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:58.798049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:58.799034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:46:58.799646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:46:58.800246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:46:59.426206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:46:59.461212 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8aba7116-655c-4928-8280-5607eaaabebc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1297 microversion: 2.1 time: 0.704682 Oct 29 20:46:59.463348 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 18/39] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:46:58 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1297 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:00.491236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:00.492212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:00.502651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:00.504954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:00.506961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:00.508318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:00.511659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:00.514378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:01.034127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:01.539899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:01.566177 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2569031d-0546-43be-b1eb-e1717eaebdcc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 1.077779 Oct 29 20:47:01.585694 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:00 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:02.307090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Calling method '.version_select at 0x7fa1731b1820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:02.309074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:02.312994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:02.313609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:02.354329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:02.355809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:02.356818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:02.372314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:02.373261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:02.374402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:02.383239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53ce2efe-0e47-41f6-b665-e66f86035ffc tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.113767 Oct 29 20:47:02.386293 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 19/41] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:02.486502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-899794513", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "1910888487", "adminPass": "***", "networks": [{"uuid": "dba6aa7d-5650-42ae-bd56-54091ec6d0c3"}], "security_groups": [{"name": "tempest-securitygroup--200950616"}], "key_name": "tempest-keypair-189153438", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:02.823081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] validate_networks() for [('dba6aa7d-5650-42ae-bd56-54091ec6d0c3', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:03.784485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-694eaba7-e64c-4271-a560-bf29b48c179d tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Calling method '.version_select at 0x7fa173b52700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:03.787742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-694eaba7-e64c-4271-a560-bf29b48c179d tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'a9f1a696c2164e20b6ae1b3173bfc8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c74a54fb1fc4cb1b5c687d88fba35e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-694eaba7-e64c-4271-a560-bf29b48c179d tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Request method failure captured: Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFBB8lHRJX6IYXa6jGt2G-tynRhI0WqCiGKITMFX1TWyseheDov_W5yWyhipswk5QbLTu-9GRiL_6NLt_c_e5wa7WixGjyHi5gvfmM2U0J4qjxnU-EpzltKCbdQKnrEc6WhtLgzl0JaUDvqz3FEYrWrTHvYO69NqPO4vcbbRIsjs7o Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0c74a54fb1fc4cb1b5c687d88fba35e3 Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2141985196 Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:03.795454 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2141985196 Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0c74a54fb1fc4cb1b5c687d88fba35e3 Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2141985196 Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: a9f1a696c2164e20b6ae1b3173bfc8d9 Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 20:47:03.796895 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'nch2-master-1'} Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:03.797713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 20:47:03.798878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:03.807635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-694eaba7-e64c-4271-a560-bf29b48c179d tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:03.811034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-694eaba7-e64c-4271-a560-bf29b48c179d tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 1.417165 Oct 29 20:47:03.813178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1209 bytes} [Sat Oct 29 20:47:02 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 1420 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:03.842429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:03.848181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:03.859182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:03.860323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:03.862097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:03.866126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:03.867549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:03.870189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:04.677926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:04.697949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dd9d3c22-c4c0-4c96-a02c-11e3b663a21b tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.866528 Oct 29 20:47:04.703279 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 24/43] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:03 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:05.256202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72f7442a-5671-4b3d-ab0b-d8923497c599 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:05.260596 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-72f7442a-5671-4b3d-ab0b-d8923497c599 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72f7442a-5671-4b3d-ab0b-d8923497c599 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin] Request method failure captured: Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFHjdMJnIWqBkiPv8y9KSe3iOT91TMtox8bOqMc-oJvgyqNtIc0CXPYXBN_rdmcWjuO0dHux2ktbNAyJD1pDnLBvqJ6tKw0DlsxUhAz7sOG014WwHORNXLY6kIbyEjlOMoya0L9pIU-A770pdzoAvChN3Q2gyQvO48IBdcWlsy7Fec Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 382d2b32795f40d1a11de6b663fea5bc Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:05.274838 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/382d2b32795f40d1a11de6b663fea5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_382d2b32795f40d1a11de6b663fea5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/382d2b32795f40d1a11de6b663fea5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/382d2b32795f40d1a11de6b663fea5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 382d2b32795f40d1a11de6b663fea5bc Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0a39ef53bf264e51bd26121f771f80f5 Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:05.275993 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid timestamp for date invalid_time Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'invalid_time'} Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:05.276583 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72f7442a-5671-4b3d-ab0b-d8923497c599 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:05.277563 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72f7442a-5671-4b3d-ab0b-d8923497c599 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874 tempest-InstanceUsageAuditLogNegativeTestJSON-169373874-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.572509 Oct 29 20:47:05.278312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 25/44] 10.222.0.36 () {58 vars in 1224 bytes} [Sat Oct 29 20:47:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 574 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:47:05.296724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Calling method '.version_select at 0x7fa173b52940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:05.300178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:05.301858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:05.302319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:05.314989 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Request method failure captured: Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFFZ4li0s1bGmhbZon3_6NcbKB0Y4geQcxuhrWQtduGPOBNftJfEJgR2twNJI2lUe0w9qpR0GLs9ZnNWzyCWVMjvzbl-NouERDuidD3IRb5_J7CzEJzVEKXzIM2-JRGNNVUOmGZD57L1efdT0gNY-RKpoDgil1bBV6BmUSgQ3X7IhE Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b30059e88894d15862acaaa3b7f903b Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2009553540 Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:05.316538 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2009553540 Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b30059e88894d15862acaaa3b7f903b Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2009553540 Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ab0cbb63dd3e4c6cae7f33179053911f Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 20:47:05.318522 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:05.319161 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:05.320646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e90cf375-0e4a-4b74-bfb1-896f4059bbe7 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.040340 Oct 29 20:47:05.332301 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 26/45] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 20:47:05 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:05.629470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:05.632254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:05.633070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:05.634523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:05.635218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45b41ff3-f4f9-41a1-8cb5-a56e438400d5 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1499651174", "ram": 512, "vcpus": 1, "disk": 10, "id": 74608183, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:05.635905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:05.667373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:05.669070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:05.669890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:05.670917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:05.671611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:05.672269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:05.686341 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45b41ff3-f4f9-41a1-8cb5-a56e438400d5 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.355654 Oct 29 20:47:05.690120 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 27/46] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:05 2022] POST /compute/v2.1/flavors => generated 410 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:05.715335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Getting quotas for project 6d30b30d07b045bb9a79cc3668a15242. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:05.721789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Getting quotas for user b9f2e85461844c6db1e27a0b5d084362 and project 6d30b30d07b045bb9a79cc3668a15242. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:05.735947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:05.739776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:05.752540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:05.817946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a024f73-db57-4511-8c6a-429eb5e27897 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.350400 Oct 29 20:47:05.827875 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 20/47] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:05.969961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:05.974088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:05.975248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:05.976023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:05.977431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:05.978510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:05.979189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.010592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df24d33a-fd63-4d1f-b9a6-d022023e79c1 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.319386 Oct 29 20:47:06.017989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 28/48] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:47:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:06.025138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-973583182", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:06.123168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:06.209057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cccf1bd0-8085-4ed0-acc9-f24f569d7287 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:06.211407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cccf1bd0-8085-4ed0-acc9-f24f569d7287 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'dc856e9773c141b792d8d56ab7b64add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad546d9b45a144f7818de56b469a42e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cccf1bd0-8085-4ed0-acc9-f24f569d7287 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Request method failure captured: Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFCCVmKRoSfEowxEe8n870swskN3i1g-JfO7nnHWHu_zkJ5ZfX9JkMpzyxB49pqyAfedwgaUV-ZyBJ2unjJnsog8JZfeodilCxm-VCN38XVl3WrVGCXzi-fzP1MJsUbS4PV-ogWddjVrH7wjryMIB-sAbdFqB4fOEDcNFUqOj0n0zk Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ad546d9b45a144f7818de56b469a42e0 Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:06.214045 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ad546d9b45a144f7818de56b469a42e0 Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: dc856e9773c141b792d8d56ab7b64add Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:06.215163 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: action_args: {} Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:06.215757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 20:47:06.217031 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.220655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cccf1bd0-8085-4ed0-acc9-f24f569d7287 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:06.222415 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cccf1bd0-8085-4ed0-acc9-f24f569d7287 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.203099 Oct 29 20:47:06.224951 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 29/49] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 20:47:06 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:06.235744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Calling method '.version_select at 0x7fa1726d3160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:06.243200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.244687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.246088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.270063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.271641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.272468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.306582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.307933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.309011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.325786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e9bf33b-926d-4ff2-8a51-93d9db3e0c96 tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.099361 Oct 29 20:47:06.330799 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 30/50] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:06.434140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:06.434610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:06.435220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:06.435647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:06.436153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:06.449524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.450512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.451248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.453551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.454422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.455057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.462537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe81d79-3cf8-4935-9ded-c657ae5fb11a", "tag": "d7291f52-e465-454c-bf74-548ed4ba05ff"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:06.477711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.478563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.479672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.504257 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Creating event network-changed:d7291f52-e465-454c-bf74-548ed4ba05ff for instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a on nch2-master-1 Oct 29 20:47:06.507015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:47:06.507648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0258d82-1da2-4527-aefe-539504a37712 req-573ecd21-ed92-4f41-a8c6-95464362c600 service nova] Acquired lock "compute-rpcapi-router" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:47:06.510252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.510901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.511440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.512301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.512880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.513440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.516233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Getting quotas for project 0d839b1a840346baa1f65e6000ea277b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:06.528081 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.rpcapi [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 20:47:06.529337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] Releasing lock "compute-rpcapi-router" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:47:06.531020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Getting quotas for user 7597be5274ff469b9eec43728cad006a and project 0d839b1a840346baa1f65e6000ea277b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:06.557639 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc762ed7-5779-4516-ae69-5de1e418373a None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224705 Oct 29 20:47:06.561409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 31/51] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:06.563330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:06.566984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:06.691683 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7937336d-7668-41e8-b1ac-200d17fffe53 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861381 Oct 29 20:47:06.694884 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 21/52] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:06.787203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6cb12389-c3ac-4fdc-a499-09031d412478 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:06.812264 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6cb12389-c3ac-4fdc-a499-09031d412478 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] HTTP exception thrown: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6cb12389-c3ac-4fdc-a499-09031d412478 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Request method failure captured: Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/flavors/74608183/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFCLEcBhyldeTumyVXoao4JP0Sh9Qm-1Wa_10_mIHfFUaI7v4rL53Htr7z7kJy8gCP9KkBh4NuRTeYFUUwJOzorGoizc65U6_D1oHX-sDKdINC-oPn06RrsU2uxfP_KUox6zpii_329Jbq2YhrPRhkT0LrNSoQ5m4elecSlI988yB8 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:06.814447 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 18f77cf4475d4363b3aa65138e99c601 Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:06.815588 ncdv-master-1 devstack@n-api.service[138885]: exception: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'flavor_id': '74608183', 'id': 'hw:cpu_thread_policy'} Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:06.816173 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:06.817255 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:06.818956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6cb12389-c3ac-4fdc-a499-09031d412478 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Returning 404 to user: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:06.820081 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6cb12389-c3ac-4fdc-a499-09031d412478 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] 10.222.0.36 "GET /compute/v2.1/flavors/74608183/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.257172 Oct 29 20:47:06.825580 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 32/53] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:47:06 2022] GET /compute/v2.1/flavors/74608183/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:06.831805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:06.832767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:06.840373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.841304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.842699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.843712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.844328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.844894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.858154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa17279d940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:06.866508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.867009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.867455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.910700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.911194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.911631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.938713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:06.939435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:06.940089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:06.950609 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd7da4d4-649d-48b5-be03-11c396291b69 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.252684 Oct 29 20:47:06.961214 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 22/54] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:06.972121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84a13e97-385a-4f72-b899-8ad89379b7c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:06.972769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84a13e97-385a-4f72-b899-8ad89379b7c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:07.096757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84a13e97-385a-4f72-b899-8ad89379b7c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.101784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.110306 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6de6c46-b317-49fa-90b3-5a0a00fb40fc tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.283308 Oct 29 20:47:07.110885 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 33/55] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:06 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:07.116399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bf5db80-2680-4dab-adf0-fbdef4962764 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.118409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6bf5db80-2680-4dab-adf0-fbdef4962764 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'dc856e9773c141b792d8d56ab7b64add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad546d9b45a144f7818de56b469a42e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bf5db80-2680-4dab-adf0-fbdef4962764 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Request method failure captured: Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2020:47:06 HTTP/1.1 Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFCCVmKRoSfEowxEe8n870swskN3i1g-JfO7nnHWHu_zkJ5ZfX9JkMpzyxB49pqyAfedwgaUV-ZyBJ2unjJnsog8JZfeodilCxm-VCN38XVl3WrVGCXzi-fzP1MJsUbS4PV-ogWddjVrH7wjryMIB-sAbdFqB4fOEDcNFUqOj0n0zk Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ad546d9b45a144f7818de56b469a42e0 Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:07.120259 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ad546d9b45a144f7818de56b469a42e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ad546d9b45a144f7818de56b469a42e0 Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: dc856e9773c141b792d8d56ab7b64add Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:07.121332 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2022-10-29 20:47:06'} Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:07.122048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 20:47:07.123071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.126373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bf5db80-2680-4dab-adf0-fbdef4962764 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.127507 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6bf5db80-2680-4dab-adf0-fbdef4962764 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965 tempest-InstanceUsageAuditLogNegativeTestJSON-59324965-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 20:47:06" status: 403 len: 128 microversion: 2.1 time: 0.014819 Oct 29 20:47:07.128282 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 34/56] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2020%3A47%3A06 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:07.128692 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84a13e97-385a-4f72-b899-8ad89379b7c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1263 microversion: 2.1 time: 0.175999 Oct 29 20:47:07.137690 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 23/57] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:06 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:07.149255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce08e949-f5a0-44c6-a226-30f06bf39c5b tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Calling method '.version_select at 0x7fa1726e2ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.153205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-191fa0a6-55ea-4592-981e-1a820199857a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.159324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-191fa0a6-55ea-4592-981e-1a820199857a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:07.161984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce08e949-f5a0-44c6-a226-30f06bf39c5b tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'a9f1a696c2164e20b6ae1b3173bfc8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c74a54fb1fc4cb1b5c687d88fba35e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce08e949-f5a0-44c6-a226-30f06bf39c5b tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Request method failure captured: Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFBB8lHRJX6IYXa6jGt2G-tynRhI0WqCiGKITMFX1TWyseheDov_W5yWyhipswk5QbLTu-9GRiL_6NLt_c_e5wa7WixGjyHi5gvfmM2U0J4qjxnU-EpzltKCbdQKnrEc6WhtLgzl0JaUDvqz3FEYrWrTHvYO69NqPO4vcbbRIsjs7o Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0c74a54fb1fc4cb1b5c687d88fba35e3 Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2141985196 Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:07.173913 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c74a54fb1fc4cb1b5c687d88fba35e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2141985196 Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0c74a54fb1fc4cb1b5c687d88fba35e3 Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2141985196 Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: a9f1a696c2164e20b6ae1b3173bfc8d9 Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 20:47:07.175364 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '1'} Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:07.176039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 20:47:07.176949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.178708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce08e949-f5a0-44c6-a226-30f06bf39c5b tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.179796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce08e949-f5a0-44c6-a226-30f06bf39c5b tempest-HypervisorAdminNegativeUnderV252Test-2141985196 tempest-HypervisorAdminNegativeUnderV252Test-2141985196-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.049283 Oct 29 20:47:07.180599 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 35/58] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:07.188899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86e2e9b4-bc6f-4f13-bea2-d779e1283d5d tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:07.193265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86e2e9b4-bc6f-4f13-bea2-d779e1283d5d tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '18f77cf4475d4363b3aa65138e99c601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfded64356324f48a2e6d994bd5c0074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86e2e9b4-bc6f-4f13-bea2-d779e1283d5d tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Request method failure captured: Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/flavors/74608183/os-extra_specs HTTP/1.1 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 66 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFCLEcBhyldeTumyVXoao4JP0Sh9Qm-1Wa_10_mIHfFUaI7v4rL53Htr7z7kJy8gCP9KkBh4NuRTeYFUUwJOzorGoizc65U6_D1oHX-sDKdINC-oPn06RrsU2uxfP_KUox6zpii_329Jbq2YhrPRhkT0LrNSoQ5m4elecSlI988yB8 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:07.196059 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 18f77cf4475d4363b3aa65138e99c601 Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 29 20:47:07.197205 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'flavor_id': '74608183', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:07.197878 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 20:47:07.198865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.205860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86e2e9b4-bc6f-4f13-bea2-d779e1283d5d tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.206949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86e2e9b4-bc6f-4f13-bea2-d779e1283d5d tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] 10.222.0.36 "POST /compute/v2.1/flavors/74608183/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.025138 Oct 29 20:47:07.212406 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 36/59] 10.222.0.36 () {60 vars in 1218 bytes} [Sat Oct 29 20:47:07 2022] POST /compute/v2.1/flavors/74608183/os-extra_specs => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:07.217123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa173b529d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.219955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.220556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.221230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.237783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.238822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.241609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.267808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.268299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.268738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.288105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be21dec3-73df-408d-bee5-ffb572154b6a tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.074754 Oct 29 20:47:07.308843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-191fa0a6-55ea-4592-981e-1a820199857a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.317851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 37/60] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:07.340303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Calling method '.version_select at 0x7fa1726d3f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.341560 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-191fa0a6-55ea-4592-981e-1a820199857a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1219 microversion: 2.1 time: 0.201761 Oct 29 20:47:07.349912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.351519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.352155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.358439 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 24/61] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:07.364978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32b26034-952d-4ee9-955a-64599227e616 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:07.369672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] HTTP exception thrown: No hypervisor matching 'd761db1f-819c-4eba-81f5-83df944cd517' could be found. Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Request method failure captured: Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/d761db1f-819c-4eba-81f5-83df944cd517/servers HTTP/1.1 Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFFZ4li0s1bGmhbZon3_6NcbKB0Y4geQcxuhrWQtduGPOBNftJfEJgR2twNJI2lUe0w9qpR0GLs9ZnNWzyCWVMjvzbl-NouERDuidD3IRb5_J7CzEJzVEKXzIM2-JRGNNVUOmGZD57L1efdT0gNY-RKpoDgil1bBV6BmUSgQ3X7IhE Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b30059e88894d15862acaaa3b7f903b Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2009553540 Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:07.371277 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b30059e88894d15862acaaa3b7f903b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2009553540 Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b30059e88894d15862acaaa3b7f903b Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2009553540 Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ab0cbb63dd3e4c6cae7f33179053911f Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: exception: No hypervisor matching 'd761db1f-819c-4eba-81f5-83df944cd517' could be found. Oct 29 20:47:07.372337 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd761db1f-819c-4eba-81f5-83df944cd517'} Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'd761db1f-819c-4eba-81f5-83df944cd517' could be found. Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.373369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.375606 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.375606 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.375606 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:07.375606 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:07.375606 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'd761db1f-819c-4eba-81f5-83df944cd517' could be found. Oct 29 20:47:07.375606 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.376721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] Returning 404 to user: No hypervisor matching 'd761db1f-819c-4eba-81f5-83df944cd517' could be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.377949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9c874250-5ecc-43d8-b2f8-0b4c43cfb81a tempest-HypervisorAdminNegativeUnderV252Test-2009553540 tempest-HypervisorAdminNegativeUnderV252Test-2009553540-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/d761db1f-819c-4eba-81f5-83df944cd517/servers" status: 404 len: 123 microversion: 2.1 time: 0.058891 Oct 29 20:47:07.379871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 38/62] 10.222.0.36 () {58 vars in 1281 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors/d761db1f-819c-4eba-81f5-83df944cd517/servers => generated 123 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:07.390597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa1726e2820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.394030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.394735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.395246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.458398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.459563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.460200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.482217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.482967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.484067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.503108 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef7c9e60-3eb8-4884-8386-6875f0012c63 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.120123 Oct 29 20:47:07.505232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 39/63] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:07.510104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32b26034-952d-4ee9-955a-64599227e616 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/74608183/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.148309 Oct 29 20:47:07.511696 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 25/64] 10.222.0.36 () {60 vars in 1218 bytes} [Sat Oct 29 20:47:07 2022] POST /compute/v2.1/flavors/74608183/os-extra_specs => generated 66 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:07.518333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa1726d3a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.529910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.530336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bfe1092-3c91-4bd2-8464-53572ed05951 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.531911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.532986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7bfe1092-3c91-4bd2-8464-53572ed05951 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '18f77cf4475d4363b3aa65138e99c601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfded64356324f48a2e6d994bd5c0074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bfe1092-3c91-4bd2-8464-53572ed05951 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Request method failure captured: Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFCLEcBhyldeTumyVXoao4JP0Sh9Qm-1Wa_10_mIHfFUaI7v4rL53Htr7z7kJy8gCP9KkBh4NuRTeYFUUwJOzorGoizc65U6_D1oHX-sDKdINC-oPn06RrsU2uxfP_KUox6zpii_329Jbq2YhrPRhkT0LrNSoQ5m4elecSlI988yB8 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:07.535500 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 18f77cf4475d4363b3aa65138e99c601 Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:07.537554 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'flavor_id': '74608183', 'id': 'hw:numa_nodes'} Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:07.538180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 20:47:07.539198 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.539987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.543356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bfe1092-3c91-4bd2-8464-53572ed05951 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.544992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bfe1092-3c91-4bd2-8464-53572ed05951 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] 10.222.0.36 "DELETE /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024944 Oct 29 20:47:07.546400 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 26/65] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:47:07 2022] DELETE /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:07.557727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aab4193f-b0c9-4059-af75-5bc7e7816ed5 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:07.602108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.602350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.603369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.660037 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-69ddd4a0-77dd-4402-b86e-abc31f8d2e0d tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.146791 Oct 29 20:47:07.665518 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 40/66] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:07.685098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97e5d5b0-5694-46ff-86ef-34991f3d2905 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa1726d3ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.689365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97e5d5b0-5694-46ff-86ef-34991f3d2905 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.690382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97e5d5b0-5694-46ff-86ef-34991f3d2905 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.691292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97e5d5b0-5694-46ff-86ef-34991f3d2905 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.714229 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aab4193f-b0c9-4059-af75-5bc7e7816ed5 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/74608183/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.162770 Oct 29 20:47:07.719093 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 27/67] 10.222.0.36 () {60 vars in 1218 bytes} [Sat Oct 29 20:47:07 2022] POST /compute/v2.1/flavors/74608183/os-extra_specs => generated 66 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:07.726722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52749499-090f-4444-9179-7fd1f864d86e tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:07.737080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97e5d5b0-5694-46ff-86ef-34991f3d2905 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.056387 Oct 29 20:47:07.739868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52749499-090f-4444-9179-7fd1f864d86e tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '18f77cf4475d4363b3aa65138e99c601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfded64356324f48a2e6d994bd5c0074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:07.743325 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 41/68] 10.222.0.36 () {58 vars in 1179 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52749499-090f-4444-9179-7fd1f864d86e tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Request method failure captured: Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 22 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFCLEcBhyldeTumyVXoao4JP0Sh9Qm-1Wa_10_mIHfFUaI7v4rL53Htr7z7kJy8gCP9KkBh4NuRTeYFUUwJOzorGoizc65U6_D1oHX-sDKdINC-oPn06RrsU2uxfP_KUox6zpii_329Jbq2YhrPRhkT0LrNSoQ5m4elecSlI988yB8 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:07.744537 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dfded64356324f48a2e6d994bd5c0074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: dfded64356324f48a2e6d994bd5c0074 Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 18f77cf4475d4363b3aa65138e99c601 Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: {"hw:numa_nodes": "1"} Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:07.749258 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'flavor_id': '74608183', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:07.750567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 20:47:07.751653 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.753847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52749499-090f-4444-9179-7fd1f864d86e tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.755060 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52749499-090f-4444-9179-7fd1f864d86e tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933 tempest-FlavorsExtraSpecsNegativeTestJSON-2077246933-project] 10.222.0.36 "PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.032517 Oct 29 20:47:07.758120 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 28/69] 10.222.0.36 () {60 vars in 1259 bytes} [Sat Oct 29 20:47:07 2022] PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:47:07.774336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa1726d3940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.779461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.779461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.779461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.786829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-49dcf746-900c-41f0-b6ec-c35cf25e3185 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.813781 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-49dcf746-900c-41f0-b6ec-c35cf25e3185 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] HTTP exception thrown: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-49dcf746-900c-41f0-b6ec-c35cf25e3185 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Request method failure captured: Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/flavors/74608183/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFIuYh_NHWbYIlk8dJyktkYFj3cGrTHCj_QyqARjzTrjjXnGmNqFCqTqfnt0vy96Hp_MW0GWa-PbmckQPSGzsrW_EU9kcdbAw7Es9zUrld-Hs5M71z8n-n_gdfgD6XcBEKNRwLk4zqfzrkayADOQdcfVJ129IMQVu8-fGr5qc_WqLI Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 5573c316ad404eac9c47300425db6a3b Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:07.820818 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5573c316ad404eac9c47300425db6a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 5573c316ad404eac9c47300425db6a3b Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7d4a841d0290475aa32b1f12113056e1 Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:07.822278 ncdv-master-1 devstack@n-api.service[138884]: exception: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'flavor_id': '74608183', 'id': 'hw:cpu_thread_policy'} Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.822909 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-49dcf746-900c-41f0-b6ec-c35cf25e3185 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Returning 404 to user: Flavor 74608183 has no extra specs with key hw:cpu_thread_policy. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.823973 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-49dcf746-900c-41f0-b6ec-c35cf25e3185 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/74608183/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.045624 Oct 29 20:47:07.830952 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 29/70] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:47:07 2022] DELETE /compute/v2.1/flavors/74608183/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:07.838307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96e65558-5836-4997-907d-da29156aba87 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:07.848313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.848914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.849373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.854847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-96e65558-5836-4997-907d-da29156aba87 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96e65558-5836-4997-907d-da29156aba87 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Request method failure captured: Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 27 Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFIuYh_NHWbYIlk8dJyktkYFj3cGrTHCj_QyqARjzTrjjXnGmNqFCqTqfnt0vy96Hp_MW0GWa-PbmckQPSGzsrW_EU9kcdbAw7Es9zUrld-Hs5M71z8n-n_gdfgD6XcBEKNRwLk4zqfzrkayADOQdcfVJ129IMQVu8-fGr5qc_WqLI Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 5573c316ad404eac9c47300425db6a3b Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:07.859042 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5573c316ad404eac9c47300425db6a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 5573c316ad404eac9c47300425db6a3b Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7d4a841d0290475aa32b1f12113056e1 Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: {"hw:cpu_policy": "shared"} Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:07.860157 ncdv-master-1 devstack@n-api.service[138884]: exception: Request body and URI mismatch Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'flavor_id': '74608183', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.860835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.861862 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:07.861862 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:07.861862 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 29 20:47:07.861862 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.861862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96e65558-5836-4997-907d-da29156aba87 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.861862 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96e65558-5836-4997-907d-da29156aba87 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028535 Oct 29 20:47:07.871778 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 30/71] 10.222.0.36 () {60 vars in 1259 bytes} [Sat Oct 29 20:47:07 2022] PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:47:07.882503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.883027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.886740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e1bc955-3d7c-4dac-b642-ac35f906f254 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:07.902260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.911155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-09bb9eb3-036f-48af-b6df-5d9251b17774 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.148669 Oct 29 20:47:07.918892 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 42/72] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:07.924163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa1728b4dc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.926565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.927769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.928625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.953039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e1bc955-3d7c-4dac-b642-ac35f906f254 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Request method failure captured: Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 49 Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFIuYh_NHWbYIlk8dJyktkYFj3cGrTHCj_QyqARjzTrjjXnGmNqFCqTqfnt0vy96Hp_MW0GWa-PbmckQPSGzsrW_EU9kcdbAw7Es9zUrld-Hs5M71z8n-n_gdfgD6XcBEKNRwLk4zqfzrkayADOQdcfVJ129IMQVu8-fGr5qc_WqLI Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 5573c316ad404eac9c47300425db6a3b Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:07.954307 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5573c316ad404eac9c47300425db6a3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5573c316ad404eac9c47300425db6a3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 5573c316ad404eac9c47300425db6a3b Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7d4a841d0290475aa32b1f12113056e1 Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 29 20:47:07.955607 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'flavor_id': '74608183', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance: Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 29 20:47:07.956207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.957799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:07.960067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:07.960067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:07.960067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:47:07.960067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:47:07.960067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 20:47:07.960067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:07.962525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e1bc955-3d7c-4dac-b642-ac35f906f254 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:07.963785 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e1bc955-3d7c-4dac-b642-ac35f906f254 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.090989 Oct 29 20:47:07.964668 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 31/73] 10.222.0.36 () {60 vars in 1259 bytes} [Sat Oct 29 20:47:07 2022] PUT /compute/v2.1/flavors/74608183/os-extra_specs/hw:numa_nodes => generated 117 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:47:07.966318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:07.966979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:07.978622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b268925-c73b-4a6d-9d2d-6f94b23d0e42 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:07.995199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cfdb2e5-6053-4eb4-9ca3-e48e5dddb3a3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.074693 Oct 29 20:47:08.009540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 43/74] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:08.024674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa172754ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:08.046879 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b268925-c73b-4a6d-9d2d-6f94b23d0e42 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/74608183" status: 202 len: 0 microversion: 2.1 time: 0.075735 Oct 29 20:47:08.049363 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 32/75] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:07 2022] DELETE /compute/v2.1/flavors/74608183 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:47:08.052044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.052732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.057100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.065236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:08.067265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b6bd1b95-5b4e-42fb-a02d-0a4e8bcf14f1 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:08.119275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.119771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.120374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.142277 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8391ebe7-15f2-4b4c-bed2-0c6ddd3ce8e3 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.131165 Oct 29 20:47:08.157205 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 44/76] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:08.164052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:08.167555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:08.179506 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b6bd1b95-5b4e-42fb-a02d-0a4e8bcf14f1 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973 tempest-FlavorsExtraSpecsNegativeTestJSON-949323973-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.125093 Oct 29 20:47:08.182873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.186663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.187283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.188156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.188763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.189364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.207748 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 33/77] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:08 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:08.214811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:08.215630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:08.232282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.233436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.234357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.235710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.236684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.238560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.488257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:08.495384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:08.511849 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f57feec1-46e6-4c68-abac-2579180ff405 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1315 microversion: 2.1 time: 0.302112 Oct 29 20:47:08.513182 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 34/78] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:08 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:08.527241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Calling method '.version_select at 0x7fa17279d700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:08.531198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.531990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.532934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.607703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.609088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.609772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.646689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.647329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.649302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.662298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:47:08.670571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6eb51176-8bba-42f8-9dc0-5c68581e2220 tempest-HypervisorAdminTestJSON-2049576800 tempest-HypervisorAdminTestJSON-2049576800-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:47:08.672960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.673984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.676787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.679793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.682505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.683621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.716608 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.rpcapi [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 20:47:08.718497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] Releasing lock "compute-rpcapi-router" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:47:08.787209 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1741983-4ea4-4a28-a95b-47378fa24203 None None] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.271679 Oct 29 20:47:08.790806 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 35/79] 10.222.0.36 () {58 vars in 1173 bytes} [Sat Oct 29 20:47:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:08.805181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:08.805181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:08.817761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.818629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.820072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:08.821064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:08.821778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:08.823468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:09.070552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:09.080765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6d224dc-2f02-4aec-b7db-26d8b2083010 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1271 microversion: 2.1 time: 0.287484 Oct 29 20:47:09.085639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 36/80] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:08 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:09.097706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:09.107094 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c5ca3336-2aef-4ad5-95c5-8dd685af4add tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.948340 Oct 29 20:47:09.110679 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 45/81] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:08 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:09.541136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:09.542438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:09.565798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:09.568080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:09.569198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:09.576134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:09.587979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:09.595179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:09.801389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:09.814146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9febba0a-b88b-4de8-bde9-c7214b79be13 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1321 microversion: 2.1 time: 0.273533 Oct 29 20:47:09.815757 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 37/82] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:09 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:10.114939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:10.115560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:10.129677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:10.130301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:10.130928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:10.132037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:10.135100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:10.142120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:10.145789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:10.147836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:10.174071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:10.175586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:10.176977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:10.179557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:10.181441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:10.185893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:10.559044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:10.569968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aaaaaaa2-6ed1-45eb-9dbb-aaf0d205bd8f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1277 microversion: 2.1 time: 0.457275 Oct 29 20:47:10.571648 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 46/83] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:10 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:10.801492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:10.810726 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e68fa56-fde4-416f-b66f-10da655267c2 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.677668 Oct 29 20:47:10.829954 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 38/84] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:10 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:10.840267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:10.841320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:10.851503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:10.854156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:10.854798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:10.855777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:10.857443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:10.859935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:11.095344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:11.102119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-213305cb-8580-47cd-8a85-cec23a36ef17 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1321 microversion: 2.1 time: 0.265811 Oct 29 20:47:11.121911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 47/85] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:10 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:11.600287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:11.600892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:11.609820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:11.614129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:11.614766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:11.615718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:11.622704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:11.623316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:11.836141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:11.836814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:11.849723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:11.850143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:11.850672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:11.851281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:11.851895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:11.852464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:11.882433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:11.892614 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54e78e64-34bc-44f2-8a5c-e30867450f1e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1277 microversion: 2.1 time: 0.296219 Oct 29 20:47:11.893516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 39/86] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:11 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:12.132936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:12.133851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:12.145215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:12.145761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:12.146201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:12.146909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:12.147357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:12.157372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:12.163193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:12.187330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:12.196740 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37a7227a-66bd-4f9a-a704-574fe3b94388 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.364719 Oct 29 20:47:12.236001 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 48/87] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:11 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:12.284726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:12.297794 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4e63ef69-31cd-4669-8889-2182288c0a3c tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1321 microversion: 2.1 time: 0.169705 Oct 29 20:47:12.309790 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 40/88] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:12 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:12.922614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:12.924032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:12.931902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:12.932400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:12.932859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:12.933769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:12.934333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:12.934977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:13.237394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:13.238689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:13.255297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:13.260498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:13.261353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:13.262537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:13.263856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:13.266006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:14.033829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:14.044347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-52f42d2c-89ac-43ea-b4b3-6ec7cc8af670 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 1.126115 Oct 29 20:47:14.049933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 49/89] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:12 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:14.057405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:14.058586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:14.080530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:14.082182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:14.083019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:14.084858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:14.086644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:14.088828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:14.260836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:14.272494 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4c50552-ef09-40b2-9d46-4a23a123b151 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 1.036994 Oct 29 20:47:14.289918 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 41/90] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:13 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:14.614472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:14.625258 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd36689a-efa3-4122-b465-477c678e2d0a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.571371 Oct 29 20:47:14.625898 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 50/91] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:14 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:15.075883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:15.076663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:15.115948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.118675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.119820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.124402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.125138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.126136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.178886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1c5e3a69-74eb-4af5-b6bd-9dec37ed37b5 req-f5c437fe-f2ff-4577-8624-cbc3a24f9544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081ac346-df70-4c2f-803e-94f0d633b72a", "tag": "74ef1822-ac00-431f-8dce-a62df761b0f3"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:15.226029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1c5e3a69-74eb-4af5-b6bd-9dec37ed37b5 req-f5c437fe-f2ff-4577-8624-cbc3a24f9544 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.226518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1c5e3a69-74eb-4af5-b6bd-9dec37ed37b5 req-f5c437fe-f2ff-4577-8624-cbc3a24f9544 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.226947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1c5e3a69-74eb-4af5-b6bd-9dec37ed37b5 req-f5c437fe-f2ff-4577-8624-cbc3a24f9544 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.299970 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1c5e3a69-74eb-4af5-b6bd-9dec37ed37b5 req-f5c437fe-f2ff-4577-8624-cbc3a24f9544 service nova] Creating event network-changed:74ef1822-ac00-431f-8dce-a62df761b0f3 for instance 081ac346-df70-4c2f-803e-94f0d633b72a on nch1-master-1 Oct 29 20:47:15.322315 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1c5e3a69-74eb-4af5-b6bd-9dec37ed37b5 req-f5c437fe-f2ff-4577-8624-cbc3a24f9544 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147062 Oct 29 20:47:15.323589 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 51/92] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:15.349375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:15.350141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:15.370919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.374510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.375175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.376091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.376810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.378288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.571519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:15.580939 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3184ce1e-eef1-4acf-8bc9-993be6b0d81f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.512575 Oct 29 20:47:15.600290 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 42/93] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:15 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:15.633818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:15.644268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9c746bc2-f84a-42d0-a9b0-e2b0215587e5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.319151 Oct 29 20:47:15.645141 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 52/94] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:15 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:15.658211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:15.660265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:15.673195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.673878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.674417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.675250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:15.675818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:15.676322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:15.883571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:15.892851 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e2ab16a7-fc57-43e2-883b-68b77cc56887 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.248036 Oct 29 20:47:15.893978 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 43/95] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:15 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:16.180147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0cc0155-0a17-4ed3-8cfe-733f011ccd30 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Action: 'create', calling method: .version_select at 0x7fa1726e2820>, body: {"keypair": {"name": "tempest-keypair-938653976", "type": "ssh", "user_id": "b1dc7e1380b94d67af50d023f939b9fd", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQMV/VdLJ3pf4Bm9SQ4m5Uh8S9pi9IMku2skpvIaDZPZo7UaSxZHHENVn9pcCpGw0TsCDPZMAvFRJf7DJx98JDuPPQ612miAPEN237Jv+nvK8mnD6Mo2q3HTfIvjtOXZg=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:16.202650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b0cc0155-0a17-4ed3-8cfe-733f011ccd30 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Getting quotas for project 449204cb23a14509affee79367c7ed79. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:16.223458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b0cc0155-0a17-4ed3-8cfe-733f011ccd30 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Getting quotas for user e370e408a09c4662a0ba08cfc1750445 and project 449204cb23a14509affee79367c7ed79. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:16.252735 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0cc0155-0a17-4ed3-8cfe-733f011ccd30 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.428518 Oct 29 20:47:16.257515 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 53/96] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 20:47:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 431 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 29 20:47:16.270036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6aedfc30-5568-4406-9ed4-debee1306bc1 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Action: 'create', calling method: .version_select at 0x7fa1731b2ee0>, body: {"keypair": {"name": "tempest-keypair-899728906", "type": "ssh", "user_id": "b1dc7e1380b94d67af50d023f939b9fd", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFD8/FAqLCtR+sP8PtARxXJ0diYIQ8ZxTQ04oMIcF1eLl3S869V5l5Pc61Yl4w3wn8wcMmYCGX4jIoBuPcbPqRv26lTSotMAKRo1sefYTCLPYf4UKDzj2Uq4GiMIuXlXw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:16.290562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=23 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:16.296700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6aedfc30-5568-4406-9ed4-debee1306bc1 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Getting quotas for project 449204cb23a14509affee79367c7ed79. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:16.301987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6aedfc30-5568-4406-9ed4-debee1306bc1 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Getting quotas for user e370e408a09c4662a0ba08cfc1750445 and project 449204cb23a14509affee79367c7ed79. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:16.334093 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6aedfc30-5568-4406-9ed4-debee1306bc1 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.070119 Oct 29 20:47:16.334939 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 44/97] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 20:47:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 20:47:16.348910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e02a04c8-ce1f-4272-901c-d124af2c091b tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Calling method '.version_select at 0x7fa1725a6940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.363853 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e02a04c8-ce1f-4272-901c-d124af2c091b tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-938653976?user_id=b1dc7e1380b94d67af50d023f939b9fd" status: 200 len: 511 microversion: 2.10 time: 0.020118 Oct 29 20:47:16.364977 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 54/98] 10.222.0.36 () {60 vars in 1337 bytes} [Sat Oct 29 20:47:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-938653976?user_id=b1dc7e1380b94d67af50d023f939b9fd => generated 511 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:16.379062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30aafc77-cd36-4a34-9342-13da99a1d4c5 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Action: 'create', calling method: .version_select at 0x7fa17279d3a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-69497046", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr4JDsQ1BEsds7beUHbZ2jwEgAgwJkDf9f0KS1rdk+biaJiTMhtNpe4FFK2fmArvwmjv4qOHJIeDTtvFNPjOec6RvgsZu23ElfuTC7p5AU6M3Z1nmL+29VAf3e33ibaZw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:16.386084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=80,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:16.399414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-30aafc77-cd36-4a34-9342-13da99a1d4c5 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Getting quotas for project 449204cb23a14509affee79367c7ed79. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:16.404625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-30aafc77-cd36-4a34-9342-13da99a1d4c5 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Getting quotas for user e370e408a09c4662a0ba08cfc1750445 and project 449204cb23a14509affee79367c7ed79. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:16.442611 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30aafc77-cd36-4a34-9342-13da99a1d4c5 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.10 time: 0.067223 Oct 29 20:47:16.444222 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 45/99] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 20:47:16 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 20:47:16.456796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-35b2c4fa-21a2-48df-ab16-1f54a53df232 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Calling method '.version_select at 0x7fa1726d39d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.461051 ncdv-master-1 devstack@n-api.service[138885]: WARNING oslo_db.sqlalchemy.utils [None req-35b2c4fa-21a2-48df-ab16-1f54a53df232 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 20:47:16.470982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-35b2c4fa-21a2-48df-ab16-1f54a53df232 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs?user_id=b1dc7e1380b94d67af50d023f939b9fd" status: 200 len: 724 microversion: 2.10 time: 0.020101 Oct 29 20:47:16.477906 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 55/100] 10.222.0.36 () {60 vars in 1259 bytes} [Sat Oct 29 20:47:16 2022] GET /compute/v2.1/os-keypairs?user_id=b1dc7e1380b94d67af50d023f939b9fd => generated 724 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:16.482975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb1fc3c3-a2a4-4a92-8f6b-1c248b56ba75 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Calling method '.version_select at 0x7fa172678e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.504357 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb1fc3c3-a2a4-4a92-8f6b-1c248b56ba75 tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-69497046" status: 204 len: 0 microversion: 2.10 time: 0.025044 Oct 29 20:47:16.505518 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 46/101] 10.222.0.36 () {60 vars in 1319 bytes} [Sat Oct 29 20:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-69497046 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:47:16.513554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6392ca28-aab1-4aee-a831-e21f85035dbd tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Calling method '.version_select at 0x7fa17264e8b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.522714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:16.551332 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6392ca28-aab1-4aee-a831-e21f85035dbd tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-899728906?user_id=b1dc7e1380b94d67af50d023f939b9fd" status: 204 len: 0 microversion: 2.10 time: 0.041292 Oct 29 20:47:16.552387 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 56/102] 10.222.0.36 () {60 vars in 1340 bytes} [Sat Oct 29 20:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-899728906?user_id=b1dc7e1380b94d67af50d023f939b9fd => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:47:16.560891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a1737eb-d104-48cd-95e1-90d37d12b86b tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] Calling method '.version_select at 0x7fa172722820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.592211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a1737eb-d104-48cd-95e1-90d37d12b86b tempest-KeyPairsV210TestJSON-1797573503 tempest-KeyPairsV210TestJSON-1797573503-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938653976?user_id=b1dc7e1380b94d67af50d023f939b9fd" status: 204 len: 0 microversion: 2.10 time: 0.035232 Oct 29 20:47:16.594147 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 47/103] 10.222.0.36 () {60 vars in 1340 bytes} [Sat Oct 29 20:47:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938653976?user_id=b1dc7e1380b94d67af50d023f939b9fd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:47:16.607545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.608738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:16.617856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:16.618353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:16.618795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:16.619499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:16.620109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:16.620539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:16.668457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.669088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:16.684381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:16.684542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:16.685323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:16.686091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:16.686590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:16.687021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:16.820858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:16.829343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-95274f39-6e51-47fa-8deb-153fc4cacc4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.225501 Oct 29 20:47:16.829826 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 57/104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:16 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:16.911904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:16.920422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:16.922456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:16.927702 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef66243a-40fa-4bc8-90f0-af92a1e83d8d tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.263497 Oct 29 20:47:16.930266 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 48/105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:16 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:16.934512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:16.935634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:16.937066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:16.938202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:16.939065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:16.939779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:17.121687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:17.130604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54602258-02e9-437a-8af8-f5044fc14f35 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.215417 Oct 29 20:47:17.132374 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 58/106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:16 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:17.852058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:17.853700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:17.862589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:17.863445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:17.864959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:17.866494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:17.867291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:17.867867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:17.953152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:17.954574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:17.975417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:17.978048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:17.978490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:17.979200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:17.979747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:17.980072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:18.237447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:18.247783 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7455f5c9-5ccc-4905-ab43-e53478c0440d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.400474 Oct 29 20:47:18.250087 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 49/107] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:17 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:18.266237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:18.283004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b08e12d3-3689-438b-9dcf-9fe34bcbd82c tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.334271 Oct 29 20:47:18.289247 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 59/108] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:17 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:18.622167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-66802e68-a2e9-49d0-9aab-9110519f9890 req-7b67e142-9fbe-40ae-9b54-b929a2f40792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe81d79-3cf8-4935-9ded-c657ae5fb11a", "name": "network-vif-plugged", "status": "completed", "tag": "d7291f52-e465-454c-bf74-548ed4ba05ff"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:18.634988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-66802e68-a2e9-49d0-9aab-9110519f9890 req-7b67e142-9fbe-40ae-9b54-b929a2f40792 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:18.635476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-66802e68-a2e9-49d0-9aab-9110519f9890 req-7b67e142-9fbe-40ae-9b54-b929a2f40792 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:18.635909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-66802e68-a2e9-49d0-9aab-9110519f9890 req-7b67e142-9fbe-40ae-9b54-b929a2f40792 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:18.675316 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-66802e68-a2e9-49d0-9aab-9110519f9890 req-7b67e142-9fbe-40ae-9b54-b929a2f40792 service nova] Creating event network-vif-plugged:d7291f52-e465-454c-bf74-548ed4ba05ff for instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a on nch2-master-1 Oct 29 20:47:18.685065 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-66802e68-a2e9-49d0-9aab-9110519f9890 req-7b67e142-9fbe-40ae-9b54-b929a2f40792 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433512 Oct 29 20:47:18.690793 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 50/109] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:18.708396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:18.712793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:18.732532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=20 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:18.751839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:18.754071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:18.754863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:18.757696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:18.758347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:18.761652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:18.803335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-461348352", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:18.880574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:19.223590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:19.248593 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a563912c-be3c-46e8-882c-f3dd1a65c4ab tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.556184 Oct 29 20:47:19.249283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 51/110] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:18 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:19.344369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:19.344973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:19.345660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:19.346179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:19.348553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:19.355782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:19.375938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:19.376636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:19.377386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:19.378389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:19.378995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:19.379574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:19.412742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:19.417962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for user 0a554d93b7864309990e6252c09f59cc and project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:19.432352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:19.435126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:19.492235 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7028b484-8bfe-4b39-bb7c-63ebf2cb2966 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201595 Oct 29 20:47:19.499268 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 60/111] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:19.499268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:19.499268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:19.505142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:19.505664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:19.506255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:19.507279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:19.507950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:19.508379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:19.508553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6abe1617-1528-4974-9940-f094cf4aeea2 tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] Calling method '.version_select at 0x7fa172722430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:19.537292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6abe1617-1528-4974-9940-f094cf4aeea2 tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.286731 Oct 29 20:47:19.537919 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 52/112] 10.222.0.36 () {60 vars in 1226 bytes} [Sat Oct 29 20:47:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:19.550599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:19.552454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:19.559463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:19.559946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:19.560379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:19.561103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:19.561600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:19.562142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:19.736711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:19.747408 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4029f50e-79b8-4843-ab3a-80b389916c4b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.253045 Oct 29 20:47:19.748196 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 61/113] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:19 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:19.753591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2070bd04-1121-48e8-bbab-a94ae6d998a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:19.754472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2070bd04-1121-48e8-bbab-a94ae6d998a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:19.776271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:19.788466 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30874756-1c1d-449a-bf6f-8aed62133d66 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.245477 Oct 29 20:47:19.789550 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 53/114] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:19 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:19.795096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa8076a5-c53c-4499-b92b-862638054399 tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] Action: 'update', calling method: .version_select at 0x7fa1726c9ca0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:19.820650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2070bd04-1121-48e8-bbab-a94ae6d998a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:19.831165 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2070bd04-1121-48e8-bbab-a94ae6d998a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1212 microversion: 2.1 time: 0.081034 Oct 29 20:47:19.831806 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 62/115] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:19 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:20.000749 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa8076a5-c53c-4499-b92b-862638054399 tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.209677 Oct 29 20:47:20.002223 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 54/116] 10.222.0.36 () {62 vars in 1247 bytes} [Sat Oct 29 20:47:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:20.012786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e5ab74a-bc18-47c7-9b57-b33aa30ca082 tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] Calling method '.version_select at 0x7fa173b529d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:20.027695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e5ab74a-bc18-47c7-9b57-b33aa30ca082 tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.018610 Oct 29 20:47:20.028285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 63/117] 10.222.0.36 () {60 vars in 1226 bytes} [Sat Oct 29 20:47:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:20.040488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4004fb21-061f-42c4-9f33-a27b409ea6ab tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] Action: 'update', calling method: .version_select at 0x7fa1726c95e0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:20.104635 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4004fb21-061f-42c4-9f33-a27b409ea6ab tempest-QuotaClassesAdmin257Test-211663633 tempest-QuotaClassesAdmin257Test-211663633-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.068643 Oct 29 20:47:20.105291 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 55/118] 10.222.0.36 () {62 vars in 1247 bytes} [Sat Oct 29 20:47:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:47:20.271760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:20.272723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:20.279016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:20.279691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:20.280827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:20.284786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:20.285267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:20.285941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:20.443442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:20.454723 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1398c137-498e-46aa-b997-f20bc078b9f0 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.186080 Oct 29 20:47:20.469768 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 64/119] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:20 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:20.770673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:20.771432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:20.783730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:20.784337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:20.784876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:20.786505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:20.787066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:20.787585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:20.986717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:20.998068 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc56b65a-7f02-4d56-82cb-e6aaaa7887d7 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.231124 Oct 29 20:47:21.009508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 65/120] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:20 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:21.009508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:21.009508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:21.013898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.015021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.015636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.016415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.016934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.017421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.075444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Action: 'update', calling method: .version_select at 0x7fa1731b2b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:21.190018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:21.203797 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8cd4e5a1-6b5c-425f-8531-55dbdcefd3fd tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1339 microversion: 2.1 time: 0.202467 Oct 29 20:47:21.204618 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 66/121] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:20 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:21.209369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:21.238996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:21.257949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.258536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.259083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.260528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.261206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.261768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.502225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:21.512833 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8bcaf87f-c465-4cba-ad04-0a11f0b0fdf1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1294 microversion: 2.1 time: 0.306958 Oct 29 20:47:21.517663 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 67/122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:21 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:21.587958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.589555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.590618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.594560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.597792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.598833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.698581 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e344ca10-21df-4b36-839f-cee09e31e5de tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554" status: 200 len: 240 microversion: 2.36 time: 0.972527 Oct 29 20:47:21.700214 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 56/123] 10.222.0.36 () {62 vars in 1303 bytes} [Sat Oct 29 20:47:20 2022] PUT /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554 => generated 240 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:21.707004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:21.707780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:21.715153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.715839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.716583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.718349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:21.719090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:21.719941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:21.834931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb1269e1-2333-4ba9-99fb-1b359ba0facd tempest-NetworksTest-1449318996 tempest-NetworksTest-1449318996-project-admin] Calling method '.version_select at 0x7fa1725d0dc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:22.435452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:22.448037 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-155aee04-47d5-4759-8f39-c43b5160e10a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.746436 Oct 29 20:47:22.448867 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 57/124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:21 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:22.454324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Calling method '.version_select at 0x7fa17268eca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:22.463566 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb1269e1-2333-4ba9-99fb-1b359ba0facd tempest-NetworksTest-1449318996 tempest-NetworksTest-1449318996-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.944109 Oct 29 20:47:22.464152 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 68/125] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:47:21 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:22.472468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:22.473233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:22.481677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:22.482472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:22.484882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:22.485972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:22.486640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:22.487446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:22.521967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:22.784137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:DELETE=2,nova_api:UPDATE=14 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:22.795253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:22.796601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:22.797084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:22.798122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:22.799085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:22.799751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:22.831406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-88c255b7-e25b-4a2a-af6d-bbb971588ff4 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554/detail" status: 200 len: 672 microversion: 2.36 time: 0.380883 Oct 29 20:47:22.832123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 58/126] 10.222.0.36 () {60 vars in 1304 bytes} [Sat Oct 29 20:47:22 2022] GET /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554/detail => generated 672 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:22.847296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:22.848031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:22.859018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:22.860672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:22.861442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:22.861984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:22.863350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:22.863888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:22.864423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:22.867979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10471220-7475-4609-bac1-c73ec4a5f230 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.399113 Oct 29 20:47:22.873791 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 69/127] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:22 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:22.880055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4072e13b-f26e-4963-915b-41e932b77f95 tempest-NetworksTest-1449318996 tempest-NetworksTest-1449318996-project-admin] Calling method '.version_select at 0x7fa173b52940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:23.299446 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4072e13b-f26e-4963-915b-41e932b77f95 tempest-NetworksTest-1449318996 tempest-NetworksTest-1449318996-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks/8514a6d3-b6d8-4910-be17-acf3d6ae61b7" status: 200 len: 652 microversion: 2.1 time: 0.424148 Oct 29 20:47:23.300275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 70/128] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 20:47:22 2022] GET /compute/v2.1/os-networks/8514a6d3-b6d8-4910-be17-acf3d6ae61b7 => generated 652 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:23.305840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:23.306736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:23.316590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.317343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.318045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.318825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.319465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.320104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.358738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:23.369613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d92de63-8cd8-4db7-a827-01bfd2f04369 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1489 microversion: 2.1 time: 0.535862 Oct 29 20:47:23.370331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 59/129] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:22 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1489 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:23.402302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:23.416340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-efeebf29-dd3a-43d3-b40d-5b88a2429d7e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1292 microversion: 2.1 time: 0.114522 Oct 29 20:47:23.417959 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 71/130] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:23 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1292 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:23.424424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Action: 'update', calling method: .version_select at 0x7fa1725a61f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:23.597028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-650f6166-acbe-4d1a-a36e-d69dc0c1ac29 req-3de27577-b2be-424f-a183-c1f958401d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd41c42-c3e8-4772-a06f-edbb7a2e709c", "tag": "ae024cbe-5629-4c49-990f-9738a59c21e3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:23.607339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-650f6166-acbe-4d1a-a36e-d69dc0c1ac29 req-3de27577-b2be-424f-a183-c1f958401d5d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.608350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-650f6166-acbe-4d1a-a36e-d69dc0c1ac29 req-3de27577-b2be-424f-a183-c1f958401d5d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.608799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-650f6166-acbe-4d1a-a36e-d69dc0c1ac29 req-3de27577-b2be-424f-a183-c1f958401d5d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.623089 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-650f6166-acbe-4d1a-a36e-d69dc0c1ac29 req-3de27577-b2be-424f-a183-c1f958401d5d service nova] Creating event network-changed:ae024cbe-5629-4c49-990f-9738a59c21e3 for instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c on nch1-master-1 Oct 29 20:47:23.631631 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-650f6166-acbe-4d1a-a36e-d69dc0c1ac29 req-3de27577-b2be-424f-a183-c1f958401d5d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258630 Oct 29 20:47:23.639742 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 60/131] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:23.649721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a5b1ac3-923b-49ba-92bc-53329d0ab61f tempest-NetworksTest-1449318996 tempest-NetworksTest-1449318996-project-admin] Calling method '.version_select at 0x7fa1725b3c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:23.706428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.707759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.708321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.709549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.710335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.711204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.781889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.782965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.784062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.786132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.786783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.787367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.870787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a3f96330-b9de-4b78-abc6-488c802f0085 tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554?user_id=da3ab757a3b844569680d1e71d9a4177" status: 200 len: 240 microversion: 2.36 time: 0.451611 Oct 29 20:47:23.874305 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 72/132] 10.222.0.36 () {62 vars in 1384 bytes} [Sat Oct 29 20:47:23 2022] PUT /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554?user_id=da3ab757a3b844569680d1e71d9a4177 => generated 240 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:23.880673 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a5b1ac3-923b-49ba-92bc-53329d0ab61f tempest-NetworksTest-1449318996 tempest-NetworksTest-1449318996-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.237497 Oct 29 20:47:23.881325 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 61/133] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:47:23 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:23.882887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:23.885838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:23.886924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:23.887692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:23.894677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.894899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.895546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.895670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.896262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.896565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.897097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.897827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:23.898217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.898593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:23.898722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:23.899504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:24.419898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:24.430797 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94713b03-8ffd-44bb-9294-96ee2860ff36 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.548259 Oct 29 20:47:24.446040 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 62/134] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:23 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:24.453672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-357194c3-9939-4ecd-a8ef-14a222eadbbb tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] Calling method '.version_select at 0x7fa172567430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:24.619331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c27cca81-0a71-4b0e-8718-ad88360adf16 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1640 microversion: 2.1 time: 0.743722 Oct 29 20:47:24.638518 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 73/135] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:23 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1640 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:24.646823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:24.647783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:24.655626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:24.656295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:24.656911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:24.657823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:24.658469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:24.659127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:24.765008 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-357194c3-9939-4ecd-a8ef-14a222eadbbb tempest-QuotasAdminTestV236-1086936339 tempest-QuotasAdminTestV236-1086936339-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554?user_id=da3ab757a3b844569680d1e71d9a4177" status: 200 len: 282 microversion: 2.36 time: 0.316939 Oct 29 20:47:24.766162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 63/136] 10.222.0.36 () {60 vars in 1364 bytes} [Sat Oct 29 20:47:24 2022] GET /compute/v2.1/os-quota-sets/79a202915ded4a739221b949dfcad554?user_id=da3ab757a3b844569680d1e71d9a4177 => generated 282 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:24.780274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:24.782322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:24.789270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:24.789888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:24.790400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:24.791186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:24.792373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:24.792879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:24.992515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:25.001093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b8bef5b1-6ea4-4136-9177-7b0d0620ac7a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.360484 Oct 29 20:47:25.017339 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 74/137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:24 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:25.023933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:25.024560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:25.030898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.031600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.032224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.033152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.033845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.034518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.065156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:47:25.084308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:25.098744 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6de11769-e7d8-44ab-b0a6-f47520f208c4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1334 microversion: 2.1 time: 0.327001 Oct 29 20:47:25.099978 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 64/138] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:24 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1334 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:25.148647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-14412ff9-3782-4577-a8d2-f1c6fa2a259f req-bfba5209-c958-4867-8711-a62150eafb92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f786a-34b7-419d-be98-f44b35f17174", "tag": "035ee969-a0e8-4370-8a01-bc9cc68cc5c8"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:25.173866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-14412ff9-3782-4577-a8d2-f1c6fa2a259f req-bfba5209-c958-4867-8711-a62150eafb92 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.177063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-14412ff9-3782-4577-a8d2-f1c6fa2a259f req-bfba5209-c958-4867-8711-a62150eafb92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.179351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-14412ff9-3782-4577-a8d2-f1c6fa2a259f req-bfba5209-c958-4867-8711-a62150eafb92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.211647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-14412ff9-3782-4577-a8d2-f1c6fa2a259f req-bfba5209-c958-4867-8711-a62150eafb92 service nova] Creating event network-changed:035ee969-a0e8-4370-8a01-bc9cc68cc5c8 for instance b39f786a-34b7-419d-be98-f44b35f17174 on nch2-master-1 Oct 29 20:47:25.231119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-14412ff9-3782-4577-a8d2-f1c6fa2a259f req-bfba5209-c958-4867-8711-a62150eafb92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088249 Oct 29 20:47:25.238331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 65/139] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:25.275227 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d96b6e5-4498-4258-8f5f-13107c1c6912 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 204 len: 0 microversion: 2.1 time: 0.256044 Oct 29 20:47:25.276604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 75/140] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:47:25 2022] DELETE /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:47:25.289285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:25.290659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:25.301946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.303201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.304006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.304813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.305442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.306518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.462885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:25.463841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:25.478139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.478643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.479084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.479808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:25.480259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:25.480680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:25.515068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:25.524228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ebe19b13-5eef-4488-8e6d-06f6783119b5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1495 microversion: 2.1 time: 0.242364 Oct 29 20:47:25.540938 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 66/141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:25 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1495 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:25.776002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:25.785228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1ab80dfd-c807-42b9-94fd-1e55a0d1a97f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.327416 Oct 29 20:47:25.787277 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 76/142] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:25 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:26.025435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:26.026864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:26.032427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Action: 'update', calling method: .version_select at 0x7fa172567ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:26.036155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.036887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.037524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.038832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.040182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.040615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.136877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.137374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.138028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.138769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.139268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.139881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.220515 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-152d2a71-3316-4f76-bc2f-0425a2c18638 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684" status: 200 len: 148 microversion: 2.57 time: 0.386378 Oct 29 20:47:26.221859 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 67/143] 10.222.0.36 () {62 vars in 1303 bytes} [Sat Oct 29 20:47:25 2022] PUT /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684 => generated 148 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:26.227621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:26.228631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:26.235686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.236200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.236834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.237633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.238094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.238553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.249908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:26.259477 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-477f496c-845f-4ee3-810b-411ef128a734 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.238966 Oct 29 20:47:26.260110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 77/144] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:26 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:26.266214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Calling method '.version_select at 0x7fa1724cdaf0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:26.446857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:26.456779 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6edb8c9f-b05f-4b67-829f-843d0884dbab tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1334 microversion: 2.1 time: 0.233285 Oct 29 20:47:26.457442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 68/145] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:26 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1334 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:26.550034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:26.551033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:26.556143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.556849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.557270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.558089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.558610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.559099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.560346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.561408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.562119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.563017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.563660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.564273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.589554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2db1e25-af59-472e-b581-cccf26a3f6f7 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684/detail" status: 200 len: 463 microversion: 2.57 time: 0.327624 Oct 29 20:47:26.591033 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 78/146] 10.222.0.36 () {60 vars in 1304 bytes} [Sat Oct 29 20:47:26 2022] GET /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684/detail => generated 463 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:26.790568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:26.798547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:26.801702 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee16144a-9df3-46f7-8245-ff8f111c5fb1 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1495 microversion: 2.1 time: 0.256715 Oct 29 20:47:26.821303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:26.821887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:26.825679 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 69/147] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:26 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1495 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:26.829603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.829942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.830380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:26.831081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:26.831537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:26.831966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.016821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:27.023887 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb44cc74-94d3-4be8-a912-4e6bab9a4819 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.208398 Oct 29 20:47:27.024822 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 79/148] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:26 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:27.287305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:27.287927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:27.296245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.296917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.297564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.298722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.299761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.300393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.361593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Action: 'update', calling method: .version_select at 0x7fa172449160>, body: {"quota_set": {"ram": "2048"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:27.520188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:27.534744 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55783f3e-64a1-4459-99e0-ea0a42733f63 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.252130 Oct 29 20:47:27.536068 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 70/149] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:27 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:27.558589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:27.559208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:27.566605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.567305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.567923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.569701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.570344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.570950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.648925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.649403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.650046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.650929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.651563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.652133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.708788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.709279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.709780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.710708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.711158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.712108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.772679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:27.817331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:27.818008 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8ccfa6b4-7a59-4a05-8074-801798d582b3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1334 microversion: 2.1 time: 0.264366 Oct 29 20:47:27.837276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39085e72-69a3-4e0f-923f-655f2dc7a8ea tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684?user_id=1a9e8778d37f4f64822335afee0835ca" status: 200 len: 148 microversion: 2.57 time: 0.482570 Oct 29 20:47:27.837608 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 71/150] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:27 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1334 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:27.838676 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 80/151] 10.222.0.36 () {62 vars in 1384 bytes} [Sat Oct 29 20:47:27 2022] PUT /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684?user_id=1a9e8778d37f4f64822335afee0835ca => generated 148 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:27.844315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:27.845144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:27.854741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ab4191a5-59a3-41c2-ba03-ff687b4d00f1 req-fdf996f2-30af-4be6-8ac8-efb6a55bf9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe81d79-3cf8-4935-9ded-c657ae5fb11a", "name": "network-vif-deleted", "tag": "d7291f52-e465-454c-bf74-548ed4ba05ff"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:27.858745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.859778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.860516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.862690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.864151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.864695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.871702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ab4191a5-59a3-41c2-ba03-ff687b4d00f1 req-fdf996f2-30af-4be6-8ac8-efb6a55bf9a9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:27.872212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ab4191a5-59a3-41c2-ba03-ff687b4d00f1 req-fdf996f2-30af-4be6-8ac8-efb6a55bf9a9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:27.872837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ab4191a5-59a3-41c2-ba03-ff687b4d00f1 req-fdf996f2-30af-4be6-8ac8-efb6a55bf9a9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:27.886911 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ab4191a5-59a3-41c2-ba03-ff687b4d00f1 req-fdf996f2-30af-4be6-8ac8-efb6a55bf9a9 service nova] Creating event network-vif-deleted:d7291f52-e465-454c-bf74-548ed4ba05ff for instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a on nch2-master-1 Oct 29 20:47:27.892657 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ab4191a5-59a3-41c2-ba03-ff687b4d00f1 req-fdf996f2-30af-4be6-8ac8-efb6a55bf9a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052406 Oct 29 20:47:27.893606 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 72/152] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:27.898715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a364c54f-cc19-45a0-93f7-9f6fe77f8c96 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] Calling method '.version_select at 0x7fa172764700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:27.945272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3ff78fa0ca434aadb4bce26fc36882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6706fd16973b41ea83ae718611e5eb61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:27.955882 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a926fb47-c70c-4ff6-b299-350ca4bcf463 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 200 len: 1453 microversion: 2.1 time: 0.115848 Oct 29 20:47:27.957261 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 81/153] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:27 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:28.048373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:28.049364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:28.064115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:28.064837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:28.065424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:28.066325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:28.066921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:28.067493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:28.328940 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a364c54f-cc19-45a0-93f7-9f6fe77f8c96 tempest-QuotasAdminTestV257-187094855 tempest-QuotasAdminTestV257-187094855-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684?user_id=1a9e8778d37f4f64822335afee0835ca" status: 200 len: 190 microversion: 2.57 time: 0.434057 Oct 29 20:47:28.330896 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 73/154] 10.222.0.36 () {60 vars in 1364 bytes} [Sat Oct 29 20:47:27 2022] GET /compute/v2.1/os-quota-sets/e3867d9186ed45ccbb28e803099b2684?user_id=1a9e8778d37f4f64822335afee0835ca => generated 190 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:28.437217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:28.447407 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7814dc05-9425-4ee3-9ed6-879b3948875e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.403916 Oct 29 20:47:28.448067 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 82/155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:28 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:28.526518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fdf22c9d-2ac4-402e-b3a3-b37cc955a750 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Calling method '.version_select at 0x7fa1726a2160>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:28.568794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:28.569424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:28.581080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:28.581722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:28.582317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:28.583523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:28.589537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:28.590060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:28.805288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:28.814623 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b187d443-c0bb-46ba-9761-dc59febd1a85 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.253957 Oct 29 20:47:28.815542 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 83/156] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:28 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:28.846082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:28.846715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:28.856921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:28.859966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:28.859966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:28.859966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:28.859966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:28.860428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.095806 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fdf22c9d-2ac4-402e-b3a3-b37cc955a750 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 371 microversion: 2.1 time: 0.746794 Oct 29 20:47:29.096849 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 74/157] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:47:28 2022] GET /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 371 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:29.102127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:29.103102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:29.105270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:29.112013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.112671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.113444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.114025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f7b1ce70-eff2-417d-a1c7-d85e007ba78a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1334 microversion: 2.1 time: 0.273317 Oct 29 20:47:29.114879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.115698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.116389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.133481 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 84/158] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:28 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:29.133481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Action: 'update', calling method: .version_select at 0x7fa172506820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:29.146827 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] HTTP exception thrown: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Request method failure captured: Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a HTTP/1.1 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZEzbTXYIlcEdHp2FHNew4IiH0Dr-hVL5f6aoIDnG3L4wQkMHC8jDohgpHakvPVAnw0c98_N1Jn8bH0G4iUx-yrT8Kr_8b0-FOHdPXNPNzrmwz_E2j7GqwoPs7XDkowWSyeJCaU8qvvLv5Y7rFGpUXk9AlkcmHL29t3mcMssqMB7Sl8 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6706fd16973b41ea83ae718611e5eb61 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:29.151912 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6706fd16973b41ea83ae718611e5eb61 Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminTestJSON-1808447834-project Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 0f3ff78fa0ca434aadb4bce26fc36882 Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminTestJSON-1808447834-project Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:29.153271 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1fe81d79-3cf8-4935-9ded-c657ae5fb11a'} Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:29.153983 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:29.155088 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:29.156142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Returning 404 to user: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:29.156142 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5779ae0e-58d2-4669-8e79-f9a29b137dd5 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 404 len: 111 microversion: 2.1 time: 0.055497 Oct 29 20:47:29.156142 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 75/159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:29 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:29.176525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5121170b-3c63-47ea-b2a2-6cbd1fe290d6 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:29.215026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5121170b-3c63-47ea-b2a2-6cbd1fe290d6 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.215528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5121170b-3c63-47ea-b2a2-6cbd1fe290d6 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.215971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5121170b-3c63-47ea-b2a2-6cbd1fe290d6 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.544018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.546100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.547553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.548531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.549380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.549994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.614305 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2638871d-f2bd-4576-b312-15f2ae7ea4da tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 328 microversion: 2.1 time: 0.492153 Oct 29 20:47:29.614931 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 85/160] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:29 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 328 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:29.620108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:29.620725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:29.626641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.627410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.628324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.630402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:29.631040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:29.631659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:29.809348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:29.823506 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91f75c39-752c-4c55-9112-f0afeb553f26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.205461 Oct 29 20:47:29.825482 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 86/161] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:29 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:29.987720 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5121170b-3c63-47ea-b2a2-6cbd1fe290d6 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.826693 Oct 29 20:47:29.989805 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 76/162] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:29.996687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:29.997612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:30.021249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.022019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.023026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.024034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.024816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.027474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.067060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-234279230", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:30.151809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:30.220487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:30.234135 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79980df8-3ede-4d17-92f9-71276c85dd5a tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.242482 Oct 29 20:47:30.250370 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 77/163] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:29 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:30.255475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1dce2fdb-110c-4787-83fe-c7a39a4443e2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:30.286489 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1dce2fdb-110c-4787-83fe-c7a39a4443e2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.034695 Oct 29 20:47:30.287788 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 78/164] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:30 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:30.301499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:30.303868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:30.312059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.313008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.313445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.315063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.316408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.317411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.578392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:30.578863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:30.579696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:30.580344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:30.580938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:30.603459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.605663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.606181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.608470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.609866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.611510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.620604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:30.626539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:30.629968 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4794f0a-4575-46f6-8ff6-c844b103ca0a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1312 microversion: 2.1 time: 0.340631 Oct 29 20:47:30.645488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Getting quotas for project 4699eb6fa12346e6b7d17ba548cd3b92. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:30.655900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 79/165] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:30 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:30.662390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af8eb25b-2e8a-43d5-b1ec-ea9ea4f5bd53 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1866829868"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:30.667976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Getting quotas for user f292600aa472400db799c59e59cab24c and project 4699eb6fa12346e6b7d17ba548cd3b92. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:30.683531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.utils [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] cores quota exceeded for 4699eb6fa12346e6b7d17ba548cd3b92, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=138885) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 20:47:30.684553 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 20:47:30.689510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-af8eb25b-2e8a-43d5-b1ec-ea9ea4f5bd53 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid e4f8a24f-9960-4231-bc83-a262116504cf for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Request method failure captured: Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 144 Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFfGkNDPM2WqK51ZNHZZ1Qia9dcYAPGhX9JVeni_tbh5F_5IRwbIdbK3zKoNWJzq8q-H3P31T4o5-8F55P_9V5J1gz7vmxhTZvjkDaq-IsxYUoxcqMgmlQhZ9C31CETNOWvWFKXWh8CyQrn-NT1RdJRjFXD7IVTm2fzxU38dfddc3Q Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:30.701221 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f292600aa472400db799c59e59cab24c Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-234279230", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} Oct 29 20:47:30.703057 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-234279230', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452'}}} Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 20:47:30.703733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:30.704684 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.707875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4aef3e12-3d45-485b-8e26-3c4114c4af27 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.875714 Oct 29 20:47:30.711679 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 87/166] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:29 2022] POST /compute/v2.1/servers => generated 111 bytes in 879 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:30.732443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Action: 'update', calling method: .version_select at 0x7fa1722c4430>, body: {"quota_set": {"cores": 20}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:30.757867 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af8eb25b-2e8a-43d5-b1ec-ea9ea4f5bd53 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097163 Oct 29 20:47:30.759570 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 80/167] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:30.771914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-29e23faf-662c-44d5-b03e-ab13f75255b8 req-382c7e93-d709-42db-bf6c-7b3cee91ce00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd41c42-c3e8-4772-a06f-edbb7a2e709c", "name": "network-vif-plugged", "status": "completed", "tag": "ae024cbe-5629-4c49-990f-9738a59c21e3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:30.793730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-29e23faf-662c-44d5-b03e-ab13f75255b8 req-382c7e93-d709-42db-bf6c-7b3cee91ce00 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.794212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-29e23faf-662c-44d5-b03e-ab13f75255b8 req-382c7e93-d709-42db-bf6c-7b3cee91ce00 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.794635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-29e23faf-662c-44d5-b03e-ab13f75255b8 req-382c7e93-d709-42db-bf6c-7b3cee91ce00 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:30.814183 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-29e23faf-662c-44d5-b03e-ab13f75255b8 req-382c7e93-d709-42db-bf6c-7b3cee91ce00 service nova] Creating event network-vif-plugged:ae024cbe-5629-4c49-990f-9738a59c21e3 for instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c on nch1-master-1 Oct 29 20:47:30.822269 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-29e23faf-662c-44d5-b03e-ab13f75255b8 req-382c7e93-d709-42db-bf6c-7b3cee91ce00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061281 Oct 29 20:47:30.823665 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 81/168] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:30.830232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f6e2641-7dba-431d-a238-27089f078f4c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:30.844498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f6e2641-7dba-431d-a238-27089f078f4c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:30.845248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f6e2641-7dba-431d-a238-27089f078f4c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:30.845901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f6e2641-7dba-431d-a238-27089f078f4c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.073097 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f6e2641-7dba-431d-a238-27089f078f4c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.248065 Oct 29 20:47:31.074127 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 82/169] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:30 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:31.081296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:31.082242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:31.095681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.099410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.100131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.101100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.101796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.103700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.219853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.220346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.220914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.221709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.222195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.222626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.309804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8766614-80a3-4641-bf2f-2f955e7b5c6b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 329 microversion: 2.1 time: 0.597189 Oct 29 20:47:31.310899 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 88/170] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:30 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 329 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:31.329198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-127bfd24-db56-4b73-a42e-2b397d4fb126 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:31.347054 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-127bfd24-db56-4b73-a42e-2b397d4fb126 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.032458 Oct 29 20:47:31.347647 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 89/171] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:47:31 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:31.363709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:31.365731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:31.374357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.375212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.376136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.377055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.377838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.378816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.392936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:31.403322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee9a5970-0886-447d-80da-d7347ef576e8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.327973 Oct 29 20:47:31.403973 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 83/172] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:31 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:31.413882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-827f2d68-d6ae-45d0-9730-8794b931371e tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Calling method '.version_select at 0x7fa172591d30>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:31.611222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:31.624735 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da1c3b1b-8ede-4581-b9f2-8e98eedcb07f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.271040 Oct 29 20:47:31.625782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 90/173] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:31 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:31.642900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-594c00bd-369c-48a0-b5a2-40bd67c4baa8 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:31.659833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-594c00bd-369c-48a0-b5a2-40bd67c4baa8 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.670272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-594c00bd-369c-48a0-b5a2-40bd67c4baa8 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.670721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-594c00bd-369c-48a0-b5a2-40bd67c4baa8 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.786678 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-827f2d68-d6ae-45d0-9730-8794b931371e tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 371 microversion: 2.1 time: 0.376703 Oct 29 20:47:31.796069 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 84/174] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:47:31 2022] GET /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:31.796069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:31.796492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:31.798639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:31.807085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.807742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.808449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.809323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:31.809939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:31.810502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:31.931535 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-594c00bd-369c-48a0-b5a2-40bd67c4baa8 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.292814 Oct 29 20:47:31.941027 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 91/175] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:31 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:31.941027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Action: 'update', calling method: .version_select at 0x7fa1725d0dc0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:32.047885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:32.055890 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-740fed1b-77ba-4cf2-99d1-df01607ca48a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1312 microversion: 2.1 time: 0.265252 Oct 29 20:47:32.056706 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 85/176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:31 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1312 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:32.061899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7579fc91-48ca-4c6e-a25b-fa646691a644 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:32.086016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7579fc91-48ca-4c6e-a25b-fa646691a644 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.027782 Oct 29 20:47:32.087517 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 86/177] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:32 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:32.098176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94599876-d466-49d2-b132-2666e204dd0b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1433008809"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:32.101533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-94599876-d466-49d2-b132-2666e204dd0b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 359bb5c7-91dd-4800-affa-cd3da873fb90 for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:32.122926 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94599876-d466-49d2-b132-2666e204dd0b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.028528 Oct 29 20:47:32.124591 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 87/178] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:32.136510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0d0e6fe1-dee6-4536-9296-a878802cfbfb tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:32.150433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d0e6fe1-dee6-4536-9296-a878802cfbfb tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.150433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d0e6fe1-dee6-4536-9296-a878802cfbfb tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.150433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d0e6fe1-dee6-4536-9296-a878802cfbfb tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.283629 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0d0e6fe1-dee6-4536-9296-a878802cfbfb tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.151768 Oct 29 20:47:32.284666 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 88/179] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:32 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:32.296880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b53179c5-fbb2-41c9-8bc0-4720e6bfecec tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:32.315024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b53179c5-fbb2-41c9-8bc0-4720e6bfecec tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.023501 Oct 29 20:47:32.322928 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 89/180] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:47:32 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:32.328188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-df3e8c3c-e115-4c08-8d91-2e10509dfc4a tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:32.340901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df3e8c3c-e115-4c08-8d91-2e10509dfc4a tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.341680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df3e8c3c-e115-4c08-8d91-2e10509dfc4a tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.343676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df3e8c3c-e115-4c08-8d91-2e10509dfc4a tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.491669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.497959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.498532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.499526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.500886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.501327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.512451 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-df3e8c3c-e115-4c08-8d91-2e10509dfc4a tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.188204 Oct 29 20:47:32.516739 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 90/181] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:32 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:32.531833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:32.534029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:32.552736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.553797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.554612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.555475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.556277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.557156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.580831 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63b44b8e-410d-4f56-82d1-440c3d445417 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 328 microversion: 2.1 time: 0.646663 Oct 29 20:47:32.581492 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 92/182] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:31 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 328 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:32.596210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2df0a1d-c2d6-44e5-a7be-010c05237f49 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:32.634668 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2df0a1d-c2d6-44e5-a7be-010c05237f49 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.052049 Oct 29 20:47:32.635270 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 93/183] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:32 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:32.649374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-57f07fc6-dadf-4023-8a92-75b82c5cce7b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850408963"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:32.662195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-57f07fc6-dadf-4023-8a92-75b82c5cce7b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 1efa52c5-8ca8-44be-9f84-22cc432fd4d9 for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:32.687340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-57f07fc6-dadf-4023-8a92-75b82c5cce7b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042531 Oct 29 20:47:32.688653 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 94/184] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:32.693945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:32.694947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:32.702658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.703168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.703590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.704301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.704757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.705184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.800803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:32.812433 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b734fbc-5617-45d5-8307-18585e4b9d31 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.289260 Oct 29 20:47:32.813188 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:32 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:32.818098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c061f71-b263-4507-adcc-3ccf955c5f67 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:32.841254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c061f71-b263-4507-adcc-3ccf955c5f67 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:32.841767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c061f71-b263-4507-adcc-3ccf955c5f67 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:32.846808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c061f71-b263-4507-adcc-3ccf955c5f67 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:32.961247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:32.971095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e55adac5-b91c-41a7-90ce-fdd284c7482e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1319 microversion: 2.1 time: 0.281182 Oct 29 20:47:32.971810 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:32 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:32.978430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-940477220", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:33.056230 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c061f71-b263-4507-adcc-3ccf955c5f67 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.241550 Oct 29 20:47:33.057874 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 92/187] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:32 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:33.057980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:33.069702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f786a-34b7-419d-be98-f44b35f17174", "name": "network-vif-plugged", "status": "completed", "tag": "035ee969-a0e8-4370-8a01-bc9cc68cc5c8"}, {"server_uuid": "081ac346-df70-4c2f-803e-94f0d633b72a", "name": "network-vif-plugged", "status": "completed", "tag": "74ef1822-ac00-431f-8dce-a62df761b0f3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:33.082366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.082904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.083342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.105344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] Creating event network-vif-plugged:035ee969-a0e8-4370-8a01-bc9cc68cc5c8 for instance b39f786a-34b7-419d-be98-f44b35f17174 on nch2-master-1 Oct 29 20:47:33.105843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] Creating event network-vif-plugged:74ef1822-ac00-431f-8dce-a62df761b0f3 for instance 081ac346-df70-4c2f-803e-94f0d633b72a on nch1-master-1 Oct 29 20:47:33.117591 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-74904543-3446-4c26-a494-a6fc978b2987 req-0501790c-32b1-4a26-8dee-caf5eed95fb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057138 Oct 29 20:47:33.118702 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 93/188] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:33.125325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a40789c-5f4a-4c54-927e-b2a1a9c04420 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:33.139840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a40789c-5f4a-4c54-927e-b2a1a9c04420 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.140352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a40789c-5f4a-4c54-927e-b2a1a9c04420 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.140795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a40789c-5f4a-4c54-927e-b2a1a9c04420 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.390240 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a40789c-5f4a-4c54-927e-b2a1a9c04420 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.269485 Oct 29 20:47:33.397202 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 94/189] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:33 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:33.404173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:33.404972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:33.417287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.418126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.418876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.419968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.421349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.422678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.634257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:33.634680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:33.635245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:33.635706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:33.636201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:33.652487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.654137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.656272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.657274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.660194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.660842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.697501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:33.705006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Getting quotas for project 4699eb6fa12346e6b7d17ba548cd3b92. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:33.710058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:33.712470 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08dac39d-241c-413e-85c9-923ff7029678 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1312 microversion: 2.1 time: 0.319886 Oct 29 20:47:33.713302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Getting quotas for user f292600aa472400db799c59e59cab24c and project 4699eb6fa12346e6b7d17ba548cd3b92. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:33.714430 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 95/190] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:33 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:33.721088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-666189d4-18fa-4a75-b1df-086e42a23766 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:33.735491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.utils [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] instances quota exceeded for 4699eb6fa12346e6b7d17ba548cd3b92, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=138885) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 20:47:33.736517 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Request method failure captured: Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 144 Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFfGkNDPM2WqK51ZNHZZ1Qia9dcYAPGhX9JVeni_tbh5F_5IRwbIdbK3zKoNWJzq8q-H3P31T4o5-8F55P_9V5J1gz7vmxhTZvjkDaq-IsxYUoxcqMgmlQhZ9C31CETNOWvWFKXWh8CyQrn-NT1RdJRjFXD7IVTm2fzxU38dfddc3Q Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:33.738918 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f292600aa472400db799c59e59cab24c Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-940477220", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} Oct 29 20:47:33.740325 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-940477220', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452'}}} Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 20:47:33.741344 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:33.742381 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.745069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5685fbac-c28f-415b-a932-3361a21c5000 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.767469 Oct 29 20:47:33.749553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 96/191] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:32 2022] POST /compute/v2.1/servers => generated 119 bytes in 772 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:33.755392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-666189d4-18fa-4a75-b1df-086e42a23766 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.038236 Oct 29 20:47:33.755993 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 96/192] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:33 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:33.766543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Action: 'update', calling method: .version_select at 0x7fa1724de940>, body: {"quota_set": {"instances": 10}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:33.988129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:33.991918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.992399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.993012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:33.993799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:33.994517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:33.995227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.021231 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b7c29e55-1702-422a-9009-0aee8e7cdba8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.275079 Oct 29 20:47:34.022068 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 97/193] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:47:33 2022] GET /compute/v2.1/os-services => generated 947 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.035138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecddb5ce-e579-4095-b735-d739ea770949 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1281653760"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:34.038444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-ecddb5ce-e579-4095-b735-d739ea770949 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 059381e4-7a75-4820-a0fe-0cf21a01d3d6 for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:34.062845 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ecddb5ce-e579-4095-b735-d739ea770949 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031168 Oct 29 20:47:34.063911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 98/194] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.069571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.070285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:34.078730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.079232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.079868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.080610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.081230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.081742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.133829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.134351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.134810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.135554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.136016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.136444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.202628 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa2008f5-0c34-44df-9b28-a9927b4fa2b3 tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 329 microversion: 2.1 time: 0.439962 Oct 29 20:47:34.203442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 97/195] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:33 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 329 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.213908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c6f672c-2509-47f0-83d1-b1be47ab5f79 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-784753235"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:34.218630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-3c6f672c-2509-47f0-83d1-b1be47ab5f79 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid d46c206f-6eec-4c2b-a240-92c8b8c1a0fe for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:34.236199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:34.245540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c6f672c-2509-47f0-83d1-b1be47ab5f79 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037236 Oct 29 20:47:34.246379 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 98/196] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.252355 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-559dd7fe-3f02-4531-a9b6-6fceeaa4ebba tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1388 microversion: 2.1 time: 0.187279 Oct 29 20:47:34.253655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.254071 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 99/197] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1388 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:34.254262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:34.258821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.262337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.262471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.262941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.263231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.263382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.264478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.264657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.265253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.265660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.265760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.266769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.267364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.293217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d1f78ba-f135-4cb5-88b9-2d1e61d1d797 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.037317 Oct 29 20:47:34.293690 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 100/198] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.298387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb6fdf6b-1f62-4e33-bba1-b8c71160613c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.319977 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb6fdf6b-1f62-4e33-bba1-b8c71160613c tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.025143 Oct 29 20:47:34.320754 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 101/199] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:34 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:34.325759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef8a2ab0-c349-404a-92b9-9933e37c76cb tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Calling method '.version_select at 0x7fa1722c4af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.422147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:34.432260 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93488758-4336-4092-88ab-ff99c1faa1c5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1469 microversion: 2.1 time: 0.183927 Oct 29 20:47:34.432946 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 99/200] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:34.439879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a29b6ab-1fe6-4f3c-a16a-e6a01364c3e4 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:34.453040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a29b6ab-1fe6-4f3c-a16a-e6a01364c3e4 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.453561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a29b6ab-1fe6-4f3c-a16a-e6a01364c3e4 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.454431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a29b6ab-1fe6-4f3c-a16a-e6a01364c3e4 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.588144 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a29b6ab-1fe6-4f3c-a16a-e6a01364c3e4 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.154268 Oct 29 20:47:34.588834 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 100/201] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:34 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.593708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.597252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.597945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.598384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.599160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.599599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.600020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.624985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-946d9294-3d9b-4a0a-beb9-e590aee5d241 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.035192 Oct 29 20:47:34.625996 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 101/202] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/os-services => generated 947 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.626760 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef8a2ab0-c349-404a-92b9-9933e37c76cb tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 371 microversion: 2.1 time: 0.304205 Oct 29 20:47:34.627737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 102/203] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:34.631034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-559ee6b8-ee2d-4180-802a-eab16e9ce082 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.637815 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-559ee6b8-ee2d-4180-802a-eab16e9ce082 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-559ee6b8-ee2d-4180-802a-eab16e9ce082 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Request method failure captured: Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE2v8s_NSaxSZpZQKKc6n3qfNzlFmjDOKtLY5S1xnDxYmbF62F0nqgoTrw_2h5WLB7kloQmiStE877-tBd4NdGo2VC3yl-m5fx8oDjItSUqAxmaN5SBy_ZCUpQCM8JyNzCBRXjYxglvFS6Xkh_RebNzEjIIsm9b6db6sEi8iWTTEcE Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:34.642070 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_930786c0443147219ffda2edf0dd31d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b60c2d08a03f47b3913f022da5acc844 Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: exception: Aggregate 6 could not be found. Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '6'} Oct 29 20:47:34.643428 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.644281 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.645500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-559ee6b8-ee2d-4180-802a-eab16e9ce082 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:34.646756 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-559ee6b8-ee2d-4180-802a-eab16e9ce082 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.018584 Oct 29 20:47:34.647426 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 102/204] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:34.780813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78a13f90-6809-4b19-90b8-d33032cff6bb tempest-TenantUsagesNegativeTestJSON-1392533826 tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T20%3A47%3A34.519943&end=2022-10-30T20%3A47%3A34.519943" status: 404 len: 112 microversion: - time: 0.129837 Oct 29 20:47:34.781350 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 103/205] 10.222.0.36 () {58 vars in 1316 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T20%3A47%3A34.519943&end=2022-10-30T20%3A47%3A34.519943 => generated 112 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 20:47:34.789440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:34.801691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.802161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.802594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.828680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] HTTP exception thrown: Aggregate 7 already has host nch2-master-1. Oct 29 20:47:34.828820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.829270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:34.835203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.835681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.836129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.836959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.837412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.837862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 39 Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:34.843615 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: {"add_host": {"host": "nch2-master-1"}} Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:34.845005 ncdv-master-1 devstack@n-api.service[138884]: exception: Aggregate 7 already has host nch2-master-1. Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7', 'body': {'add_host': {'host': 'nch2-master-1'}}} Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result.read() Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:47:34.845896 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:47:34.847153 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:47:34.848188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:47:34.850089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result.read() Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 20, 47, 34, 816850), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 7}] Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.851325 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host nch2-master-1. Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.852424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host nch2-master-1. Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:34.854086 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:34.855519 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host nch2-master-1. Oct 29 20:47:34.855519 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:34.855519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 409 to user: Aggregate 7 already has host nch2-master-1. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:34.855519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-470ce048-79e9-4e64-9499-d005f49f0940 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.062852 Oct 29 20:47:34.855519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 104/206] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:34 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 29 20:47:34.855519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:34.856908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.857394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.857933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.858674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.859127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.859547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.863026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:47:34.870287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:34.884661 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b640d5dd-c916-49a3-993c-8a5779d15b09 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037987 Oct 29 20:47:34.885247 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 105/207] 10.222.0.36 () {58 vars in 1196 bytes} [Sat Oct 29 20:47:34 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:34.890394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Action: 'update', calling method: .version_select at 0x7fa1724dea60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:34.960659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.961150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.961856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.962653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:34.963136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:34.963611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:34.974459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:34.983874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd8e1821-d0fc-4a9c-a86f-fdcd77a322c6 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 204 len: 0 microversion: 2.1 time: 0.354927 Oct 29 20:47:34.984461 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 103/208] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:47:34 2022] DELETE /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:47:34.989333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0724de31-a373-4e20-a177-45af596f975b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.002268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0724de31-a373-4e20-a177-45af596f975b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0724de31-a373-4e20-a177-45af596f975b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Request method failure captured: Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZE2v8s_NSaxSZpZQKKc6n3qfNzlFmjDOKtLY5S1xnDxYmbF62F0nqgoTrw_2h5WLB7kloQmiStE877-tBd4NdGo2VC3yl-m5fx8oDjItSUqAxmaN5SBy_ZCUpQCM8JyNzCBRXjYxglvFS6Xkh_RebNzEjIIsm9b6db6sEi8iWTTEcE Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:35.005362 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_930786c0443147219ffda2edf0dd31d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b60c2d08a03f47b3913f022da5acc844 Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: exception: Aggregate 6 could not be found. Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6'} Oct 29 20:47:35.007349 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:35.008196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.009230 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0724de31-a373-4e20-a177-45af596f975b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0724de31-a373-4e20-a177-45af596f975b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.021150 Oct 29 20:47:35.011372 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 104/209] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:34 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:35.014632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.015344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:35.021969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.022461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.022896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.023593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.024049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.024477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.025953 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48542a86-f2e5-4fec-b541-4953c499657b tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 325 microversion: 2.1 time: 0.139607 Oct 29 20:47:35.037529 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 106/210] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:34 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 325 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:35.037529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b416f1c-f7a4-40aa-bf4d-3893a4fbaf3c tempest-TenantUsagesNegativeTestJSON-1392533826 tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin] Calling method '.version_select at 0x7fa17249aa60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.037529 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7b416f1c-f7a4-40aa-bf4d-3893a4fbaf3c tempest-TenantUsagesNegativeTestJSON-1392533826 tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b416f1c-f7a4-40aa-bf4d-3893a4fbaf3c tempest-TenantUsagesNegativeTestJSON-1392533826 tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin] Request method failure captured: Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-simple-tenant-usage/8d784f5e76f94a0fb11bec4e9fa21dd0?start=2022-10-30T20%3A47%3A34.519943&end=2022-10-28T20%3A47%3A34.519943 HTTP/1.1 Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFmOTFUCI6XwPYh0SKAh6U7y5dfLNcEOwNrNhpHogDE9Fv2hCWBd4ZDQH08cY9s0_t08TvLZKkMlEK3lKAIx-CAr_sZCtGP2T5D0c4dBCEdUXB0G0YY73cFVVvX6OgcPvQXR6BOGKUTUZkDTtQ5zEIV1LaLyfZVdbwiHklKKYFYWes Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 7230c11a626549b4be83b8968d0434a9 Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1392533826 Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:35.039276 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7230c11a626549b4be83b8968d0434a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7230c11a626549b4be83b8968d0434a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7230c11a626549b4be83b8968d0434a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7230c11a626549b4be83b8968d0434a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1392533826 Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 7230c11a626549b4be83b8968d0434a9 Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1392533826 Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ad66dee5bfd4401192c1a4c8a7b8148c Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid start time. The start time cannot occur after the end time. Oct 29 20:47:35.040383 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '8d784f5e76f94a0fb11bec4e9fa21dd0'} Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 20:47:35.041024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b416f1c-f7a4-40aa-bf4d-3893a4fbaf3c tempest-TenantUsagesNegativeTestJSON-1392533826 tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:35.042340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b416f1c-f7a4-40aa-bf4d-3893a4fbaf3c tempest-TenantUsagesNegativeTestJSON-1392533826 tempest-TenantUsagesNegativeTestJSON-1392533826-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/8d784f5e76f94a0fb11bec4e9fa21dd0?start=2022-10-30T20%3A47%3A34.519943&end=2022-10-28T20%3A47%3A34.519943" status: 400 len: 111 microversion: 2.1 time: 0.012640 Oct 29 20:47:35.042984 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 107/211] 10.222.0.36 () {58 vars in 1412 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/os-simple-tenant-usage/8d784f5e76f94a0fb11bec4e9fa21dd0?start=2022-10-30T20%3A47%3A34.519943&end=2022-10-28T20%3A47%3A34.519943 => generated 111 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:47:35.045822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6adfac81-211a-4522-b2ec-6dca17c873f6 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:35.057131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6adfac81-211a-4522-b2ec-6dca17c873f6 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.057406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6adfac81-211a-4522-b2ec-6dca17c873f6 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.057872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6adfac81-211a-4522-b2ec-6dca17c873f6 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.194452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:35.196801 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6adfac81-211a-4522-b2ec-6dca17c873f6 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.154898 Oct 29 20:47:35.198035 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 108/212] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:35 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:35.207624 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23ecfe4d-6cef-4054-9ecf-03284c9e27b7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1462 microversion: 2.1 time: 0.199155 Oct 29 20:47:35.210136 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 105/213] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1462 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:35.211726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.215936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.216494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.217650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.217843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.218436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:35.219004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.219465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.219890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.224960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.225385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.225922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.226617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.227433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.228063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.244951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5818ad0d-8191-4f24-baff-3a14488c46f8 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.045683 Oct 29 20:47:35.245569 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 109/214] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/os-services => generated 947 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:35.251385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f457d131-2c3c-4b72-a6d3-8b0c9678b4ea tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-373195144", "name": "tempest-test_aggregate-834583348"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:35.272416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-f457d131-2c3c-4b72-a6d3-8b0c9678b4ea tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 3755156a-7de8-4631-91ec-b115e30f2e17 for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:35.298758 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f457d131-2c3c-4b72-a6d3-8b0c9678b4ea tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.051986 Oct 29 20:47:35.299743 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 110/215] 10.222.0.36 () {60 vars in 1165 bytes} [Sat Oct 29 20:47:35 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:35.378546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:35.387024 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3ff68f1-92dd-4a8a-aaaa-7349c5e90a9c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1475 microversion: 2.1 time: 0.175846 Oct 29 20:47:35.387606 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 106/216] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:35.392843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-533304187", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:35.407150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b910323-578d-4136-ad8b-80b29a50a487 tempest-TenantUsagesNegativeTestJSON-1456856925 tempest-TenantUsagesNegativeTestJSON-1456856925-project] Calling method '.version_select at 0x7fa17249aa60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.410627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b910323-578d-4136-ad8b-80b29a50a487 tempest-TenantUsagesNegativeTestJSON-1456856925 tempest-TenantUsagesNegativeTestJSON-1456856925-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '6b008b5e427142cf992cd20e49be144c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d784f5e76f94a0fb11bec4e9fa21dd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b910323-578d-4136-ad8b-80b29a50a487 tempest-TenantUsagesNegativeTestJSON-1456856925 tempest-TenantUsagesNegativeTestJSON-1456856925-project] Request method failure captured: Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T20%3A47%3A34.519943&end=2022-10-30T20%3A47%3A34.519943&detailed=1 HTTP/1.1 Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFlvXDeS0aJ0Wx2FPlzYHLxHHeO9VIo7wcxaJq6As0nxdavLxsvhDQ5rCPBy0ANVBaOH3lzhrLmwUMLeb_tfZ-1CPMjy0NPE_-6fx7LZ9n6op5ifZ-wK3N5rF59VGT350-mGJB4fNwStiAMr6u4n_eEVnRCeXhtiPcRKeRFojZAH-w Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 8d784f5e76f94a0fb11bec4e9fa21dd0 Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1456856925 Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:35.412670 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d784f5e76f94a0fb11bec4e9fa21dd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d784f5e76f94a0fb11bec4e9fa21dd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d784f5e76f94a0fb11bec4e9fa21dd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d784f5e76f94a0fb11bec4e9fa21dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1456856925 Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 8d784f5e76f94a0fb11bec4e9fa21dd0 Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1456856925 Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TenantUsagesNegativeTestJSON-1456856925-project Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6b008b5e427142cf992cd20e49be144c Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1456856925-project Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:47:35.414117 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:35.415026 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:35.416297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:35.417691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 20:47:35.417691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.417691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b910323-578d-4136-ad8b-80b29a50a487 tempest-TenantUsagesNegativeTestJSON-1456856925 tempest-TenantUsagesNegativeTestJSON-1456856925-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:35.417691 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b910323-578d-4136-ad8b-80b29a50a487 tempest-TenantUsagesNegativeTestJSON-1456856925 tempest-TenantUsagesNegativeTestJSON-1456856925-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T20%3A47%3A34.519943&end=2022-10-30T20%3A47%3A34.519943&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.113390 Oct 29 20:47:35.417691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 111/217] 10.222.0.36 () {58 vars in 1335 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T20%3A47%3A34.519943&end=2022-10-30T20%3A47%3A34.519943&detailed=1 => generated 123 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:35.418934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ab84784-b7c6-4f4a-878c-cd69ca0fa185 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.443802 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ab84784-b7c6-4f4a-878c-cd69ca0fa185 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.028222 Oct 29 20:47:35.444773 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 112/218] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:35.468012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:35.567326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.568199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:35.574233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.574789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.575309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.576219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.577241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.577693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.688103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:35.688530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:35.689228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:35.689674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:35.690098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:35.700706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.701136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.701868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.702752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.703435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.704229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.725546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Getting quotas for project 4699eb6fa12346e6b7d17ba548cd3b92. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:35.733932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Getting quotas for user f292600aa472400db799c59e59cab24c and project 4699eb6fa12346e6b7d17ba548cd3b92. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:35.750356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.utils [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] ram quota exceeded for 4699eb6fa12346e6b7d17ba548cd3b92, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=138885) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 20:47:35.750948 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Request method failure captured: Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 144 Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFfGkNDPM2WqK51ZNHZZ1Qia9dcYAPGhX9JVeni_tbh5F_5IRwbIdbK3zKoNWJzq8q-H3P31T4o5-8F55P_9V5J1gz7vmxhTZvjkDaq-IsxYUoxcqMgmlQhZ9C31CETNOWvWFKXWh8CyQrn-NT1RdJRjFXD7IVTm2fzxU38dfddc3Q Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:35.753061 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f292600aa472400db799c59e59cab24c Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-533304187", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} Oct 29 20:47:35.754254 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-533304187', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452'}}} Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 20:47:35.754884 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.755822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.756875 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6d92671-e292-4dc9-892a-cba14a04d2f0 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.366004 Oct 29 20:47:35.758089 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 107/219] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:35 2022] POST /compute/v2.1/servers => generated 110 bytes in 367 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:35.765313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.770188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.770670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.771364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.772328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.773952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.774594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.801091 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-992176ae-e0ad-4963-8ea0-90d029ee1019 tempest-ServicesAdminNegativeTestJSON-1151431391 tempest-ServicesAdminNegativeTestJSON-1151431391-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.044323 Oct 29 20:47:35.802498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 108/220] 10.222.0.36 () {58 vars in 1198 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:35.807238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:35.809525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:35.817391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.818134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.818823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:35.819720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:35.820478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:35.821386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.075725 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e038889-1d7d-41fd-9f68-a2a9b2b9de39 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1613 microversion: 2.1 time: 0.629724 Oct 29 20:47:36.076297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 113/221] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1613 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:36.077003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:36.091676 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67395e68-f23d-4b46-8667-2cef2473b1ce tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1588 microversion: 2.1 time: 0.287891 Oct 29 20:47:36.094694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4ca11ea-9a49-48ab-a28a-7a95bcaefefd tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:36.105086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 109/222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:35 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1588 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:36.123810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3bfdcbff-f41f-4cf7-a7b1-33624bc050f7 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-439026965"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:36.128413 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4ca11ea-9a49-48ab-a28a-7a95bcaefefd tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.049814 Oct 29 20:47:36.129163 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 114/223] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:36 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:36.129294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-3bfdcbff-f41f-4cf7-a7b1-33624bc050f7 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid e556f74b-5320-40dc-91c0-90a8265a997d for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:36.136908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Action: 'update', calling method: .version_select at 0x7fa1723fe160>, body: {"quota_set": {"ram": 51200}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:36.157395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3bfdcbff-f41f-4cf7-a7b1-33624bc050f7 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050828 Oct 29 20:47:36.158750 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 110/224] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:36.388368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-934c164e-0af7-4813-92fc-0bf7880c2dfa tempest-ServicesAdminNegativeTestJSON-1399691789 tempest-ServicesAdminNegativeTestJSON-1399691789-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:36.392134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-934c164e-0af7-4813-92fc-0bf7880c2dfa tempest-ServicesAdminNegativeTestJSON-1399691789 tempest-ServicesAdminNegativeTestJSON-1399691789-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '855aa36d1c8048a5b71c175eefc85913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70493f2854784de4a259ade6ba681c11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-934c164e-0af7-4813-92fc-0bf7880c2dfa tempest-ServicesAdminNegativeTestJSON-1399691789 tempest-ServicesAdminNegativeTestJSON-1399691789-project] Request method failure captured: Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFkGhu4RA-8GZqZKNSiccNqLNzN8L45-HwxDv3JkcyukbBVTlv2pVBvPQAG7ahQA3oBTVg8uOcgTNNNucaZf8XL6RQKbusMdo_JGOvmIPS8zyMbcK_Z-bpGyeTWiBElouaVydkL7V3Avwt9rufP6qjZPiy5b0QOIkyjeTefuXFxIpw Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 70493f2854784de4a259ade6ba681c11 Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1399691789 Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:36.394509 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70493f2854784de4a259ade6ba681c11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_70493f2854784de4a259ade6ba681c11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70493f2854784de4a259ade6ba681c11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/70493f2854784de4a259ade6ba681c11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1399691789 Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 70493f2854784de4a259ade6ba681c11 Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1399691789 Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServicesAdminNegativeTestJSON-1399691789-project Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 855aa36d1c8048a5b71c175eefc85913 Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1399691789-project Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 20:47:36.395724 ncdv-master-1 devstack@n-api.service[138885]: action_args: {} Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:36.396362 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 20:47:36.398870 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.399898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:36.400861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-934c164e-0af7-4813-92fc-0bf7880c2dfa tempest-ServicesAdminNegativeTestJSON-1399691789 tempest-ServicesAdminNegativeTestJSON-1399691789-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:36.400937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:36.401018 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-934c164e-0af7-4813-92fc-0bf7880c2dfa tempest-ServicesAdminNegativeTestJSON-1399691789 tempest-ServicesAdminNegativeTestJSON-1399691789-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.235594 Oct 29 20:47:36.401089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.401157 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 111/225] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:47:36 2022] GET /compute/v2.1/os-services => generated 112 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:36.401224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:36.401224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:36.401224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.402858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:36.403443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:36.410928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:36.411423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:36.412043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.412749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:36.413208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:36.413669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.486035 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-58e1d0af-f29f-4a49-9818-62361522c94d tempest-QuotasAdminNegativeTest-795447557 tempest-QuotasAdminNegativeTest-795447557-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 200 len: 329 microversion: 2.1 time: 0.355787 Oct 29 20:47:36.486661 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 115/226] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:36 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 329 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:36.491296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:36.492071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:36.501111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:36.501277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:36.501641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.502503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:36.502980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:36.503394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:36.644788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ccaa0ac8-29f4-4d2b-9fb6-c488c70acf63 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157020 Oct 29 20:47:36.645384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 116/227] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:47:36 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:36.649796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a09afd87-cc60-466e-b65c-2e6ed48795a2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:36.656684 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a09afd87-cc60-466e-b65c-2e6ed48795a2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a09afd87-cc60-466e-b65c-2e6ed48795a2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Request method failure captured: Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE2v8s_NSaxSZpZQKKc6n3qfNzlFmjDOKtLY5S1xnDxYmbF62F0nqgoTrw_2h5WLB7kloQmiStE877-tBd4NdGo2VC3yl-m5fx8oDjItSUqAxmaN5SBy_ZCUpQCM8JyNzCBRXjYxglvFS6Xkh_RebNzEjIIsm9b6db6sEi8iWTTEcE Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:36.658274 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_930786c0443147219ffda2edf0dd31d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b60c2d08a03f47b3913f022da5acc844 Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: exception: Aggregate 8 could not be found. Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '8'} Oct 29 20:47:36.659417 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:36.660100 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:36.661075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a09afd87-cc60-466e-b65c-2e6ed48795a2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:36.663330 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a09afd87-cc60-466e-b65c-2e6ed48795a2 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.013323 Oct 29 20:47:36.663330 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 117/228] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:47:36 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:36.934841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c2d52662206f426aa458635417493e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4716859cce98493db25853e5b5f08651', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:36.935517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: b39f786a-34b7-419d-be98-f44b35f17174] flavor_id is None. Assuming migration. {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 20:47:36.936393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 20:47:37.068872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2cae48a3-8921-4c8d-b312-e7bccc8802b6 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.072457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2cae48a3-8921-4c8d-b312-e7bccc8802b6 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '579a0729e70e49d98501842ff8484cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e350d753c4bf498a79b4cfd764a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2cae48a3-8921-4c8d-b312-e7bccc8802b6 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Request method failure captured: Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 39 Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFD0Mc7mTOFjM_hZfCQJWvdJ5t8S80ufjbbsUHigwS2WhDmXuIW_ZoPrJldcWaevNriFl5NziaGlJpy19DrAfy8vAumJJj5tXCdutBjCB8v_7b4xxv0XRG29ICE7xSRRKeuZCk9W_ZjhVryLBEcpZ4cEYFCHs6UeKnfma7DspTmnzM Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:37.080249 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 579a0729e70e49d98501842ff8484cb6 Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: {"add_host": {"host": "nch2-master-1"}} Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:37.081437 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9', 'body': {'add_host': {'host': 'nch2-master-1'}}} Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:37.082276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 20:47:37.083520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.089921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2cae48a3-8921-4c8d-b312-e7bccc8802b6 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.089921 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2cae48a3-8921-4c8d-b312-e7bccc8802b6 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.420588 Oct 29 20:47:37.089921 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 118/229] 10.222.0.36 () {60 vars in 1191 bytes} [Sat Oct 29 20:47:36 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 425 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:37.093737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.094478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:37.101064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:37.101814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:37.102321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:37.103037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:37.103508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:37.103939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:37.192809 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a544d97-9f1f-4958-9485-1651b0a52d3e tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174/action" status: 202 len: 0 microversion: 2.1 time: 0.795165 Oct 29 20:47:37.194484 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 112/230] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:47:36 2022] POST /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:47:37.200575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ce66675-d02b-46d6-acaa-878b202fb025 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Action: 'update', calling method: .version_select at 0x7fa17225fa60>, body: {"quota_set": {"ram": 0}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.207121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ce66675-d02b-46d6-acaa-878b202fb025 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f292600aa472400db799c59e59cab24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4699eb6fa12346e6b7d17ba548cd3b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ce66675-d02b-46d6-acaa-878b202fb025 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Request method failure captured: Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 HTTP/1.1 Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 25 Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFfGkNDPM2WqK51ZNHZZ1Qia9dcYAPGhX9JVeni_tbh5F_5IRwbIdbK3zKoNWJzq8q-H3P31T4o5-8F55P_9V5J1gz7vmxhTZvjkDaq-IsxYUoxcqMgmlQhZ9C31CETNOWvWFKXWh8CyQrn-NT1RdJRjFXD7IVTm2fzxU38dfddc3Q Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:37.211155 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4699eb6fa12346e6b7d17ba548cd3b92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4699eb6fa12346e6b7d17ba548cd3b92 Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-966376987 Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f292600aa472400db799c59e59cab24c Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-QuotasAdminNegativeTest-966376987-project Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: {"quota_set": {"ram": 0}} Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 20:47:37.212369 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '4699eb6fa12346e6b7d17ba548cd3b92', 'body': {'quota_set': {'ram': 0}}} Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.213159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.214261 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.215301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ce66675-d02b-46d6-acaa-878b202fb025 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.218275 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ce66675-d02b-46d6-acaa-878b202fb025 tempest-QuotasAdminNegativeTest-966376987 tempest-QuotasAdminNegativeTest-966376987-project] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92" status: 403 len: 116 microversion: 2.1 time: 0.022033 Oct 29 20:47:37.219175 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 113/231] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:47:37 2022] PUT /compute/v2.1/os-quota-sets/4699eb6fa12346e6b7d17ba548cd3b92 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:37.229886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3321016-34e3-4783-b5a5-b7b219b6ffad tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.242831 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b3321016-34e3-4783-b5a5-b7b219b6ffad tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3321016-34e3-4783-b5a5-b7b219b6ffad tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Request method failure captured: Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZE2v8s_NSaxSZpZQKKc6n3qfNzlFmjDOKtLY5S1xnDxYmbF62F0nqgoTrw_2h5WLB7kloQmiStE877-tBd4NdGo2VC3yl-m5fx8oDjItSUqAxmaN5SBy_ZCUpQCM8JyNzCBRXjYxglvFS6Xkh_RebNzEjIIsm9b6db6sEi8iWTTEcE Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:37.245110 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_930786c0443147219ffda2edf0dd31d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/930786c0443147219ffda2edf0dd31d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 930786c0443147219ffda2edf0dd31d6 Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-59117185 Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b60c2d08a03f47b3913f022da5acc844 Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminTestJSON-59117185-project-admin Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: exception: Aggregate 8 could not be found. Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8'} Oct 29 20:47:37.246410 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:37.247082 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.248240 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.249854 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.249854 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:37.249854 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:37.249854 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 29 20:47:37.249854 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.252065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3321016-34e3-4783-b5a5-b7b219b6ffad tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.254737 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3321016-34e3-4783-b5a5-b7b219b6ffad tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.029850 Oct 29 20:47:37.256294 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 114/232] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:37.268100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2af63b9e-7430-414a-8f1a-c326dfcb8386 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.314857 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2af63b9e-7430-414a-8f1a-c326dfcb8386 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.056728 Oct 29 20:47:37.320237 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 115/233] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:37 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:37.332601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.333480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:37.344417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:37.344924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:37.345607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:37.346993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:37.347464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:37.347982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:37.377797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:37.385875 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30941d2b-dada-434b-a344-c8cad4c45344 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1475 microversion: 2.1 time: 0.298099 Oct 29 20:47:37.387212 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 119/234] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:37 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1475 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:37.397040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f9d4275d-bfe9-4b93-99c0-31e7a5fa0175 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-844665577"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.421722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-f9d4275d-bfe9-4b93-99c0-31e7a5fa0175 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 00aeca45-2c74-480c-92b4-87934156391b for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:37.468891 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f9d4275d-bfe9-4b93-99c0-31e7a5fa0175 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081308 Oct 29 20:47:37.470174 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 120/235] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.477422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-032b2159-191e-499e-89dd-e5d3a8ec0048 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1750172843"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.486439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-032b2159-191e-499e-89dd-e5d3a8ec0048 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid 3096f5b0-7406-4af0-939b-84360ead6dc1 for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:37.533062 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-032b2159-191e-499e-89dd-e5d3a8ec0048 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059546 Oct 29 20:47:37.533972 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 121/236] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.551063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20f7ece5-1050-4d52-89fe-e9490b0866cd tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.566971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20f7ece5-1050-4d52-89fe-e9490b0866cd tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.021893 Oct 29 20:47:37.568555 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 122/237] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:37 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.575967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1311154317"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.591657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:37.594466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:37.595820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:37.609056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:37.609858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:37.610458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:37.623609 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1311154317 could not be found. Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 58 Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:37.627417 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: {"add_host": {"host": "tempest-nonexist_host-1311154317"}} Oct 29 20:47:37.628902 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: exception: Compute host tempest-nonexist_host-1311154317 could not be found. Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1311154317'}}} Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1311154317' is not mapped to any cell Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.629691 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 29 20:47:37.630750 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1311154317 could not be found. Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1311154317 could not be found. Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.631850 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1311154317 could not be found. Oct 29 20:47:37.634905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.635774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:37.637062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1311154317 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.638945 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad779d0b-487d-4367-90c5-5bed669c18cd tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.068375 Oct 29 20:47:37.639710 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 123/238] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:37.645198 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f41a9b6d-bd89-46ec-a5d1-b4fc386251d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1471 microversion: 2.1 time: 0.322232 Oct 29 20:47:37.645537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a95b81c1-1741-44ad-8208-bc5ab93da2d5 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.649296 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 116/239] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:37 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:37.659607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21311f0b-572e-4be2-a165-cd6b9029d23a tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.694777 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a95b81c1-1741-44ad-8208-bc5ab93da2d5 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.053606 Oct 29 20:47:37.695697 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 124/240] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.715271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-46fd3281-8643-4b1e-a558-c571632b8d48 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.718874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21311f0b-572e-4be2-a165-cd6b9029d23a tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.067786 Oct 29 20:47:37.720466 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 117/241] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:37 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:37.734947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e13d47b-0653-4a24-8991-7d7349de29c9 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.739216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-46fd3281-8643-4b1e-a558-c571632b8d48 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.035757 Oct 29 20:47:37.739957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 125/242] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:37 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e13d47b-0653-4a24-8991-7d7349de29c9 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 283 Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:37.750594 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.751879 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:47:37.752422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.753007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.753957 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.757265 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:47:37.757265 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:47:37.757265 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:47:37.757265 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.757265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e13d47b-0653-4a24-8991-7d7349de29c9 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.757617 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e13d47b-0653-4a24-8991-7d7349de29c9 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024585 Oct 29 20:47:37.757720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b6de655-728c-4c08-9341-9ed87ab7b849 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.758459 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 118/243] 10.222.0.36 () {60 vars in 1165 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:47:37.764140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-711666ec-e6a0-4f30-95ac-5b164b142bef tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-711666ec-e6a0-4f30-95ac-5b164b142bef tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 27 Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:37.769373 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: {"aggregate": {"name": ""}} Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:37.770654 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '' Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.771363 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 20:47:37.772638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.775677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-711666ec-e6a0-4f30-95ac-5b164b142bef tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.776801 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-711666ec-e6a0-4f30-95ac-5b164b142bef tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018469 Oct 29 20:47:37.783035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 119/244] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:47:37.790734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b6de655-728c-4c08-9341-9ed87ab7b849 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.043161 Oct 29 20:47:37.791652 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 126/245] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:37 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:37.800686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3de52edb-33bc-4bea-97a9-0ae954df0bab tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-501116248"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.804799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1647841a-a103-44f0-bf68-67c71c089004 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032284761", "availability_zone": "tempest-test_az-786862327"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.811553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3de52edb-33bc-4bea-97a9-0ae954df0bab tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '579a0729e70e49d98501842ff8484cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e350d753c4bf498a79b4cfd764a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:37.813608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-1647841a-a103-44f0-bf68-67c71c089004 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid 00cae57c-ab1f-443b-9f01-51ba1a725716 for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3de52edb-33bc-4bea-97a9-0ae954df0bab tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Request method failure captured: Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 59 Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD0Mc7mTOFjM_hZfCQJWvdJ5t8S80ufjbbsUHigwS2WhDmXuIW_ZoPrJldcWaevNriFl5NziaGlJpy19DrAfy8vAumJJj5tXCdutBjCB8v_7b4xxv0XRG29ICE7xSRRKeuZCk9W_ZjhVryLBEcpZ4cEYFCHs6UeKnfma7DspTmnzM Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:37.813763 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 579a0729e70e49d98501842ff8484cb6 Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: {"aggregate": {"name": "tempest-test_aggregate-501116248"}} Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:37.814954 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-501116248'}}} Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:37.815644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:37.816598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 20:47:37.818152 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.818152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3de52edb-33bc-4bea-97a9-0ae954df0bab tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.818152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3de52edb-33bc-4bea-97a9-0ae954df0bab tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.031304 Oct 29 20:47:37.823567 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 120/246] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:37.831329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5fb84d1e-19a3-4810-ae5e-e26281cd975d tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-416360603"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.833590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:37.838821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-5fb84d1e-19a3-4810-ae5e-e26281cd975d tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid 766f6ec4-f0e7-4dde-86a7-e694f4190f8d for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:37.872740 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1647841a-a103-44f0-bf68-67c71c089004 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.075138 Oct 29 20:47:37.874067 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 127/247] 10.222.0.36 () {60 vars in 1165 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.895226 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5fb84d1e-19a3-4810-ae5e-e26281cd975d tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067780 Oct 29 20:47:37.896330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fffc2b72-9ea0-4d92-81ad-bbf1dae51c64 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032284761_new", "availability_zone": "tempest-test_az-786862327_new"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.896709 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 121/248] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:37.911346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-71a04f8e-4cb9-4cee-a6ba-5b4415109155 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-416360603"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:37.916752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-71a04f8e-4cb9-4cee-a6ba-5b4415109155 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid edababac-ec81-489b-9b5d-aa917104e6db for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:37.929229 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-71a04f8e-4cb9-4cee-a6ba-5b4415109155 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-416360603 already exists. Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-71a04f8e-4cb9-4cee-a6ba-5b4415109155 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 59 Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:37.931868 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: {"aggregate": {"name": "tempest-test_aggregate-416360603"}} Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:37.933108 ncdv-master-1 devstack@n-api.service[138885]: exception: Aggregate tempest-test_aggregate-416360603 already exists. Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-416360603'}}} Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 29 20:47:37.933917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-416360603 already exists. Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:37.935187 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-416360603 already exists. Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-416360603 already exists. Oct 29 20:47:37.936424 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:37.938444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-71a04f8e-4cb9-4cee-a6ba-5b4415109155 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-416360603 already exists. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:37.939650 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-71a04f8e-4cb9-4cee-a6ba-5b4415109155 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.036076 Oct 29 20:47:37.941110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 122/249] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:37 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:47:37.959822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-006adc09-1446-42a1-875f-6f3d60a59372 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:37.993334 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-006adc09-1446-42a1-875f-6f3d60a59372 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.047300 Oct 29 20:47:37.996535 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 123/250] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:37 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:38.011011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fffc2b72-9ea0-4d92-81ad-bbf1dae51c64 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.011956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fffc2b72-9ea0-4d92-81ad-bbf1dae51c64 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.012720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fffc2b72-9ea0-4d92-81ad-bbf1dae51c64 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.017497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1d4fc6b-5612-4366-8c8e-92540f1ccbae tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-957065350"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:38.028774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-f1d4fc6b-5612-4366-8c8e-92540f1ccbae tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid 937a972f-52a1-4d8c-abe3-f58f246994ed for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:38.045412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:38.100860 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f1d4fc6b-5612-4366-8c8e-92540f1ccbae tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098917 Oct 29 20:47:38.102909 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 124/251] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:38.119852 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fffc2b72-9ea0-4d92-81ad-bbf1dae51c64 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.234839 Oct 29 20:47:38.126783 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 128/252] 10.222.0.36 () {60 vars in 1173 bytes} [Sat Oct 29 20:47:37 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff81310d-9d3c-499a-a9bb-445793abe1ef tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff81310d-9d3c-499a-a9bb-445793abe1ef tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '579a0729e70e49d98501842ff8484cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e350d753c4bf498a79b4cfd764a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff81310d-9d3c-499a-a9bb-445793abe1ef tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Request method failure captured: Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD0Mc7mTOFjM_hZfCQJWvdJ5t8S80ufjbbsUHigwS2WhDmXuIW_ZoPrJldcWaevNriFl5NziaGlJpy19DrAfy8vAumJJj5tXCdutBjCB8v_7b4xxv0XRG29ICE7xSRRKeuZCk9W_ZjhVryLBEcpZ4cEYFCHs6UeKnfma7DspTmnzM Oct 29 20:47:38.126948 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:38.127730 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 579a0729e70e49d98501842ff8484cb6 Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '14'} Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:38.128639 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 20:47:38.129707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.130707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff81310d-9d3c-499a-a9bb-445793abe1ef tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.130707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff81310d-9d3c-499a-a9bb-445793abe1ef tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.016878 Oct 29 20:47:38.132939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32d06f08-2911-47c5-9c52-a92782006173 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.135601 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 125/253] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:38.150429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7bd26fd1-d936-4422-b9ea-ac9d18876dac tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.159900 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32d06f08-2911-47c5-9c52-a92782006173 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 552 microversion: 2.1 time: 0.031793 Oct 29 20:47:38.161040 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 129/254] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/os-aggregates => generated 552 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:38.194173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-068f04ad-b561-46a0-b90e-ba5b5294cfcf tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.214404 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7bd26fd1-d936-4422-b9ea-ac9d18876dac tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.072409 Oct 29 20:47:38.221525 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 126/255] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:38.232351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed42604c-69de-48c8-a119-b3a3e879faf0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.244022 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-068f04ad-b561-46a0-b90e-ba5b5294cfcf tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.068100 Oct 29 20:47:38.245268 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 130/256] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:38.258885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b8a645c-1d64-4977-a784-cf732537ae50 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1796598670"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:38.266650 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ed42604c-69de-48c8-a119-b3a3e879faf0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 20:47:38.272455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-9b8a645c-1d64-4977-a784-cf732537ae50 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Generated uuid f6790ef9-4dd3-4edd-89db-80dee83871df for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed42604c-69de-48c8-a119-b3a3e879faf0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:38.276556 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: exception: Aggregate -1 could not be found. Oct 29 20:47:38.277838 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '-1'} Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 20:47:38.278490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.280153 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed42604c-69de-48c8-a119-b3a3e879faf0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed42604c-69de-48c8-a119-b3a3e879faf0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.054312 Oct 29 20:47:38.281290 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 127/257] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:38.292936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e1b8049-f9f4-4214-bd04-e41fc06e8811 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2100729227"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:38.298986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-2e1b8049-f9f4-4214-bd04-e41fc06e8811 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid 41d05dcb-8be8-453e-9433-511d9efa022b for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:38.321741 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b8a645c-1d64-4977-a784-cf732537ae50 tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071454 Oct 29 20:47:38.326161 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 131/258] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:38.335162 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e1b8049-f9f4-4214-bd04-e41fc06e8811 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050714 Oct 29 20:47:38.336318 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 128/259] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:38.338958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d80d66f0-61d2-4377-9b0e-48a8b100152b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.349115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-189c5d24-3acc-417e-b42d-acc8816af0c4 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.352609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-189c5d24-3acc-417e-b42d-acc8816af0c4 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '579a0729e70e49d98501842ff8484cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e350d753c4bf498a79b4cfd764a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-189c5d24-3acc-417e-b42d-acc8816af0c4 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Request method failure captured: Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD0Mc7mTOFjM_hZfCQJWvdJ5t8S80ufjbbsUHigwS2WhDmXuIW_ZoPrJldcWaevNriFl5NziaGlJpy19DrAfy8vAumJJj5tXCdutBjCB8v_7b4xxv0XRG29ICE7xSRRKeuZCk9W_ZjhVryLBEcpZ4cEYFCHs6UeKnfma7DspTmnzM Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:38.355019 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 579a0729e70e49d98501842ff8484cb6 Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 20:47:38.356219 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '16'} Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:38.356876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.358953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-189c5d24-3acc-417e-b42d-acc8816af0c4 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.359852 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-189c5d24-3acc-417e-b42d-acc8816af0c4 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.011803 Oct 29 20:47:38.359852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 129/260] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:38.380148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d80d66f0-61d2-4377-9b0e-48a8b100152b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.029095 Oct 29 20:47:38.380794 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 132/261] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:38.386559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39a2c678-e039-456a-825b-abfdfe52b0c9 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.399365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60fe6b91-8d00-4c59-8774-4ddf37fa777b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.449070 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39a2c678-e039-456a-825b-abfdfe52b0c9 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.083478 Oct 29 20:47:38.450409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 130/262] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:38.463823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.464618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:38.493993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.494538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.494988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.495437 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60fe6b91-8d00-4c59-8774-4ddf37fa777b tempest-AggregatesAdminTestJSON-59117185 tempest-AggregatesAdminTestJSON-59117185-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.105944 Oct 29 20:47:38.496573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 133/263] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:38.502428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.503057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.506228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.508799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0162b340-7d64-4db2-8191-c224a4cea5ad tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.524021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0162b340-7d64-4db2-8191-c224a4cea5ad tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0162b340-7d64-4db2-8191-c224a4cea5ad tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:38.536575 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: exception: Aggregate -1 could not be found. Oct 29 20:47:38.538951 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '-1'} Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.539687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 20:47:38.540984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.552369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0162b340-7d64-4db2-8191-c224a4cea5ad tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.556900 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0162b340-7d64-4db2-8191-c224a4cea5ad tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.054834 Oct 29 20:47:38.582459 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 134/264] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:38.582459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.582459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:38.606840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.611784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.612448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.613262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.613866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.614363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.630251 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] HTTP exception thrown: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Request method failure captured: Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a HTTP/1.1 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZEzbTXYIlcEdHp2FHNew4IiH0Dr-hVL5f6aoIDnG3L4wQkMHC8jDohgpHakvPVAnw0c98_N1Jn8bH0G4iUx-yrT8Kr_8b0-FOHdPXNPNzrmwz_E2j7GqwoPs7XDkowWSyeJCaU8qvvLv5Y7rFGpUXk9AlkcmHL29t3mcMssqMB7Sl8 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6706fd16973b41ea83ae718611e5eb61 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:38.636633 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6706fd16973b41ea83ae718611e5eb61 Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminTestJSON-1808447834-project Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 0f3ff78fa0ca434aadb4bce26fc36882 Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminTestJSON-1808447834-project Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.638168 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1fe81d79-3cf8-4935-9ded-c657ae5fb11a'} Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.639032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.640301 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.642692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Returning 404 to user: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.643902 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94f8b41e-245d-4eed-ae07-6768ca0d2be3 tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 404 len: 111 microversion: 2.1 time: 0.074045 Oct 29 20:47:38.647462 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 135/265] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:47:38 2022] DELETE /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:38.657356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-242bde47-ebe1-4481-8f2a-a19492bcee9b tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.658400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-242bde47-ebe1-4481-8f2a-a19492bcee9b tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '579a0729e70e49d98501842ff8484cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e350d753c4bf498a79b4cfd764a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-242bde47-ebe1-4481-8f2a-a19492bcee9b tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Request method failure captured: Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFD0Mc7mTOFjM_hZfCQJWvdJ5t8S80ufjbbsUHigwS2WhDmXuIW_ZoPrJldcWaevNriFl5NziaGlJpy19DrAfy8vAumJJj5tXCdutBjCB8v_7b4xxv0XRG29ICE7xSRRKeuZCk9W_ZjhVryLBEcpZ4cEYFCHs6UeKnfma7DspTmnzM Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:38.670496 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 579a0729e70e49d98501842ff8484cb6 Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 20:47:38.671970 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:38.673267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.674889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-242bde47-ebe1-4481-8f2a-a19492bcee9b tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.676550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-242bde47-ebe1-4481-8f2a-a19492bcee9b tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.022901 Oct 29 20:47:38.682970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:38.693621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d41694ed-95a9-4312-a3d0-8f553434deca tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1433 microversion: 2.1 time: 0.240046 Oct 29 20:47:38.699807 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 136/266] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:38.700032 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 131/267] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1433 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:38.702382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.703926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] [instance: 1fe81d79-3cf8-4935-9ded-c657ae5fb11a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:38.709792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:38.712391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:38.720182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.722345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.722832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.727051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.727598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.729602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.730099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.730534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.731241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.731702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.732133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.733324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.781916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] HTTP exception thrown: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Request method failure captured: Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a HTTP/1.1 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZEzbTXYIlcEdHp2FHNew4IiH0Dr-hVL5f6aoIDnG3L4wQkMHC8jDohgpHakvPVAnw0c98_N1Jn8bH0G4iUx-yrT8Kr_8b0-FOHdPXNPNzrmwz_E2j7GqwoPs7XDkowWSyeJCaU8qvvLv5Y7rFGpUXk9AlkcmHL29t3mcMssqMB7Sl8 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6706fd16973b41ea83ae718611e5eb61 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:38.783479 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6706fd16973b41ea83ae718611e5eb61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6706fd16973b41ea83ae718611e5eb61 Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1808447834 Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AggregatesAdminTestJSON-1808447834-project Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 0f3ff78fa0ca434aadb4bce26fc36882 Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AggregatesAdminTestJSON-1808447834-project Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.784909 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1fe81d79-3cf8-4935-9ded-c657ae5fb11a'} Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:38.785720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. Oct 29 20:47:38.787052 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:38.788128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] Returning 404 to user: Instance 1fe81d79-3cf8-4935-9ded-c657ae5fb11a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:38.788128 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6a7834a-189b-4bb4-b346-2ff5ff7cf7be tempest-AggregatesAdminTestJSON-1808447834 tempest-AggregatesAdminTestJSON-1808447834-project] 10.222.0.36 "GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a" status: 404 len: 111 microversion: 2.1 time: 0.090742 Oct 29 20:47:38.790394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 137/268] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/servers/1fe81d79-3cf8-4935-9ded-c657ae5fb11a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:38.802687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-949b612a-26a8-4b78-bf2e-86eaae0cf4eb tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1198524963"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:38.806248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-949b612a-26a8-4b78-bf2e-86eaae0cf4eb tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid 6ca35896-ec10-498e-85c0-648f85c9a699 for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:38.807267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:38.866189 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-949b612a-26a8-4b78-bf2e-86eaae0cf4eb tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074383 Oct 29 20:47:38.867384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 138/269] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:38.878358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0cb62106-ada5-49f6-aaf0-b7664a08b2a6 req-30554ebc-2c41-4524-88d2-730e9b8f7b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd41c42-c3e8-4772-a06f-edbb7a2e709c", "name": "network-vif-deleted", "tag": "ae024cbe-5629-4c49-990f-9738a59c21e3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:38.895334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0cb62106-ada5-49f6-aaf0-b7664a08b2a6 req-30554ebc-2c41-4524-88d2-730e9b8f7b68 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.896261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0cb62106-ada5-49f6-aaf0-b7664a08b2a6 req-30554ebc-2c41-4524-88d2-730e9b8f7b68 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.896967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0cb62106-ada5-49f6-aaf0-b7664a08b2a6 req-30554ebc-2c41-4524-88d2-730e9b8f7b68 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:38.911409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0cb62106-ada5-49f6-aaf0-b7664a08b2a6 req-30554ebc-2c41-4524-88d2-730e9b8f7b68 service nova] Creating event network-vif-deleted:ae024cbe-5629-4c49-990f-9738a59c21e3 for instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c on nch1-master-1 Oct 29 20:47:38.918693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0cb62106-ada5-49f6-aaf0-b7664a08b2a6 req-30554ebc-2c41-4524-88d2-730e9b8f7b68 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049581 Oct 29 20:47:38.921219 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 139/270] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:38.930470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4d7b8fc-8048-4bec-bd80-cd5502e97cc0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:38.946786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d7b8fc-8048-4bec-bd80-cd5502e97cc0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:38.947650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d7b8fc-8048-4bec-bd80-cd5502e97cc0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:38.948421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d7b8fc-8048-4bec-bd80-cd5502e97cc0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.044921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:39.061030 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbe70bf6-b17f-489a-89e6-84cbd26e4ada tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1471 microversion: 2.1 time: 0.362158 Oct 29 20:47:39.082193 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 132/271] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:38 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:39.229829 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4d7b8fc-8048-4bec-bd80-cd5502e97cc0 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.306994 Oct 29 20:47:39.230574 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 140/272] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 20:47:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:39.246069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d5373c0-63ce-43e8-b69f-13f232cbed45 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:39.251390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d5373c0-63ce-43e8-b69f-13f232cbed45 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '579a0729e70e49d98501842ff8484cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e350d753c4bf498a79b4cfd764a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d5373c0-63ce-43e8-b69f-13f232cbed45 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Request method failure captured: Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 42 Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD0Mc7mTOFjM_hZfCQJWvdJ5t8S80ufjbbsUHigwS2WhDmXuIW_ZoPrJldcWaevNriFl5NziaGlJpy19DrAfy8vAumJJj5tXCdutBjCB8v_7b4xxv0XRG29ICE7xSRRKeuZCk9W_ZjhVryLBEcpZ4cEYFCHs6UeKnfma7DspTmnzM Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:39.253293 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b0e350d753c4bf498a79b4cfd764a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b0e350d753c4bf498a79b4cfd764a5b Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476 Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 579a0729e70e49d98501842ff8484cb6 Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1677542476-project Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: {"remove_host": {"host": "nch2-master-1"}} Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:39.254511 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:39.255231 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 20:47:39.256246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.268052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d5373c0-63ce-43e8-b69f-13f232cbed45 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:39.270478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d5373c0-63ce-43e8-b69f-13f232cbed45 tempest-AggregatesAdminNegativeTestJSON-1677542476 tempest-AggregatesAdminNegativeTestJSON-1677542476-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.030604 Oct 29 20:47:39.272852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 133/273] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 20:47:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:39.284078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c40ffc2-fafc-4d59-843b-679271b25f9e tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:39.309867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c40ffc2-fafc-4d59-843b-679271b25f9e tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:39.311735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c40ffc2-fafc-4d59-843b-679271b25f9e tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:39.313423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c40ffc2-fafc-4d59-843b-679271b25f9e tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.546813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c40ffc2-fafc-4d59-843b-679271b25f9e tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.266694 Oct 29 20:47:39.548280 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 141/274] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 20:47:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:39.562976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10288aa3-f64a-4278-9e64-a02fd9e3ce05 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:39.624771 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10288aa3-f64a-4278-9e64-a02fd9e3ce05 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.066924 Oct 29 20:47:39.626509 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 134/275] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:39 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:39.637794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02bf7d3c-8876-48ef-a790-809049f6ba1b tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1517169246"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:39.643156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.aggregate [None req-02bf7d3c-8876-48ef-a790-809049f6ba1b tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Generated uuid 98af5669-1dec-487c-bacf-8c3ef8aff9a3 for aggregate {{(pid=138884) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 20:47:39.700675 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02bf7d3c-8876-48ef-a790-809049f6ba1b tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066726 Oct 29 20:47:39.705163 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 142/276] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 20:47:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:39.723988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:39.725258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:39.726991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:39.740761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:39.743031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:39.749498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.750281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:39.753552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:39.754408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.778749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:39.779249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:39.782809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.796578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:39.798002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:39.798617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.809912 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.compute.aggregates [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 20:47:39.812450 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Request method failure captured: Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 42 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFIRN_u-R6nxH5S_3qfCmvnN57JRt5YvOhnHWXjFA5zOKLDCM-4kyPCPOqA5IQZ9Wa6-EnQZmayYV0rMtBj20POwh78PcW4O9KUgt7yV2i2eTJrMWi-yZ5-c5zr0CSnqawBrkUioUdWllWWfBenSCwfCsKlSp3F4hBGGI9wQSdteaI Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:39.816828 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74748a2a5c274211b0d4cdabb2430a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 74748a2a5c274211b0d4cdabb2430a82 Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605 Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e5f2996a6bdd4823822561e5204c731e Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: {"remove_host": {"host": "nonexist_host"}} Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:39.818396 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 20:47:39.819294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 29 20:47:39.821614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.823459 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:39.825065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:39.825065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:39.825065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:39.825065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:39.825065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 29 20:47:39.825065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:39.828893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:39.831593 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1365be8f-4800-4afe-aad9-e17d89a00156 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.117226 Oct 29 20:47:39.838600 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 135/277] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 20:47:39 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:39.839191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:39.839702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:39.840134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:39.847112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lazy-loading 'fault' on Instance uuid 6fd41c42-c3e8-4772-a06f-edbb7a2e709c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:47:39.853297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7e90fe0-b858-4912-a3fc-036c2b57cb16 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:39.918950 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7e90fe0-b858-4912-a3fc-036c2b57cb16 tempest-AggregatesAdminNegativeTestJSON-1357686605 tempest-AggregatesAdminNegativeTestJSON-1357686605-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.075022 Oct 29 20:47:39.921598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 136/278] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:47:39 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:47:39.940745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:39.952585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-785a1a62-aaac-4be3-acf9-a7a9f6beaf72 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 200 len: 1309 microversion: 2.1 time: 0.232094 Oct 29 20:47:39.972196 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 143/279] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:39 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:40.090085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:40.090903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:40.099308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:40.101905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:40.102944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:40.105256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:40.106224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:40.107266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:40.156345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:40.157128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:40.164308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:40.165019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:40.165639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:40.166495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:40.167352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:40.167950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:40.463001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:40.471834 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da27425e-d097-43cf-a0f5-e61a8a9d8cc7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1471 microversion: 2.1 time: 0.387301 Oct 29 20:47:40.488762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 137/280] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:40 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:40.548685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:40.561706 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f48e4e3f-dfaa-4721-9d8b-a12939112c67 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 200 len: 1588 microversion: 2.1 time: 0.408062 Oct 29 20:47:40.563900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 144/281] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:40 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 1588 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:40.986063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:40.987077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:40.995318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:40.996633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:40.997444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:40.998988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:40.999843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:41.000504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:41.018612 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] HTTP exception thrown: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Request method failure captured: Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c HTTP/1.1 Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD3qkD9frCHSyavdw5L-iROTDpyWunA3XPelUKne0NsPjb4XxOVa5gG1p5SuKqR4e2y3zCb35kyvdurGNNPLtZCvMoizWtoTjlX4xhBDp_zCBWkdleg04gTSNDWvWz2NmvvGh6NUBHCCRBRQk9NdhcOsEbtqenm79Ny11UaSIAmcc Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:41.020460 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7597be5274ff469b9eec43728cad006a Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:47:41.021729 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6fd41c42-c3e8-4772-a06f-edbb7a2e709c'} Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:41.022416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:47:41.023546 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:41.026860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Returning 404 to user: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:41.026860 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-42d6094e-9b79-49a3-87b2-309713b20a4c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 404 len: 111 microversion: 2.1 time: 0.042927 Oct 29 20:47:41.028688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5952d298-4033-4f8e-a1be-dc2f4a5c20e9 req-16b804b7-b278-460a-9739-035bceaa2f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081ac346-df70-4c2f-803e-94f0d633b72a", "tag": "74ef1822-ac00-431f-8dce-a62df761b0f3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:41.041674 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 138/282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:40 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:41.042567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5952d298-4033-4f8e-a1be-dc2f4a5c20e9 req-16b804b7-b278-460a-9739-035bceaa2f62 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:41.044670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5952d298-4033-4f8e-a1be-dc2f4a5c20e9 req-16b804b7-b278-460a-9739-035bceaa2f62 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:41.045584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5952d298-4033-4f8e-a1be-dc2f4a5c20e9 req-16b804b7-b278-460a-9739-035bceaa2f62 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:41.068674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5952d298-4033-4f8e-a1be-dc2f4a5c20e9 req-16b804b7-b278-460a-9739-035bceaa2f62 service nova] Creating event network-changed:74ef1822-ac00-431f-8dce-a62df761b0f3 for instance 081ac346-df70-4c2f-803e-94f0d633b72a on nch1-master-1 Oct 29 20:47:41.073944 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5952d298-4033-4f8e-a1be-dc2f4a5c20e9 req-16b804b7-b278-460a-9739-035bceaa2f62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056603 Oct 29 20:47:41.074814 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 145/283] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:41.379342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-755501438", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:41.503553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:41.504337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:41.522206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:41.523970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:41.525031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:41.525237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:41.527092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:41.527615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:41.547095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:42.098971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:42.109386 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d46c1f1-26cc-413c-9cbf-69d9e5b0e5f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1471 microversion: 2.1 time: 0.612403 Oct 29 20:47:42.115434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:42.116030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:42.116756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:42.117303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:42.117878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:42.122770 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 146/284] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:41 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1471 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:42.125764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=85 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:42.134835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:42.136541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:42.138035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:42.139141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:42.139862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:42.141068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:42.191879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Getting quotas for project 0d839b1a840346baa1f65e6000ea277b. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:42.208978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Getting quotas for user 7597be5274ff469b9eec43728cad006a and project 0d839b1a840346baa1f65e6000ea277b. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:42.246324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:42.248773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:42.332517 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e594a897-b819-4c32-b463-26fad57e0fdf tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965693 Oct 29 20:47:42.333546 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 139/285] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:42.345889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7492f7d-d52e-44c1-a450-7d2e5f6702a5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:42.346872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7492f7d-d52e-44c1-a450-7d2e5f6702a5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:42.432312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7492f7d-d52e-44c1-a450-7d2e5f6702a5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:42.441739 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7492f7d-d52e-44c1-a450-7d2e5f6702a5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1219 microversion: 2.1 time: 0.100016 Oct 29 20:47:42.443897 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 147/286] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:42 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:42.970913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-393c02bd-82cd-439c-b3b7-cdee2f6007ba tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Calling method '.version_select at 0x7fa17225f1f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:42.996666 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-393c02bd-82cd-439c-b3b7-cdee2f6007ba tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] HTTP exception thrown: Image not found. Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-393c02bd-82cd-439c-b3b7-cdee2f6007ba tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Request method failure captured: Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/b791a43c-6ac7-41d0-bd27-e83aff9d2acc/metadata/os_distro HTTP/1.1 Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFufaz1pcPGUf7fEtjtWnNScC_L48UJFGrzEIRDRgNOKxoDp2gt8cFRybY-OBlnhF1Tc8vN9YhPFo09ydk5A2Moxps4eympF5WipGr1IBgVkaaoVhaLW-InHRJ3LpuGRlcJfvH3Fjm80MecruHHpRli2-EpQxU0VHZr9YWHZPb0cmw Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:43.008081 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2534c7847c824e7f87978b636cd11cae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 34301acebd9b4b5aa271badcc5061375 Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'image_id': 'b791a43c-6ac7-41d0-bd27-e83aff9d2acc', 'id': 'os_distro'} Oct 29 20:47:43.009584 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.010360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b791a43c-6ac7-41d0-bd27-e83aff9d2acc Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.011931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b791a43c-6ac7-41d0-bd27-e83aff9d2acc could not be found. Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:43.013001 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:47:43.014126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.016793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-393c02bd-82cd-439c-b3b7-cdee2f6007ba tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:43.017973 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-393c02bd-82cd-439c-b3b7-cdee2f6007ba tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] 10.222.0.36 "DELETE /compute/v2.1/images/b791a43c-6ac7-41d0-bd27-e83aff9d2acc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.602773 Oct 29 20:47:43.029105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9df42605-5b7f-4e6a-a246-3bbdf912025c tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Calling method '.version_select at 0x7fa1721b7670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:43.038094 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 140/287] 10.222.0.36 () {58 vars in 1293 bytes} [Sat Oct 29 20:47:42 2022] DELETE /compute/v2.1/images/b791a43c-6ac7-41d0-bd27-e83aff9d2acc/metadata/os_distro => generated 62 bytes in 623 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:43.066171 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-9df42605-5b7f-4e6a-a246-3bbdf912025c tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] HTTP exception thrown: Image not found. Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9df42605-5b7f-4e6a-a246-3bbdf912025c tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Request method failure captured: Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/images/36473b46-f060-4acf-8b9a-fa0a63079abd/metadata/os_version HTTP/1.1 Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFufaz1pcPGUf7fEtjtWnNScC_L48UJFGrzEIRDRgNOKxoDp2gt8cFRybY-OBlnhF1Tc8vN9YhPFo09ydk5A2Moxps4eympF5WipGr1IBgVkaaoVhaLW-InHRJ3LpuGRlcJfvH3Fjm80MecruHHpRli2-EpQxU0VHZr9YWHZPb0cmw Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:43.071510 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2534c7847c824e7f87978b636cd11cae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 34301acebd9b4b5aa271badcc5061375 Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'image_id': '36473b46-f060-4acf-8b9a-fa0a63079abd', 'id': 'os_version'} Oct 29 20:47:43.072702 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.073449 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 36473b46-f060-4acf-8b9a-fa0a63079abd Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.074987 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 36473b46-f060-4acf-8b9a-fa0a63079abd could not be found. Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:43.076031 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:47:43.077601 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.082621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9df42605-5b7f-4e6a-a246-3bbdf912025c tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:43.084285 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9df42605-5b7f-4e6a-a246-3bbdf912025c tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] 10.222.0.36 "GET /compute/v2.1/images/36473b46-f060-4acf-8b9a-fa0a63079abd/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.059774 Oct 29 20:47:43.085585 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 148/288] 10.222.0.36 () {58 vars in 1293 bytes} [Sat Oct 29 20:47:43 2022] GET /compute/v2.1/images/36473b46-f060-4acf-8b9a-fa0a63079abd/metadata/os_version => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:47:43.098493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba3e6f0d-2b5c-4f72-bb62-2cbc11b55456 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Calling method '.version_select at 0x7fa1722c5040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:43.140231 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ba3e6f0d-2b5c-4f72-bb62-2cbc11b55456 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] HTTP exception thrown: Image not found. Oct 29 20:47:43.146067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:43.147297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba3e6f0d-2b5c-4f72-bb62-2cbc11b55456 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Request method failure captured: Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/images/2cf3c9a9-f78b-410d-bef9-ac28db4b0066/metadata HTTP/1.1 Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFufaz1pcPGUf7fEtjtWnNScC_L48UJFGrzEIRDRgNOKxoDp2gt8cFRybY-OBlnhF1Tc8vN9YhPFo09ydk5A2Moxps4eympF5WipGr1IBgVkaaoVhaLW-InHRJ3LpuGRlcJfvH3Fjm80MecruHHpRli2-EpQxU0VHZr9YWHZPb0cmw Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:43.149496 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2534c7847c824e7f87978b636cd11cae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 34301acebd9b4b5aa271badcc5061375 Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'image_id': '2cf3c9a9-f78b-410d-bef9-ac28db4b0066'} Oct 29 20:47:43.150684 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.151428 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2cf3c9a9-f78b-410d-bef9-ac28db4b0066 Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.152361 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2cf3c9a9-f78b-410d-bef9-ac28db4b0066 could not be found. Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:43.154093 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:47:43.157620 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.163780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba3e6f0d-2b5c-4f72-bb62-2cbc11b55456 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:43.165017 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba3e6f0d-2b5c-4f72-bb62-2cbc11b55456 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] 10.222.0.36 "GET /compute/v2.1/images/2cf3c9a9-f78b-410d-bef9-ac28db4b0066/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074470 Oct 29 20:47:43.166123 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 141/289] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:47:43 2022] GET /compute/v2.1/images/2cf3c9a9-f78b-410d-bef9-ac28db4b0066/metadata => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:47:43.169174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:43.171170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:43.171922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:43.174242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:43.175257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:43.175755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:43.215302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d295a68-be9b-4f23-9458-043d0ef34479 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Action: 'update_all', calling method: .version_select at 0x7fa172295af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:43.250111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0d295a68-be9b-4f23-9458-043d0ef34479 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] HTTP exception thrown: Image not found. Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d295a68-be9b-4f23-9458-043d0ef34479 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Request method failure captured: Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/images/822bbc69-73d0-43ba-98d0-3599e7423e7b/metadata HTTP/1.1 Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 57 Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFufaz1pcPGUf7fEtjtWnNScC_L48UJFGrzEIRDRgNOKxoDp2gt8cFRybY-OBlnhF1Tc8vN9YhPFo09ydk5A2Moxps4eympF5WipGr1IBgVkaaoVhaLW-InHRJ3LpuGRlcJfvH3Fjm80MecruHHpRli2-EpQxU0VHZr9YWHZPb0cmw Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:43.254687 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2534c7847c824e7f87978b636cd11cae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 34301acebd9b4b5aa271badcc5061375 Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:43.255949 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'image_id': '822bbc69-73d0-43ba-98d0-3599e7423e7b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.256719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 822bbc69-73d0-43ba-98d0-3599e7423e7b Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.257687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 822bbc69-73d0-43ba-98d0-3599e7423e7b could not be found. Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:43.258737 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:47:43.259926 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.267249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d295a68-be9b-4f23-9458-043d0ef34479 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:43.268527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d295a68-be9b-4f23-9458-043d0ef34479 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] 10.222.0.36 "PUT /compute/v2.1/images/822bbc69-73d0-43ba-98d0-3599e7423e7b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.077683 Oct 29 20:47:43.269724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 142/290] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:47:43 2022] PUT /compute/v2.1/images/822bbc69-73d0-43ba-98d0-3599e7423e7b/metadata => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:43.283480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f40f7fe9-3a60-490a-b1be-04fd394a90be tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Action: 'update', calling method: .version_select at 0x7fa172109ee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:43.316330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f40f7fe9-3a60-490a-b1be-04fd394a90be tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] HTTP exception thrown: Image not found. Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f40f7fe9-3a60-490a-b1be-04fd394a90be tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Request method failure captured: Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/images/240f773d-7d5e-4889-8cb0-20fef8bcbcf9/metadata/os_distro HTTP/1.1 Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 30 Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFufaz1pcPGUf7fEtjtWnNScC_L48UJFGrzEIRDRgNOKxoDp2gt8cFRybY-OBlnhF1Tc8vN9YhPFo09ydk5A2Moxps4eympF5WipGr1IBgVkaaoVhaLW-InHRJ3LpuGRlcJfvH3Fjm80MecruHHpRli2-EpQxU0VHZr9YWHZPb0cmw Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:43.320160 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2534c7847c824e7f87978b636cd11cae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 34301acebd9b4b5aa271badcc5061375 Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: {"meta": {"os_distro": "alt"}} Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:47:43.321343 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'image_id': '240f773d-7d5e-4889-8cb0-20fef8bcbcf9', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.322467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 240f773d-7d5e-4889-8cb0-20fef8bcbcf9 Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.323525 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 240f773d-7d5e-4889-8cb0-20fef8bcbcf9 could not be found. Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:43.325521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:47:43.328431 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.330475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f40f7fe9-3a60-490a-b1be-04fd394a90be tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:43.330475 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f40f7fe9-3a60-490a-b1be-04fd394a90be tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] 10.222.0.36 "PUT /compute/v2.1/images/240f773d-7d5e-4889-8cb0-20fef8bcbcf9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.049024 Oct 29 20:47:43.330475 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 143/291] 10.222.0.36 () {60 vars in 1310 bytes} [Sat Oct 29 20:47:43 2022] PUT /compute/v2.1/images/240f773d-7d5e-4889-8cb0-20fef8bcbcf9/metadata/os_distro => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:43.342428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adb7fd3c-977c-4f68-9fc2-3c850b0cf149 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Action: 'create', calling method: .version_select at 0x7fa17202c160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:43.380905 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-adb7fd3c-977c-4f68-9fc2-3c850b0cf149 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] HTTP exception thrown: Image not found. Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adb7fd3c-977c-4f68-9fc2-3c850b0cf149 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Request method failure captured: Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/images/363ec417-2b8a-44bd-972d-d7f311e08a61/metadata HTTP/1.1 Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 57 Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFufaz1pcPGUf7fEtjtWnNScC_L48UJFGrzEIRDRgNOKxoDp2gt8cFRybY-OBlnhF1Tc8vN9YhPFo09ydk5A2Moxps4eympF5WipGr1IBgVkaaoVhaLW-InHRJ3LpuGRlcJfvH3Fjm80MecruHHpRli2-EpQxU0VHZr9YWHZPb0cmw Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:43.383120 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2534c7847c824e7f87978b636cd11cae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2534c7847c824e7f87978b636cd11cae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2534c7847c824e7f87978b636cd11cae Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178 Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 34301acebd9b4b5aa271badcc5061375 Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2038221178-project Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:47:43.384282 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'image_id': '363ec417-2b8a-44bd-972d-d7f311e08a61', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.385021 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 363ec417-2b8a-44bd-972d-d7f311e08a61 Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:47:43.385993 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 363ec417-2b8a-44bd-972d-d7f311e08a61 could not be found. Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:43.387014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:47:43.389237 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:43.392168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adb7fd3c-977c-4f68-9fc2-3c850b0cf149 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:43.392168 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-adb7fd3c-977c-4f68-9fc2-3c850b0cf149 tempest-ImagesMetadataNegativeTestJSON-2038221178 tempest-ImagesMetadataNegativeTestJSON-2038221178-project] 10.222.0.36 "POST /compute/v2.1/images/363ec417-2b8a-44bd-972d-d7f311e08a61/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051609 Oct 29 20:47:43.392168 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 144/292] 10.222.0.36 () {60 vars in 1281 bytes} [Sat Oct 29 20:47:43 2022] POST /compute/v2.1/images/363ec417-2b8a-44bd-972d-d7f311e08a61/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:43.466611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:43.468198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:43.479123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:43.479932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:43.480726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:43.482147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:43.482916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:43.483728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:43.540307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:43.554683 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de9df248-e0e5-460c-9efa-db84382fbee0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1471 microversion: 2.1 time: 0.420530 Oct 29 20:47:43.554683 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 149/293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:43 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1471 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:43.583316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:43.594238 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-12976122-6b0f-4ad1-b66b-374f50c40be5 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1271 microversion: 2.1 time: 0.132194 Oct 29 20:47:43.606410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 145/294] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:43 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:44.577323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:44.577977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:44.592652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:44.594095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:44.596165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:44.598307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:44.599564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:44.600442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:44.618447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:44.619766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:44.646745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:44.649348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:44.650528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:44.660403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:44.662306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:44.662771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:45.069495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:45.080216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a2eb7bb-4445-4548-ad79-1b2d27cf4958 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1277 microversion: 2.1 time: 0.465433 Oct 29 20:47:45.083623 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 146/295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:44 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1277 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:45.344214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-485357295", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:45.434756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:45.471320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:45.481212 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-acc2cdd1-21d3-48b3-9c0f-8a2785be842c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.907650 Oct 29 20:47:45.481842 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 150/296] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:44 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:46.090078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:46.090932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:46.091674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:46.092233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:46.092935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:46.108493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.108963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:46.109767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:46.113036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.115132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:46.117257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.119227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.120979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.121127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:46.126355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.127076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:46.128035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.128706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.129368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:46.181351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Getting quotas for project 4fd6966959864b80b945ae69a275ca8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:46.193505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Getting quotas for user 027a78fcee5a4f44b47fc5e187f6da67 and project 4fd6966959864b80b945ae69a275ca8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:46.233755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:46.235964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:46.353611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0224ddd0-eab4-4802-82d2-53eeafbc4074 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237094 Oct 29 20:47:46.375576 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 147/297] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:46.859022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Calling method '.version_select at 0x7fa17225fa60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:46.867280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.867810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.868221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:46.919633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.922099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.922993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:46.994584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:46.997885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:46.998794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.026836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.027655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.029855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.077121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.079746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.080213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.103276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-79e3601e-312f-4fa2-9bd4-fbb03da1a692 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.726489 Oct 29 20:47:47.118869 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 148/298] 10.222.0.36 () {60 vars in 1243 bytes} [Sat Oct 29 20:47:46 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:47:47.125348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:47.127912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:47.140240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:47.147966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.150388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.151853 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b5385e6f-a298-411f-aee4-17673b16ab43 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1319 microversion: 2.1 time: 1.047295 Oct 29 20:47:47.152464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.153447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.154974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.157996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.173268 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 151/299] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:46 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1319 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:47.183074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-123599541", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:47.279063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:47.608729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=20 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:47.658135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:47.677870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f554cfb-9882-4f0e-90fe-4b7bb581d7ee tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.545210 Oct 29 20:47:47.678560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 149/300] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:47 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:47.689638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b2dd9419-66f2-4668-acc8-69975bf0d083 req-42e385e5-d7b3-4bc7-bfc9-e1c77a9e094c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755a851c-4f30-45db-8efd-e02e385bd2bf", "tag": "a3b4f1b8-85fd-443d-96b6-d48f9fc9a144"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:47.701939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b2dd9419-66f2-4668-acc8-69975bf0d083 req-42e385e5-d7b3-4bc7-bfc9-e1c77a9e094c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.703201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b2dd9419-66f2-4668-acc8-69975bf0d083 req-42e385e5-d7b3-4bc7-bfc9-e1c77a9e094c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.703645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b2dd9419-66f2-4668-acc8-69975bf0d083 req-42e385e5-d7b3-4bc7-bfc9-e1c77a9e094c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.733847 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b2dd9419-66f2-4668-acc8-69975bf0d083 req-42e385e5-d7b3-4bc7-bfc9-e1c77a9e094c service nova] Creating event network-changed:a3b4f1b8-85fd-443d-96b6-d48f9fc9a144 for instance 755a851c-4f30-45db-8efd-e02e385bd2bf on nch2-master-1 Oct 29 20:47:47.747877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b2dd9419-66f2-4668-acc8-69975bf0d083 req-42e385e5-d7b3-4bc7-bfc9-e1c77a9e094c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067331 Oct 29 20:47:47.748844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 150/301] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:47.754362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Calling method '.version_select at 0x7fa172295b80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:47.776769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.777264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.777727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.807776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.808265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.808702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.864841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.873403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.873884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.874471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:47.875219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:47.875888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:47.876629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:47.877231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:47.889857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=91,nova_cell0:UPDATE=7 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:47.898605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.899297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.900922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.903907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.905180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.906501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.922874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.923282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.923720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.954009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:47.960265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:47.963868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Getting quotas for project 4fd6966959864b80b945ae69a275ca8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:47.964550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:47.965279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:47.973750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Getting quotas for user 027a78fcee5a4f44b47fc5e187f6da67 and project 4fd6966959864b80b945ae69a275ca8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:47.985484 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca760815-a762-4e43-9ec1-956e9fa35213 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.233824 Oct 29 20:47:47.986091 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 151/302] 10.222.0.36 () {60 vars in 1222 bytes} [Sat Oct 29 20:47:47 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:47:48.002555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:48.007485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Calling method '.version_select at 0x7fa1721091f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:48.007684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:48.012620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:48.018275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:48.018764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:48.019197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:48.063756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:48.064245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:48.064679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:48.077180 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6920378f-4c07-491a-ad1a-84cd8575a290 tempest-HypervisorAdminV253TestBase-1210059933 tempest-HypervisorAdminV253TestBase-1210059933-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/57908c28-b329-4567-b95d-a8109fcbe171" status: 200 len: 792 microversion: 2.53 time: 0.079775 Oct 29 20:47:48.080255 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 152/303] 10.222.0.36 () {60 vars in 1298 bytes} [Sat Oct 29 20:47:47 2022] GET /compute/v2.1/os-hypervisors/57908c28-b329-4567-b95d-a8109fcbe171 => generated 792 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:47:48.110287 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7e89604-5e63-4974-9143-5edaf4241842 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.935784 Oct 29 20:47:48.116873 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 152/304] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:48.121874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6044ddad-e2c4-4877-a9d8-87552aa0b970 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:48.122614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6044ddad-e2c4-4877-a9d8-87552aa0b970 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:48.179044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:48.179821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:48.190779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:48.191980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:48.192501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:48.193497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:48.204655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:48.214509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:48.230456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6044ddad-e2c4-4877-a9d8-87552aa0b970 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:48.242988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6044ddad-e2c4-4877-a9d8-87552aa0b970 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1213 microversion: 2.1 time: 0.121902 Oct 29 20:47:48.245578 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 153/305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:48 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:48.432660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:48.444944 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e527d752-6743-4c54-b9d9-5482b49830dd tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1319 microversion: 2.1 time: 0.268440 Oct 29 20:47:48.446769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 153/306] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:48 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:48.703639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:48.704394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:48.714703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:48.716508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:48.717213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:48.719006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:48.720629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:48.724610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:49.602132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:49.612726 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bec6ed47-4d78-4e21-9262-28ab80667a44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.916068 Oct 29 20:47:49.632178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 154/307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:48 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:49.641435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:49.642106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:49.656736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:49.658936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:49.664601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:49.666496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:49.668369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:49.670499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:49.696680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67142c37-3b32-49bc-8789-1331115710e1 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1820968788", "id": 642629521, "os-flavor-access:is_public": "False"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:49.731709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67142c37-3b32-49bc-8789-1331115710e1 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.470386 Oct 29 20:47:49.740893 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 154/308] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:49 2022] POST /compute/v2.1/flavors => generated 436 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:49.745091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:49.745760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:49.752351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:49.752833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:49.753327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:49.754074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:49.754532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:49.754961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:49.766272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:49.774855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-159edba9-b8f5-4580-967a-6bdb277c8679 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1265 microversion: 2.1 time: 0.141425 Oct 29 20:47:49.779495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 155/309] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:49 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:49.795790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fda4f654-7b3e-4616-8545-5216c0a20ee0 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:49.900665 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fda4f654-7b3e-4616-8545-5216c0a20ee0 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/642629521/action" status: 200 len: 96 microversion: 2.1 time: 0.118372 Oct 29 20:47:49.901260 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 156/310] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:47:49 2022] POST /compute/v2.1/flavors/642629521/action => generated 96 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:49.912613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb7dbd03-8536-4ee6-bc1f-837d308e2935 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:50.075642 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-bb7dbd03-8536-4ee6-bc1f-837d308e2935 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project e64b754d455a47f4bd0492d4892678e0 combination. Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb7dbd03-8536-4ee6-bc1f-837d308e2935 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Request method failure captured: Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/flavors/642629521/action HTTP/1.1 Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 67 Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFza6T5OpXU-30BmeClXMNdBtfz3a5Z6wlva3wmOHEV87jgWTbYOakVztuNLCEb-35QUBVggc2GtmkbYi817CdrNEpAGJAFdmsLfD9R4b0T0SEAVuSU064uztuPCJgN8WXPHyXjQBbbMtqysyCrm2UcdyFYJjY7jAttdhZ2yomu4Yc Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 12e0ad088d9547cc91d1859340c10cf7 Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:50.114142 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 12e0ad088d9547cc91d1859340c10cf7 Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 246b0aa292d04567b214fe55853ec9fa Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: {"addTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} Oct 29 20:47:50.115364 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: exception: Flavor access already exists for flavor 19 and project e64b754d455a47f4bd0492d4892678e0 combination. Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '642629521', 'body': {'addTenantAccess': {'tenant': 'e64b754d455a47f4bd0492d4892678e0'}}} Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result.read() Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:47:50.116016 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-e64b754d455a47f4bd0492d4892678e0' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:47:50.117008 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:47:50.118068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:47:50.119038 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result.read() Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-e64b754d455a47f4bd0492d4892678e0' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 20, 47, 50, 69191), 'updated_at': None, 'flavor_id': 19, 'project_id': 'e64b754d455a47f4bd0492d4892678e0'}] Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:50.120181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project e64b754d455a47f4bd0492d4892678e0 combination. Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:50.121095 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project e64b754d455a47f4bd0492d4892678e0 combination. Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:50.126450 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:50.128910 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project e64b754d455a47f4bd0492d4892678e0 combination. Oct 29 20:47:50.128910 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.131272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb7dbd03-8536-4ee6-bc1f-837d308e2935 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project e64b754d455a47f4bd0492d4892678e0 combination. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:50.131272 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bb7dbd03-8536-4ee6-bc1f-837d308e2935 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/642629521/action" status: 409 len: 152 microversion: 2.1 time: 0.223385 Oct 29 20:47:50.131272 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 157/311] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:47:49 2022] POST /compute/v2.1/flavors/642629521/action => generated 152 bytes in 224 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:47:50.143574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:50.152567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92530f47-9bc5-405e-85de-05012b141af2 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:50.154348 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9122ed01-ec73-46fe-8a95-c96f3af8eafa tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1319 microversion: 2.1 time: 0.419529 Oct 29 20:47:50.163551 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 155/312] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:49 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:50.343632 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92530f47-9bc5-405e-85de-05012b141af2 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/642629521/action" status: 200 len: 21 microversion: 2.1 time: 0.207551 Oct 29 20:47:50.351434 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 158/313] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:47:50 2022] POST /compute/v2.1/flavors/642629521/action => generated 21 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:50.355549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b76e5d7-de14-468e-80ca-36668eb97ef0 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:50.376830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b76e5d7-de14-468e-80ca-36668eb97ef0 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/642629521" status: 202 len: 0 microversion: 2.1 time: 0.025066 Oct 29 20:47:50.378123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:47:50 2022] DELETE /compute/v2.1/flavors/642629521 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:47:50.386829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a4783a0-f347-4113-a7b6-d31e8ab4a958 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:50.419342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a4783a0-f347-4113-a7b6-d31e8ab4a958 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036370 Oct 29 20:47:50.421631 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 159/315] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:50 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:50.441937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b93170ab-c094-4dd3-9b95-2d9023112e10 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-708699808", "id": 2006190387, "os-flavor-access:is_public": "True"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:50.493436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b93170ab-c094-4dd3-9b95-2d9023112e10 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.055210 Oct 29 20:47:50.495818 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 157/316] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:50.508575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7cba5e5e-fff9-4cce-82a3-45c982889248 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:50.517054 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7cba5e5e-fff9-4cce-82a3-45c982889248 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7cba5e5e-fff9-4cce-82a3-45c982889248 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Request method failure captured: Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/flavors/2006190387/os-flavor-access HTTP/1.1 Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFza6T5OpXU-30BmeClXMNdBtfz3a5Z6wlva3wmOHEV87jgWTbYOakVztuNLCEb-35QUBVggc2GtmkbYi817CdrNEpAGJAFdmsLfD9R4b0T0SEAVuSU064uztuPCJgN8WXPHyXjQBbbMtqysyCrm2UcdyFYJjY7jAttdhZ2yomu4Yc Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 12e0ad088d9547cc91d1859340c10cf7 Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:47:50.518656 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 12e0ad088d9547cc91d1859340c10cf7 Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 246b0aa292d04567b214fe55853ec9fa Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: exception: Access list not available for public flavors. Oct 29 20:47:50.519856 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'flavor_id': '2006190387'} Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 29 20:47:50.520642 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:50.531903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7cba5e5e-fff9-4cce-82a3-45c982889248 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:50.533380 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7cba5e5e-fff9-4cce-82a3-45c982889248 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/2006190387/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.028240 Oct 29 20:47:50.534480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 160/317] 10.222.0.36 () {58 vars in 1209 bytes} [Sat Oct 29 20:47:50 2022] GET /compute/v2.1/flavors/2006190387/os-flavor-access => generated 91 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:47:50.545494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bd4e04fe-b25e-4803-b4ab-51dafc1dfab3 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:50.576752 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bd4e04fe-b25e-4803-b4ab-51dafc1dfab3 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2006190387" status: 202 len: 0 microversion: 2.1 time: 0.036985 Oct 29 20:47:50.583079 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 158/318] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:47:50 2022] DELETE /compute/v2.1/flavors/2006190387 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:47:50.600179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f02e23fb-8b42-4c45-8a84-a86d51c0e176 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:50.637668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:50.639616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:50.652004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:50.654018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:50.655138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:50.657256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:50.657876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:50.659773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:50.710386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:50.712193 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f02e23fb-8b42-4c45-8a84-a86d51c0e176 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.123554 Oct 29 20:47:50.717663 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 161/319] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:50 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:50.745551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a27e489-72bd-4882-85fb-9c17fc558c27 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1359775393", "id": 2110559223, "os-flavor-access:is_public": "False"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:50.773924 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a27e489-72bd-4882-85fb-9c17fc558c27 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.032945 Oct 29 20:47:50.777505 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 162/320] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:50 2022] POST /compute/v2.1/flavors => generated 439 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:51.061379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:51.073485 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f3b4635-c06a-47b7-b375-d2666b54a2f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.440877 Oct 29 20:47:51.086732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 159/321] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:50 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:51.108838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:51.114915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:51.149830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:51.155370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:51.156264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:51.157952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:51.162333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:51.170017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:51.237474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8703f42d-824a-426d-9773-00351e5e31e7 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:51.242207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8703f42d-824a-426d-9773-00351e5e31e7 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '6a4dc371a7094272b16d55575d45e620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64b754d455a47f4bd0492d4892678e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8703f42d-824a-426d-9773-00351e5e31e7 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Request method failure captured: Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/flavors/2110559223/action HTTP/1.1 Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 67 Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFyMd4XPEfQxol2gDzU8rxGtMhE63lZ0sdTnwKd7uzowj3ov--1KpTzI_RJ-tDTeMfYxZzDmsgvIpTeZ8hLQvAlcdEPVZy51uOBAV3C8kasNYB2cbqAy92CcP5dIS-h0mx6ijTgND5b6c5t_8qMdfeOyanl4l5vLSxvAnQmzMNs-jU Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e64b754d455a47f4bd0492d4892678e0 Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-486389101 Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:47:51.246397 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-486389101 Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e64b754d455a47f4bd0492d4892678e0 Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-486389101 Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FlavorsAccessNegativeTestJSON-486389101-project Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6a4dc371a7094272b16d55575d45e620 Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-486389101-project Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: {"addTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} Oct 29 20:47:51.248454 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2110559223', 'body': {'addTenantAccess': {'tenant': 'e64b754d455a47f4bd0492d4892678e0'}}} Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:51.249234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 20:47:51.250393 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:47:51.251493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8703f42d-824a-426d-9773-00351e5e31e7 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:51.251493 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8703f42d-824a-426d-9773-00351e5e31e7 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] 10.222.0.36 "POST /compute/v2.1/flavors/2110559223/action" status: 403 len: 130 microversion: 2.1 time: 0.462622 Oct 29 20:47:51.256358 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 163/322] 10.222.0.36 () {60 vars in 1200 bytes} [Sat Oct 29 20:47:50 2022] POST /compute/v2.1/flavors/2110559223/action => generated 130 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:47:51.267988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:51.268590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:51.285862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:51.288005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:51.288463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:51.289301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:51.289921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:51.294199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:51.678058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:51.698643 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dbd978c5-78c6-4d5c-ba5a-7b8fbbfc78a5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1271 microversion: 2.1 time: 0.608316 Oct 29 20:47:51.699876 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 160/323] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:51 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1271 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:51.723231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-44dc968b-4f64-4aaa-bb5e-764ec1855031 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:51.777025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-44dc968b-4f64-4aaa-bb5e-764ec1855031 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2110559223" status: 202 len: 0 microversion: 2.1 time: 0.074113 Oct 29 20:47:51.778469 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 161/324] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:47:51 2022] DELETE /compute/v2.1/flavors/2110559223 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:47:51.788905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-669a272f-5c44-4a60-9ca9-83b7a045ea2d tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:51.845204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-669a272f-5c44-4a60-9ca9-83b7a045ea2d tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.062777 Oct 29 20:47:51.845931 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 162/325] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:51 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:51.892196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9eddb709-58f4-41a4-a31a-7db9f4b75c94 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1108338706", "id": 974842748, "os-flavor-access:is_public": "False"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:51.961830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9eddb709-58f4-41a4-a31a-7db9f4b75c94 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.078937 Oct 29 20:47:51.981095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 163/326] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:51.991090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bab1bbda-d300-4ad7-851c-e284569e5ddc tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:52.080840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:52.088678 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef648c31-57a2-4f47-bf28-d61a50193d3d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1319 microversion: 2.1 time: 0.830210 Oct 29 20:47:52.089258 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 164/327] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:51 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1319 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:52.101876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:52.102486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:52.120275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:52.120769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:52.121205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:52.121977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:52.126290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:52.126956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:52.450731 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bab1bbda-d300-4ad7-851c-e284569e5ddc tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/974842748/action" status: 200 len: 96 microversion: 2.1 time: 0.467709 Oct 29 20:47:52.457742 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 164/328] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:47:51 2022] POST /compute/v2.1/flavors/974842748/action => generated 96 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:52.464091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bbf951d3-bbc2-45c7-a216-4d01fc65722f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17215cdc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:52.527077 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bbf951d3-bbc2-45c7-a216-4d01fc65722f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/e2ae2504-65c3-44ac-a655-b8d2e7e4b5a6" status: 200 len: 662 microversion: 2.1 time: 0.067789 Oct 29 20:47:52.537681 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 165/329] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:47:52 2022] GET /compute/v2.1/images/e2ae2504-65c3-44ac-a655-b8d2e7e4b5a6 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:52.543936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb3073b7-84fc-446f-9b19-9e61f23776a2 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:52.548018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb3073b7-84fc-446f-9b19-9e61f23776a2 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '6a4dc371a7094272b16d55575d45e620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64b754d455a47f4bd0492d4892678e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb3073b7-84fc-446f-9b19-9e61f23776a2 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Request method failure captured: Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/flavors/974842748/action HTTP/1.1 Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 70 Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFyMd4XPEfQxol2gDzU8rxGtMhE63lZ0sdTnwKd7uzowj3ov--1KpTzI_RJ-tDTeMfYxZzDmsgvIpTeZ8hLQvAlcdEPVZy51uOBAV3C8kasNYB2cbqAy92CcP5dIS-h0mx6ijTgND5b6c5t_8qMdfeOyanl4l5vLSxvAnQmzMNs-jU Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e64b754d455a47f4bd0492d4892678e0 Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-486389101 Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:47:52.549992 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e64b754d455a47f4bd0492d4892678e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-486389101 Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e64b754d455a47f4bd0492d4892678e0 Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-486389101 Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsAccessNegativeTestJSON-486389101-project Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6a4dc371a7094272b16d55575d45e620 Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-486389101-project Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: {"removeTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} Oct 29 20:47:52.551141 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '974842748', 'body': {'removeTenantAccess': {'tenant': 'e64b754d455a47f4bd0492d4892678e0'}}} Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can( Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:47:52.551792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 20:47:52.553161 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:52.554262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb3073b7-84fc-446f-9b19-9e61f23776a2 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:52.554262 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb3073b7-84fc-446f-9b19-9e61f23776a2 tempest-FlavorsAccessNegativeTestJSON-486389101 tempest-FlavorsAccessNegativeTestJSON-486389101-project] 10.222.0.36 "POST /compute/v2.1/flavors/974842748/action" status: 403 len: 133 microversion: 2.1 time: 0.012568 Oct 29 20:47:52.555454 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 166/330] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:47:52 2022] POST /compute/v2.1/flavors/974842748/action => generated 133 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:52.560711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d96f4509-724b-4251-ac8e-7b113b1d95f1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1724e41f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:52.617911 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d96f4509-724b-4251-ac8e-7b113b1d95f1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/e2ae2504-65c3-44ac-a655-b8d2e7e4b5a6" status: 200 len: 662 microversion: 2.1 time: 0.061072 Oct 29 20:47:52.618488 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 167/331] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:47:52 2022] GET /compute/v2.1/images/e2ae2504-65c3-44ac-a655-b8d2e7e4b5a6 => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:52.629404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da21cc12-7289-47f4-bfa0-c676ced892e4 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e64b754d455a47f4bd0492d4892678e0"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:53.031931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da21cc12-7289-47f4-bfa0-c676ced892e4 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/974842748/action" status: 200 len: 21 microversion: 2.1 time: 0.410237 Oct 29 20:47:53.040160 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 168/332] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:47:52 2022] POST /compute/v2.1/flavors/974842748/action => generated 21 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:47:53.056317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:53.057079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:53.070217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:53.072288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:53.074597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:53.076765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:53.079070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:53.079981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:53.092923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:53.102658 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-632c2015-9403-4847-94f4-9707df3cc040 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 1.004536 Oct 29 20:47:53.110052 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 165/333] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:52 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:53.122268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9fb8042a-a402-4dce-9b41-31c3c3bcf55e req-963369aa-10af-42de-8cb6-35c4550cc51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:53.150313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9fb8042a-a402-4dce-9b41-31c3c3bcf55e req-963369aa-10af-42de-8cb6-35c4550cc51e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:53.151165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9fb8042a-a402-4dce-9b41-31c3c3bcf55e req-963369aa-10af-42de-8cb6-35c4550cc51e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:53.151766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9fb8042a-a402-4dce-9b41-31c3c3bcf55e req-963369aa-10af-42de-8cb6-35c4550cc51e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:53.168815 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9fb8042a-a402-4dce-9b41-31c3c3bcf55e req-963369aa-10af-42de-8cb6-35c4550cc51e service nova] Creating event network-changed:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:47:53.176872 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9fb8042a-a402-4dce-9b41-31c3c3bcf55e req-963369aa-10af-42de-8cb6-35c4550cc51e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058523 Oct 29 20:47:53.177725 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 166/334] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:53.185071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a39485e-4e7b-4a33-b81f-09a8e28b0543 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:53.235370 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a39485e-4e7b-4a33-b81f-09a8e28b0543 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/974842748" status: 202 len: 0 microversion: 2.1 time: 0.056014 Oct 29 20:47:53.236930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 167/335] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:47:53 2022] DELETE /compute/v2.1/flavors/974842748 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:47:53.252953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:53.254413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:53.271838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:53.272752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:53.274023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:53.278166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:53.278708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:53.280615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:53.322890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:53.764562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:53.777855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7bc3593c-8a25-42d3-bc5b-4a9a121ad38c tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1319 microversion: 2.1 time: 0.534483 Oct 29 20:47:53.778820 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:53 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:53.784380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6301efe9-b9e3-4acf-b918-a352a028a099 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:53.830518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:53.835215 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6301efe9-b9e3-4acf-b918-a352a028a099 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.053232 Oct 29 20:47:53.838262 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-328aef03-db7d-4217-ae06-7f8cee22b10a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.796867 Oct 29 20:47:53.850024 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 169/337] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:53 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:53.856931 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:53 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:53.859840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0ec8c2d1-1eee-4795-854a-755697c82e62 req-29605ed6-3d1f-461a-b4fb-d78f00dbea2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755a851c-4f30-45db-8efd-e02e385bd2bf", "name": "network-vif-plugged", "status": "completed", "tag": "a3b4f1b8-85fd-443d-96b6-d48f9fc9a144"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:53.873438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fcbf79d5-46c6-4a25-b436-1c8d76979cb7 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1476800568", "id": 1984364050, "os-flavor-access:is_public": "False"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:53.881333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0ec8c2d1-1eee-4795-854a-755697c82e62 req-29605ed6-3d1f-461a-b4fb-d78f00dbea2c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:53.882200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0ec8c2d1-1eee-4795-854a-755697c82e62 req-29605ed6-3d1f-461a-b4fb-d78f00dbea2c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:53.882642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0ec8c2d1-1eee-4795-854a-755697c82e62 req-29605ed6-3d1f-461a-b4fb-d78f00dbea2c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:53.897679 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0ec8c2d1-1eee-4795-854a-755697c82e62 req-29605ed6-3d1f-461a-b4fb-d78f00dbea2c service nova] Creating event network-vif-plugged:a3b4f1b8-85fd-443d-96b6-d48f9fc9a144 for instance 755a851c-4f30-45db-8efd-e02e385bd2bf on nch2-master-1 Oct 29 20:47:53.905797 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0ec8c2d1-1eee-4795-854a-755697c82e62 req-29605ed6-3d1f-461a-b4fb-d78f00dbea2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060678 Oct 29 20:47:53.906027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fcbf79d5-46c6-4a25-b436-1c8d76979cb7 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.043591 Oct 29 20:47:53.907746 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 170/339] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:53.916550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 170/340] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:53 2022] POST /compute/v2.1/flavors => generated 439 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:53.922841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9bc1f820-0f3a-4bf6-932e-9c0d47e73964 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7dd6de0672a54cc2a783cdf4a65b936c"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:54.135034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:54.135645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:54.145047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:54.145566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:54.151727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:54.153826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:54.154343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:54.154781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:54.356414 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-9bc1f820-0f3a-4bf6-932e-9c0d47e73964 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] HTTP exception thrown: Flavor access not found for 23 / 7dd6de0672a54cc2a783cdf4a65b936c combination. Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9bc1f820-0f3a-4bf6-932e-9c0d47e73964 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Request method failure captured: Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/flavors/1984364050/action HTTP/1.1 Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 70 Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFza6T5OpXU-30BmeClXMNdBtfz3a5Z6wlva3wmOHEV87jgWTbYOakVztuNLCEb-35QUBVggc2GtmkbYi817CdrNEpAGJAFdmsLfD9R4b0T0SEAVuSU064uztuPCJgN8WXPHyXjQBbbMtqysyCrm2UcdyFYJjY7jAttdhZ2yomu4Yc Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 12e0ad088d9547cc91d1859340c10cf7 Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:47:54.363440 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/12e0ad088d9547cc91d1859340c10cf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 12e0ad088d9547cc91d1859340c10cf7 Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-111792351 Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 246b0aa292d04567b214fe55853ec9fa Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: {"removeTenantAccess": {"tenant": "7dd6de0672a54cc2a783cdf4a65b936c"}} Oct 29 20:47:54.364864 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: exception: Flavor access not found for 23 / 7dd6de0672a54cc2a783cdf4a65b936c combination. Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1984364050', 'body': {'removeTenantAccess': {'tenant': '7dd6de0672a54cc2a783cdf4a65b936c'}}} Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 29 20:47:54.365574 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / 7dd6de0672a54cc2a783cdf4a65b936c combination. Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / 7dd6de0672a54cc2a783cdf4a65b936c combination. Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:54.366532 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:47:54.367579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:47:54.367579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:47:54.367579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:47:54.367579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:47:54.367579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / 7dd6de0672a54cc2a783cdf4a65b936c combination. Oct 29 20:47:54.367579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:47:54.368606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9bc1f820-0f3a-4bf6-932e-9c0d47e73964 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Returning 404 to user: Flavor access not found for 23 / 7dd6de0672a54cc2a783cdf4a65b936c combination. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:47:54.369768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9bc1f820-0f3a-4bf6-932e-9c0d47e73964 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1984364050/action" status: 404 len: 124 microversion: 2.1 time: 0.452051 Oct 29 20:47:54.371461 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 171/341] 10.222.0.36 () {60 vars in 1200 bytes} [Sat Oct 29 20:47:53 2022] POST /compute/v2.1/flavors/1984364050/action => generated 124 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:47:54.382554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74f579f2-e7b1-42e8-a4ac-4094504b3442 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:54.402231 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74f579f2-e7b1-42e8-a4ac-4094504b3442 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1984364050" status: 202 len: 0 microversion: 2.1 time: 0.026029 Oct 29 20:47:54.402803 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 172/342] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:47:54 2022] DELETE /compute/v2.1/flavors/1984364050 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:47:54.410890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ca76fb2-422c-42c6-b1f1-22f4f3b539a9 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:54.438499 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ca76fb2-422c-42c6-b1f1-22f4f3b539a9 tempest-FlavorsAccessNegativeTestJSON-111792351 tempest-FlavorsAccessNegativeTestJSON-111792351-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.031034 Oct 29 20:47:54.439277 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 173/343] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:47:54 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:54.515815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30ceb5b2-5018-4124-8b30-250a7e1d2ab1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa172030ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:54.565137 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30ceb5b2-5018-4124-8b30-250a7e1d2ab1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/003f7c57-2945-4fea-9d13-dec1db4e30cc" status: 200 len: 661 microversion: 2.1 time: 0.053532 Oct 29 20:47:54.576874 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 174/344] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:47:54 2022] GET /compute/v2.1/images/003f7c57-2945-4fea-9d13-dec1db4e30cc => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:47:54.582287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eac6005a-bff4-4c0e-9d5d-5553dba278e1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1721b7c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:54.609422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:54.622546 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f61449e-370a-49b1-a6a2-a00e7e514c65 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.491409 Oct 29 20:47:54.639221 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 171/345] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:54 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:47:54.643739 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eac6005a-bff4-4c0e-9d5d-5553dba278e1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/003f7c57-2945-4fea-9d13-dec1db4e30cc" status: 200 len: 661 microversion: 2.1 time: 0.065396 Oct 29 20:47:54.644922 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 175/346] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:47:54 2022] GET /compute/v2.1/images/003f7c57-2945-4fea-9d13-dec1db4e30cc => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:54.752691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-46e3cf06-5f04-46d7-8914-7273dc6a60b9 req-a578c463-94c4-4e9b-867b-64e4dc665d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "478e2710-ed11-4485-ac45-9cc2a0d2dbe0", "tag": "5ce528cf-59a6-435c-874a-3136ca6415b3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:54.774532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46e3cf06-5f04-46d7-8914-7273dc6a60b9 req-a578c463-94c4-4e9b-867b-64e4dc665d02 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:54.775123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46e3cf06-5f04-46d7-8914-7273dc6a60b9 req-a578c463-94c4-4e9b-867b-64e4dc665d02 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:54.776205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46e3cf06-5f04-46d7-8914-7273dc6a60b9 req-a578c463-94c4-4e9b-867b-64e4dc665d02 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:54.805687 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-46e3cf06-5f04-46d7-8914-7273dc6a60b9 req-a578c463-94c4-4e9b-867b-64e4dc665d02 service nova] Creating event network-changed:5ce528cf-59a6-435c-874a-3136ca6415b3 for instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 on nch2-master-1 Oct 29 20:47:54.812722 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-46e3cf06-5f04-46d7-8914-7273dc6a60b9 req-a578c463-94c4-4e9b-867b-64e4dc665d02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065406 Oct 29 20:47:54.813880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 176/347] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:54.820744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:54.821794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:54.829948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:54.830641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:54.831503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:54.832728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:54.833721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:54.834158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:54.993708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2079398924", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:55.071265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:55.115177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:55.127079 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dae90007-c9a1-4ce2-8d21-5b5bd5f08b36 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1319 microversion: 2.1 time: 0.311288 Oct 29 20:47:55.128531 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 177/348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:54 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:55.136923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:55.138024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:55.153339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:55.154157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:55.154641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:55.155364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:55.155987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:55.156585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:55.489687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:55.506962 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0b439e7-f356-4148-9477-1a51db14d85b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.376868 Oct 29 20:47:55.523476 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 178/349] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:55 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:55.581646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:55.582110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:55.582547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:55.582976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:55.583364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:55.604565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:55.605165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:55.605836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:55.606909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:55.608085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:55.609498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:55.629826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0574546b-d61b-4e3e-94ce-d9cdb09d5490 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Action: 'create', calling method: .version_select at 0x7fa17245b9d0>, body: {"pool": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:55.634625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=39 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:55.662883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Getting quotas for project 72fe1048bfcd4a53866483b5495f4de0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:55.674992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Getting quotas for user d056b2a4e08348ff8ccdfb149f01cdaf and project 72fe1048bfcd4a53866483b5495f4de0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:55.695244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:55.703521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:55.787992 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b9b67af1-1599-4b9e-a585-ea5b20b62f70 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083246 Oct 29 20:47:55.798097 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 172/350] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:55.803392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:55.804222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:55.812893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:55.814502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:55.815133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:55.816058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:55.818317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:55.835204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:56.413825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:56.426983 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b2bec16-3b4e-437a-be6f-829d6c1025a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.627323 Oct 29 20:47:56.441987 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 173/351] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:55 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:56.453825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8ce4270-d51f-4b6d-a6c3-278c17f0833c tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:56.454697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a8ce4270-d51f-4b6d-a6c3-278c17f0833c tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:56.631409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8ce4270-d51f-4b6d-a6c3-278c17f0833c tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:56.645291 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8ce4270-d51f-4b6d-a6c3-278c17f0833c tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1219 microversion: 2.1 time: 0.202039 Oct 29 20:47:56.646136 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 174/352] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:56 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1219 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:56.661793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:56.662287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:56.676010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:56.677442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:56.679707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:56.682675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:56.683407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:56.684140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.144838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:57.153374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-988189f5-b1a0-42af-a7d5-1d11c522d744 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1468 microversion: 2.1 time: 0.506141 Oct 29 20:47:57.159495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 175/353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:56 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1468 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:57.164697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:57.170728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:57.187870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:57.188791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:57.189200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.189963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:57.190429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:57.190865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.421988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:57.433601 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-379d842b-f25a-43e7-bc4f-075aa8789bd5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.272864 Oct 29 20:47:57.435091 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 176/354] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:57 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:57.447435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2a489d3-32db-4945-af64-cd50dc59a698 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171e52310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:57.538763 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b2a489d3-32db-4945-af64-cd50dc59a698 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/cb17e22e-aad6-4677-8d7f-88cd0f3c538f" status: 200 len: 661 microversion: 2.1 time: 0.095577 Oct 29 20:47:57.539313 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 177/355] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:47:57 2022] GET /compute/v2.1/images/cb17e22e-aad6-4677-8d7f-88cd0f3c538f => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:57.579933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:57.582586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:57.592225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:57.594433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:57.595374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.596294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:57.599163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:57.599787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.734030 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4226c16a-0bbd-441c-b8d2-dc8323cb1647 tempest-DeleteServersAdminTestJSON-2115113076 tempest-DeleteServersAdminTestJSON-2115113076-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf/action" status: 202 len: 0 microversion: 2.1 time: 0.190486 Oct 29 20:47:57.735751 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 178/356] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:47:57 2022] POST /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:47:57.753778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:57.754684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:57.764188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:57.765038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:57.765786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.766712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:57.767655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:57.768344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:57.929913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:57.991647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=5 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:58.167653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:58.187801 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4113ccb8-8369-4f9e-9ce6-ef50e77f1756 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.447826 Oct 29 20:47:58.188392 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 179/357] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:57 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:58.199363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab157f80-6642-43d0-a804-fe2b4c931838 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171e524c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:58.258238 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab157f80-6642-43d0-a804-fe2b4c931838 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/cb17e22e-aad6-4677-8d7f-88cd0f3c538f" status: 200 len: 661 microversion: 2.1 time: 0.068606 Oct 29 20:47:58.261611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 180/358] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:47:58 2022] GET /compute/v2.1/images/cb17e22e-aad6-4677-8d7f-88cd0f3c538f => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:58.267960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:58.268789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:58.279571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:58.280077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:58.280525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:58.281223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:58.281706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:58.282309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:58.477283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:58.490674 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-76745513-abc5-4de8-8041-bb0dc8f367eb tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1277 microversion: 2.1 time: 0.230276 Oct 29 20:47:58.491275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 181/359] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:58 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:58.497747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:58.499024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:58.509488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:58.511701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:58.512299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:58.513382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:58.514443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:58.515031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:58.562897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:58.564913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:58.568497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:58.569630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lazy-loading 'fault' on Instance uuid 755a851c-4f30-45db-8efd-e02e385bd2bf {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:47:59.040627 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0574546b-d61b-4e3e-94ce-d9cdb09d5490 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.514906 Oct 29 20:47:59.041027 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 179/360] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:47:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:59.057798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:59.067892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2140584090", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:47:59.068027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1639f478-36cd-4481-bd9c-7aa1f3331db6 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1451 microversion: 2.1 time: 0.574826 Oct 29 20:47:59.068808 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 182/361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:58 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1451 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:59.074115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:59.074679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:59.082076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.082772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.083369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.084795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.086929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.087533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.184535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:47:59.413094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:47:59.427695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a072f8db-37cb-4ba9-ae33-a6aff27fca78 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.357801 Oct 29 20:47:59.428278 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 183/362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:59 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:47:59.432838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2acca7f4-d848-4dc0-88c1-a5236f12df72 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Calling method '.version_select at 0x7fa171e52b80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:59.671081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:47:59.672254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:47:59.673060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:47:59.674014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:47:59.674709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:47:59.695566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.697514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.698473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.699568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.701092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.702047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.750709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Getting quotas for project c07b27294cb2456c98c092ff73c7dd66. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:47:59.765731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2acca7f4-d848-4dc0-88c1-a5236f12df72 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/bf404e71-6e8d-47c5-81e9-18a5a0cb6561" status: 200 len: 142 microversion: 2.1 time: 0.336207 Oct 29 20:47:59.766635 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 184/363] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:47:59 2022] GET /compute/v2.1/os-floating-ips/bf404e71-6e8d-47c5-81e9-18a5a0cb6561 => generated 142 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:47:59.771477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:59.772168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:59.772916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Getting quotas for user 66082eeadd4942d69d772b686aebd48f and project c07b27294cb2456c98c092ff73c7dd66. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:47:59.779271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:59.781143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.782292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.782877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.783826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.784423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.784995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.818162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:47:59.820631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:47:59.848282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:47:59.928140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b61bda4f-7401-4203-9fa0-4961beb203dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885549 Oct 29 20:47:59.932260 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 180/364] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:47:59.944308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:47:59.946383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:47:59.954061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:DELETE=14 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:47:59.962201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.963359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.964500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.983206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:47:59.984523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:47:59.986824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:47:59.997407 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da98b909-6909-4018-a3b3-3caf85df6d4f tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "DELETE /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 204 len: 0 microversion: 2.1 time: 0.229344 Oct 29 20:48:00.001674 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 185/365] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:47:59 2022] DELETE /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:48:00.013733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:00.014473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:00.025048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.027791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.030353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.032670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.033155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.033627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.309569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:00.324371 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1286eb8f-11e1-41fd-bf06-f6092a87b46a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.390625 Oct 29 20:48:00.326692 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 181/366] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:47:59 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:00.335879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c55a77c3-bebd-4d16-afd4-be0968221670 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Calling method '.version_select at 0x7fa171ffa700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:00.493773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:00.505300 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbf3ac78-9dcc-4d57-854d-2934998886af tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1319 microversion: 2.1 time: 0.502319 Oct 29 20:48:00.506279 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 186/367] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:00 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:00.527709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:00.528830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:00.535487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.536055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.536645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.537592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.538257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.539219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.588496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.590041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.592247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.592796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lazy-loading 'fault' on Instance uuid 755a851c-4f30-45db-8efd-e02e385bd2bf {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:00.752912 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c55a77c3-bebd-4d16-afd4-be0968221670 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.425108 Oct 29 20:48:00.753691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 182/368] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:48:00 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:00.767129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1fd69bf0-f968-4777-ad88-6258bea1ce9d req-41237699-e791-4e68-beaf-f7b7395cd548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f5fbc1-cc84-4c77-8170-cb755717648c", "tag": "9f17c0af-1664-4c1f-808e-3418b927e975"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:00.782342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1fd69bf0-f968-4777-ad88-6258bea1ce9d req-41237699-e791-4e68-beaf-f7b7395cd548 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.783847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1fd69bf0-f968-4777-ad88-6258bea1ce9d req-41237699-e791-4e68-beaf-f7b7395cd548 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.784436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1fd69bf0-f968-4777-ad88-6258bea1ce9d req-41237699-e791-4e68-beaf-f7b7395cd548 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.800579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:00.812805 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bb0bbaf5-173d-4cd5-beda-23659fc78ffc tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1457 microversion: 2.1 time: 0.293066 Oct 29 20:48:00.814267 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 187/369] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:00 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1457 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:00.815971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1fd69bf0-f968-4777-ad88-6258bea1ce9d req-41237699-e791-4e68-beaf-f7b7395cd548 service nova] Creating event network-changed:9f17c0af-1664-4c1f-808e-3418b927e975 for instance e5f5fbc1-cc84-4c77-8170-cb755717648c on nch1-master-1 Oct 29 20:48:00.822320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1981867016", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:00.822979 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1fd69bf0-f968-4777-ad88-6258bea1ce9d req-41237699-e791-4e68-beaf-f7b7395cd548 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067976 Oct 29 20:48:00.826191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 183/370] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:00.843916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:00.844519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:00.854605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.855151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.855791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.862482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:00.863198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:00.863796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:00.900960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:48:01.095433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:01.103102 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-56215c58-7ea2-40b5-b468-e1511025a068 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.273649 Oct 29 20:48:01.103669 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 184/371] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:00 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:01.108726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74dcd5c1-c700-45e1-a64d-9843536532a0 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Calling method '.version_select at 0x7fa171ffaca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:01.207280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:48:01.208044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:48:01.208654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:48:01.209313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:48:01.209870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:48:01.219940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:01.220502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:01.221012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:01.222002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:01.222528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:01.223074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:01.230421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:01.244313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Getting quotas for project c07b27294cb2456c98c092ff73c7dd66. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:01.249122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Getting quotas for user 66082eeadd4942d69d772b686aebd48f and project c07b27294cb2456c98c092ff73c7dd66. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:01.261233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:48:01.264096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:48:01.312834 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6be0bad9-f4c2-44aa-a293-489efc54ff46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496770 Oct 29 20:48:01.313513 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 188/372] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:48:01.583425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb2527e6-7081-4c42-99fd-aa080cf9c238 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1934984446", "id": 1334633260, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:01.616385 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb2527e6-7081-4c42-99fd-aa080cf9c238 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.301546 Oct 29 20:48:01.617208 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 189/373] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:48:01 2022] POST /compute/v2.1/flavors => generated 449 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:01.622317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e8afdb89-d209-4349-bef5-d103f7b69c85 req-a0907473-ef21-4c01-9fdd-fc173e2dbbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "name": "network-vif-plugged", "status": "completed", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:01.634616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e8afdb89-d209-4349-bef5-d103f7b69c85 req-a0907473-ef21-4c01-9fdd-fc173e2dbbb1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:01.635172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e8afdb89-d209-4349-bef5-d103f7b69c85 req-a0907473-ef21-4c01-9fdd-fc173e2dbbb1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:01.635828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e8afdb89-d209-4349-bef5-d103f7b69c85 req-a0907473-ef21-4c01-9fdd-fc173e2dbbb1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:01.648374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e8afdb89-d209-4349-bef5-d103f7b69c85 req-a0907473-ef21-4c01-9fdd-fc173e2dbbb1 service nova] Creating event network-vif-plugged:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:48:01.653376 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e8afdb89-d209-4349-bef5-d103f7b69c85 req-a0907473-ef21-4c01-9fdd-fc173e2dbbb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Oct 29 20:48:01.654066 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 190/374] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:01.659176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2140151-9577-4192-8709-16cc32d18459 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:01.659876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2140151-9577-4192-8709-16cc32d18459 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:01.778867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2140151-9577-4192-8709-16cc32d18459 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:01.787643 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2140151-9577-4192-8709-16cc32d18459 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1218 microversion: 2.1 time: 0.132208 Oct 29 20:48:01.801032 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 191/375] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:01 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:01.806077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:01.806756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:01.814509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:01.815015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:01.815462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:01.816377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:01.816851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:01.817274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.297800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:02.306269 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-260ad912-3974-49ff-a76c-61b1665f9ae1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.516932 Oct 29 20:48:02.306842 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 192/376] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:01 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:02.325228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:02.325873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:02.331817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.332307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.332746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.333442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.333923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.334349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.601277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:02.610279 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-351aced0-0042-4e78-afd3-94a633807879 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1319 microversion: 2.1 time: 0.302351 Oct 29 20:48:02.610960 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 193/377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:02 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:02.751112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-260ea1b9-eaca-49de-ad44-9b01786f8d1f tempest-FlavorsV255TestJSON-648466120 tempest-FlavorsV255TestJSON-648466120-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:02.759395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-260ea1b9-eaca-49de-ad44-9b01786f8d1f tempest-FlavorsV255TestJSON-648466120 tempest-FlavorsV255TestJSON-648466120-project] 10.222.0.36 "GET /compute/v2.1/flavors/1334633260" status: 200 len: 449 microversion: 2.55 time: 0.147316 Oct 29 20:48:02.769096 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 194/378] 10.222.0.36 () {60 vars in 1199 bytes} [Sat Oct 29 20:48:02 2022] GET /compute/v2.1/flavors/1334633260 => generated 449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:02.774141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:02.774761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:02.782649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.783149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.783610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.784317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.784767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.785267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.827276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.828137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.828723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.829481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lazy-loading 'fault' on Instance uuid 755a851c-4f30-45db-8efd-e02e385bd2bf {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:02.841946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74dcd5c1-c700-45e1-a64d-9843536532a0 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/bf404e71-6e8d-47c5-81e9-18a5a0cb6561" status: 202 len: 0 microversion: 2.1 time: 1.735976 Oct 29 20:48:02.843072 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 185/379] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:48:01 2022] DELETE /compute/v2.1/os-floating-ips/bf404e71-6e8d-47c5-81e9-18a5a0cb6561 => generated 0 bytes in 1739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:48:02.848408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:02.849155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:02.857357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.858814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.859322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.860281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.861251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.861783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.878083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7597be5274ff469b9eec43728cad006a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d839b1a840346baa1f65e6000ea277b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:02.890765 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f936986e-0be1-4360-ab3b-089ee0f3f232 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 200 len: 1415 microversion: 2.1 time: 0.120405 Oct 29 20:48:02.905480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 195/380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:02 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 1415 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:02.912333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-848be809-32f1-4de8-a19c-20d88a6a7ff4 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] Action: 'update', calling method: .version_select at 0x7fa1737a3dc0>, body: {"flavor": {"description": "new"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:02.957411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-848be809-32f1-4de8-a19c-20d88a6a7ff4 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1334633260" status: 200 len: 450 microversion: 2.55 time: 0.056687 Oct 29 20:48:02.958918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 196/381] 10.222.0.36 () {62 vars in 1219 bytes} [Sat Oct 29 20:48:02 2022] PUT /compute/v2.1/flavors/1334633260 => generated 450 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:02.965679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:02.967358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:02.973875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.974758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.975379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:02.976501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:02.976947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:02.977556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.061446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:03.067123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:03.078339 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9152241a-5b2c-4675-a149-c3028376194d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.233857 Oct 29 20:48:03.078501 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2463c8d-fc3d-428d-b2b0-1ab8b1d6e6bc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1222 microversion: 2.1 time: 0.118528 Oct 29 20:48:03.079582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 197/382] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:02 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:03.084416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-03e046d7-811d-4689-bf75-01692eb06126 req-2e799a68-c4e9-4a7c-bc66-d53865ca94d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755a851c-4f30-45db-8efd-e02e385bd2bf", "name": "network-vif-deleted", "tag": "a3b4f1b8-85fd-443d-96b6-d48f9fc9a144"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:03.099307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 186/383] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:02 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:03.115201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-03e046d7-811d-4689-bf75-01692eb06126 req-2e799a68-c4e9-4a7c-bc66-d53865ca94d8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.119380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d871205e-7287-4f58-80d4-ab2ef0059b1b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Action: 'create', calling method: .version_select at 0x7fa1720b6310>, body: {"pool": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:03.120026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-03e046d7-811d-4689-bf75-01692eb06126 req-2e799a68-c4e9-4a7c-bc66-d53865ca94d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.120705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-03e046d7-811d-4689-bf75-01692eb06126 req-2e799a68-c4e9-4a7c-bc66-d53865ca94d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.134969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-03e046d7-811d-4689-bf75-01692eb06126 req-2e799a68-c4e9-4a7c-bc66-d53865ca94d8 service nova] Creating event network-vif-deleted:a3b4f1b8-85fd-443d-96b6-d48f9fc9a144 for instance 755a851c-4f30-45db-8efd-e02e385bd2bf on nch2-master-1 Oct 29 20:48:03.140873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-03e046d7-811d-4689-bf75-01692eb06126 req-2e799a68-c4e9-4a7c-bc66-d53865ca94d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059764 Oct 29 20:48:03.141912 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 198/384] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:03.146955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-691087d5-a2ae-4399-a827-ed6b8cb7135e tempest-FlavorsV255TestJSON-648466120 tempest-FlavorsV255TestJSON-648466120-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.188348 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-691087d5-a2ae-4399-a827-ed6b8cb7135e tempest-FlavorsV255TestJSON-648466120 tempest-FlavorsV255TestJSON-648466120-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.044857 Oct 29 20:48:03.189230 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 199/385] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 20:48:03 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:48:03.220403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8cc64376-fb18-42bc-ad3a-4fced46dc582 tempest-FlavorsV255TestJSON-648466120 tempest-FlavorsV255TestJSON-648466120-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.254266 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8cc64376-fb18-42bc-ad3a-4fced46dc582 tempest-FlavorsV255TestJSON-648466120 tempest-FlavorsV255TestJSON-648466120-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.039119 Oct 29 20:48:03.254862 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 200/386] 10.222.0.36 () {60 vars in 1166 bytes} [Sat Oct 29 20:48:03 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:48:03.272967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26004c81-28ed-47d4-9cd5-3f45b3d67959 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.296234 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26004c81-28ed-47d4-9cd5-3f45b3d67959 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1334633260" status: 202 len: 0 microversion: 2.55 time: 0.028136 Oct 29 20:48:03.301569 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 201/387] 10.222.0.36 () {60 vars in 1202 bytes} [Sat Oct 29 20:48:03 2022] DELETE /compute/v2.1/flavors/1334633260 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 29 20:48:03.306973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f390d935-f880-4091-b69d-c1250c0850b7 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.331394 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f390d935-f880-4091-b69d-c1250c0850b7 tempest-FlavorsV255TestJSON-1710211726 tempest-FlavorsV255TestJSON-1710211726-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.028527 Oct 29 20:48:03.331989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 202/388] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 20:48:03 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:48:03.354449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.355197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:03.362079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.362861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.363473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.364272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.364790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.365417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.602081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:03.611913 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a27829c2-1133-48bf-87cd-fb12c5680cba tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.268708 Oct 29 20:48:03.612824 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 203/389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:03 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:03.634254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.634864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:03.641297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.641927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.642240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.643257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.643714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.644138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.900306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:03.907972 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15872b2a-3c4e-4331-83c8-4a9578f3b0c5 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1319 microversion: 2.1 time: 0.277929 Oct 29 20:48:03.921672 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 204/390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:03 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:03.921672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7def8580-94d1-4d7a-a92b-499b82ca004b req-f82d96ce-8429-4c40-9a0b-93028f0e8e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478e2710-ed11-4485-ac45-9cc2a0d2dbe0", "name": "network-vif-plugged", "status": "completed", "tag": "5ce528cf-59a6-435c-874a-3136ca6415b3"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:03.923887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7def8580-94d1-4d7a-a92b-499b82ca004b req-f82d96ce-8429-4c40-9a0b-93028f0e8e45 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.924559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7def8580-94d1-4d7a-a92b-499b82ca004b req-f82d96ce-8429-4c40-9a0b-93028f0e8e45 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.925136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7def8580-94d1-4d7a-a92b-499b82ca004b req-f82d96ce-8429-4c40-9a0b-93028f0e8e45 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.941584 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7def8580-94d1-4d7a-a92b-499b82ca004b req-f82d96ce-8429-4c40-9a0b-93028f0e8e45 service nova] Creating event network-vif-plugged:5ce528cf-59a6-435c-874a-3136ca6415b3 for instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 on nch2-master-1 Oct 29 20:48:03.947072 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7def8580-94d1-4d7a-a92b-499b82ca004b req-f82d96ce-8429-4c40-9a0b-93028f0e8e45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037317 Oct 29 20:48:03.947762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 205/391] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:03.954171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.954872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:03.960983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.961562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.962248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.962746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.963374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:03.963789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:03.977975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] HTTP exception thrown: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Request method failure captured: Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf HTTP/1.1 Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD3qkD9frCHSyavdw5L-iROTDpyWunA3XPelUKne0NsPjb4XxOVa5gG1p5SuKqR4e2y3zCb35kyvdurGNNPLtZCvMoizWtoTjlX4xhBDp_zCBWkdleg04gTSNDWvWz2NmvvGh6NUBHCCRBRQk9NdhcOsEbtqenm79Ny11UaSIAmcc Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:03.979839 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7597be5274ff469b9eec43728cad006a Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:03.981071 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '755a851c-4f30-45db-8efd-e02e385bd2bf'} Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:03.981804 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:03.982928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:03.983968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Returning 404 to user: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:03.983968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-663dc98e-d517-4c37-b77a-8cb5c2779293 tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 404 len: 111 microversion: 2.1 time: 0.032167 Oct 29 20:48:03.983968 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 206/392] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:03 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:03.992031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:03.992541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:03.999091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:03.999588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.000032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.000753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.001208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.001910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.020677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] HTTP exception thrown: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Request method failure captured: Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf HTTP/1.1 Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD3qkD9frCHSyavdw5L-iROTDpyWunA3XPelUKne0NsPjb4XxOVa5gG1p5SuKqR4e2y3zCb35kyvdurGNNPLtZCvMoizWtoTjlX4xhBDp_zCBWkdleg04gTSNDWvWz2NmvvGh6NUBHCCRBRQk9NdhcOsEbtqenm79Ny11UaSIAmcc Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:04.022342 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7597be5274ff469b9eec43728cad006a Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.023572 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '755a851c-4f30-45db-8efd-e02e385bd2bf'} Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:04.024279 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.028372 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.029601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Returning 404 to user: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:04.029601 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ac30009-acf5-4b70-bf4a-f7260435735d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "DELETE /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 404 len: 111 microversion: 2.1 time: 0.036610 Oct 29 20:48:04.029601 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 207/393] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:48:03 2022] DELETE /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:04.032836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:04.033443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 755a851c-4f30-45db-8efd-e02e385bd2bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:04.039522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.040017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.040448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.041164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.041640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.042466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.056289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] HTTP exception thrown: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Request method failure captured: Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf HTTP/1.1 Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD3qkD9frCHSyavdw5L-iROTDpyWunA3XPelUKne0NsPjb4XxOVa5gG1p5SuKqR4e2y3zCb35kyvdurGNNPLtZCvMoizWtoTjlX4xhBDp_zCBWkdleg04gTSNDWvWz2NmvvGh6NUBHCCRBRQk9NdhcOsEbtqenm79Ny11UaSIAmcc Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:04.057891 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7597be5274ff469b9eec43728cad006a Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.059400 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '755a851c-4f30-45db-8efd-e02e385bd2bf'} Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:04.060739 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. Oct 29 20:48:04.062071 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.063034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Returning 404 to user: Instance 755a851c-4f30-45db-8efd-e02e385bd2bf could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:04.063034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21e3c1f3-470d-4f20-8478-f7acfd51da2e tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf" status: 404 len: 111 microversion: 2.1 time: 0.030412 Oct 29 20:48:04.063034 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 208/394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:04 2022] GET /compute/v2.1/servers/755a851c-4f30-45db-8efd-e02e385bd2bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:04.068363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:04.068853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:04.075247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.076361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.076799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.077520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.077976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.078401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.092689 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] HTTP exception thrown: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Request method failure captured: Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c HTTP/1.1 Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD3qkD9frCHSyavdw5L-iROTDpyWunA3XPelUKne0NsPjb4XxOVa5gG1p5SuKqR4e2y3zCb35kyvdurGNNPLtZCvMoizWtoTjlX4xhBDp_zCBWkdleg04gTSNDWvWz2NmvvGh6NUBHCCRBRQk9NdhcOsEbtqenm79Ny11UaSIAmcc Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:04.094245 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7597be5274ff469b9eec43728cad006a Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.095464 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6fd41c42-c3e8-4772-a06f-edbb7a2e709c'} Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:04.096130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.097221 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.098408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Returning 404 to user: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:04.098408 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3d254f2-f0c1-45d2-b2be-a94fc14b299d tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 404 len: 111 microversion: 2.1 time: 0.030866 Oct 29 20:48:04.098408 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 209/395] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:48:04 2022] DELETE /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:04.103613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:04.104221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] [instance: 6fd41c42-c3e8-4772-a06f-edbb7a2e709c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:04.110947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.111457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.111899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.112601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.113057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.113511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.129302 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] HTTP exception thrown: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Request method failure captured: Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c HTTP/1.1 Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFD3qkD9frCHSyavdw5L-iROTDpyWunA3XPelUKne0NsPjb4XxOVa5gG1p5SuKqR4e2y3zCb35kyvdurGNNPLtZCvMoizWtoTjlX4xhBDp_zCBWkdleg04gTSNDWvWz2NmvvGh6NUBHCCRBRQk9NdhcOsEbtqenm79Ny11UaSIAmcc Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:04.130885 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d839b1a840346baa1f65e6000ea277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d839b1a840346baa1f65e6000ea277b Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-412246735 Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7597be5274ff469b9eec43728cad006a Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersAdminTestJSON-412246735-project Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.132117 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6fd41c42-c3e8-4772-a06f-edbb7a2e709c'} Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:04.132780 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. Oct 29 20:48:04.134925 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:04.136360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] Returning 404 to user: Instance 6fd41c42-c3e8-4772-a06f-edbb7a2e709c could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:04.136360 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-46104a6a-3a4b-488f-b1f6-7ef19911bd8b tempest-DeleteServersAdminTestJSON-412246735 tempest-DeleteServersAdminTestJSON-412246735-project] 10.222.0.36 "GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c" status: 404 len: 111 microversion: 2.1 time: 0.032208 Oct 29 20:48:04.136360 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 210/396] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:04 2022] GET /compute/v2.1/servers/6fd41c42-c3e8-4772-a06f-edbb7a2e709c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:48:04.140243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:04.140545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:04.147578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.147737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.148288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.149701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.149701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.150280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.396450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:04.405749 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7ecc03f5-88d8-4638-96e1-664b1bd1928c tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.271513 Oct 29 20:48:04.406630 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 211/397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:04 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:04.411469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:04.412155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:04.427271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.428186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.428702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.429544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.430001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.430420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.541613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:04.557365 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c72d1ad4-4792-4858-87d0-9c1fd5b3e1d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1214 microversion: 2.1 time: 0.149394 Oct 29 20:48:04.558884 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 212/398] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:04 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:04.636170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:04.637093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:04.649493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.649493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.649776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:04.650392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:04.651222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:04.651822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:05.021157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:05.034982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-602d0775-5782-473b-a533-306dca311ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.399634 Oct 29 20:48:05.037418 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 213/399] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:04 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:05.070517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:05.074513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:05.093242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:05.098959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:05.099702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:05.102486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:05.104771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:05.105331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:05.130246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d871205e-7287-4f58-80d4-ab2ef0059b1b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.029407 Oct 29 20:48:05.130978 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 187/400] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:48:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:05.145178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bcbddb8-d620-438b-a894-1934657abffc tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Calling method '.version_select at 0x7fa17204daf0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:05.820592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:05.829177 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb8d3524-df24-4022-95b2-452906edc061 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1319 microversion: 2.1 time: 0.789688 Oct 29 20:48:05.836042 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 214/401] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:05 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1319 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:05.842187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:05.843058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:05.860320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:05.860824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:05.862181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:05.863278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:05.863864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:05.864425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:06.253737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:06.270476 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-80c0f821-08dc-4958-b0c3-140d6a3f2671 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1313 microversion: 2.1 time: 0.424471 Oct 29 20:48:06.271712 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 215/402] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:05 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:06.276669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:06.277482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:06.282233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:06.285626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:06.286118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:06.286567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:06.287255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:06.297600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:06.298234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:06.438011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:06.462871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bbec920b-5269-499c-bf66-9b41d8f376aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1276 microversion: 2.1 time: 0.189705 Oct 29 20:48:06.473678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 216/403] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:06 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:06.473678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:06.473678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:06.492917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:06.493624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:06.494171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:06.495351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:06.496612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:06.497855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:06.893706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:06.902504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d70b0d6-2bbd-47f6-b4cb-0fa2262bcf9e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1476 microversion: 2.1 time: 0.433396 Oct 29 20:48:06.903081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 217/404] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:06 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:06.915426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:06.918483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:06.942894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:06.943492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:06.943948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:06.966053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:06.969709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:06.970259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:07.017718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:07.223283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bcbddb8-d620-438b-a894-1934657abffc tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae" status: 202 len: 0 microversion: 2.1 time: 2.082960 Oct 29 20:48:07.226624 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 188/405] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:48:05 2022] DELETE /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae => generated 0 bytes in 2087 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:48:07.233645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3e4eb824-eacb-4703-a09f-7c45242db33d req-9a22d3c3-472a-4879-aa55-586fa4bec4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f5fbc1-cc84-4c77-8170-cb755717648c", "name": "network-vif-plugged", "status": "completed", "tag": "9f17c0af-1664-4c1f-808e-3418b927e975"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:07.256304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3e4eb824-eacb-4703-a09f-7c45242db33d req-9a22d3c3-472a-4879-aa55-586fa4bec4f9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:07.257855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3e4eb824-eacb-4703-a09f-7c45242db33d req-9a22d3c3-472a-4879-aa55-586fa4bec4f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:07.258327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3e4eb824-eacb-4703-a09f-7c45242db33d req-9a22d3c3-472a-4879-aa55-586fa4bec4f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:07.285368 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3e4eb824-eacb-4703-a09f-7c45242db33d req-9a22d3c3-472a-4879-aa55-586fa4bec4f9 service nova] Creating event network-vif-plugged:9f17c0af-1664-4c1f-808e-3418b927e975 for instance e5f5fbc1-cc84-4c77-8170-cb755717648c on nch1-master-1 Oct 29 20:48:07.293910 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3e4eb824-eacb-4703-a09f-7c45242db33d req-9a22d3c3-472a-4879-aa55-586fa4bec4f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065217 Oct 29 20:48:07.305427 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 189/406] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:07.316995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-455952a5-82fe-4cf2-a9c6-4a155778bb5b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Calling method '.version_select at 0x7fa171ffa3a0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:07.491503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-455952a5-82fe-4cf2-a9c6-4a155778bb5b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0581fbfe-da61-4440-b214-e014759120ae could not be found", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:48:07.493514 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-455952a5-82fe-4cf2-a9c6-4a155778bb5b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] HTTP exception thrown: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-455952a5-82fe-4cf2-a9c6-4a155778bb5b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Request method failure captured: Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae HTTP/1.1 Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZF6BJwc_yx1_ct8xZt6P22coceNftijUFr4Ss6D5INEHb7tQITgEg6_Ow_OWh3gQypLrii0VxvJecpz71JXhwAzJNK1UyK7tmhaR-bwQyBUg6O6p-_hWMNttSHFY3hryjKV4WxTyaRYAvLFu7_5VjCwq6XRYiWqA_qtDmIlobEN6LQ Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 96d4b58156054be5a7053574acdb8f66 Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsTestJSON-1046067905 Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:07.513138 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96d4b58156054be5a7053574acdb8f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_96d4b58156054be5a7053574acdb8f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96d4b58156054be5a7053574acdb8f66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/96d4b58156054be5a7053574acdb8f66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsTestJSON-1046067905 Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 96d4b58156054be5a7053574acdb8f66 Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1046067905 Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsTestJSON-1046067905-project Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6b063ce8ef664a3d96e2d411ac970a49 Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsTestJSON-1046067905-project Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: exception: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '0581fbfe-da61-4440-b214-e014759120ae'} Oct 29 20:48:07.514435 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:48:07.515164 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0581fbfe-da61-4440-b214-e014759120ae could not be found Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5d61f0b-e7a1-4c1d-94de-1b90a5b51861'] Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae. Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:07.516175 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:07.517273 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:07.520356 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:07.520356 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:07.520356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-455952a5-82fe-4cf2-a9c6-4a155778bb5b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Returning 404 to user: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:07.520356 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-455952a5-82fe-4cf2-a9c6-4a155778bb5b tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae" status: 404 len: 111 microversion: 2.1 time: 0.208222 Oct 29 20:48:07.520356 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 190/407] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:48:07 2022] GET /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:07.537387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:07.542568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:07.567829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:07.568348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:07.568835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:07.572756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:07.573232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:07.573725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:07.592020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:07.600956 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a1f3183-99ef-4124-a3e7-1cc10b0966d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1319 microversion: 2.1 time: 0.694547 Oct 29 20:48:07.607970 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 218/408] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:06 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:07.613428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:07.622446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:07.636942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:07.638127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:07.638929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:07.640026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:07.640763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:07.641365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.025572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:08.041366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11fa67b9-cd5e-4d65-8418-1f166dfbe7d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1462 microversion: 2.1 time: 0.523741 Oct 29 20:48:08.043870 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 191/409] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:07 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1462 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:08.052756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eae4c17d-4a5d-4dad-9807-c3983b4620e4 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Calling method '.version_select at 0x7fa171fa3c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:08.105103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:08.113110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-215a2f18-1e1c-4cf9-90ce-e36fa7fa953f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.504007 Oct 29 20:48:08.114636 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 219/410] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:07 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:08.119590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:08.120361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:08.126838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:08.127386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:08.127990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.128884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:08.129502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:08.130093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.154358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-eae4c17d-4a5d-4dad-9807-c3983b4620e4 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0581fbfe-da61-4440-b214-e014759120ae could not be found", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:48:08.155261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-eae4c17d-4a5d-4dad-9807-c3983b4620e4 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] HTTP exception thrown: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eae4c17d-4a5d-4dad-9807-c3983b4620e4 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Request method failure captured: Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae HTTP/1.1 Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZF6BJwc_yx1_ct8xZt6P22coceNftijUFr4Ss6D5INEHb7tQITgEg6_Ow_OWh3gQypLrii0VxvJecpz71JXhwAzJNK1UyK7tmhaR-bwQyBUg6O6p-_hWMNttSHFY3hryjKV4WxTyaRYAvLFu7_5VjCwq6XRYiWqA_qtDmIlobEN6LQ Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 96d4b58156054be5a7053574acdb8f66 Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsTestJSON-1046067905 Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:08.157819 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96d4b58156054be5a7053574acdb8f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_96d4b58156054be5a7053574acdb8f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96d4b58156054be5a7053574acdb8f66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/96d4b58156054be5a7053574acdb8f66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsTestJSON-1046067905 Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 96d4b58156054be5a7053574acdb8f66 Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1046067905 Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsTestJSON-1046067905-project Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6b063ce8ef664a3d96e2d411ac970a49 Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsTestJSON-1046067905-project Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: exception: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '0581fbfe-da61-4440-b214-e014759120ae'} Oct 29 20:48:08.159320 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:48:08.160243 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0581fbfe-da61-4440-b214-e014759120ae could not be found Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e37fa3ba-45ef-44f1-ae78-f2ed664c1021'] Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae. Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:08.161566 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:08.162875 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:08.164272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae Oct 29 20:48:08.164272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:08.165348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eae4c17d-4a5d-4dad-9807-c3983b4620e4 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] Returning 404 to user: Floating IP not found for ID 0581fbfe-da61-4440-b214-e014759120ae {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:08.168832 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eae4c17d-4a5d-4dad-9807-c3983b4620e4 tempest-FloatingIPsTestJSON-1046067905 tempest-FloatingIPsTestJSON-1046067905-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae" status: 404 len: 111 microversion: 2.1 time: 0.122668 Oct 29 20:48:08.169484 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 192/411] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:48:08 2022] DELETE /compute/v2.1/os-floating-ips/0581fbfe-da61-4440-b214-e014759120ae => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:08.175314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:08.176283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:08.185383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:08.186497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:08.187416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.188323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:08.189070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:08.189740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.413141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:08.426991 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-596c891b-a615-499d-a03d-d3e33ee33f6a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1475 microversion: 2.1 time: 0.310880 Oct 29 20:48:08.427879 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 220/412] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:08 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:08.459717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:08.472306 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a608aa46-394b-4757-91db-b952c83de5cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1463 microversion: 2.1 time: 0.301541 Oct 29 20:48:08.473283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 193/413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:08 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:08.692799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3fe6487-75c6-46b3-bc86-09afdf851c0b tempest-InstanceUsageAuditLogTestJSON-1581110951 tempest-InstanceUsageAuditLogTestJSON-1581110951-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:08.741872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9fe475ec-60fd-4abb-8631-d0cc6246d5b3 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1388534858", "id": 977683198, "os-flavor-access:is_public": "False"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:08.757574 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3fe6487-75c6-46b3-bc86-09afdf851c0b tempest-InstanceUsageAuditLogTestJSON-1581110951 tempest-InstanceUsageAuditLogTestJSON-1581110951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 20:48:08" status: 200 len: 318 microversion: 2.1 time: 0.325622 Oct 29 20:48:08.761070 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 221/414] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 20:48:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2020%3A48%3A08 => generated 318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:08.771805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:08.772773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:08.796893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:08.798065 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9fe475ec-60fd-4abb-8631-d0cc6246d5b3 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.322283 Oct 29 20:48:08.798430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:08.799540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 194/415] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:08 2022] POST /compute/v2.1/flavors => generated 428 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:08.800023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.802106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:08.804225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:08.806530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:08.814259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-01da4830-f327-4111-b81e-d589d4af7910 tempest-InstanceUsageAuditLogTestJSON-1581110951 tempest-InstanceUsageAuditLogTestJSON-1581110951-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:08.839254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-01da4830-f327-4111-b81e-d589d4af7910 tempest-InstanceUsageAuditLogTestJSON-1581110951 tempest-InstanceUsageAuditLogTestJSON-1581110951-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.037107 Oct 29 20:48:08.840360 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 195/416] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 20:48:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:08.846574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1442675397", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4f981c21-556b-40cc-8edf-87f69b2e4e4e"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:08.923674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:48:09.236255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:09.265003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8361511d-aa59-4f3c-87a2-f1186cea6f88 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1319 microversion: 2.1 time: 0.491281 Oct 29 20:48:09.267074 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 222/417] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:08 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:09.277381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2687d5a8-7156-493a-85b9-3443723ded32 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0cae4f19db8b4ab19178b71319346862"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:09.385110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:48:09.385561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:48:09.386336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:48:09.387050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:48:09.387634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:48:09.407851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:09.414913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:09.417229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:09.419911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:09.422458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:09.423338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:09.469840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Getting quotas for project 4fd6966959864b80b945ae69a275ca8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:09.478949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Getting quotas for user 027a78fcee5a4f44b47fc5e187f6da67 and project 4fd6966959864b80b945ae69a275ca8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:09.494396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:48:09.497760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:48:09.595383 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78d2bfcd-d4fd-4ef3-940b-00ad15454b4a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753311 Oct 29 20:48:09.606309 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 196/418] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:48:09.612535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:09.613448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:09.620772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:09.621648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:09.622376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:09.623361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:09.624135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:09.624555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2687d5a8-7156-493a-85b9-3443723ded32 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/977683198/action" status: 200 len: 96 microversion: 2.1 time: 0.355101 Oct 29 20:48:09.625006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:09.630233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 223/419] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:48:09 2022] POST /compute/v2.1/flavors/977683198/action => generated 96 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:09.639713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:09.641961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:09.650237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:09.650989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:09.651749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:09.653060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:09.654397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:09.655573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.446704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:10.451134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:10.459102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c8e9aaef-ea6d-46e3-9a51-84e67aa3f9ff tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1475 microversion: 2.1 time: 0.825952 Oct 29 20:48:10.465236 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 224/420] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:09 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1475 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:10.479126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f786a-34b7-419d-be98-f44b35f17174", "name": "network-vif-unplugged", "status": "completed", "tag": "035ee969-a0e8-4370-8a01-bc9cc68cc5c8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:10.480859 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c83dddb-c42d-4fa6-84e5-57c718a052fb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.872844 Oct 29 20:48:10.483642 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 197/421] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:09 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:10.492044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:10.492918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:10.493570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.494015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:10.495233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:10.509488 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] Creating event network-vif-unplugged:035ee969-a0e8-4370-8a01-bc9cc68cc5c8 for instance b39f786a-34b7-419d-be98-f44b35f17174 on nch1-master-1 Oct 29 20:48:10.518139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:10.518979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:10.519643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.520519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:10.521147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:10.521781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.546618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] Instance b39f786a-34b7-419d-be98-f44b35f17174 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:48:10.573766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2c3136d8-f431-4413-926c-8cd3521dafee req-6b59e1da-d96c-4d51-8049-5b13b3df3c1a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106899 Oct 29 20:48:10.574913 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 225/422] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:10.740142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:10.751945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adac73f2-96f8-4a5a-b2c9-49dd7e0ff009 tempest-FlavorsAccessTestJSON-2066010291 tempest-FlavorsAccessTestJSON-2066010291-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:10.764360 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6c58b8a-f10e-4177-af66-10e689d0c372 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1266 microversion: 2.1 time: 0.279288 Oct 29 20:48:10.770840 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 198/423] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:10 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:10.790471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7fd307c9-1e1a-4251-90ec-53c3e286e55f req-a1fc38ae-77c6-4782-a7cf-b8151b572251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f23b76-3ea1-4e7b-b365-250a3e9cb2e5", "tag": "4b48e5f0-230f-4540-9f4c-7268b1f36419"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:10.805625 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-adac73f2-96f8-4a5a-b2c9-49dd7e0ff009 tempest-FlavorsAccessTestJSON-2066010291 tempest-FlavorsAccessTestJSON-2066010291-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.229082 Oct 29 20:48:10.806234 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 226/424] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:10 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:10.810897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:10.811628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:10.827670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:10.828164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:10.828829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7fd307c9-1e1a-4251-90ec-53c3e286e55f req-a1fc38ae-77c6-4782-a7cf-b8151b572251 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:10.831769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7fd307c9-1e1a-4251-90ec-53c3e286e55f req-a1fc38ae-77c6-4782-a7cf-b8151b572251 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:10.832520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7fd307c9-1e1a-4251-90ec-53c3e286e55f req-a1fc38ae-77c6-4782-a7cf-b8151b572251 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.835583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.836444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:10.836931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:10.837370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:10.882674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7fd307c9-1e1a-4251-90ec-53c3e286e55f req-a1fc38ae-77c6-4782-a7cf-b8151b572251 service nova] Creating event network-changed:4b48e5f0-230f-4540-9f4c-7268b1f36419 for instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 on nch1-master-1 Oct 29 20:48:10.889943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7fd307c9-1e1a-4251-90ec-53c3e286e55f req-a1fc38ae-77c6-4782-a7cf-b8151b572251 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116991 Oct 29 20:48:10.891017 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 199/425] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:10.896170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab700027-6566-498c-9f98-b6e17c69801f tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0cae4f19db8b4ab19178b71319346862"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:11.037786 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab700027-6566-498c-9f98-b6e17c69801f tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/977683198/action" status: 200 len: 21 microversion: 2.1 time: 0.145287 Oct 29 20:48:11.044860 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 200/426] 10.222.0.36 () {60 vars in 1197 bytes} [Sat Oct 29 20:48:10 2022] POST /compute/v2.1/flavors/977683198/action => generated 21 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:11.050344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0a44d56a-7855-4c94-9688-f9721ddc742c tempest-FlavorsAccessTestJSON-2066010291 tempest-FlavorsAccessTestJSON-2066010291-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.085075 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0a44d56a-7855-4c94-9688-f9721ddc742c tempest-FlavorsAccessTestJSON-2066010291 tempest-FlavorsAccessTestJSON-2066010291-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.038359 Oct 29 20:48:11.086101 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 201/427] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:11.100433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:11.107379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-980e8a74-0e80-4e12-bac4-6366e3cd50ae tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.110975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cda9dc3b-5f71-4186-91a7-ebb7c9b6ff16 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1468 microversion: 2.1 time: 0.303292 Oct 29 20:48:11.113208 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 227/428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:10 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:11.163442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-980e8a74-0e80-4e12-bac4-6366e3cd50ae tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/977683198" status: 202 len: 0 microversion: 2.1 time: 0.038020 Oct 29 20:48:11.164201 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 202/429] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:48:11 2022] DELETE /compute/v2.1/flavors/977683198 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:48:11.173577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-167402e8-737a-4fc8-a867-cfee1cf74aec tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.231443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:11.242285 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-167402e8-737a-4fc8-a867-cfee1cf74aec tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.072789 Oct 29 20:48:11.243260 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 203/430] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:11.269532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85540df3-fb17-4452-a649-f36ddb754891 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-267851597", "id": 1846234531, "os-flavor-access:is_public": "False"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:11.320552 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85540df3-fb17-4452-a649-f36ddb754891 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.057695 Oct 29 20:48:11.322414 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 204/431] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:11 2022] POST /compute/v2.1/flavors => generated 430 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:48:11.341922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd6d20ef-6efd-409b-8d09-86ca4e553f26 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.383267 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd6d20ef-6efd-409b-8d09-86ca4e553f26 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1846234531/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.049464 Oct 29 20:48:11.386471 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 205/432] 10.222.0.36 () {58 vars in 1209 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/flavors/1846234531/os-flavor-access => generated 21 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:11.408156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfa6b6a3-109f-45aa-9f9b-e023e8ed9028 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.454427 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfa6b6a3-109f-45aa-9f9b-e023e8ed9028 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1846234531" status: 202 len: 0 microversion: 2.1 time: 0.060656 Oct 29 20:48:11.455420 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 206/433] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:48:11 2022] DELETE /compute/v2.1/flavors/1846234531 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:48:11.465780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ccc9c81-9a2f-4144-b8f8-861f5f084831 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.477064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-661077589", "block_migration": true, "disk_over_commit": false}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:11.485069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:11.502867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.505190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.506594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ccc9c81-9a2f-4144-b8f8-861f5f084831 tempest-FlavorsAccessTestJSON-659654159 tempest-FlavorsAccessTestJSON-659654159-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.044757 Oct 29 20:48:11.507131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.507471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.508831 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 207/434] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:11.510057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.512157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.514614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.515543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:11.546079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.549614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.552347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.553290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.555606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.556060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.691439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lazy-loading 'flavor' on Instance uuid e5f5fbc1-cc84-4c77-8170-cb755717648c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:11.804980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Going to try to live migrate instance to tempest-host-661077589 {{(pid=138885) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:48:11.820984 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] HTTP exception thrown: Compute host tempest-host-661077589 could not be found. Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Request method failure captured: Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c/action HTTP/1.1 Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 106 Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZF6ka5mxSQ4mUJq5yDSko4jzcoXfYNxlQZtdMCTABDFVUoNDtvbD0AGlHIHEpM8WbzLL-N4ELYnAPu13QXxuvlhz-S392NcQU4l_3AQFGjWmOmSyp-Ulr6sxrF2dPaEVlnU-_5CtLBZsI4P5u-vpsr3F4gWxphAknfUrawpM3VruYk Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca3db0b7c4da4555bcc376df9d9ef16f Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveMigrationNegativeTest-1398747367 Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:48:11.828493 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveMigrationNegativeTest-1398747367 Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca3db0b7c4da4555bcc376df9d9ef16f Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1398747367 Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveMigrationNegativeTest-1398747367-project-admin Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: aa502bebdb604f0083840ef9fcbbdb82 Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveMigrationNegativeTest-1398747367-project-admin Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: {"os-migrateLive": {"host": "tempest-host-661077589", "block_migration": true, "disk_over_commit": false}} Oct 29 20:48:11.830112 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: exception: Compute host tempest-host-661077589 could not be found. Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'e5f5fbc1-cc84-4c77-8170-cb755717648c', 'body': {'os-migrateLive': {'host': 'tempest-host-661077589', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:11.831067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-661077589 could not be found. Oct 29 20:48:11.832478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-661077589 could not be found. Oct 29 20:48:11.834011 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-661077589 could not be found. Oct 29 20:48:11.835460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:11.839369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Returning 400 to user: Compute host tempest-host-661077589 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:11.843268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f78b33c9-503b-4808-8013-7f862bb976cc tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c/action" status: 400 len: 99 microversion: 2.1 time: 0.707511 Oct 29 20:48:11.846323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 228/435] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Oct 29 20:48:11 2022] POST /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c/action => generated 99 bytes in 711 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:48:11.859744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.860816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:11.874803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.877283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.880868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.882088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.883168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.883776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.894220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:11.906745 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2ad810c-ae9b-41b1-ae2e-5f65291b1220 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1475 microversion: 2.1 time: 0.395806 Oct 29 20:48:11.922281 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 208/436] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1475 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:11.931189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:11.932472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:11.940918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.941864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.942871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:11.943938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:11.944766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:11.945544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:12.113961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:12.125044 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54157040-2ee3-4b25-880b-d3e5885942bc tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1274 microversion: 2.1 time: 0.201285 Oct 29 20:48:12.141490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 209/437] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:12.141490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:12.141490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:12.154400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:12.155037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:12.162545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:12.166010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:12.166516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:12.167227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:12.420548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:12.435849 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8adc20cc-342d-4752-a4d4-392068076c66 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.581489 Oct 29 20:48:12.436891 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 229/438] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:11 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:12.496255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:12.500891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:12.510657 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a971268f-cf52-4f8a-94a5-23ec9c45d273 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1468 microversion: 2.1 time: 0.381279 Oct 29 20:48:12.513980 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 210/439] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:12 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:12.694504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2122022942", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:12.707199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f786a-34b7-419d-be98-f44b35f17174", "tag": "035ee969-a0e8-4370-8a01-bc9cc68cc5c8"}, {"name": "network-changed", "server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:12.746895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:12.750470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:12.751080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:12.779258 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Creating event network-changed:035ee969-a0e8-4370-8a01-bc9cc68cc5c8 for instance b39f786a-34b7-419d-be98-f44b35f17174 on nch1-master-1 Oct 29 20:48:12.780177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Creating event network-changed:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:48:12.800774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] Instance b39f786a-34b7-419d-be98-f44b35f17174 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:48:12.816811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4bcb1c6f-37a0-422e-abc4-6d12a7ed0626 req-d169bdd6-7b73-4a28-bf7b-a55f4be57597 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.113460 Oct 29 20:48:12.818098 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 211/440] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:12.840225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:48:12.936149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:12.937118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:12.952990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:12.953935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:12.954566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:12.956454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:12.957420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:12.958086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:13.886564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:13.896720 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e6e5aff-ca2d-4d61-b2c1-9520e5485ca7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1475 microversion: 2.1 time: 0.966880 Oct 29 20:48:13.897303 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 212/441] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:12 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1475 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:13.905763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:13.907992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:13.918018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:13.918566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:13.919011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:13.919963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:13.920424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:13.920894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:13.930391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:48:13.931338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:48:13.932012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:48:13.932570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:48:13.933279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:48:13.940755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:13.946630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:13.947495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:13.948284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:13.949177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:13.949828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:13.951174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:13.972521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Getting quotas for project 72fe1048bfcd4a53866483b5495f4de0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:13.978684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Getting quotas for user d056b2a4e08348ff8ccdfb149f01cdaf and project 72fe1048bfcd4a53866483b5495f4de0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:13.992762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:48:13.995721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:48:14.049554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae063f8e-b5d0-436e-921d-51399e04fd67 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358924 Oct 29 20:48:14.057133 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 230/442] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:48:14.063106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:14.064053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:14.071122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:14.071841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:14.072429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:14.073303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:14.073973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:14.074681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:14.128294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:14.140029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1151c89e-0789-4d53-bf57-20f70dbcf635 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1272 microversion: 2.1 time: 0.241208 Oct 29 20:48:14.148369 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 213/443] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:13 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:14.156693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-145e0541-7812-4415-8d72-5952bc8d48a6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:14.159206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-145e0541-7812-4415-8d72-5952bc8d48a6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:14.383390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-145e0541-7812-4415-8d72-5952bc8d48a6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:14.393385 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-145e0541-7812-4415-8d72-5952bc8d48a6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1219 microversion: 2.1 time: 0.241042 Oct 29 20:48:14.406078 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 214/444] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:14 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1219 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:14.624943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:14.642629 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-715dcb7d-4318-4c08-b2f7-1daf2722e634 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.583733 Oct 29 20:48:14.643266 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 231/445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:14 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:14.920755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:14.921489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:14.938441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:14.938946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:14.939395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:14.940204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:14.940765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:14.941285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.175200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:15.175970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:15.187351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:15.187883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:15.188341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.189083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:15.189603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:15.190028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.353110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:15.369319 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b883ae5a-6bd4-4300-8271-e6ac33269b22 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1272 microversion: 2.1 time: 0.195087 Oct 29 20:48:15.382840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 232/446] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:15 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:15.421548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:15.421886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:15.422595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:15.431988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:15.432660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:15.433426 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-462b914c-1dfc-46da-a564-d1baaa7487ea tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1475 microversion: 2.1 time: 0.514169 Oct 29 20:48:15.433730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.434664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:15.435275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:15.435852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.449416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 215/447] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:14 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:15.668401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:15.669247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:15.683622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:15.684204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:15.684777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.685617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:15.686245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:15.686921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:15.847598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:15.865021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-829934f5-73f8-474b-b8d3-4bcfbdf9f347 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1271 microversion: 2.1 time: 0.438617 Oct 29 20:48:15.865989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 233/448] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:15 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1271 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:16.236984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:16.253332 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31c098c4-8ed1-4d49-8622-90efc430f3f8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.588652 Oct 29 20:48:16.267095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 216/449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:15 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:16.392412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:16.393608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:16.403282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:16.403826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:16.408241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:16.409001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:16.409506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:16.409954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:16.457883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:16.458747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:16.472734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:16.475987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:16.476642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:16.477579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:16.478181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:16.478764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:16.944566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:16.962437 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e33e2db0-d68d-47f1-8ad7-3503a5e8b811 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.571279 Oct 29 20:48:16.964123 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 234/450] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:16 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:16.979043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:16.979924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:16.998302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:16.998814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:16.999843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:17.000600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:17.001062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:17.001550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:17.004624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:17.019063 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-048aa4df-22f7-450a-a8ab-f5852942db0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1473 microversion: 2.1 time: 0.564304 Oct 29 20:48:17.019984 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 217/451] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:16 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1473 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:17.231283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:17.242440 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cefacc26-4dfe-4e91-8ab4-de321f1606cf tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1277 microversion: 2.1 time: 0.276815 Oct 29 20:48:17.242938 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 235/452] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:16 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:17.283073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:17.283685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:17.297220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:17.298666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:17.301193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:17.301878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:17.302352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:17.302786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:17.358863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b754c08f-4a1f-4269-badd-9f33844baa0a req-954e81bb-d44b-44ab-8464-c0539365f097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f23b76-3ea1-4e7b-b365-250a3e9cb2e5", "name": "network-vif-plugged", "status": "completed", "tag": "4b48e5f0-230f-4540-9f4c-7268b1f36419"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:17.370028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b754c08f-4a1f-4269-badd-9f33844baa0a req-954e81bb-d44b-44ab-8464-c0539365f097 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:17.370814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b754c08f-4a1f-4269-badd-9f33844baa0a req-954e81bb-d44b-44ab-8464-c0539365f097 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:17.371686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b754c08f-4a1f-4269-badd-9f33844baa0a req-954e81bb-d44b-44ab-8464-c0539365f097 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:17.391434 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b754c08f-4a1f-4269-badd-9f33844baa0a req-954e81bb-d44b-44ab-8464-c0539365f097 service nova] Creating event network-vif-plugged:4b48e5f0-230f-4540-9f4c-7268b1f36419 for instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 on nch1-master-1 Oct 29 20:48:17.398089 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b754c08f-4a1f-4269-badd-9f33844baa0a req-954e81bb-d44b-44ab-8464-c0539365f097 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044831 Oct 29 20:48:17.400320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 236/453] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:17.687390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:17.701761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d1408114-c4dd-4d3c-8534-5e131ba86c13 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.423374 Oct 29 20:48:17.702371 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 218/454] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:17 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:17.988350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:17.989282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:18.000740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:18.001235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:18.001707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:18.008715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:18.009719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:18.009719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:18.159829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d89b8b6-3a54-48cf-bfa5-13ce5a55ccb1 tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-217651663", "id": 50690204, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:18.215646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d89b8b6-3a54-48cf-bfa5-13ce5a55ccb1 tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 461 microversion: 2.61 time: 0.484230 Oct 29 20:48:18.234785 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 237/455] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:48:17 2022] POST /compute/v2.1/flavors => generated 461 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:18.252513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:18.253557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:18.271471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:18.276978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:18.278976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:18.282735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:18.283456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:18.285391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:19.107903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:19.116075 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b19d020d-fc79-4c87-9846-7ad2a03d8d08 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 1.133363 Oct 29 20:48:19.116964 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 219/456] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:17 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:19.156900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:19.165071 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ada0f6ac-ebec-4be9-8659-9afc9539830e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1473 microversion: 2.1 time: 0.925775 Oct 29 20:48:19.165944 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 238/457] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:18 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1473 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:19.177134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.179064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:19.187727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:19.188860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:19.189765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:19.191128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:19.191743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:19.192318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:19.334511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b67ae730-8af0-4f62-8742-52a179fbe09e tempest-FlavorsV261TestJSON-148649785 tempest-FlavorsV261TestJSON-148649785-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.338959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:19.357698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b67ae730-8af0-4f62-8742-52a179fbe09e tempest-FlavorsV261TestJSON-148649785 tempest-FlavorsV261TestJSON-148649785-project] 10.222.0.36 "GET /compute/v2.1/flavors/50690204" status: 200 len: 461 microversion: 2.61 time: 0.239833 Oct 29 20:48:19.358904 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 220/458] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:48:19 2022] GET /compute/v2.1/flavors/50690204 => generated 461 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:19.424068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de746364-1c9a-4494-9f75-a13eec0769c2 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171f20040>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJITcsSkGOPfY5YlcIEmGcLFhM2JrCnEJk362d+qAqagjMenP890slHOlZinP7MhZL/ZEx8xhluszHxe9sjy+6sLxu+FUD07qMmMuZSRKSlVmZoqC4YOowfQQMsAOnHuYw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de746364-1c9a-4494-9f75-a13eec0769c2 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 257 Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:19.429507 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:48:19.431104 ncdv-master-1 devstack@n-api.service[138884]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJITcsSkGOPfY5YlcIEmGcLFhM2JrCnEJk362d+qAqagjMenP890slHOlZinP7MhZL/ZEx8xhluszHxe9sjy+6sLxu+FUD07qMmMuZSRKSlVmZoqC4YOowfQQMsAOnHuYw=="}} Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJITcsSkGOPfY5YlcIEmGcLFhM2JrCnEJk362d+qAqagjMenP890slHOlZinP7MhZL/ZEx8xhluszHxe9sjy+6sLxu+FUD07qMmMuZSRKSlVmZoqC4YOowfQQMsAOnHuYw=='}}} Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.431799 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:19.433524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:48:19.435920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:48:19.437224 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 20:48:19.437224 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.444222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de746364-1c9a-4494-9f75-a13eec0769c2 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:19.445674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de746364-1c9a-4494-9f75-a13eec0769c2 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.085504 Oct 29 20:48:19.446990 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 221/459] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:19 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:48:19.453406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.454055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:19.455966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:19.461875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:19.462608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:19.463202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:19.464295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:19.464911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:19.465526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:19.582842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:19.596143 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4fc3a140-8d01-4a47-835d-cd61fa85dd32 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 0.422334 Oct 29 20:48:19.597506 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 239/460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:19 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:19.603102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-984ed04f-d996-4dce-a396-7b840388de1a tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.640672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-984ed04f-d996-4dce-a396-7b840388de1a tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/50690204" status: 200 len: 462 microversion: 2.61 time: 0.041870 Oct 29 20:48:19.641247 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 240/461] 10.222.0.36 () {62 vars in 1213 bytes} [Sat Oct 29 20:48:19 2022] PUT /compute/v2.1/flavors/50690204 => generated 462 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:19.658049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171c45430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1797201132", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.683227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:19.691053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for user c73a8fe7d98141458de2a1ba20cbc862 and project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:19.717331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 2167 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1797201132", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:48:19.725625 ncdv-master-1 devstack@n-api.service[138885]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1797201132', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:19.728107 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f904348-c4f3-40f0-9719-1dfa5351b5d1 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.076323 Oct 29 20:48:19.731039 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 241/462] 10.222.0.36 () {60 vars in 1160 bytes} [Sat Oct 29 20:48:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:48:19.733369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed4445f8-7a0a-4faa-9f27-d038da8e28a6 tempest-FlavorsV261TestJSON-148649785 tempest-FlavorsV261TestJSON-148649785-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.758961 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed4445f8-7a0a-4faa-9f27-d038da8e28a6 tempest-FlavorsV261TestJSON-148649785 tempest-FlavorsV261TestJSON-148649785-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 7149 microversion: 2.61 time: 0.029996 Oct 29 20:48:19.759750 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 242/463] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 20:48:19 2022] GET /compute/v2.1/flavors/detail => generated 7149 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:48:19.764367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eed62db0-4ef0-49f7-8d3c-925597f3955e tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171d640d0>, body: {"keypair": {"name": "tempest-keypair-1621103470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSMp5U+ynOTMSX9XeetkiWBWIYkYxy0t0tCbdE9PV4K4rBSkZ3BHxdt+vUzLKCd1PUjFVuPvMPjA3Kn8yXGwBQo3qj2vbrOEh5FNGbxcjcYDZcoSK4Vc3XfeHH2CVm//w=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.784180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-eed62db0-4ef0-49f7-8d3c-925597f3955e tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:19.790483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-eed62db0-4ef0-49f7-8d3c-925597f3955e tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for user c73a8fe7d98141458de2a1ba20cbc862 and project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:19.808691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:19.817291 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eed62db0-4ef0-49f7-8d3c-925597f3955e tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056590 Oct 29 20:48:19.818200 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 243/464] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:19.822193 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9f396bb-6083-44fd-86b4-2f93ae330085 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.373771 Oct 29 20:48:19.833480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 222/465] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:19 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:19.834301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0800cae4-ab37-48b0-8aaa-c1639249802a tempest-FlavorsV261TestJSON-148649785 tempest-FlavorsV261TestJSON-148649785-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.834519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171f200d0>, body: {"keypair": {"name": "tempest-keypair-1621103470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAvPH2jjDdlGENXeoZBwgukeAFl35fnMJARqUvyaeXDJaB2gxRcrVFZeLVTHiWBC4KU7PQyMmPHB1nTb3IBCWct0ZPaVH05lk5s5jdrBBD65pd5Ak1CkLKVGFCXD9uAOg=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.854287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:19.858286 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0800cae4-ab37-48b0-8aaa-c1639249802a tempest-FlavorsV261TestJSON-148649785 tempest-FlavorsV261TestJSON-148649785-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.61 time: 0.038801 Oct 29 20:48:19.861680 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 244/466] 10.222.0.36 () {60 vars in 1166 bytes} [Sat Oct 29 20:48:19 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:48:19.861847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for user c73a8fe7d98141458de2a1ba20cbc862 and project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:19.878538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e6271b0-08ca-4822-bb71-dd5b95571f77 tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.890422 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] HTTP exception thrown: Key pair 'tempest-keypair-1621103470' already exists. Oct 29 20:48:19.894644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 273 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: {"keypair": {"name": "tempest-keypair-1621103470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAvPH2jjDdlGENXeoZBwgukeAFl35fnMJARqUvyaeXDJaB2gxRcrVFZeLVTHiWBC4KU7PQyMmPHB1nTb3IBCWct0ZPaVH05lk5s5jdrBBD65pd5Ak1CkLKVGFCXD9uAOg=="}} Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: exception: Key pair 'tempest-keypair-1621103470' already exists. Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1621103470', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAvPH2jjDdlGENXeoZBwgukeAFl35fnMJARqUvyaeXDJaB2gxRcrVFZeLVTHiWBC4KU7PQyMmPHB1nTb3IBCWct0ZPaVH05lk5s5jdrBBD65pd5Ak1CkLKVGFCXD9uAOg=='}}} Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result.read() Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'c73a8fe7d98141458de2a1ba20cbc862-tempest-keypair-1621103470' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 20:48:19.894783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result.read() Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 20:48:19.900149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'c73a8fe7d98141458de2a1ba20cbc862-tempest-keypair-1621103470' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 20, 48, 19, 882369), 'updated_at': None, 'name': 'tempest-keypair-1621103470', 'user_id': 'c73a8fe7d98141458de2a1ba20cbc862', 'fingerprint': '24:8d:1f:58:cc:84:d2:72:f6:56:2f:b3:8d:2a:dc:14', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAvPH2jjDdlGENXeoZBwgukeAFl35fnMJARqUvyaeXDJaB2gxRcrVFZeLVTHiWBC4KU7PQyMmPHB1nTb3IBCWct0ZPaVH05lk5s5jdrBBD65pd5Ak1CkLKVGFCXD9uAOg==', 'type': 'ssh'}] Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi keypair.create() Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._create() Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1621103470' already exists. Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 29 20:48:19.904339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1621103470' already exists. Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1621103470' already exists. Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 409 to user: Key pair 'tempest-keypair-1621103470' already exists. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-801a1bb8-5e53-4838-a0d0-d8167df609e7 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.067297 Oct 29 20:48:19.909591 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 223/467] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:19 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:48:19.910318 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e6271b0-08ca-4822-bb71-dd5b95571f77 tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/50690204" status: 202 len: 0 microversion: 2.61 time: 0.032217 Oct 29 20:48:19.910405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eba6a926-0de3-42ea-9c8c-b6ff51016fb3 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Calling method '.version_select at 0x7fa171fa3700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.911840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 245/468] 10.222.0.36 () {60 vars in 1196 bytes} [Sat Oct 29 20:48:19 2022] DELETE /compute/v2.1/flavors/50690204 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:48:19.917975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7386c346-8381-436c-a5df-76645cd4a51c tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:19.937160 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eba6a926-0de3-42ea-9c8c-b6ff51016fb3 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621103470" status: 202 len: 0 microversion: 2.1 time: 0.034339 Oct 29 20:48:19.937581 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 224/469] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 20:48:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621103470 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:48:19.951814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5fecae8-c411-41eb-a095-81471ffa8223 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171f204c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHSDWLaj1hMxO6EfRqUkZcXBkj37KE2ZXmW5KYMYS50ikoPm0zXWWbfrGu6tF0JehK84X3nLNlEtDBqrPBKDARxO3bACj/Dx6xRi71nUOv2iV98eF/oiEMjiW7CqJmrcQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5fecae8-c411-41eb-a095-81471ffa8223 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 247 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHSDWLaj1hMxO6EfRqUkZcXBkj37KE2ZXmW5KYMYS50ikoPm0zXWWbfrGu6tF0JehK84X3nLNlEtDBqrPBKDARxO3bACj/Dx6xRi71nUOv2iV98eF/oiEMjiW7CqJmrcQ=="}} Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHSDWLaj1hMxO6EfRqUkZcXBkj37KE2ZXmW5KYMYS50ikoPm0zXWWbfrGu6tF0JehK84X3nLNlEtDBqrPBKDARxO3bACj/Dx6xRi71nUOv2iV98eF/oiEMjiW7CqJmrcQ=='}}} Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi '' Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:48:19.956373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5fecae8-c411-41eb-a095-81471ffa8223 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f5fecae8-c411-41eb-a095-81471ffa8223 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011453 Oct 29 20:48:19.960372 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 225/470] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:19 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:48:19.966442 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7386c346-8381-436c-a5df-76645cd4a51c tempest-FlavorsV261TestJSON-291948758 tempest-FlavorsV261TestJSON-291948758-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.053336 Oct 29 20:48:19.967179 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 246/471] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 20:48:19 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:48:19.972320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171f30d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-261847009", "public_key": " "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:19.998955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:20.004591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for user c73a8fe7d98141458de2a1ba20cbc862 and project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:20.025213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 94 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-261847009", "public_key": " "}} Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-261847009', 'public_key': ' '}}} Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.028743 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e82141e-d400-46c2-9ba1-3e8e3160c7c5 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.061956 Oct 29 20:48:20.036895 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 226/472] 10.222.0.36 () {60 vars in 1158 bytes} [Sat Oct 29 20:48:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:48:20.047279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49bdf275-288f-4f27-86c7-69906d0c7bde tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171d64dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3z12BSs7YQGA9DfxrhTjoT3WCwyMpsacjwlOIwiP5V0iHSosCRyCqoTepjCYnwtgYxqnGOqoSYd9Zr1aKaimnUx8hxer6OWTxGWijJ6Q8rXP+KWG7RSG3cf5RGenz6Mw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49bdf275-288f-4f27-86c7-69906d0c7bde tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 507 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3z12BSs7YQGA9DfxrhTjoT3WCwyMpsacjwlOIwiP5V0iHSosCRyCqoTepjCYnwtgYxqnGOqoSYd9Zr1aKaimnUx8hxer6OWTxGWijJ6Q8rXP+KWG7RSG3cf5RGenz6Mw=="}} Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3z12BSs7YQGA9DfxrhTjoT3WCwyMpsacjwlOIwiP5V0iHSosCRyCqoTepjCYnwtgYxqnGOqoSYd9Zr1aKaimnUx8hxer6OWTxGWijJ6Q8rXP+KWG7RSG3cf5RGenz6Mw=='}}} Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 20:48:20.052205 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49bdf275-288f-4f27-86c7-69906d0c7bde tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:20.056000 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49bdf275-288f-4f27-86c7-69906d0c7bde tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012794 Oct 29 20:48:20.061953 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 247/473] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:20 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:48:20.067238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Action: 'create', calling method: .version_select at 0x7fa171ef7160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1392239281", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:20.087363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:20.093658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Getting quotas for user c73a8fe7d98141458de2a1ba20cbc862 and project 8c544c744aa54dee8ae1a464bb484304. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:20.117814 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 118 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1392239281", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1392239281', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 20:48:20.121229 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e94f63f2-aea8-487f-971d-1b6c453f4000 tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.061295 Oct 29 20:48:20.127751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 227/474] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:48:20.141353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bf5a869-5ab4-4665-8257-90788f0e35cb tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Calling method '.version_select at 0x7fa171c45a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:20.146470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:20.150511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:20.162297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.165666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.167591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.168556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.172266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.172888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.176372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1bf5a869-5ab4-4665-8257-90788f0e35cb tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1824417513 not found for user c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bf5a869-5ab4-4665-8257-90788f0e35cb tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Request method failure captured: Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1824417513 HTTP/1.1 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGSvyUcZXHh7PjYaEKAE9J1kqt5NMfBvNXX0hyekJn7cTJyxdl62v7WUGoWXTEAv0ymlF-UAqWJNk-QbE_dIB0oMRZM8Dw0qDUFPm8C4VYSMEf6G0wIihYE9HajAOOYo9ylJfC1TwJPZlyL6ZoNFM1sBF80B0MkownrBk9TcwYZv9A Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c544c744aa54dee8ae1a464bb484304"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 8c544c744aa54dee8ae1a464bb484304 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-332957875 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-332957875-project Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: exception: Keypair tempest-keypair-non-existent-1824417513 not found for user c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'tempest-keypair-non-existent-1824417513'} Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1824417513 not found for user c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.185908 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1824417513 not found for user c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1824417513 not found for user c73a8fe7d98141458de2a1ba20cbc862 Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bf5a869-5ab4-4665-8257-90788f0e35cb tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1824417513 not found for user c73a8fe7d98141458de2a1ba20cbc862 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:20.189504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1bf5a869-5ab4-4665-8257-90788f0e35cb tempest-KeyPairsNegativeTestJSON-332957875 tempest-KeyPairsNegativeTestJSON-332957875-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1824417513" status: 404 len: 145 microversion: 2.1 time: 0.054128 Oct 29 20:48:20.194450 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 248/475] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1824417513 => generated 145 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:20.208538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:20.209118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:20.233796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.234576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.235213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.235935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.236394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.236823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.281705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:20.806105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:20.818034 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c15c290-9148-45aa-9633-c1f7f67c15ae tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.680630 Oct 29 20:48:20.834990 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 228/476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:20 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:20.846140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:20.847068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:20.855857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.856643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.857918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.859408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.860490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.861703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.913877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:20.930606 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df3b68d9-756a-40e8-9993-dd16e6ddb43d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1473 microversion: 2.1 time: 0.732931 Oct 29 20:48:20.931602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 249/477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:20 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1473 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:20.938921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:20.939871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:20.948890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.949706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.950857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:20.952372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:20.953030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:20.953679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:21.639487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:21.647765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45670531-ba6a-42f6-a254-47134c418107 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 0.811460 Oct 29 20:48:21.658257 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 229/478] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:20 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:21.663305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-24400b8f-e5e3-40de-acce-1f20287ee0a2 req-05fc4251-673e-4e50-a28f-ad227f134cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dd6eeb-269e-423e-927e-921572b1522b", "tag": "f083a1fd-24f3-436d-b01b-b7c6837bee8b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:21.686826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-24400b8f-e5e3-40de-acce-1f20287ee0a2 req-05fc4251-673e-4e50-a28f-ad227f134cdb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:21.687309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-24400b8f-e5e3-40de-acce-1f20287ee0a2 req-05fc4251-673e-4e50-a28f-ad227f134cdb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:21.687785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-24400b8f-e5e3-40de-acce-1f20287ee0a2 req-05fc4251-673e-4e50-a28f-ad227f134cdb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:21.719491 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-24400b8f-e5e3-40de-acce-1f20287ee0a2 req-05fc4251-673e-4e50-a28f-ad227f134cdb service nova] Creating event network-changed:f083a1fd-24f3-436d-b01b-b7c6837bee8b for instance d7dd6eeb-269e-423e-927e-921572b1522b on nch1-master-1 Oct 29 20:48:21.724687 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-24400b8f-e5e3-40de-acce-1f20287ee0a2 req-05fc4251-673e-4e50-a28f-ad227f134cdb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064901 Oct 29 20:48:21.725290 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 230/479] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:21.798336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:21.806693 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee2669ea-f63c-4568-9f3c-9daad6775940 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1318 microversion: 2.1 time: 0.873066 Oct 29 20:48:21.818210 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 250/480] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:20 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:21.853203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:21.854064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:21.864004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:21.864814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:21.865738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:21.866778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:21.867249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:21.867834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:21.955065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:21.955570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:21.964754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:21.968012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:21.968669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:21.969405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:21.969900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:21.970330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.476519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:22.487445 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c55d203-c137-493e-92d3-07d1d6306118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.639789 Oct 29 20:48:22.488251 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 231/481] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:21 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:22.550259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:22.566824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3392fc4-7831-4166-ba9b-731888845de2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1470 microversion: 2.1 time: 0.615823 Oct 29 20:48:22.568156 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 251/482] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:21 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1470 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:22.594258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:22.595150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:22.602533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.604232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.606203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.607330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.608033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.608667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.692619 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d29ba1fd-8ed4-4c13-9ffe-65c5ff76c5a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174/action" status: 204 len: 0 microversion: 2.1 time: 0.102422 Oct 29 20:48:22.696570 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 232/483] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:22 2022] POST /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174/action => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:48:22.708034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:22.709161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:22.735848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.739119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.740154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.741879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.742572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.743527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.889428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Calling method '.version_select at 0x7fa171c2aa60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:22.904912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.905407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.914211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.917685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.918629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.919909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.946447 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db11afac-8672-4d4e-9e3c-c8fbcee06dc8 tempest-AbsoluteLimitsTestJSON-1592242681 tempest-AbsoluteLimitsTestJSON-1592242681-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.290899 Oct 29 20:48:22.947394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 252/484] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 29 20:48:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:48:22.952822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:22.953853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:22.972920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.973416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.975923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:22.978538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:22.982492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:22.983270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:23.394688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:23.410460 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-37eff7a5-23e9-491e-9c04-ed37bebe855e tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 0.712522 Oct 29 20:48:23.411302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 233/485] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:22 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:23.416681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:23.421923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:23.434142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:23.435562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:23.436250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:23.437228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:23.437919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:23.439075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:23.946055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:23.963287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6628e405-82e7-4823-ba2f-a2c7beef70fe tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1470 microversion: 2.1 time: 1.014189 Oct 29 20:48:23.964537 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 253/486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:22 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1470 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:23.971721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:23.972785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:23.980361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:23.981071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:23.982361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:23.983298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:23.984381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:23.985035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:24.274562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:24.288613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d742b50b-c954-4f13-bdff-bbd98542fa28 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1467 microversion: 2.1 time: 0.874273 Oct 29 20:48:24.292421 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 234/487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:23 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1467 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:24.308141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-36336d95-9068-4201-8fd3-b82dc5787c9e req-353295fc-f8ca-4192-badb-90cf7b5375b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7643ac7-93a1-4589-a8e7-8a9f16cb0174", "tag": "fbab8b3f-a4d0-4de3-a9d4-380cf2d5b60c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:24.341064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-36336d95-9068-4201-8fd3-b82dc5787c9e req-353295fc-f8ca-4192-badb-90cf7b5375b9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:24.342269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-36336d95-9068-4201-8fd3-b82dc5787c9e req-353295fc-f8ca-4192-badb-90cf7b5375b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:24.345031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-36336d95-9068-4201-8fd3-b82dc5787c9e req-353295fc-f8ca-4192-badb-90cf7b5375b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:24.359436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-36336d95-9068-4201-8fd3-b82dc5787c9e req-353295fc-f8ca-4192-badb-90cf7b5375b9 service nova] Creating event network-changed:fbab8b3f-a4d0-4de3-a9d4-380cf2d5b60c for instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 on nch2-master-1 Oct 29 20:48:24.366967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-36336d95-9068-4201-8fd3-b82dc5787c9e req-353295fc-f8ca-4192-badb-90cf7b5375b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072265 Oct 29 20:48:24.367855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 235/488] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:24.375094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f786a-34b7-419d-be98-f44b35f17174", "name": "network-vif-plugged", "status": "completed", "tag": "035ee969-a0e8-4370-8a01-bc9cc68cc5c8"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:24.391960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:24.392630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:24.393153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:24.405303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:24.409310 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] Creating event network-vif-plugged:035ee969-a0e8-4370-8a01-bc9cc68cc5c8 for instance b39f786a-34b7-419d-be98-f44b35f17174 on nch1-master-1 Oct 29 20:48:24.425633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] Instance b39f786a-34b7-419d-be98-f44b35f17174 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:48:24.447005 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b66ab7ad-3901-48f5-b5f1-52d810c022e2 req-f2dc4339-c502-4a3f-acad-13a2e021285d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077014 Oct 29 20:48:24.448864 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 236/489] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:24.456102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:24.456940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:24.466403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:24.467231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:24.467913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:24.468852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:24.469575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:24.470226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:24.736006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:24.745125 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf56d424-db8c-4090-b8b3-043c039c24c8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.779297 Oct 29 20:48:24.746235 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 254/490] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:23 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:24.753513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:24.754325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:24.768625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:24.769302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:24.769823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:24.772895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:24.773378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:24.773906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:25.229757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:25.238229 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1318 microversion: 2.1 time: 0.787921 Oct 29 20:48:25.255839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 237/491] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:24 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:25.257041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:25.258053 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ef3701f-f455-4102-becb-bc82deffaba0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001328 Oct 29 20:48:25.258572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 238/492] 10.222.0.36 () {56 vars in 886 bytes} [Sat Oct 29 20:48:25 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 20:48:25.263466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:25.264687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:25.272075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:25.272788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:25.273375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:25.274262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:25.274885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:25.275897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:25.852773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:25.866533 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac8fe457-58da-4543-b6f6-0f3d5b0e09d4 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 1.117876 Oct 29 20:48:25.873917 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 255/493] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:24 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:25.891845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:25.891845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:25.910116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:25.910627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:25.911074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:25.911802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:25.912280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:25.912700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:26.751644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:26.766242 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-010e76b1-bc07-44e3-9ae1-8bdd63447707 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1470 microversion: 2.1 time: 1.506849 Oct 29 20:48:26.767133 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 239/494] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:25 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1470 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:26.775890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:26.777832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:26.786521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:26.787012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:26.787476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:26.788189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:26.788641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:26.789230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:26.898640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:26.924332 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-47f9b2fe-14c1-49bb-8c2a-7ed3631a5219 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 1.047940 Oct 29 20:48:26.927866 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 256/495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:25 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:27.352960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Calling method '.version_select at 0x7fa171c4a0d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:27.363079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:27.376860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06381913-8369-401c-a637-e1c096b812d3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1318 microversion: 2.1 time: 0.608502 Oct 29 20:48:27.384982 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 240/496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:26 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:27.402594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:27.407052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:27.411707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:27.412212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:27.412663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:27.413404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:27.413904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:27.414332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:27.417923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:27.418419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:27.419751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:27.420469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:27.420931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:27.421362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:27.469966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6f87359-382f-46ac-8d1f-e6c770af8405 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.528168 Oct 29 20:48:27.473988 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 257/497] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 29 20:48:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:27.498141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-74596da6-861d-4a1a-b7d3-31405340074c req-1a145935-24c7-40b4-bbcc-c3f526be08ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "name": "network-vif-plugged", "status": "completed", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:27.523584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-74596da6-861d-4a1a-b7d3-31405340074c req-1a145935-24c7-40b4-bbcc-c3f526be08ce service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:27.527150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-74596da6-861d-4a1a-b7d3-31405340074c req-1a145935-24c7-40b4-bbcc-c3f526be08ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:27.527683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-74596da6-861d-4a1a-b7d3-31405340074c req-1a145935-24c7-40b4-bbcc-c3f526be08ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:27.553489 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-74596da6-861d-4a1a-b7d3-31405340074c req-1a145935-24c7-40b4-bbcc-c3f526be08ce service nova] Creating event network-vif-plugged:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:48:27.562410 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-74596da6-861d-4a1a-b7d3-31405340074c req-1a145935-24c7-40b4-bbcc-c3f526be08ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085869 Oct 29 20:48:27.563664 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 258/498] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:27.661902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1894288818", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:27.774737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:48:27.967127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:27.986859 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c5c8e41c-b727-46e2-9b24-4f0bc8f698ee tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 0.592334 Oct 29 20:48:27.988474 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 241/499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:27 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:27.999929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:28.001012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:28.012823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.013318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.013795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.014669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.022106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.023374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.316490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Getting quotas for project 0c7bb66da6744da5915e3d032992b653. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:28.321682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Getting quotas for user 768e9c41d985407798e3996e00d5d04b and project 0c7bb66da6744da5915e3d032992b653. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:28.336812 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Request method failure captured: Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 1752 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGaIegRek7-msOjisYGx01gxFbVJdFXAJFG4EGjG0qiC9k07lZUFTcHatLgX8_aUNqBNCLy26RX_siLLmcGtrnIegbAoatEaqZAlK3dW4BLxi49yxB_-f-sZ03EUfGI2n2CxfuvaHlx3cqGPducWUe1InaJCPCJjcw0Wcsvk1K9r_U Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0c7bb66da6744da5915e3d032992b653 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-361097469 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c7bb66da6744da5915e3d032992b653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c7bb66da6744da5915e3d032992b653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c7bb66da6744da5915e3d032992b653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c7bb66da6744da5915e3d032992b653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-361097469 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0c7bb66da6744da5915e3d032992b653 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-361097469 Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-361097469-project Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 768e9c41d985407798e3996e00d5d04b Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-361097469-project Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1894288818", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:28.339234 ncdv-master-1 devstack@n-api.service[138885]: exception: Maximum number of metadata items exceeds 128 Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1894288818', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:28.343238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ac56912-c335-44df-aa41-4f5f5c91d2b5 tempest-AbsoluteLimitsNegativeTestJSON-361097469 tempest-AbsoluteLimitsNegativeTestJSON-361097469-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.684001 Oct 29 20:48:28.346943 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 259/500] 10.222.0.36 () {60 vars in 1148 bytes} [Sat Oct 29 20:48:27 2022] POST /compute/v2.1/servers => generated 87 bytes in 686 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:48:28.349312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:28.349312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:28.356081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.356675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.357444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.357918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.358372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.358899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.399256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:28.413169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c2c1527b-5d9b-41ab-8337-3cd775094ab8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1462 microversion: 2.1 time: 0.421777 Oct 29 20:48:28.413858 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 242/501] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:27 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1462 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:28.448884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:28.449546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:28.457236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.457972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.458418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.459129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.459586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.460904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.647714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:28.667710 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9df549f-faee-4620-b871-7a7ec2e552c7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.324146 Oct 29 20:48:28.685934 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 260/502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:28 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:28.695241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:28.697547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:28.713204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.713743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.714187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.715317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:28.715826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:28.716261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:28.741642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:28.750338 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5fb434ec-252f-4554-9f61-f722a00d151f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1318 microversion: 2.1 time: 0.320180 Oct 29 20:48:28.750944 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 243/503] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:28 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:28.977420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a853e78-fbeb-4971-8814-ddde491ed76d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1613 microversion: 2.1 time: 0.289613 Oct 29 20:48:28.977936 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 261/504] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:28 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1613 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:29.011387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c2b8461-5e7a-4ec1-a52b-106278784b49 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '.version_select at 0x7fa171f30700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:29.015070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:29.015653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2b8461-5e7a-4ec1-a52b-106278784b49 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.015801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:29.016477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2b8461-5e7a-4ec1-a52b-106278784b49 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.017119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2b8461-5e7a-4ec1-a52b-106278784b49 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:29.024721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.025226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.027527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:29.028372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.028784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.029222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:29.033004 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c2b8461-5e7a-4ec1-a52b-106278784b49 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.028565 Oct 29 20:48:29.051368 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 244/505] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:48:29 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:29.366486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:29.378845 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0f18e6e-4f44-4ed3-a5e0-695bfc11e86a tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 0.364246 Oct 29 20:48:29.393483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 262/506] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:29 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:29.393483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1947136437", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:29.483326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:48:29.527677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6d58a92-1cb6-451a-a197-3e4903dc5374 tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Calling method '.version_select at 0x7fa171e7d670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:29.530548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e6d58a92-1cb6-451a-a197-3e4903dc5374 tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e96680059a5443e5a1317c05e9e109f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ded6ecc95948ce9b8aa055841eccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6d58a92-1cb6-451a-a197-3e4903dc5374 tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Request method failure captured: Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGckFRvl-dwvvNBnn1Ql_sd6njESAp66UkEZxjpJRyL5A4PWNh8elG0LjJIVQ7xZW2J1J_slJ_IscAtB8HGFE7lrCjG-EFaqT0ohVf5GM5T9rLJh-wPK956aOT-ThdBnEvB1ckcPDcNZfUUQ16TJHJX4McbT3b8BHM3vTmInyQCXo4 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e96680059a5443e5a1317c05e9e109f5 Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 20:48:29.533357 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6d58a92-1cb6-451a-a197-3e4903dc5374 tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e6d58a92-1cb6-451a-a197-3e4903dc5374 tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.409760 Oct 29 20:48:29.537572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 245/507] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 29 20:48:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:48:29.548776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-058c2817-5cc8-4225-a920-b8d777cd418a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Calling method '.version_select at 0x7fa171e69280>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:29.552201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-058c2817-5cc8-4225-a920-b8d777cd418a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e96680059a5443e5a1317c05e9e109f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ded6ecc95948ce9b8aa055841eccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-058c2817-5cc8-4225-a920-b8d777cd418a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Request method failure captured: Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGckFRvl-dwvvNBnn1Ql_sd6njESAp66UkEZxjpJRyL5A4PWNh8elG0LjJIVQ7xZW2J1J_slJ_IscAtB8HGFE7lrCjG-EFaqT0ohVf5GM5T9rLJh-wPK956aOT-ThdBnEvB1ckcPDcNZfUUQ16TJHJX4McbT3b8BHM3vTmInyQCXo4 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e96680059a5443e5a1317c05e9e109f5 Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 20:48:29.554247 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-058c2817-5cc8-4225-a920-b8d777cd418a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:29.559501 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-058c2817-5cc8-4225-a920-b8d777cd418a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014647 Oct 29 20:48:29.563387 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 246/508] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:29 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:29.571262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0884a06a-542b-4aa8-94f5-e8e20cbe5bfe tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Calling method '.version_select at 0x7fa171ed0af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:29.574084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0884a06a-542b-4aa8-94f5-e8e20cbe5bfe tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e96680059a5443e5a1317c05e9e109f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ded6ecc95948ce9b8aa055841eccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0884a06a-542b-4aa8-94f5-e8e20cbe5bfe tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Request method failure captured: Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGckFRvl-dwvvNBnn1Ql_sd6njESAp66UkEZxjpJRyL5A4PWNh8elG0LjJIVQ7xZW2J1J_slJ_IscAtB8HGFE7lrCjG-EFaqT0ohVf5GM5T9rLJh-wPK956aOT-ThdBnEvB1ckcPDcNZfUUQ16TJHJX4McbT3b8BHM3vTmInyQCXo4 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e96680059a5443e5a1317c05e9e109f5 Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.576561 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0884a06a-542b-4aa8-94f5-e8e20cbe5bfe tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:29.580337 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0884a06a-542b-4aa8-94f5-e8e20cbe5bfe tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.013673 Oct 29 20:48:29.584023 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 247/509] 10.222.0.36 () {58 vars in 1179 bytes} [Sat Oct 29 20:48:29 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:29.849648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Calling method '.version_select at 0x7fa17279d940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:29.851423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.851910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.852510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:29.885510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.888612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.889553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:29.917502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.919254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.920908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:29.935957 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4e293aca-086f-47ec-96b9-06b2c4584ba5 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.344199 Oct 29 20:48:29.939050 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 248/510] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:29.956998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d4df1667-b607-4ccd-9691-c4a61a8cdb4f req-bb3da4dd-b337-44e8-b9d9-dee06e357854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7643ac7-93a1-4589-a8e7-8a9f16cb0174", "name": "network-vif-plugged", "status": "completed", "tag": "fbab8b3f-a4d0-4de3-a9d4-380cf2d5b60c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:29.987049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d4df1667-b607-4ccd-9691-c4a61a8cdb4f req-bb3da4dd-b337-44e8-b9d9-dee06e357854 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:29.987836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d4df1667-b607-4ccd-9691-c4a61a8cdb4f req-bb3da4dd-b337-44e8-b9d9-dee06e357854 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:29.988584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d4df1667-b607-4ccd-9691-c4a61a8cdb4f req-bb3da4dd-b337-44e8-b9d9-dee06e357854 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.006351 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d4df1667-b607-4ccd-9691-c4a61a8cdb4f req-bb3da4dd-b337-44e8-b9d9-dee06e357854 service nova] Creating event network-vif-plugged:fbab8b3f-a4d0-4de3-a9d4-380cf2d5b60c for instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 on nch2-master-1 Oct 29 20:48:30.019738 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d4df1667-b607-4ccd-9691-c4a61a8cdb4f req-bb3da4dd-b337-44e8-b9d9-dee06e357854 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076544 Oct 29 20:48:30.021544 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 249/511] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:30.048840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:30.049596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:30.081089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.081624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.082075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.082793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.090070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.090565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.114587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=30 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:30.499121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:48:30.499855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:48:30.500461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:48:30.501028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:48:30.501446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:48:30.521521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.522443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.523996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.524973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.525682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.526391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.552687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:30.562128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for user 0a554d93b7864309990e6252c09f59cc and project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:30.579816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:30.582791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:48:30.586191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:48:30.588318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-86c27978-bb44-48f2-92d4-efebde4ffac3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.565602 Oct 29 20:48:30.589483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 250/512] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:30 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:30.594087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:30.594691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:30.600660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.601154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.601628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.602334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.602788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.603528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.661303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91f7d4f6-9526-47d0-ab8f-800fa4350ddb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278525 Oct 29 20:48:30.662194 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 263/513] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:48:30.674019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c811b38e-313b-4cbd-821e-a2b11484263c tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Calling method '.version_select at 0x7fa171c2a310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:30.676875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c811b38e-313b-4cbd-821e-a2b11484263c tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e96680059a5443e5a1317c05e9e109f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ded6ecc95948ce9b8aa055841eccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c811b38e-313b-4cbd-821e-a2b11484263c tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Request method failure captured: Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGckFRvl-dwvvNBnn1Ql_sd6njESAp66UkEZxjpJRyL5A4PWNh8elG0LjJIVQ7xZW2J1J_slJ_IscAtB8HGFE7lrCjG-EFaqT0ohVf5GM5T9rLJh-wPK956aOT-ThdBnEvB1ckcPDcNZfUUQ16TJHJX4McbT3b8BHM3vTmInyQCXo4 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e96680059a5443e5a1317c05e9e109f5 Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '1'} Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:30.679375 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:30.683090 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:30.683090 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:30.683090 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:48:30.683090 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:48:30.683090 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 20:48:30.683090 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:30.689646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c811b38e-313b-4cbd-821e-a2b11484263c tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:30.691037 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c811b38e-313b-4cbd-821e-a2b11484263c tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.026840 Oct 29 20:48:30.691869 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 264/514] 10.222.0.36 () {58 vars in 1173 bytes} [Sat Oct 29 20:48:30 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:30.697582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:30.698532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:30.710085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.710859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.711520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.712492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:30.724986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:30.725890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:30.973415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:30.985016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-937ae313-4cd2-40a6-b27d-9c4a7adb4bcb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1318 microversion: 2.1 time: 0.394433 Oct 29 20:48:30.988238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 251/515] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:30 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:31.012951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27233538-fae9-4d95-8964-bd802e9c49d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:31.014172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27233538-fae9-4d95-8964-bd802e9c49d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:31.099895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:31.109745 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b278c567-f5c7-4181-a24d-a2199a64af07 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1319 microversion: 2.1 time: 0.416511 Oct 29 20:48:31.114434 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 265/516] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:30 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:31.126366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bf1bb31-7515-4a03-a71b-edfdb77c8791 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Calling method '.version_select at 0x7fa171d64ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:31.128780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6bf1bb31-7515-4a03-a71b-edfdb77c8791 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] HTTP exception thrown: Hypervisor with ID '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef' could not be found. Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bf1bb31-7515-4a03-a71b-edfdb77c8791 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Request method failure captured: Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef/uptime HTTP/1.1 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGcBFWFHZ7675f3YCDPEqmKnwivH_W2i0vbwSgsNsLklttVEpx3uOT0SbRXsI6jdoTcOEB3YgV2NFuGa78f24kA4WasrjyEzT-965rKLCa4MLrZcWrMphpPoQBeJ4qVwSa4G96yL5sQ3T0mZADMI9X-36vOcAIwtoMwXC3wYhRg7is Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: cc16b882bc31406bae1199d9c59b456d Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1024996952 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1024996952 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: cc16b882bc31406bae1199d9c59b456d Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1024996952 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 12ff39bed8b143ef84be09e6e22a6e57 Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: exception: Hypervisor with ID '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef' could not be found. Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef'} Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef' Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:31.143069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef' could not be found. Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef' could not be found. Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bf1bb31-7515-4a03-a71b-edfdb77c8791 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Returning 404 to user: Hypervisor with ID '3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef' could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:31.146972 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6bf1bb31-7515-4a03-a71b-edfdb77c8791 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef/uptime" status: 404 len: 123 microversion: 2.1 time: 0.028314 Oct 29 20:48:31.156349 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 266/517] 10.222.0.36 () {58 vars in 1278 bytes} [Sat Oct 29 20:48:31 2022] GET /compute/v2.1/os-hypervisors/3b2d78b7-0b36-478a-a6f4-fb567fa6e4ef/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:31.156741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27233538-fae9-4d95-8964-bd802e9c49d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:31.164061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Calling method '.version_select at 0x7fa171c45310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:31.167437 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27233538-fae9-4d95-8964-bd802e9c49d2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1213 microversion: 2.1 time: 0.177691 Oct 29 20:48:31.169153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:31.173582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:31.174374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:31.179782 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 252/518] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:30 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:31.211358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:31.212080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:31.212976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:31.226720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:31.227215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:31.227657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:31.236025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c7998d2-5e17-4280-b201-d2fc5515d79a tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079003 Oct 29 20:48:31.243192 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 267/519] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:31.250228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6e4c9fd-63b3-405d-8458-14ad4171d22a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Calling method '.version_select at 0x7fa171f06790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:31.253233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e6e4c9fd-63b3-405d-8458-14ad4171d22a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e96680059a5443e5a1317c05e9e109f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ded6ecc95948ce9b8aa055841eccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6e4c9fd-63b3-405d-8458-14ad4171d22a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Request method failure captured: Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGckFRvl-dwvvNBnn1Ql_sd6njESAp66UkEZxjpJRyL5A4PWNh8elG0LjJIVQ7xZW2J1J_slJ_IscAtB8HGFE7lrCjG-EFaqT0ohVf5GM5T9rLJh-wPK956aOT-ThdBnEvB1ckcPDcNZfUUQ16TJHJX4McbT3b8BHM3vTmInyQCXo4 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c2ded6ecc95948ce9b8aa055841eccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c2ded6ecc95948ce9b8aa055841eccce Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: e96680059a5443e5a1317c05e9e109f5 Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1961948077-project Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1'} Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 20:48:31.261015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 20:48:31.264760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.267143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6e4c9fd-63b3-405d-8458-14ad4171d22a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:31.269681 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e6e4c9fd-63b3-405d-8458-14ad4171d22a tempest-HypervisorAdminNegativeTestJSON-1961948077 tempest-HypervisorAdminNegativeTestJSON-1961948077-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024962 Oct 29 20:48:31.271302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 253/520] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:48:31 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:31.283485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-542a8b7e-5a41-4f75-869b-f76ebe267c88 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Calling method '.version_select at 0x7fa171c45670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:31.285359 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-542a8b7e-5a41-4f75-869b-f76ebe267c88 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] HTTP exception thrown: Hypervisor with ID '9abf041a-0173-4bff-bf75-6cdf42efe502' could not be found. Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-542a8b7e-5a41-4f75-869b-f76ebe267c88 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Request method failure captured: Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hypervisors/9abf041a-0173-4bff-bf75-6cdf42efe502 HTTP/1.1 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGcBFWFHZ7675f3YCDPEqmKnwivH_W2i0vbwSgsNsLklttVEpx3uOT0SbRXsI6jdoTcOEB3YgV2NFuGa78f24kA4WasrjyEzT-965rKLCa4MLrZcWrMphpPoQBeJ4qVwSa4G96yL5sQ3T0mZADMI9X-36vOcAIwtoMwXC3wYhRg7is Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: cc16b882bc31406bae1199d9c59b456d Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1024996952 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cc16b882bc31406bae1199d9c59b456d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1024996952 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: cc16b882bc31406bae1199d9c59b456d Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1024996952 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 12ff39bed8b143ef84be09e6e22a6e57 Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: exception: Hypervisor with ID '9abf041a-0173-4bff-bf75-6cdf42efe502' could not be found. Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9abf041a-0173-4bff-bf75-6cdf42efe502'} Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9abf041a-0173-4bff-bf75-6cdf42efe502' Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:31.288601 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9abf041a-0173-4bff-bf75-6cdf42efe502' could not be found. Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9abf041a-0173-4bff-bf75-6cdf42efe502' could not be found. Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-542a8b7e-5a41-4f75-869b-f76ebe267c88 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] Returning 404 to user: Hypervisor with ID '9abf041a-0173-4bff-bf75-6cdf42efe502' could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-542a8b7e-5a41-4f75-869b-f76ebe267c88 tempest-HypervisorAdminNegativeTestJSON-1024996952 tempest-HypervisorAdminNegativeTestJSON-1024996952-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/9abf041a-0173-4bff-bf75-6cdf42efe502" status: 404 len: 123 microversion: 2.1 time: 0.013188 Oct 29 20:48:31.302282 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 268/521] 10.222.0.36 () {58 vars in 1257 bytes} [Sat Oct 29 20:48:31 2022] GET /compute/v2.1/os-hypervisors/9abf041a-0173-4bff-bf75-6cdf42efe502 => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:31.620371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:31.621684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:31.647112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:31.647718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:31.648171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:31.651440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:31.654863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:31.655662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.013198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:32.014498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:32.031887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.034347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.034983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.038192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.039836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.040981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.317963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:32.338026 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b70732a8-ac4a-47a2-bbe8-eb02b201ca85 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.724100 Oct 29 20:48:32.342082 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 254/522] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:31 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:32.348542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:32.349955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:32.369518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.370460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.372093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.379373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.381033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.382723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.706977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:32.717146 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd5ab3c0-375a-441d-a1d8-9bf9b7cf2d6d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1318 microversion: 2.1 time: 0.708741 Oct 29 20:48:32.722564 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 269/523] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:32 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:32.738014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:32.739137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:32.754878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.758408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.758913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.760742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.761215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.766067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.848547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:32.859992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a68b96b-561a-44ac-8c3d-fd939f0f766f tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1467 microversion: 2.1 time: 0.516519 Oct 29 20:48:32.860585 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 255/524] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:32 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1467 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:32.888761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:32.889587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:32.900520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.901443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.902068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:32.908777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:32.909645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:32.910253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:33.039278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:33.049982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-adc7a859-91a8-4bc2-8f8b-c76729444033 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1265 microversion: 2.1 time: 0.326152 Oct 29 20:48:33.060428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lazy-loading 'flavor' on Instance uuid a7643ac7-93a1-4589-a8e7-8a9f16cb0174 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:33.067802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 270/525] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:32 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:33.273367 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22ee98a1-5744-4813-a175-93d803ce4bd6 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174/action" status: 202 len: 0 microversion: 2.1 time: 0.390083 Oct 29 20:48:33.274210 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 256/526] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:32 2022] POST /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:48:33.284042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:33.285079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:33.297669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:33.300533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:33.301330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:33.302382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:33.305575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:33.305906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:33.369168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:33.370492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:33.390425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:33.391083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:33.391747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:33.392629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:33.393393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:33.393988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:33.842581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:33.855227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:33.861707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dec43ddd-6e1c-4d66-a133-23a15364c45d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1475 microversion: 2.1 time: 0.582291 Oct 29 20:48:33.862871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 271/527] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:33 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1475 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:33.870792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:33.873659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:33.884344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-976276e9-ab5f-48fe-9cc3-b3dece2a7b34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.520775 Oct 29 20:48:33.893747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:33.896070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:33.896696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:33.898246 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 257/528] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:33 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:33.900418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:33.900917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:33.902516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.080496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:34.083204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:34.094979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.095806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.096484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.097449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.098204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.098854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.240560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:34.243530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:34.255941 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8dbfd40d-bc09-48f1-9615-2ed2a1561aef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1271 microversion: 2.1 time: 0.177890 Oct 29 20:48:34.274583 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 258/529] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:34 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:34.370633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:34.375935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:34.389249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-504f4839-5251-44d7-a56e-27d8bdef0bd0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1468 microversion: 2.1 time: 0.524956 Oct 29 20:48:34.394666 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 272/530] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:33 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1468 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:34.422209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1916404632"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:34.425591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:34.470472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.470978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.477624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.478785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.479272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.479708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.563205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7be9d043-9cae-4ff4-979b-2bb60331d213 req-ef9ff659-0f7b-419d-a3e5-11020296355f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dd6eeb-269e-423e-927e-921572b1522b", "name": "network-vif-plugged", "status": "completed", "tag": "f083a1fd-24f3-436d-b01b-b7c6837bee8b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:34.617484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7be9d043-9cae-4ff4-979b-2bb60331d213 req-ef9ff659-0f7b-419d-a3e5-11020296355f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.620120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7be9d043-9cae-4ff4-979b-2bb60331d213 req-ef9ff659-0f7b-419d-a3e5-11020296355f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.620755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7be9d043-9cae-4ff4-979b-2bb60331d213 req-ef9ff659-0f7b-419d-a3e5-11020296355f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.641224 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7be9d043-9cae-4ff4-979b-2bb60331d213 req-ef9ff659-0f7b-419d-a3e5-11020296355f service nova] Creating event network-vif-plugged:f083a1fd-24f3-436d-b01b-b7c6837bee8b for instance d7dd6eeb-269e-423e-927e-921572b1522b on nch1-master-1 Oct 29 20:48:34.651380 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7be9d043-9cae-4ff4-979b-2bb60331d213 req-ef9ff659-0f7b-419d-a3e5-11020296355f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096482 Oct 29 20:48:34.652582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 273/531] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:48:34.841343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aae4763a-bf60-43b8-ba6c-e2fe98ee332d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "POST /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896/action" status: 202 len: 0 microversion: 2.1 time: 0.423014 Oct 29 20:48:34.847736 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 259/532] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:34 2022] POST /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:48:34.854453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-296fbc7e-f809-452f-bb6b-f5db0e8286e6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c01f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:34.885701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:34.890755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:34.903039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.903560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.904005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.906486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:34.907134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:34.908869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:34.955199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-296fbc7e-f809-452f-bb6b-f5db0e8286e6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.105336 Oct 29 20:48:34.958831 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 274/533] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:34 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:34.980546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:34.982154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:35.016558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:35.017054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:35.017512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:35.027413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:35.027939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:35.028415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:35.918783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:35.935261 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8a59d80a-8d33-44fc-9068-e2554780f168 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.973006 Oct 29 20:48:35.953986 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 275/534] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:34 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:35.953986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:35.953986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:35.962281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:35.964510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:35.969589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:35.973864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:35.974592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:35.975368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:36.051768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:36.067751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4afd6b97-2c09-4160-ba32-abfba3bd990d tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1458 microversion: 2.1 time: 1.186486 Oct 29 20:48:36.078483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 260/535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:34 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1458 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:36.111454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b83477fb-9360-44be-bb4e-3c5cbbfac8d5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171ef7ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:36.225445 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b83477fb-9360-44be-bb4e-3c5cbbfac8d5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.145260 Oct 29 20:48:36.226474 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 261/536] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:36 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:36.239758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:36.243644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:36.259833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:36.263881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:36.264584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:36.268038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:36.271596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:36.273201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:36.673802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:36.732774 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3a58d72-54d1-4473-95a3-7f69058db3f1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.791334 Oct 29 20:48:36.733394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 276/537] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:35 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:36.968946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:36.970544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:36.984347 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-852f63c6-9a38-4b1f-864a-abaaaa5e40ad tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1609 microversion: 2.1 time: 0.752502 Oct 29 20:48:36.990525 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 262/538] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:36 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1609 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:36.999670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.000550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.001855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.003014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.003700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.005178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.022376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:37.028482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.029178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.029841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.030992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.031606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.032191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.050092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:37.069144 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5846b003-e571-416c-a375-7e2388b0aa6d tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059771 Oct 29 20:48:37.071247 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 263/539] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:48:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:37.094789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:37.102065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:37.116899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.117912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.118510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.119403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.120066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.120659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.227290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Lazy-loading 'flavor' on Instance uuid a7643ac7-93a1-4589-a8e7-8a9f16cb0174 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:37.249483 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 while it is in vm_state suspended Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Request method failure captured: Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174/action HTTP/1.1 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 97 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZF6ka5mxSQ4mUJq5yDSko4jzcoXfYNxlQZtdMCTABDFVUoNDtvbD0AGlHIHEpM8WbzLL-N4ELYnAPu13QXxuvlhz-S392NcQU4l_3AQFGjWmOmSyp-Ulr6sxrF2dPaEVlnU-_5CtLBZsI4P5u-vpsr3F4gWxphAknfUrawpM3VruYk Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ca3db0b7c4da4555bcc376df9d9ef16f Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-LiveMigrationNegativeTest-1398747367 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3db0b7c4da4555bcc376df9d9ef16f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-LiveMigrationNegativeTest-1398747367 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ca3db0b7c4da4555bcc376df9d9ef16f Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1398747367 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-LiveMigrationNegativeTest-1398747367-project-admin Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: aa502bebdb604f0083840ef9fcbbdb82 Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-LiveMigrationNegativeTest-1398747367-project-admin Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'os-migrateLive' instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 while it is in vm_state suspended Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'a7643ac7-93a1-4589-a8e7-8a9f16cb0174', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:37.251655 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 while it is in vm_state suspended Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 while it is in vm_state suspended Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 while it is in vm_state suspended {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:37.256079 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67ec3edf-472f-4942-849e-66efa2a945a8 tempest-LiveMigrationNegativeTest-1398747367 tempest-LiveMigrationNegativeTest-1398747367-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174/action" status: 409 len: 155 microversion: 2.1 time: 0.169042 Oct 29 20:48:37.263899 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 264/540] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:37 2022] POST /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174/action => generated 155 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:48:37.268991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7a8201b-48ba-46ad-8164-7325acee4133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171f20790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:37.323729 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7a8201b-48ba-46ad-8164-7325acee4133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.058095 Oct 29 20:48:37.332136 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 265/541] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:37 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:37.340862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:37.341399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:37.363588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.367203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.368552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.375200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.376027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.376630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.378651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:37.390666 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e8ca8bd-73fb-4f05-a75d-9a93da916bb2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1314 microversion: 2.1 time: 0.427178 Oct 29 20:48:37.391697 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 277/542] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:36 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:37.437715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:48:37.598116 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-658a9f6e-1472-4c9e-b708-2752e1967f94 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 204 len: 0 microversion: 2.1 time: 0.270671 Oct 29 20:48:37.601549 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 266/543] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:48:37 2022] DELETE /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:48:37.608859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:37.609889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:37.618434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.619191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.619851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.620788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.621608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.622966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.756962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:37.757974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:37.772121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.774030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.776762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:37.778595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:37.787671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:37.788600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:38.049672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:38.063850 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7df2b2ea-6bf4-4da4-8fe3-621e4b0a3586 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1464 microversion: 2.1 time: 0.459820 Oct 29 20:48:38.081987 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 278/544] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:37 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1464 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:38.081987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ca0b2ff5-e0a3-4b8c-b270-3823576474c5 req-b63fb2e0-db7b-4c9c-a1c6-c1e2019efa19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38b7560-af3b-4b34-9b58-1579730d6484", "tag": "a21152b8-9e98-4abd-8e16-2f6e6a4bced5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:38.099350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ca0b2ff5-e0a3-4b8c-b270-3823576474c5 req-b63fb2e0-db7b-4c9c-a1c6-c1e2019efa19 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:38.099840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ca0b2ff5-e0a3-4b8c-b270-3823576474c5 req-b63fb2e0-db7b-4c9c-a1c6-c1e2019efa19 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:38.100281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ca0b2ff5-e0a3-4b8c-b270-3823576474c5 req-b63fb2e0-db7b-4c9c-a1c6-c1e2019efa19 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:38.132985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ca0b2ff5-e0a3-4b8c-b270-3823576474c5 req-b63fb2e0-db7b-4c9c-a1c6-c1e2019efa19 service nova] Creating event network-changed:a21152b8-9e98-4abd-8e16-2f6e6a4bced5 for instance c38b7560-af3b-4b34-9b58-1579730d6484 on nch2-master-1 Oct 29 20:48:38.146026 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ca0b2ff5-e0a3-4b8c-b270-3823576474c5 req-b63fb2e0-db7b-4c9c-a1c6-c1e2019efa19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075489 Oct 29 20:48:38.147318 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 279/545] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:38.175830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:38.190487 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-755faaf0-50c1-49be-a1f2-54d0e70deb9a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.433605 Oct 29 20:48:38.193742 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 267/546] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:37 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:38.341339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7ce74d9-d434-4993-b826-d86e6fcb4e7d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c2a8b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:38.402731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7ce74d9-d434-4993-b826-d86e6fcb4e7d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.065966 Oct 29 20:48:38.412918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 280/547] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:38 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:38.419356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:38.420333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:38.431421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:38.436566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:38.437396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:38.439513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:38.443230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:38.444425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:38.765114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:38.774005 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4edca173-0f95-4361-8ea7-bb1ee504ee6d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1464 microversion: 2.1 time: 0.359246 Oct 29 20:48:38.801438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 268/548] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:38 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1464 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:39.089325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:39.090245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:39.116306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.119351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.120710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.125402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.126103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.128155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.373641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:39.381377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'deleted': False, 'project_id': 'a266480d98ec422baf2f711a32bd92ab'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:39.399515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.400609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.404241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.405378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.406116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.406788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.584089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:39.603079 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5df3dcd-542f-4ebb-9c83-348607126dd7 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1464 microversion: 2.1 time: 0.519960 Oct 29 20:48:39.604308 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 269/549] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:39 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1464 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:39.618880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:39.619742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:39.640660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.642229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.642699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.645441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.648596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.649278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.794501 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a57859e-ad1b-4e12-be00-3bc2cd3b07b7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.986998 Oct 29 20:48:39.795079 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 281/550] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:48:38 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:39.811810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-376107d7-b292-4509-bc44-a5d0b46594b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171dd5280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:39.876722 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-376107d7-b292-4509-bc44-a5d0b46594b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.080303 Oct 29 20:48:39.877746 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 282/551] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:39 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:39.882936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:39.892271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'deleted': False} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:39.896858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:39.899156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.899820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.900417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:39.901603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:39.902382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:39.903517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:40.123882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:48:40.216260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:40.225886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dffe8522-1180-48b7-b6f6-a9d28e0a1ee6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.619635 Oct 29 20:48:40.231626 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 270/552] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:39 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:40.463402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:40.464611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:40.466203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:40.627725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:40.628940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:40.639868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:40.641759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:40.642625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:40.646225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:40.646900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:40.649961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:41.161615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:41.788764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:41.804108 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1924e9aa-4ef0-43ea-bf38-d078ed8870d6 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1464 microversion: 2.1 time: 1.179034 Oct 29 20:48:41.806461 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 271/553] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:40 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1464 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:41.815451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9712e70e-cd42-45bb-8bbf-e2939055f1f3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d905e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:41.910102 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9712e70e-cd42-45bb-8bbf-e2939055f1f3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.102192 Oct 29 20:48:41.920784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 272/554] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:41 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:41.921355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:41.931661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:41.966669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:41.969184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:41.971496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:41.972519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:41.975795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:41.976483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.346367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ac7739e-e198-4aed-aeba-0eb8932c5c25 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16179 microversion: 2.1 time: 2.467371 Oct 29 20:48:42.347147 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 283/555] 10.222.0.36 () {58 vars in 1171 bytes} [Sat Oct 29 20:48:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16179 bytes in 2469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:48:42.352321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d8019ce7-7375-4490-b09d-92697724575c req-fcfa3434-d718-4be6-a8ea-717ec3caa702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7643ac7-93a1-4589-a8e7-8a9f16cb0174", "name": "network-vif-deleted", "tag": "fbab8b3f-a4d0-4de3-a9d4-380cf2d5b60c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:42.376465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d8019ce7-7375-4490-b09d-92697724575c req-fcfa3434-d718-4be6-a8ea-717ec3caa702 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.377202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d8019ce7-7375-4490-b09d-92697724575c req-fcfa3434-d718-4be6-a8ea-717ec3caa702 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.377833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d8019ce7-7375-4490-b09d-92697724575c req-fcfa3434-d718-4be6-a8ea-717ec3caa702 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.391344 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d8019ce7-7375-4490-b09d-92697724575c req-fcfa3434-d718-4be6-a8ea-717ec3caa702 service nova] Creating event network-vif-deleted:fbab8b3f-a4d0-4de3-a9d4-380cf2d5b60c for instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 on nch2-master-1 Oct 29 20:48:42.397219 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d8019ce7-7375-4490-b09d-92697724575c req-fcfa3434-d718-4be6-a8ea-717ec3caa702 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048595 Oct 29 20:48:42.398447 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 284/556] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:42.406615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:42.419518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'deleted': False, 'project_id': 'a266480d98ec422baf2f711a32bd92ab'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:42.439240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.441741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.442378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.443594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.444223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.445159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.460604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=13 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:42.498756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9fcbbd59-1f91-4c67-8eaa-19fcaa26bfb8 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?tenant_id=4fd6966959864b80b945ae69a275ca8f" status: 200 len: 15 microversion: 2.1 time: 0.098678 Oct 29 20:48:42.499989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 285/557] 10.222.0.36 () {58 vars in 1231 bytes} [Sat Oct 29 20:48:42 2022] GET /compute/v2.1/servers/detail?tenant_id=4fd6966959864b80b945ae69a275ca8f => generated 15 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:42.523668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:42.534331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'tenant_id': '4fd6966959864b80b945ae69a275ca8f', 'deleted': False} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:42.551728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.552273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.552722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.553540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.553994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.554421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.614268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:42.623986 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-484cb576-3e37-41f3-a372-600b3585c653 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.709521 Oct 29 20:48:42.638849 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 273/558] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:41 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:42.645049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:48:42.777180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.778162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.778850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.829583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:42.830847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:42.839924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.840643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.841259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.842190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.842825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.843415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.906798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:42.907305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:42.907749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:42.908204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lazy-loading 'fault' on Instance uuid a7643ac7-93a1-4589-a8e7-8a9f16cb0174 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:43.084538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:43.093038 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5507a9c6-67ef-40bd-acb2-49e09d4d8ab8 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 200 len: 1309 microversion: 2.1 time: 0.268491 Oct 29 20:48:43.103304 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 274/559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:42 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:43.120445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-42951f59-5c40-4caa-bec3-33ff17164799 req-64960736-6122-4f98-b7d0-7fa7c19a9490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "name": "network-vif-plugged", "status": "completed", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:43.137129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-42951f59-5c40-4caa-bec3-33ff17164799 req-64960736-6122-4f98-b7d0-7fa7c19a9490 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.137685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-42951f59-5c40-4caa-bec3-33ff17164799 req-64960736-6122-4f98-b7d0-7fa7c19a9490 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.138125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-42951f59-5c40-4caa-bec3-33ff17164799 req-64960736-6122-4f98-b7d0-7fa7c19a9490 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.151548 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-42951f59-5c40-4caa-bec3-33ff17164799 req-64960736-6122-4f98-b7d0-7fa7c19a9490 service nova] Creating event network-vif-plugged:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:48:43.167669 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-42951f59-5c40-4caa-bec3-33ff17164799 req-64960736-6122-4f98-b7d0-7fa7c19a9490 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062773 Oct 29 20:48:43.168288 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 275/560] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:43.174517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6a30218c-be08-451d-b9c8-a38d3e963989 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d7a1f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:43.249578 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9258d33-244e-4853-8d11-6fefaeaa063c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4fd6966959864b80b945ae69a275ca8f" status: 200 len: 4825 microversion: 2.1 time: 0.730692 Oct 29 20:48:43.249838 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6a30218c-be08-451d-b9c8-a38d3e963989 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.079401 Oct 29 20:48:43.261483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 286/562] 10.222.0.36 () {58 vars in 1257 bytes} [Sat Oct 29 20:48:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4fd6966959864b80b945ae69a275ca8f => generated 4825 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:43.262078 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 276/562] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:43 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:43.286435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:43.295687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'tenant_id': 'a266480d98ec422baf2f711a32bd92ab', 'deleted': False} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:43.308040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.310486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.311299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.313069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.318132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.320732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.387218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c10c463-f781-4a78-8246-e87364670afd tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a266480d98ec422baf2f711a32bd92ab" status: 200 len: 15 microversion: 2.1 time: 0.104174 Oct 29 20:48:43.391822 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 287/563] 10.222.0.36 () {58 vars in 1257 bytes} [Sat Oct 29 20:48:43 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a266480d98ec422baf2f711a32bd92ab => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:43.422663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5ca2f49-115e-4515-b964-3448312bbfda tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:43.432397 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5ca2f49-115e-4515-b964-3448312bbfda tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.024777 Oct 29 20:48:43.433296 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 277/564] 10.222.0.36 () {58 vars in 1189 bytes} [Sat Oct 29 20:48:43 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:43.458709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:43.462938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:43.472143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.473232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.473980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.474946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.475563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.476181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.656907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:43.658083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:43.683131 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b9968fc-3802-410f-9175-06d92bf41de4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 0 microversion: 2.1 time: 0.222254 Oct 29 20:48:43.692292 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 288/565] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:43 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:48:43.703135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.705873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.706775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.712660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.715158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:43.717445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.725068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.755247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:43.755247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '4fd6966959864b80b945ae69a275ca8f'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:43.807163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.807683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.808135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.808910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:43.809408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:43.809864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:43.825765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:44.022057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:48:44.169797 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f4b75b0-8f42-4bcf-8a05-63063407f863 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.475267 Oct 29 20:48:44.176989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 289/566] 10.222.0.36 () {58 vars in 1150 bytes} [Sat Oct 29 20:48:43 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:44.176989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:44.176989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: a7643ac7-93a1-4589-a8e7-8a9f16cb0174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:44.184796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.185230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.185830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.186449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.186938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.190710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.252007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:44.264993 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] HTTP exception thrown: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 could not be found. Oct 29 20:48:44.268409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d9cfcc7-55fe-4f1e-a5d1-1a2b368c4cfa tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.618050 Oct 29 20:48:44.284204 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 278/567] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:43 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Request method failure captured: Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 HTTP/1.1 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZF50del9xLXLXyUDe5hqgYgrQcEqe-3mBQuZFNQ6BzVrr8ZukPLIGl2d6B53r6p40rd6G2_lA0hjxG6BR67Zvk5pqOAbP1R12MuipiUOAAMmU8ltZT935wU9tq0x0Hs9G1EP_NpVUmCPtvvF6ud_onodLgjxQs6xwcs0-Y0Qtm8-FQ Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 72fe1048bfcd4a53866483b5495f4de0 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveMigrationNegativeTest-1663215900 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveMigrationNegativeTest-1663215900 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 72fe1048bfcd4a53866483b5495f4de0 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1663215900 Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveMigrationNegativeTest-1663215900-project Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d056b2a4e08348ff8ccdfb149f01cdaf Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveMigrationNegativeTest-1663215900-project Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 could not be found. Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a7643ac7-93a1-4589-a8e7-8a9f16cb0174'} Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 could not be found. Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 could not be found. Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:44.284526 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 could not be found. Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Returning 404 to user: Instance a7643ac7-93a1-4589-a8e7-8a9f16cb0174 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9847f15-1795-4367-b6bc-d8d09b769361 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174" status: 404 len: 111 microversion: 2.1 time: 0.100819 Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 290/568] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:44 2022] GET /compute/v2.1/servers/a7643ac7-93a1-4589-a8e7-8a9f16cb0174 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:44.288543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3216f6dd-6f10-4938-9d54-90ba7779b338 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c2a550>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:44.304904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:44.336255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:44.366470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.369324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.370335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.373814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.376423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.378480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.394013 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3216f6dd-6f10-4938-9d54-90ba7779b338 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.114102 Oct 29 20:48:44.395371 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 291/569] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:44 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:44.412601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:44.416028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:44.442287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.442287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.442287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.442978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.445277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.445866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.505594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:48:44.611392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd405c61-42e3-4de7-ae0b-c524392ef634 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 0 microversion: 2.1 time: 0.338069 Oct 29 20:48:44.612096 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 279/570] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:44 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:48:44.674925 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41006628-bb12-44ae-abd2-b8e0934ef11b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 204 len: 0 microversion: 2.1 time: 0.278280 Oct 29 20:48:44.678541 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 292/571] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:48:44 2022] DELETE /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:48:44.691160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:44.692330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:44.700148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.700809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.701263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.704617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.704617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.704617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.735201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61402e10-1008-4db0-b4b8-df8363eb26b6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Action: 'create', calling method: .version_select at 0x7fa171f204c0>, body: {"keypair": {"name": "tempest-keypair-476162476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfDE8pMN0+A7+vvlEi6kHMJbnNLUonX8BgkOZA1lw2A04p1MXGY/5gIhufnGasnfQTMWcj+dQonplldVMxPEYAk7mgDUFChnfnPmvnB+w09ndj8GaLBFKvS2ZD4Y2humQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:44.750823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:44.760759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-61402e10-1008-4db0-b4b8-df8363eb26b6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Getting quotas for project dfe32b0a32524e2bbaa26501305d418b. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:48:44.773963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-61402e10-1008-4db0-b4b8-df8363eb26b6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Getting quotas for user 91932364eb4e4742b5f7fc998d202a70 and project dfe32b0a32524e2bbaa26501305d418b. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:48:44.822000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61402e10-1008-4db0-b4b8-df8363eb26b6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206022 Oct 29 20:48:44.823345 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 280/572] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:48:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:44.829580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:44.830475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:44.840016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.840835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.842439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:44.843968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:44.844984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:44.846068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:45.048406 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-419826af-9014-4493-910a-48cd896ce945 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1614 microversion: 2.1 time: 0.368242 Oct 29 20:48:45.049068 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 293/573] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:44 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1614 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:45.083070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:45.083939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:45.117621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:45.118394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:45.118858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:45.119631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:45.120113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:45.120569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:45.504922 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6d33c0e-6a11-43ba-8443-df731c20bc12 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1614 microversion: 2.1 time: 0.426021 Oct 29 20:48:45.509876 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 294/574] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:45 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1614 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:45.514883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:45.520829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:45.540912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:45.541640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:45.542467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:45.543804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:45.544522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:45.545282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:45.578048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:45.588105 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d6074f2-2f23-45dc-823e-d4d258498082 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1474 microversion: 2.1 time: 0.763498 Oct 29 20:48:45.597857 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 281/575] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:44 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1474 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:45.610049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48ad9a0c-982c-42e4-8732-b85a771e14c4 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d49b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:45.715110 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48ad9a0c-982c-42e4-8732-b85a771e14c4 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.115857 Oct 29 20:48:45.725945 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 282/576] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:45 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:45.736286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:45.744011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:45.762789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:45.766119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:45.766823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:45.771949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:45.772786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:45.773522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:46.012397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:48:46.391272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:46.399529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3044c87-3ac5-4807-b7e8-e69b507366b9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.888354 Oct 29 20:48:46.424170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 295/577] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:45 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:46.627906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:46.629237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:46.645914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:46.654277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:46.662229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:46.663371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:46.665329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:46.666278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:46.813807 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a5b20070-38ce-41d4-90cf-d392ae3cf7a1 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2317 microversion: 2.1 time: 1.084854 Oct 29 20:48:46.814804 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 283/578] 10.222.0.36 () {58 vars in 1190 bytes} [Sat Oct 29 20:48:45 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2317 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:46.819901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26426f03-2857-4840-8fb1-7936308db3c0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d49e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:46.899560 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26426f03-2857-4840-8fb1-7936308db3c0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.083320 Oct 29 20:48:46.900712 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 284/579] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:46 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:46.911453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:46.924675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:48:46.939906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:46.940836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:46.942561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:46.943578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:46.946836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:46.947530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:46.989383 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55227c61-671d-45f5-83e3-78387c5f111f tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.086953 Oct 29 20:48:46.990822 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 285/580] 10.222.0.36 () {58 vars in 1196 bytes} [Sat Oct 29 20:48:46 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:48:47.004517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:47.007454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:47.024823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.025623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.026278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.027250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.033498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.034352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.186583 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd368f92-42c1-436d-a3b0-560308e56de5 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 0 microversion: 2.1 time: 0.185974 Oct 29 20:48:47.187985 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 286/581] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:46 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:48:47.196629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:47.200026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:47.214708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.218042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.218682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.219604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.228725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.229203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.391143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:48:47.395394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:48:47.396403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:48:47.399082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:48:47.400682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:48:47.565825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:47.573263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.573910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.574528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.575902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.577036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.577577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.620161 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd8d459d-c455-43d4-98bf-ea3b03f1b01d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 1067 microversion: 2.1 time: 0.426754 Oct 29 20:48:47.635033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 287/582] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:48:47 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 1067 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 29 20:48:47.642214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:47.643454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:47.657297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.657899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.658413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.659606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.659606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.661411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.678373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:47.689804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c10c781-2132-4e4b-b56e-ec9bedf4bc57 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1474 microversion: 2.1 time: 1.063886 Oct 29 20:48:47.691046 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 296/583] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:46 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1474 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:47.697568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:47.698532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:47.709305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.711191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.717842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:47.720561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:47.721685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:47.722349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:48.476388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:48.484800 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a50a293-090b-4204-a638-66e34406ab51 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1471 microversion: 2.1 time: 0.792467 Oct 29 20:48:48.494568 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 297/584] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:47 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1471 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:48.512694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2fc025e9-62a8-4cc1-a794-4e2e3c620c5c tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d64ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:48.618595 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2fc025e9-62a8-4cc1-a794-4e2e3c620c5c tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.122553 Oct 29 20:48:48.619365 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 298/585] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:48 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:48.687076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:48.724869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:48.725868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:48.730713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f81cefe9-43f6-4a65-b0e7-30dd32855534 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 1.094340 Oct 29 20:48:48.753895 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 288/586] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:47 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:48.754262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:48.754262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:48.754262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:48.754262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:48.754262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:48.754262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:49.523703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:49.524956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:49.542861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:49.543401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:49.543853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:49.549862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:49.551961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:49.553075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:50.157297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:50.213986 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f779a8a-901c-46a0-8687-a3ee717da314 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1474 microversion: 2.1 time: 1.500542 Oct 29 20:48:50.249042 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 299/587] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:48 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1474 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:50.255721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-006e3cac-e9d6-430e-8c21-acf0e9a16a2a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa172533040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:50.385248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:50.401665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8be3c2f7-8b81-4e7b-86f2-b58a98d559d5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1471 microversion: 2.1 time: 0.884526 Oct 29 20:48:50.413438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 289/588] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:49 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1471 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:48:50.413438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:50.415083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:50.429292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:50.432021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:50.432598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:50.434524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:50.436215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:50.437909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:50.487213 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-006e3cac-e9d6-430e-8c21-acf0e9a16a2a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.235348 Oct 29 20:48:50.489210 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 300/589] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:50 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:50.503049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-96ea80c3-88b5-4578-80af-943240a4e421 req-9f78bb58-eb58-41d7-a36d-c2f147fe08c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f5fbc1-cc84-4c77-8170-cb755717648c", "name": "network-vif-deleted", "tag": "9f17c0af-1664-4c1f-808e-3418b927e975"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:50.537434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-96ea80c3-88b5-4578-80af-943240a4e421 req-9f78bb58-eb58-41d7-a36d-c2f147fe08c2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:50.541621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-96ea80c3-88b5-4578-80af-943240a4e421 req-9f78bb58-eb58-41d7-a36d-c2f147fe08c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:50.543822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-96ea80c3-88b5-4578-80af-943240a4e421 req-9f78bb58-eb58-41d7-a36d-c2f147fe08c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:50.568335 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-96ea80c3-88b5-4578-80af-943240a4e421 req-9f78bb58-eb58-41d7-a36d-c2f147fe08c2 service nova] Creating event network-vif-deleted:9f17c0af-1664-4c1f-808e-3418b927e975 for instance e5f5fbc1-cc84-4c77-8170-cb755717648c on nch1-master-1 Oct 29 20:48:50.595164 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-96ea80c3-88b5-4578-80af-943240a4e421 req-9f78bb58-eb58-41d7-a36d-c2f147fe08c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102457 Oct 29 20:48:50.601198 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 301/590] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:48:51.252414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:51.254275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:51.268818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:51.285436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:51.286302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:51.291450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:51.293746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:51.294497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:51.415206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:51.416116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:51.417332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:51.418856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lazy-loading 'fault' on Instance uuid e5f5fbc1-cc84-4c77-8170-cb755717648c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:48:51.974454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd056b2a4e08348ff8ccdfb149f01cdaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fe1048bfcd4a53866483b5495f4de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:51.985143 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c25f0d2b-8801-4590-aa04-9a1964f5d78b tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 200 len: 1309 microversion: 2.1 time: 0.738709 Oct 29 20:48:51.988296 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 302/591] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:51 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 1309 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:52.017272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:52.020949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:52.060036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:52.060842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:52.061817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:52.063395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:52.079540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:52.080396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:52.551232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:52.563280 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-057e79d2-6481-492d-b9ff-231198efc2ad tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 2.155668 Oct 29 20:48:52.573516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 290/592] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:50 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:52.592696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dad27850-2b61-4189-9a18-fb5f37aab596 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171fa3d30>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:52.727713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dad27850-2b61-4189-9a18-fb5f37aab596 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1455 microversion: 2.1 time: 0.162234 Oct 29 20:48:52.738277 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 291/593] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:52 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:52.769585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=31 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:53.017404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:53.018082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] [instance: e5f5fbc1-cc84-4c77-8170-cb755717648c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:53.068853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:53.069372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:53.069860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:53.070601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:53.071067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:53.071508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:53.126136 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] HTTP exception thrown: Instance e5f5fbc1-cc84-4c77-8170-cb755717648c could not be found. Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Request method failure captured: Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c HTTP/1.1 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZF50del9xLXLXyUDe5hqgYgrQcEqe-3mBQuZFNQ6BzVrr8ZukPLIGl2d6B53r6p40rd6G2_lA0hjxG6BR67Zvk5pqOAbP1R12MuipiUOAAMmU8ltZT935wU9tq0x0Hs9G1EP_NpVUmCPtvvF6ud_onodLgjxQs6xwcs0-Y0Qtm8-FQ Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 72fe1048bfcd4a53866483b5495f4de0 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-LiveMigrationNegativeTest-1663215900 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/72fe1048bfcd4a53866483b5495f4de0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-LiveMigrationNegativeTest-1663215900 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 72fe1048bfcd4a53866483b5495f4de0 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1663215900 Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-LiveMigrationNegativeTest-1663215900-project Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d056b2a4e08348ff8ccdfb149f01cdaf Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-LiveMigrationNegativeTest-1663215900-project Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance e5f5fbc1-cc84-4c77-8170-cb755717648c could not be found. Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e5f5fbc1-cc84-4c77-8170-cb755717648c'} Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f5fbc1-cc84-4c77-8170-cb755717648c could not be found. Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f5fbc1-cc84-4c77-8170-cb755717648c could not be found. Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:48:53.128352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f5fbc1-cc84-4c77-8170-cb755717648c could not be found. Oct 29 20:48:53.135178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:48:53.138934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] Returning 404 to user: Instance e5f5fbc1-cc84-4c77-8170-cb755717648c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:48:53.148509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-811817e5-bdca-496d-8b24-c9f864cc9002 tempest-LiveMigrationNegativeTest-1663215900 tempest-LiveMigrationNegativeTest-1663215900-project] 10.222.0.36 "GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c" status: 404 len: 111 microversion: 2.1 time: 0.136578 Oct 29 20:48:53.154050 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 292/594] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:53 2022] GET /compute/v2.1/servers/e5f5fbc1-cc84-4c77-8170-cb755717648c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:48:53.162568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:53.192110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83095302-e3d3-40f7-9562-3f8b802329d8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1471 microversion: 2.1 time: 1.181974 Oct 29 20:48:53.193138 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 303/595] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:51 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1471 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:53.593257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:53.593925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:53.616639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:53.623629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:53.625136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:53.627228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:53.630655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:53.641294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:53.746908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-844bf1f6-eadf-45fe-af5a-bfe3f3d0023c tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c4a670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:53.928126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=7 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:54.071002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:54.083134 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d944a57-da5a-40a6-9077-5f779721aa3b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.494172 Oct 29 20:48:54.095821 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 293/596] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:53 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:54.218091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:54.218913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:54.233498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:54.246191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:54.246691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:54.247644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:54.250154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:54.254695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:54.789733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:55.555395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:55.573427 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b0528c8-69b8-48f5-b948-6fbb97d87a57 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1471 microversion: 2.1 time: 1.361002 Oct 29 20:48:55.623871 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 294/597] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:54 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1471 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:55.635749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:55.638723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:55.659029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:55.659945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:55.660579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:55.664355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:55.665074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:55.665753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:55.678164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:55.986244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:55.999600 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-561c89ec-b69d-492b-affa-66edd9e9f267 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 0.373492 Oct 29 20:48:56.018309 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 295/598] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:55 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:56.424576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a59bf9e5-d5e6-4710-9b49-91dab5a004a0 req-6e482ed2-0080-482c-8289-33f8b0f75c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38b7560-af3b-4b34-9b58-1579730d6484", "name": "network-vif-plugged", "status": "completed", "tag": "a21152b8-9e98-4abd-8e16-2f6e6a4bced5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:48:56.442750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a59bf9e5-d5e6-4710-9b49-91dab5a004a0 req-6e482ed2-0080-482c-8289-33f8b0f75c74 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:56.443269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a59bf9e5-d5e6-4710-9b49-91dab5a004a0 req-6e482ed2-0080-482c-8289-33f8b0f75c74 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:56.443710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a59bf9e5-d5e6-4710-9b49-91dab5a004a0 req-6e482ed2-0080-482c-8289-33f8b0f75c74 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:56.477267 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a59bf9e5-d5e6-4710-9b49-91dab5a004a0 req-6e482ed2-0080-482c-8289-33f8b0f75c74 service nova] Creating event network-vif-plugged:a21152b8-9e98-4abd-8e16-2f6e6a4bced5 for instance c38b7560-af3b-4b34-9b58-1579730d6484 on nch2-master-1 Oct 29 20:48:56.487185 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a59bf9e5-d5e6-4710-9b49-91dab5a004a0 req-6e482ed2-0080-482c-8289-33f8b0f75c74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067352 Oct 29 20:48:56.488038 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 296/599] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:48:56.609204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:56.610546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:56.628294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:56.633361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:56.634449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:56.639662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:56.641693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:56.644181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:56.966524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:48:57.198538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:57.286261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0bee81f-76f2-4be9-8e41-ad59782e81ba tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1471 microversion: 2.1 time: 0.682124 Oct 29 20:48:57.288367 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 297/600] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:56 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1471 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:57.299471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:57.300003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:57.317853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:57.318722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:57.319336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:57.320784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:57.321394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:57.322820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:57.398703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:48:57.579249 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fcd9b7c5-7b84-475c-b77b-977af0cce47f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 204 len: 0 microversion: 2.1 time: 0.289311 Oct 29 20:48:57.580327 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 298/601] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:48:57 2022] DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:48:57.599601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:48:57.612175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:48:57.627192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:57.635546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:57.638841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:57.641100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:48:57.642463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:48:57.646065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:48:58.692000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:48:58.711021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af669a22-34d1-4539-8946-55d0bc63bf7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1313 microversion: 2.1 time: 1.126016 Oct 29 20:48:58.716781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 299/602] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:48:57 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1313 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:48:58.736910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-157800541", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "839638491", "adminPass": "***", "networks": [{"uuid": "dba6aa7d-5650-42ae-bd56-54091ec6d0c3"}], "security_groups": [{"name": "tempest-securitygroup--200950616"}], "key_name": "tempest-keypair-189153438", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:02.058306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:03.167046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=50 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:08.699459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:08.778317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:14.101887 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-844bf1f6-eadf-45fe-af5a-bfe3f3d0023c tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1464 microversion: 2.1 time: 20.359256 Oct 29 20:49:14.103159 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 304/603] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:48:53 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1464 bytes in 20361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:14.110486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:14.111367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:14.120222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:14.121099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:14.121584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:14.122334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:14.123045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:14.125944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:14.171803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] validate_networks() for [('dba6aa7d-5650-42ae-bd56-54091ec6d0c3', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:49:14.468712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:14.494342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-646c9571-037f-4bee-874a-255db1bf9910 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1477 microversion: 2.1 time: 0.389149 Oct 29 20:49:14.495580 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 305/604] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:14 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1477 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:14.501817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:14.502649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:14.510239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:14.511197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:14.512501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:14.513622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:14.515998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:14.516651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:14.772525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:14.782320 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2306eb1f-60b8-4e23-a86e-dc58fe37b21f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1463 microversion: 2.1 time: 0.284534 Oct 29 20:49:14.782911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 306/605] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:14 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1463 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:14.922098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:14.922393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:14.923076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:14.923655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:14.924241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:14.936323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:14.937106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:14.937791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:14.938756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:14.939408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:14.940015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:14.976869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Getting quotas for project 6d30b30d07b045bb9a79cc3668a15242. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:14.996056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Getting quotas for user b9f2e85461844c6db1e27a0b5d084362 and project 6d30b30d07b045bb9a79cc3668a15242. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:15.034257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:49:15.036765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2b8d9a5-7816-47c4-8d88-c41d7109265a tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] Calling method '.version_select at 0x7fa1719c23a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:15.037881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:49:15.057421 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2b8d9a5-7816-47c4-8d88-c41d7109265a tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.273191 Oct 29 20:49:15.058890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 307/606] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 20:49:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:15.110712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-851769cd-c02b-4862-b904-be61f006c748 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 16.390471 Oct 29 20:49:15.117800 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 300/607] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:48:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 16396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:49:15.119004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-25c50985-76d3-4eda-949a-bd1e5c0530de req-e97e44ae-c408-4bc5-9d4e-01b4a965bb4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081ac346-df70-4c2f-803e-94f0d633b72a", "name": "network-vif-deleted", "tag": "74ef1822-ac00-431f-8dce-a62df761b0f3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:15.132431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-25c50985-76d3-4eda-949a-bd1e5c0530de req-e97e44ae-c408-4bc5-9d4e-01b4a965bb4b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.133024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-25c50985-76d3-4eda-949a-bd1e5c0530de req-e97e44ae-c408-4bc5-9d4e-01b4a965bb4b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.133576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-25c50985-76d3-4eda-949a-bd1e5c0530de req-e97e44ae-c408-4bc5-9d4e-01b4a965bb4b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.170043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-25c50985-76d3-4eda-949a-bd1e5c0530de req-e97e44ae-c408-4bc5-9d4e-01b4a965bb4b service nova] Creating event network-vif-deleted:74ef1822-ac00-431f-8dce-a62df761b0f3 for instance 081ac346-df70-4c2f-803e-94f0d633b72a on nch1-master-1 Oct 29 20:49:15.175866 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-25c50985-76d3-4eda-949a-bd1e5c0530de req-e97e44ae-c408-4bc5-9d4e-01b4a965bb4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060413 Oct 29 20:49:15.181799 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 301/608] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:15.190456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6f463093-cdec-4ebb-82e6-dd732ab6f82a req-acc42978-d992-4ec0-b598-aa70f4a94c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:15.204962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6f463093-cdec-4ebb-82e6-dd732ab6f82a req-acc42978-d992-4ec0-b598-aa70f4a94c99 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.206365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6f463093-cdec-4ebb-82e6-dd732ab6f82a req-acc42978-d992-4ec0-b598-aa70f4a94c99 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.207802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6f463093-cdec-4ebb-82e6-dd732ab6f82a req-acc42978-d992-4ec0-b598-aa70f4a94c99 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.228826 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6f463093-cdec-4ebb-82e6-dd732ab6f82a req-acc42978-d992-4ec0-b598-aa70f4a94c99 service nova] Creating event network-vif-unplugged:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:49:15.229291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-943762087", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "151c0760-9de5-4226-8749-cb91b64e1da1"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:15.236199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6f463093-cdec-4ebb-82e6-dd732ab6f82a req-acc42978-d992-4ec0-b598-aa70f4a94c99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051714 Oct 29 20:49:15.237121 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 302/609] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:15.317869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-206674116", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:15.322919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] validate_networks() for [('151c0760-9de5-4226-8749-cb91b64e1da1', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:49:15.386868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:15.387561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:15.388236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:15.388864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:15.389515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:15.400850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.401323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.401833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.403153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.403622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.404421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.429235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Getting quotas for project 4b08ea740b7543c8b50c67c6b82a4d17. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:15.435798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Getting quotas for user 859b2544443d42cc9ef5ecc6f1e26f4f and project 4b08ea740b7543c8b50c67c6b82a4d17. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:15.451712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:49:15.455443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:49:15.523333 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36342424-f1af-40c7-962d-b9b96c6c2ee1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.282261 Oct 29 20:49:15.524404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 303/610] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:49:15.531496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0dead9f-b7aa-47c0-8c6b-736c6b210d88 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa172040ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:15.594125 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0dead9f-b7aa-47c0-8c6b-736c6b210d88 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 200 len: 1464 microversion: 2.1 time: 0.068088 Oct 29 20:49:15.594617 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 304/611] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:15 2022] GET /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:15.610821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:15.614266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:15.622411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.622912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.623358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.624073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.625183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.625594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.828755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:15.845491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Old instance type m1.heat2, new instance type m1.heat {{(pid=138884) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 20:49:15.854795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:15.856357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:15.856872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:15.857298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:15.857797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:15.879520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:15.880442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:15.881315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:15.882316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:15.883085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:15.899274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.902888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.906211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.907642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:15.910280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:15.910953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:15.933189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:15.939997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for user 869b7117eab8443e9cbb52400b875ebc and project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:15.956106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:49:15.958571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:49:16.018832 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9aac502c-4a9e-42aa-b81f-5dde8072124b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958500 Oct 29 20:49:16.020543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 308/612] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:49:16.027631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8aa83925-8c9a-4d2c-bdb1-6a3defe2e14e tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] Action: 'update', calling method: .version_select at 0x7fa171e04700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:16.056186 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d77030d0-f885-4c06-af49-f7a1992b6185 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484/action" status: 202 len: 0 microversion: 2.1 time: 0.449903 Oct 29 20:49:16.059919 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 305/613] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:49:15 2022] POST /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:49:16.071295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:16.072621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:16.080967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.081822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.082551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.083495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.084188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.084827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.245967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:16.266353 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67034a7b-2d01-435c-913a-1651565ceb09 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1313 microversion: 2.1 time: 0.205025 Oct 29 20:49:16.266955 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 306/614] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:16 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:16.291375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:16.294265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:16.310508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.311845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.312500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.313622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.314526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.315267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.443552 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8aa83925-8c9a-4d2c-bdb1-6a3defe2e14e tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.418690 Oct 29 20:49:16.451215 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 309/615] 10.222.0.36 () {60 vars in 1206 bytes} [Sat Oct 29 20:49:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:16.459423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:16.464308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:16.494103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.497752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.497752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.498032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.507534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.508410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.633737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:16.643691 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-46b2eb4f-0c19-4bb6-9a9d-e8e826d7819a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1477 microversion: 2.1 time: 0.369356 Oct 29 20:49:16.644299 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 307/616] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:16 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1477 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:16.680118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:16.680812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:16.706878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.707388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.707827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.708543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.709005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.709434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.732368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:16.741659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:16.743134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:16.751919 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a18d52b2-f83b-4603-acb6-8f0ff21caa13 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "PUT /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1354 microversion: 2.75 time: 0.299433 Oct 29 20:49:16.752722 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 310/617] 10.222.0.36 () {62 vars in 1297 bytes} [Sat Oct 29 20:49:16 2022] PUT /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:16.757337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-936cec70-bf52-455c-89df-38763ca676cf tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:16.757998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-936cec70-bf52-455c-89df-38763ca676cf tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:16.924821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-936cec70-bf52-455c-89df-38763ca676cf tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:16.935713 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-936cec70-bf52-455c-89df-38763ca676cf tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1210 microversion: 2.1 time: 0.181538 Oct 29 20:49:16.936379 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 311/618] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:16 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1210 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:16.957706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:16.958656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:16.968016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.968796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.969405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:16.970203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:16.970589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:16.971026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.044383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:17.062455 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f9ecef18-9d0f-4b80-bb49-85246f730e1b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1468 microversion: 2.1 time: 0.401363 Oct 29 20:49:17.077059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 308/619] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:16 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1468 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:17.077059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7309f7e-bc8b-49cc-97e9-f10e116fb7b7 tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] Calling method '.version_select at 0x7fa171d49c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:17.113727 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d7309f7e-bc8b-49cc-97e9-f10e116fb7b7 tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.047463 Oct 29 20:49:17.114813 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 309/620] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 20:49:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:17.125987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:17.126795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:17.143254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.146136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.147114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.150643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.151325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.153200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.299285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:17.309097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d71b5104-ba06-4fcb-a547-26b5dfcb4bbd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1472 microversion: 2.1 time: 0.357100 Oct 29 20:49:17.311770 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 312/621] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:16 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:17.326280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-631023948"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:17.328945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:17.350901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.351546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.352091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.352873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.353442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.353906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.415678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:17.432479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:17.434631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:17.451658 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a7b3db5b-6a4d-497b-88ad-cf91e4ca668f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1410 microversion: 2.75 time: 0.335617 Oct 29 20:49:17.452269 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 310/622] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:17 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1410 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:17.458684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b9257af5-f94e-4bf2-b836-68555071e5eb tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] Action: 'update', calling method: .version_select at 0x7fa171f30ca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:17.691253 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b9257af5-f94e-4bf2-b836-68555071e5eb tempest-QuotaClassesAdminTestJSON-1600418803 tempest-QuotaClassesAdminTestJSON-1600418803-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.235266 Oct 29 20:49:17.694326 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 311/623] 10.222.0.36 () {60 vars in 1206 bytes} [Sat Oct 29 20:49:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:17.710926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2cbffd68-6243-4af5-aff6-c7af18bb6be5 req-ae3fed8a-cd56-45b1-a7cf-c31edc26ecf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "name": "network-vif-plugged", "status": "completed", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:17.719692 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b4bfe80-7c64-4887-a80d-9d5065c22f46 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "POST /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5/action" status: 202 len: 0 microversion: 2.1 time: 0.406409 Oct 29 20:49:17.720659 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 313/624] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:49:17 2022] POST /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:49:17.735234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:17.735763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:17.750905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.754086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.755121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.755588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cbffd68-6243-4af5-aff6-c7af18bb6be5 req-ae3fed8a-cd56-45b1-a7cf-c31edc26ecf9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.756247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.756900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.757074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cbffd68-6243-4af5-aff6-c7af18bb6be5 req-ae3fed8a-cd56-45b1-a7cf-c31edc26ecf9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.759315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cbffd68-6243-4af5-aff6-c7af18bb6be5 req-ae3fed8a-cd56-45b1-a7cf-c31edc26ecf9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.760051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.797748 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2cbffd68-6243-4af5-aff6-c7af18bb6be5 req-ae3fed8a-cd56-45b1-a7cf-c31edc26ecf9 service nova] Creating event network-vif-plugged:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:49:17.815535 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2cbffd68-6243-4af5-aff6-c7af18bb6be5 req-ae3fed8a-cd56-45b1-a7cf-c31edc26ecf9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117774 Oct 29 20:49:17.821566 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 312/625] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:17.830997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:17.832101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:17.843476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.844323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.845402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.846543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:17.847252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:17.848115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:17.937241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:17.948023 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fad27290-1a15-4b93-9376-59d69f2db732 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1319 microversion: 2.1 time: 0.226440 Oct 29 20:49:17.952422 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 314/626] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:17 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:17.964204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25aaa717-6a0b-4570-91bd-a9fd8600dd5d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171940af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:18.046279 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25aaa717-6a0b-4570-91bd-a9fd8600dd5d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.089686 Oct 29 20:49:18.047358 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 315/627] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:17 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:18.055456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:18.062022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:18.077054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.081564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.084342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.085216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.086831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.089193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.192209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:18.207558 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5e12f37-cf85-44fb-a6a5-48b67a9ea03d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1262 microversion: 2.1 time: 0.158758 Oct 29 20:49:18.219162 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 316/628] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:18 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:18.223200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:18.232267 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cbe44d50-d5dd-433c-8944-fed8809f2c92 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1477 microversion: 2.1 time: 0.406544 Oct 29 20:49:18.232847 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 313/629] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:17 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1477 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:18.338155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:18.339236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:18.348106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.349623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.350316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.351242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.351928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.352569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.480886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:18.482748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:18.496646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.497650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.498310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.500479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.504392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.505381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.664969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:18.680042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:18.692596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:18.694879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:18.695989 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-84dc00da-d6d4-425c-9ef4-3323eb5c3bfd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1472 microversion: 2.1 time: 0.361621 Oct 29 20:49:18.696910 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 317/630] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:18 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:18.704181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b21c3ac7-df10-4303-8b0c-6aeddce31753 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1416 microversion: 2.75 time: 0.228279 Oct 29 20:49:18.725877 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 314/631] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:18 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1416 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:18.976606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:18.977955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:18.986946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.988966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.992247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:18.997063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:18.998118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:18.999167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.064349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f28b72a7-67df-4e7f-8359-fbff6d3aaf9f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1721b71f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:19.179897 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f28b72a7-67df-4e7f-8359-fbff6d3aaf9f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.121065 Oct 29 20:49:19.182036 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 315/632] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:19 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:19.232660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:19.233594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:19.251238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:19.252030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:19.252632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.253540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:19.255257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:19.255865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.473921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:19.486516 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de43e7fa-951f-4025-803b-f061d0f8ddf4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1268 microversion: 2.1 time: 0.259564 Oct 29 20:49:19.487153 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 316/633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:19 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1268 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:19.502682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:19.503342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:19.517850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:19.518265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:19.518701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.521274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:19.521793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:19.522236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.540580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:19.557140 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ebbeefb9-5e8a-458c-9f28-ed26d610cd26 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.584636 Oct 29 20:49:19.573505 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 318/634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:18 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:19.723102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:19.723975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:19.739565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:19.742102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:19.742828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.746292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:19.748943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:19.757361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:19.994703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.008646 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfa6f57b-0c8b-4e9d-9d0d-97344d7154a6 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1477 microversion: 2.1 time: 0.520491 Oct 29 20:49:20.009402 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 317/635] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:19 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1477 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:20.018283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:20.020983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:20.035434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.036231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.037384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.039007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.039697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.040375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.152780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.168604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.170350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.184014 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85116d7c-5a1a-4983-af1d-419943658165 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1416 microversion: 2.75 time: 0.172749 Oct 29 20:49:20.191912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.202529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f6564ee-e614-4683-8af0-7b16064f9547 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1472 microversion: 2.1 time: 0.485664 Oct 29 20:49:20.212131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 318/636] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:20 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1416 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:20.218335 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 319/637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:19 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:20.223924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7236be42-b72a-404c-ad5f-fd60c9f73644 req-746c6a38-84e2-4b96-ad36-97abb57a5793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "name": "network-vif-unplugged", "status": "completed", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:20.229589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4981f68b-db7f-4973-b238-0bc05d2ddf9f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171974a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:20.242333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7236be42-b72a-404c-ad5f-fd60c9f73644 req-746c6a38-84e2-4b96-ad36-97abb57a5793 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.243599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7236be42-b72a-404c-ad5f-fd60c9f73644 req-746c6a38-84e2-4b96-ad36-97abb57a5793 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.244368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7236be42-b72a-404c-ad5f-fd60c9f73644 req-746c6a38-84e2-4b96-ad36-97abb57a5793 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.271622 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7236be42-b72a-404c-ad5f-fd60c9f73644 req-746c6a38-84e2-4b96-ad36-97abb57a5793 service nova] Creating event network-vif-unplugged:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:49:20.284839 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7236be42-b72a-404c-ad5f-fd60c9f73644 req-746c6a38-84e2-4b96-ad36-97abb57a5793 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071230 Oct 29 20:49:20.285891 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 319/638] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:20.302654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4981f68b-db7f-4973-b238-0bc05d2ddf9f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.082900 Oct 29 20:49:20.303525 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 320/639] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:20 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:20.433994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-954c2663-f6ab-4429-aa98-def5b13db1fc req-e2ddeb49-28bb-4884-b171-46528ce07972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37204d7-69fa-4ef8-abc6-b76eca0c482c", "tag": "cb71f2c0-f460-43a7-8ad9-bbc3adcc1363"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:20.447695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:20.454151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-954c2663-f6ab-4429-aa98-def5b13db1fc req-e2ddeb49-28bb-4884-b171-46528ce07972 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.454979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-954c2663-f6ab-4429-aa98-def5b13db1fc req-e2ddeb49-28bb-4884-b171-46528ce07972 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.456870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-954c2663-f6ab-4429-aa98-def5b13db1fc req-e2ddeb49-28bb-4884-b171-46528ce07972 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.515573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:20.517597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:20.522098 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-954c2663-f6ab-4429-aa98-def5b13db1fc req-e2ddeb49-28bb-4884-b171-46528ce07972 service nova] Creating event network-changed:cb71f2c0-f460-43a7-8ad9-bbc3adcc1363 for instance f37204d7-69fa-4ef8-abc6-b76eca0c482c on nch2-master-1 Oct 29 20:49:20.538091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.541222 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-954c2663-f6ab-4429-aa98-def5b13db1fc req-e2ddeb49-28bb-4884-b171-46528ce07972 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120358 Oct 29 20:49:20.543829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.545739 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 320/640] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:20.545982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.547264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.548144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.549047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.584574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:20.586188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:20.601920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.605977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.609922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.611925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:20.612579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:20.614066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:20.690030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.709063 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-791945bf-327c-4052-9f4c-507c73c1d30b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1268 microversion: 2.1 time: 0.203773 Oct 29 20:49:20.709678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 321/641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:20 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:20.886686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:20.898170 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-197b15b4-c65b-4845-a7c6-e799265629c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.320654 Oct 29 20:49:20.913367 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 321/642] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:20 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:21.036921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:21.038506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:21.046097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.046870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.047480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.050355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.051117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.051747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.213328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:21.214197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:21.221169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.221849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.222449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.223325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.223942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.224527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.373111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:21.386052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:21.390264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:21.403928 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa8dcc98-fcaa-4117-8eca-6b49ee0a5de0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1437 microversion: 2.75 time: 0.194446 Oct 29 20:49:21.405213 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 322/643] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:21 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1437 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:49:21.420287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:21.421482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:21.439959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.442076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.442720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.445279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.447684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.448313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.476054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:21.495232 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bd7175d7-8562-4ad5-9835-c5b8ec0a7593 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1477 microversion: 2.1 time: 0.467310 Oct 29 20:49:21.534180 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 322/644] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:21 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:21.547719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fc42eb5-5701-4e92-9f5e-6e5bd4ef13a3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d83820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:21.632281 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9fc42eb5-5701-4e92-9f5e-6e5bd4ef13a3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.096963 Oct 29 20:49:21.636816 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 323/645] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:21 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:21.648519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:21.652277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:21.660203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.660918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.661580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.662440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.663048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.663624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.771087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:21.771850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:21.772488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:21.773059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:21.773701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:21.804881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:21.808747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:21.813760 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b893b3a-47d6-4bc6-8583-c9f41da33e99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1472 microversion: 2.1 time: 0.407293 Oct 29 20:49:21.820979 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 323/646] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:21 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:21.826291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:21.828741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:21.847121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.847892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.848502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.849383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.850029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.852096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.885075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:21.893606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10,nova_api:UPDATE=12 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:21.904492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.905186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.905731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.908082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:21.909175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:21.911596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:21.948449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:22.087455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.104697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.111053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.127382 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5de62abd-dba3-4634-8c8f-92b1a6b27b42 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "POST /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d/action" status: 202 len: 1494 microversion: 2.75 time: 0.486896 Oct 29 20:49:22.128213 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 324/647] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:49:21 2022] POST /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d/action => generated 1494 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 20:49:22.155284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:22.156448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:22.164281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:22.164944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:22.166006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:22.166851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:22.167714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:22.168240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:22.168917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.178959 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8eef4529-9b47-48a1-9362-2a41015451ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.356199 Oct 29 20:49:22.179702 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 324/648] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:21 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:22.185954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:22.186742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:22.194274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:22.194986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:22.195591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:22.196513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:22.197121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:22.197752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:22.343480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.364794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.367779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.375585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b20ca39-227b-4027-bc2a-85550241e270 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.194486 Oct 29 20:49:22.376665 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 325/649] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:22 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:22.527267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:22.538205 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64bfd691-0086-4601-bf80-77e31910ae06 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.408853 Oct 29 20:49:22.550681 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 325/650] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:22 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:22.559354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:22.559885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:22.565906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:22.566398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:22.566828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:22.567527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:22.567982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:22.568409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:22.640965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-586f165c-d7f7-4932-aeed-189fd3137519 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] Action: 'create', calling method: .version_select at 0x7fa1725915e0>, body: {"security_group": {"name": "tempest-securitygroup-376542995", "description": "tempest-description-1691995643"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:23.052882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:23.061787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fc6f59b7-4f1d-44cb-9ec5-ed973f28cc14 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1463 microversion: 2.1 time: 0.508142 Oct 29 20:49:23.078304 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 326/651] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:22 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1463 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:23.087087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15c36b79-6e54-465e-84f6-3a2939135bb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171974160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:23.147854 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15c36b79-6e54-465e-84f6-3a2939135bb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.068243 Oct 29 20:49:23.149725 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 327/652] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:23 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:23.164107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:23.169031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:23.178566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:23.179800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:23.181682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:23.182980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:23.183770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:23.184367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:23.913387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:23.925254 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-50448510-d218-49d6-8f16-986e497dc9cd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1472 microversion: 2.1 time: 0.770267 Oct 29 20:49:23.926462 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 328/653] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:23 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1472 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:23.933919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:23.934722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:23.946778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:23.947598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:23.949332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:23.952292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:23.952940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:23.953739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.158090 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-586f165c-d7f7-4932-aeed-189fd3137519 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.765498 Oct 29 20:49:24.160307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 326/654] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:49:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:24.168267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-819e09de-4902-47a2-a369-2012eb524fdd req-338cb22b-6981-44de-ae40-1cd7149bb00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a5f0f2-b498-4e74-9889-c6ea2fb68d22", "tag": "1cd47c01-9bb9-4c88-97a5-4c4844fdf5af"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:24.180349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-819e09de-4902-47a2-a369-2012eb524fdd req-338cb22b-6981-44de-ae40-1cd7149bb00a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.181056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-819e09de-4902-47a2-a369-2012eb524fdd req-338cb22b-6981-44de-ae40-1cd7149bb00a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.181850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-819e09de-4902-47a2-a369-2012eb524fdd req-338cb22b-6981-44de-ae40-1cd7149bb00a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.194909 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-819e09de-4902-47a2-a369-2012eb524fdd req-338cb22b-6981-44de-ae40-1cd7149bb00a service nova] Creating event network-changed:1cd47c01-9bb9-4c88-97a5-4c4844fdf5af for instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 on nch1-master-1 Oct 29 20:49:24.200645 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-819e09de-4902-47a2-a369-2012eb524fdd req-338cb22b-6981-44de-ae40-1cd7149bb00a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040135 Oct 29 20:49:24.201533 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 327/655] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:24.208512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:24.210566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:24.219042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.219535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.219975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.220676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.221126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.221737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.357917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:24.375292 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f97072b-baf5-4caf-8fbc-b7790803fe8d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1463 microversion: 2.1 time: 0.447315 Oct 29 20:49:24.376123 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 329/656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:23 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1463 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:24.381041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:24.381710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:24.414093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.414838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.415450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.416507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.417546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.419027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.509427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:24.529061 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c54130c-6b43-49d4-838b-b36fe41b3597 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.326009 Oct 29 20:49:24.530040 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 328/657] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:24 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:24.546209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:24.548064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:24.562342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.563361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:24.563556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.564017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.565265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.565822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.566928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.576829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:24.578681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:24.587145 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53f09016-5dfe-49ac-be7e-1999e666c09f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.209906 Oct 29 20:49:24.587778 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 330/658] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:24 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:24.595092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65b090fe-269b-42c2-b064-afe094b19ea3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171914160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:24.670929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65b090fe-269b-42c2-b064-afe094b19ea3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.081246 Oct 29 20:49:24.671550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 331/659] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:24 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:24.679278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f484297e-4214-461b-a655-6c3bcacadda2 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] Action: 'create', calling method: .version_select at 0x7fa171955820>, body: {"security_group": {"name": "tempest-securitygroup-139930256", "description": "tempest-description-582152996"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:24.838297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:24.850225 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c3b7be9-7e55-4ebb-87d4-a7e749c167c3 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.317639 Oct 29 20:49:24.851539 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 329/660] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:24 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:24.861314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:24.864988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:24.872031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.872956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.873594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.874511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.878086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.878593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.977926 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f484297e-4214-461b-a655-6c3bcacadda2 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.305213 Oct 29 20:49:24.978968 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 332/661] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:49:24 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:24.984463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:24.985872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:24.996514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.997322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:24.998073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:24.998977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:24.999599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.000718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:25.000718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:25.000987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:25.001863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:25.002040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.002279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:25.128377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:25.137257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.138114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.138748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.139854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.140527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.141143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.192708 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-57ea1736-7f64-4305-a3a7-658d920c90e7 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 1067 microversion: 2.1 time: 0.340004 Oct 29 20:49:25.203681 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 330/662] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:49:24 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 1067 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 20:49:25.220849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:25.230888 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5c2f3487-1377-4735-8575-ef99e7abcb37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1477 microversion: 2.1 time: 0.250545 Oct 29 20:49:25.238897 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 333/663] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:24 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:25.246841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:25.247837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:25.255632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.256347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.257118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.258522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.259182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.259668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.294917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f36d50c1-cd95-402d-ae3e-22b0c2a8eee5 tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] Action: 'create', calling method: .version_select at 0x7fa172678b80>, body: {"security_group": {"name": "tempest-securitygroup-1505335538", "description": "tempest-description-1810715918"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:25.416634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:25.484114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:25.497961 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df964285-fa17-48fe-a1d0-01d6e9ae1ae4 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.256154 Oct 29 20:49:25.514367 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 334/664] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:25 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:25.521655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ab83e525-89b6-4cc0-9c98-b7f8c4d54e12 req-4546a001-8be0-49eb-b434-d4515552f0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f23b76-3ea1-4e7b-b365-250a3e9cb2e5", "name": "network-vif-plugged", "status": "completed", "tag": "4b48e5f0-230f-4540-9f4c-7268b1f36419"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:25.532212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ab83e525-89b6-4cc0-9c98-b7f8c4d54e12 req-4546a001-8be0-49eb-b434-d4515552f0e0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.532789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ab83e525-89b6-4cc0-9c98-b7f8c4d54e12 req-4546a001-8be0-49eb-b434-d4515552f0e0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.533999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ab83e525-89b6-4cc0-9c98-b7f8c4d54e12 req-4546a001-8be0-49eb-b434-d4515552f0e0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.548512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ab83e525-89b6-4cc0-9c98-b7f8c4d54e12 req-4546a001-8be0-49eb-b434-d4515552f0e0 service nova] Creating event network-vif-plugged:4b48e5f0-230f-4540-9f4c-7268b1f36419 for instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 on nch1-master-1 Oct 29 20:49:25.555846 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ab83e525-89b6-4cc0-9c98-b7f8c4d54e12 req-4546a001-8be0-49eb-b434-d4515552f0e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040005 Oct 29 20:49:25.559293 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 335/665] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:25.567971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:25.568878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:25.577241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.578116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.578572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.579342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.580419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.580924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.744499 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f36d50c1-cd95-402d-ae3e-22b0c2a8eee5 tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.538755 Oct 29 20:49:25.746049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 331/666] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:49:25 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:25.751480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:25.752300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:25.759852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.760557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.761783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.762982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.763604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.774502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.816718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:25.825569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ebb5a382-ccbf-4e83-b182-90b2591b76c1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.264581 Oct 29 20:49:25.837733 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 336/667] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:25 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:25.837733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9564011-27b3-4c2c-b45a-40cec5969bfd tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719400d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:25.867958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:25.882207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:25.883967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:25.888624 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9564011-27b3-4c2c-b45a-40cec5969bfd tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.061314 Oct 29 20:49:25.896884 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 337/668] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:25 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:25.896884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a38cb5a0-a1b5-43ce-8e22-af061fdc2dab tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] Action: 'create', calling method: .version_select at 0x7fa171940a60>, body: {"security_group": {"name": "tempest-securitygroup-2025246629", "description": "tempest-description-1183573088"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:25.898650 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d2936f8d-562d-4fe3-87e1-d80083b0c34b tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.142703 Oct 29 20:49:25.899424 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 332/669] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:25 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:25.904242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:25.904867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:25.911416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.911908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.912355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.913144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:25.913878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:25.914317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:25.922872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:26.114209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:26.123694 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a38cb5a0-a1b5-43ce-8e22-af061fdc2dab tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.232525 Oct 29 20:49:26.125703 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81106527-28bd-478d-8d0f-53f435aeb667 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.225054 Oct 29 20:49:26.126571 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 333/670] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:25 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:26.133010 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 338/671] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:49:25 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:26.146125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e58b7e2e-a330-4ef6-a8e0-f994d269f1ba tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] Calling method '.version_select at 0x7fa172764430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:26.254462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:26.255429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:26.261797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:26.262285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:26.262718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:26.263417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:26.263873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:26.264376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:26.460430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:26.470374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7ca4f829-2ab7-4cdd-9368-03ca67deef49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1477 microversion: 2.1 time: 0.219961 Oct 29 20:49:26.471656 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 339/672] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:26 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:26.523350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:26.524133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:26.531314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:26.531924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:26.532467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:26.533268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:26.534043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:26.534833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:26.731211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:26.740664 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f43bef6f-bb17-458a-9577-e13f80488a0b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.221225 Oct 29 20:49:26.741486 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 340/673] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:26 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:26.848451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:26.849048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:26.855273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:26.855805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:26.856254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:26.856961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:26.857415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:26.857872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:26.930980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:27.056992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:27.066356 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-95b5207c-d74d-4228-940e-c2d0e40c8ab5 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.221642 Oct 29 20:49:27.067053 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 341/674] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:26 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:27.071793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9f9190a-5f00-4158-a08a-5ce853318b63 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171955e50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:27.117823 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9f9190a-5f00-4158-a08a-5ce853318b63 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.049680 Oct 29 20:49:27.119001 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 342/675] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:27 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:27.123592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:27.124194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:27.130402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.130881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.131312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.132006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.132456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.132895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.208712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:27.219143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:27.221070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:27.227185 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-079a0d9f-8a06-4dfc-b6cc-e78285cfa7a4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.107615 Oct 29 20:49:27.240664 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 343/676] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:27 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:27.240664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:27.240664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:27.240664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.241171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.241658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.248986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.248986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.248986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.450980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:27.460293 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7d2b204-fda6-4674-a596-8cf0e348906a tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.231415 Oct 29 20:49:27.461004 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 344/677] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:27 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:27.502064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:27.503115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:27.512239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.512911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.513490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.514902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.515025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.515560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.686756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=16 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:27.800908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:27.814981 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-458ea5a5-7bd0-412f-972b-131eaa900450 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1477 microversion: 2.1 time: 0.317898 Oct 29 20:49:27.826802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 345/678] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:27 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:27.826802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ef74ae22-eb98-4676-82c4-c8719fe19b39 req-7b3b2f19-c315-4863-9b8c-4633d484c20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37204d7-69fa-4ef8-abc6-b76eca0c482c", "name": "network-vif-plugged", "status": "completed", "tag": "cb71f2c0-f460-43a7-8ad9-bbc3adcc1363"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:27.832136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ef74ae22-eb98-4676-82c4-c8719fe19b39 req-7b3b2f19-c315-4863-9b8c-4633d484c20a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.832136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ef74ae22-eb98-4676-82c4-c8719fe19b39 req-7b3b2f19-c315-4863-9b8c-4633d484c20a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.832136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ef74ae22-eb98-4676-82c4-c8719fe19b39 req-7b3b2f19-c315-4863-9b8c-4633d484c20a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.849934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ef74ae22-eb98-4676-82c4-c8719fe19b39 req-7b3b2f19-c315-4863-9b8c-4633d484c20a service nova] Creating event network-vif-plugged:cb71f2c0-f460-43a7-8ad9-bbc3adcc1363 for instance f37204d7-69fa-4ef8-abc6-b76eca0c482c on nch2-master-1 Oct 29 20:49:27.856095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ef74ae22-eb98-4676-82c4-c8719fe19b39 req-7b3b2f19-c315-4863-9b8c-4633d484c20a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Oct 29 20:49:27.856849 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 346/679] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:27.862530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:27.863691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:27.870188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.870649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.871759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:27.873296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:27.877140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:27.877629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:28.192755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:28.204090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9999b0f5-5acb-486b-99b7-cb8836171497 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.345772 Oct 29 20:49:28.205218 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 347/680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:27 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:28.215849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:28.217101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:28.226384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:28.226986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:28.227438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:28.228280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:28.229260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:28.229390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:28.255875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:28.578796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:28.592075 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c157bb3-f6d6-438f-8eb1-50a63ba1f55f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.385550 Oct 29 20:49:28.593444 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 348/681] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:28 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:28.604954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5ae7ced-f60c-4cf5-9d49-c84376c42090 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c4ac10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:28.690641 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5ae7ced-f60c-4cf5-9d49-c84376c42090 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.091807 Oct 29 20:49:28.692558 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 349/682] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:28 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:28.706899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:28.708212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:28.719042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:28.720251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:28.721136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:28.722098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:28.723235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:28.723679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:28.815834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:28.827726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:28.829223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:28.835451 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f0ebd40e-479f-4a38-834d-2570cf811edd tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.140362 Oct 29 20:49:28.836219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 350/683] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:28 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:28.845549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:28.846410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:28.860221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:28.860932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:28.861437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:28.862212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:28.862723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:28.863152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:29.148062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:29.163721 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1a47d8fc-ca78-4a52-b5db-6d6401b65ee8 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1386 microversion: 2.1 time: 0.326264 Oct 29 20:49:29.166306 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 351/684] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:28 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:29.172752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:29.173538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:29.189338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:29.190149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:29.190424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:29.191434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:29.191905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:29.192491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:29.696814 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e58b7e2e-a330-4ef6-a8e0-f994d269f1ba tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12363 microversion: 2.1 time: 3.553071 Oct 29 20:49:29.707947 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 334/685] 10.222.0.36 () {58 vars in 1191 bytes} [Sat Oct 29 20:49:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12363 bytes in 3566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:49:29.712036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:29.724071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:29.724736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:29.727046 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5369d393-c8fd-4437-b7be-4d4142fc90a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1477 microversion: 2.1 time: 0.559785 Oct 29 20:49:29.727956 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 352/686] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:29 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1477 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:29.742270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:29.743333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:29.757077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:29.757705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:29.759571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:29.760670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:29.761907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:29.762580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:29.763084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:29.770509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:29.771970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:29.773761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:29.774453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:29.775188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.049511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:30.061109 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f7c07f5c-4a1e-48e7-b68f-775f62f5bb6c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.331238 Oct 29 20:49:30.062120 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 353/687] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:29 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:30.067785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40a68751-29cb-404b-a3cc-a52013dbaf8f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719553a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.072242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:30.082770 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9992c8cb-fb5a-40b8-942f-60cf4d92777e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.373598 Oct 29 20:49:30.083541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 335/688] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:29 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:30.090960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-baf5ca4b-8975-4620-acc0-5679661a4c33 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] Calling method '.version_select at 0x7fa172075c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.156911 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40a68751-29cb-404b-a3cc-a52013dbaf8f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.087600 Oct 29 20:49:30.162573 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 354/689] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:30 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:30.169152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.169152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:30.217224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:30.220859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:30.224207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.226030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:30.230364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:30.230364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.388186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:30.398206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:30.399599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:30.406469 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d32f9e7-98c0-4694-82b6-d19dada6979d tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.243913 Oct 29 20:49:30.407062 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 355/690] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:30 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:30.411661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.412335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:30.418836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:30.419404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:30.419848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.420559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:30.421020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:30.421472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.476395 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-baf5ca4b-8975-4620-acc0-5679661a4c33 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.391651 Oct 29 20:49:30.477541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 336/691] 10.222.0.36 () {58 vars in 1191 bytes} [Sat Oct 29 20:49:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:30.493011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3d76a89-ca9b-4962-852b-922137c56470 tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] Calling method '.version_select at 0x7fa1725b6ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.725667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:30.742242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4bc56260-540e-4440-9b4c-cb044bfb8ecc tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1586 microversion: 2.1 time: 0.334083 Oct 29 20:49:30.758105 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 356/692] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:30 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1586 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:30.769900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.772156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:30.787413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:30.793325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:30.794077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.795004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:30.795633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:30.796256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:30.972252 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3d76a89-ca9b-4962-852b-922137c56470 tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1246b675-83b4-40e7-a9f8-8d91d36700cd" status: 202 len: 0 microversion: 2.1 time: 0.483372 Oct 29 20:49:30.973880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 337/693] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:49:30 2022] DELETE /compute/v2.1/os-security-groups/1246b675-83b4-40e7-a9f8-8d91d36700cd => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:49:30.981394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:30.982463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:31.001394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:31.012374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:31.013250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:31.014371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:31.019521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:31.024606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:31.290103 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d69c846b-bd87-431f-b366-711780caeca7 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.314332 Oct 29 20:49:31.291486 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 338/694] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:49:30 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c/os-interface => generated 285 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:31.306928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:31.317102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-80eb6d26-0478-46ac-899a-19a81eca76b6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1477 microversion: 2.1 time: 0.556549 Oct 29 20:49:31.317102 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 357/695] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:30 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1477 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:31.321709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:31.322332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:31.336517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11a859b9-be3f-4c6e-a61b-8de095054d31 tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] Calling method '.version_select at 0x7fa172040ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:31.375439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:31.376018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:31.376700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:31.383911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:31.385288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:31.385684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:31.965242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:31.980461 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34f29d90-ba1a-4d19-9914-68d7e86c5c3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.661938 Oct 29 20:49:31.995024 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 358/696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:31 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:32.003785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:32.005359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:32.018589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.019182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.019694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:32.020722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.021338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.021805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:32.107711 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11a859b9-be3f-4c6e-a61b-8de095054d31 tempest-SecurityGroupsTestAdminJSON-1716006281 tempest-SecurityGroupsTestAdminJSON-1716006281-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/a3108ee3-5fc5-48a5-986a-c0e8e3bb3af6" status: 202 len: 0 microversion: 2.1 time: 0.808364 Oct 29 20:49:32.112357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 339/697] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:49:31 2022] DELETE /compute/v2.1/os-security-groups/a3108ee3-5fc5-48a5-986a-c0e8e3bb3af6 => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:49:32.119254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ec0ae32-cd65-40a8-9c10-e159e6f42723 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1725e2e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:32.205766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ec0ae32-cd65-40a8-9c10-e159e6f42723 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.087709 Oct 29 20:49:32.206384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 340/698] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:32 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:32.220199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:32.221149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:32.256056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.256942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.258376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:32.259925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.260415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.260889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:32.462305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:32.476673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:32.481080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:32.498584 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-981f4fae-8dce-4f1a-a644-711656628474 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.290875 Oct 29 20:49:32.499573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 341/699] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:32 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:32.509645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ac4a21e6-dbde-4260-95f9-cc16169d23c4 req-1eb875e3-8172-40df-812f-7fb22d5257e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a5f0f2-b498-4e74-9889-c6ea2fb68d22", "name": "network-vif-plugged", "status": "completed", "tag": "1cd47c01-9bb9-4c88-97a5-4c4844fdf5af"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:32.533707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ac4a21e6-dbde-4260-95f9-cc16169d23c4 req-1eb875e3-8172-40df-812f-7fb22d5257e9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.534468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ac4a21e6-dbde-4260-95f9-cc16169d23c4 req-1eb875e3-8172-40df-812f-7fb22d5257e9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.536376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ac4a21e6-dbde-4260-95f9-cc16169d23c4 req-1eb875e3-8172-40df-812f-7fb22d5257e9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:32.562989 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ac4a21e6-dbde-4260-95f9-cc16169d23c4 req-1eb875e3-8172-40df-812f-7fb22d5257e9 service nova] Creating event network-vif-plugged:1cd47c01-9bb9-4c88-97a5-4c4844fdf5af for instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 on nch1-master-1 Oct 29 20:49:32.568944 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ac4a21e6-dbde-4260-95f9-cc16169d23c4 req-1eb875e3-8172-40df-812f-7fb22d5257e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067806 Oct 29 20:49:32.570519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 342/700] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:32.577988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd25c4af-fb5f-422a-b072-fb624c010fc9 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] Calling method '.version_select at 0x7fa172764ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:32.751922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:32.763498 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41d16396-80b8-46a3-9765-c7e031ed9670 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.766717 Oct 29 20:49:32.773854 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 359/701] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:31 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:32.785248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:32.786139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:32.793071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.806222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.806939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:32.808310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:32.808984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:32.809645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:33.605438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:33.624343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1cca63a-3653-41df-b02d-44c66e9c3560 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1476 microversion: 2.1 time: 0.849050 Oct 29 20:49:33.624933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 360/702] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:32 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1476 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:33.630256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:33.631102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:33.638131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:33.638840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:33.639728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:33.640685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:33.641366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:33.642104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:33.738543 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd25c4af-fb5f-422a-b072-fb624c010fc9 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/cbd7719e-52ec-460c-9b74-03656e941957" status: 202 len: 0 microversion: 2.1 time: 1.166593 Oct 29 20:49:33.739120 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 343/703] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:49:32 2022] DELETE /compute/v2.1/os-security-groups/cbd7719e-52ec-460c-9b74-03656e941957 => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:49:33.744169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9ba68a8e-a027-4ea7-8f9c-59356c0332ce req-200d55a6-3e9b-48cb-9af8-6c0bd469febd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37204d7-69fa-4ef8-abc6-b76eca0c482c", "tag": "cb71f2c0-f460-43a7-8ad9-bbc3adcc1363"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:33.763377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9ba68a8e-a027-4ea7-8f9c-59356c0332ce req-200d55a6-3e9b-48cb-9af8-6c0bd469febd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:33.763861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9ba68a8e-a027-4ea7-8f9c-59356c0332ce req-200d55a6-3e9b-48cb-9af8-6c0bd469febd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:33.766058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9ba68a8e-a027-4ea7-8f9c-59356c0332ce req-200d55a6-3e9b-48cb-9af8-6c0bd469febd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:33.789282 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9ba68a8e-a027-4ea7-8f9c-59356c0332ce req-200d55a6-3e9b-48cb-9af8-6c0bd469febd service nova] Creating event network-changed:cb71f2c0-f460-43a7-8ad9-bbc3adcc1363 for instance f37204d7-69fa-4ef8-abc6-b76eca0c482c on nch2-master-1 Oct 29 20:49:33.807105 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9ba68a8e-a027-4ea7-8f9c-59356c0332ce req-200d55a6-3e9b-48cb-9af8-6c0bd469febd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066567 Oct 29 20:49:33.808844 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 344/704] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:33.815254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:33.816193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:33.836315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:33.836825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:33.837476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:33.838174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:33.838607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:33.839144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:34.472953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:34.501775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65ccce1a-cc0a-42d0-be6a-cb8ae970d6da tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1586 microversion: 2.1 time: 0.875493 Oct 29 20:49:34.504702 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 361/705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:33 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1586 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:34.515955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-17baa9f5-ba2a-4bca-b371-bb4ce751e5bd tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719408b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:34.576077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:34.590747 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e366503a-c3fc-4577-9ede-feea5f6c10f9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1310 microversion: 2.1 time: 0.775231 Oct 29 20:49:34.591056 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-17baa9f5-ba2a-4bca-b371-bb4ce751e5bd tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.085119 Oct 29 20:49:34.591393 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 345/706] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:33 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1310 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:34.592381 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 362/707] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:34 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:34.599171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:34.600194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:34.605300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38b7560-af3b-4b34-9b58-1579730d6484", "name": "network-vif-unplugged", "status": "completed", "tag": "a21152b8-9e98-4abd-8e16-2f6e6a4bced5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:34.617311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:34.619612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:34.622913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:34.624617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:34.626268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:34.626974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:34.670047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:34.670545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:34.670986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:34.728913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] Creating event network-vif-unplugged:a21152b8-9e98-4abd-8e16-2f6e6a4bced5 for instance c38b7560-af3b-4b34-9b58-1579730d6484 on nch1-master-1 Oct 29 20:49:34.740883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] Instance c38b7560-af3b-4b34-9b58-1579730d6484 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:49:34.753858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9961078b-5373-4aaf-8367-0941852eca67 req-5cb15dce-8393-4efc-bd48-fb1f763b18ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157796 Oct 29 20:49:34.755128 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 346/708] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:34.760998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee94da93-c251-42e7-b11c-9471131cd034 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] Calling method '.version_select at 0x7fa17268e040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:34.783336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:34.800336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:34.803143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:34.810545 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff451780-bfaa-497c-9be4-fde7dbac2f08 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.216637 Oct 29 20:49:34.811600 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 363/709] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:34 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:34.829400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:34.830334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:34.840496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:34.841956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:34.842834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:34.845981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:34.846858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:34.847578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:35.204104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:35.219768 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ddcae34-4e70-4861-ac6f-bea32c220d9a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.404867 Oct 29 20:49:35.221246 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 364/710] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:34 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:35.242731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:35.246506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:35.268852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:35.272855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:35.273353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:35.276264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:35.277951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:35.279698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:35.318144 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee94da93-c251-42e7-b11c-9471131cd034 tempest-SecurityGroupsTestAdminJSON-362713609 tempest-SecurityGroupsTestAdminJSON-362713609-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/b00b408d-a8ec-4756-9dd7-7b8787cd38c4" status: 202 len: 0 microversion: 2.1 time: 0.561492 Oct 29 20:49:35.318746 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 347/711] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:49:34 2022] DELETE /compute/v2.1/os-security-groups/b00b408d-a8ec-4756-9dd7-7b8787cd38c4 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:49:35.346186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1364795302", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "05a9b245-29bf-4827-913a-7a4f494e3f64"}], "security_groups": [{"name": "tempest-securitygroup--1953968077"}], "key_name": "tempest-keypair-476162476", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2214e232-d1fe-4255-9dd8-84ea44b0fb7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:35.844945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] validate_networks() for [('05a9b245-29bf-4827-913a-7a4f494e3f64', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:49:35.935432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:35.951350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a76b69c5-24b3-4579-bc80-f20f7b79ce8a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1476 microversion: 2.1 time: 0.726721 Oct 29 20:49:35.951967 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 365/712] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:35 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1476 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:35.971906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:35.972526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:35.978673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:35.981668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:35.983280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:35.984282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:35.984904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:35.985519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:36.395751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:36.404929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5fb2d40d-525c-4b98-a35c-66033e97b2af tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1493 microversion: 2.1 time: 0.446784 Oct 29 20:49:36.405788 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 366/713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:35 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1493 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:36.410669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37088ca0-1f84-4f00-8a7e-b0de4c3431aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171955a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:36.491211 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37088ca0-1f84-4f00-8a7e-b0de4c3431aa tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.084136 Oct 29 20:49:36.501140 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 367/714] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:36 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:36.506688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:36.508033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:36.538608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:36.539440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:36.540114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:36.541416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:36.543312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:36.544361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:36.672979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:36.684458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:36.692106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:36.716872 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25110a7f-2c5b-4ae5-add5-705745bd1b24 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.197387 Oct 29 20:49:36.720321 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 368/715] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:36 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:36.741840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:36.743832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:36.759173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:36.759830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:36.763087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:36.764134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:36.764720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:36.765624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:36.780888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:37.106583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:37.114702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81ace9e4-4ef1-415a-9569-a3e2f74e2a84 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.391818 Oct 29 20:49:37.121127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Getting quotas for project dfe32b0a32524e2bbaa26501305d418b. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:37.131168 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 369/716] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:36 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:37.137719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Getting quotas for user 91932364eb4e4742b5f7fc998d202a70 and project dfe32b0a32524e2bbaa26501305d418b. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:37.169494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:37.170116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:37.171333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:37.172102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:37.172682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:37.187468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.188501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.189274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:37.190323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.190954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.191556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:37.220632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Getting quotas for project dfe32b0a32524e2bbaa26501305d418b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:37.227257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Getting quotas for user 91932364eb4e4742b5f7fc998d202a70 and project dfe32b0a32524e2bbaa26501305d418b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:37.308377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:49:37.311691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2214e232-d1fe-4255-9dd8-84ea44b0fb7b',volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:49:37.566168 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22e1949e-4229-44ba-aa01-d1a86313c0dd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.240935 Oct 29 20:49:37.567764 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 348/717] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:49:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:49:37.574405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38b7560-af3b-4b34-9b58-1579730d6484", "tag": "a21152b8-9e98-4abd-8e16-2f6e6a4bced5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:37.590678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.591465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.592065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:37.595504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:37.596573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:37.607159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.608289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.609489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:37.610887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.613354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.614287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:37.625430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] Creating event network-changed:a21152b8-9e98-4abd-8e16-2f6e6a4bced5 for instance c38b7560-af3b-4b34-9b58-1579730d6484 on nch1-master-1 Oct 29 20:49:37.632437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] Instance c38b7560-af3b-4b34-9b58-1579730d6484 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:49:37.644822 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8649d880-091c-4abf-ab2f-8948dfe5fb90 req-debe12c6-4a6c-4072-ac0d-89a3903241d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074513 Oct 29 20:49:37.645941 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 349/718] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:37.652730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:37.665583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:37.676842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.677344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.677836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:37.678542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:37.678996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:37.679423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.016667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a42a444c-5b80-41a2-902c-5d3d28c8684c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1644 microversion: 2.1 time: 0.884288 Oct 29 20:49:38.035443 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 370/719] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:37 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1644 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:38.050315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83048b17-2d90-417d-b588-3e9fd63ba685 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c4ac10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:38.076269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:38.087238 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-73122d87-c111-4d3b-ae9a-2cbc9737240f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1474 microversion: 2.1 time: 0.439882 Oct 29 20:49:38.088240 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 350/720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:37 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1474 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:38.093678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61877171-5177-4ee3-9d0f-4bf51ee8f359 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:38.094450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-61877171-5177-4ee3-9d0f-4bf51ee8f359 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:38.165778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61877171-5177-4ee3-9d0f-4bf51ee8f359 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:38.172452 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83048b17-2d90-417d-b588-3e9fd63ba685 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.134784 Oct 29 20:49:38.173413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 371/721] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:38 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:38.178884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61877171-5177-4ee3-9d0f-4bf51ee8f359 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1121 microversion: 2.1 time: 0.089435 Oct 29 20:49:38.180034 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 351/722] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:38 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1121 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:38.188244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:38.189102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:38.196625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.197539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.198135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.199201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.199817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.200429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.206616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:38.213566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:38.215096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:38.227776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.228484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.229105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.240547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.241859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.242498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.448650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:38.468049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:38.478566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:38.493626 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab7e6c9f-32d8-4f14-adfb-975a19bebdb6 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.317123 Oct 29 20:49:38.494508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 372/723] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:38 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:38.499511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c6fcc21f-7222-4f94-b6fb-74dadca1fdd9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1644 microversion: 2.1 time: 0.318248 Oct 29 20:49:38.500105 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 352/724] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:38 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1644 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:38.517443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:38.525172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:38.530262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.535861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:38.536428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.539598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.540914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.541500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.543059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.551300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.553370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.556081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.557091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.559120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.561543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.602254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9ed6a46-090b-40a6-b950-76e47daf84cb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080725 Oct 29 20:49:38.607195 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 353/725] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:49:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:49:38.619302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:38.624627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:38.637796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.638571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.639172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.640102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:38.640913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:38.641566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:38.708620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lazy-loading 'flavor' on Instance uuid 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:49:38.735665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Going to try to live migrate instance to nch2-master-1 {{(pid=138884) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:49:38.844568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:38.856062 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec22b252-ecfb-4361-9f65-1b84d4da9188 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.360223 Oct 29 20:49:38.869516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 373/726] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:38 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:39.116586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:39.117185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:39.129946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.132576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.133209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.136562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.137337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.137820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.343565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:39.351852 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca101f29-c317-41e0-9d64-6c9e5b3570a0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1474 microversion: 2.1 time: 0.239506 Oct 29 20:49:39.352730 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 374/727] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:39 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1474 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:39.358337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6bd2d35-3862-4dba-875e-3e3171277d89 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171940160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:39.436461 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6bd2d35-3862-4dba-875e-3e3171277d89 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.078873 Oct 29 20:49:39.437672 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 375/728] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:39 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:39.444038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:39.444966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:39.465326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.465915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.466358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.467490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.468251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.477163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.563504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:39.574935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8eed66d-59a5-4070-803c-76d59ac3040b tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1219 microversion: 2.1 time: 0.135874 Oct 29 20:49:39.590222 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 376/729] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:39 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:39.596077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:39.596910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:39.604294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.605602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.606206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.607103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.607807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.608391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.720407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:39.731657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:39.733143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:39.751886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:39.754111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dfab2dcc-cc0a-4050-8c80-43804a7da685 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.162612 Oct 29 20:49:39.755309 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 377/730] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:39 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:39.881548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:39.882920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:39.892948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.893676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.894288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:39.895149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:39.895731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:39.896155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:40.071611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:40.088129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-289395c0-a880-406f-8972-a28caafa71c5 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.211563 Oct 29 20:49:40.089611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 378/731] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:39 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:40.305167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-485902023", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:40.374576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:49:40.726733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:40.727282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:40.727824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:40.728483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:40.729115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:40.749827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:40.753106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:40.754868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:40.756732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:40.759514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:40.760220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:40.822448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Getting quotas for project 19f6c2de012941568db7fd6bbe26c5ab. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:40.841081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Getting quotas for user 0a91f45b10294340b057b0af59e728db and project 19f6c2de012941568db7fd6bbe26c5ab. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:40.903208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:49:40.910705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:49:41.074008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d189503-c586-472d-adba-c88dc9e07e16 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982165 Oct 29 20:49:41.083459 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 379/732] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:49:41.104367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:41.106034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:41.137945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:41.138879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:41.138999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:41.140147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:41.140147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:41.140594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:41.770533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:41.779974 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48b3648c-16dc-4085-a965-52fb4f91bbe0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1474 microversion: 2.1 time: 0.695312 Oct 29 20:49:41.783390 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 380/733] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:41 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1474 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:41.793406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eaf25c94-4f66-400f-b685-4493a99dbf95 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171974550>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:41.901485 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eaf25c94-4f66-400f-b685-4493a99dbf95 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.116773 Oct 29 20:49:41.902672 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 381/734] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:41 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:41.919313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:41.923388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:41.946057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:41.950281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:41.953563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:41.954621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:41.955256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:41.967784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.231347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:42.243101 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6fb2163d-8f23-4c33-8f28-5a8fac919c51 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1305 microversion: 2.1 time: 0.339135 Oct 29 20:49:42.244260 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 382/735] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:41 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1305 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:42.250041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:42.250837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:42.256998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.257901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.258559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.259670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.260071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.261394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.363162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:42.375350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:42.377229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:42.383679 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5285f240-c517-4178-8a62-7f375cc59861 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.137267 Oct 29 20:49:42.384877 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 383/736] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:42 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:42.390155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:42.391134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:42.397544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.399629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.400322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.401352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.402067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.402726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.509919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:42.526401 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eebadd51-46d3-4edd-9d3c-f860fa755662 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1226 microversion: 2.1 time: 0.140099 Oct 29 20:49:42.531662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 384/737] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:42 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:42.536742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:42.546638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:42.560174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.560843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.561390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.562226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.574139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.574733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.911966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:42.924703 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ed41155-19d3-4cdf-9ef3-5fb41350de35 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.391651 Oct 29 20:49:42.925598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 385/738] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:42 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:42.933758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e4e5cdb8-b453-4af4-bafb-113881d55672 req-66249ca6-19f4-48b0-a9ae-9682ede6b601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0f3d42-f2ec-4f60-b906-5dbb1e692deb", "tag": "55da6b15-8655-478c-9a57-53f06958a65c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:42.952086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e4e5cdb8-b453-4af4-bafb-113881d55672 req-66249ca6-19f4-48b0-a9ae-9682ede6b601 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.952654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e4e5cdb8-b453-4af4-bafb-113881d55672 req-66249ca6-19f4-48b0-a9ae-9682ede6b601 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.953891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e4e5cdb8-b453-4af4-bafb-113881d55672 req-66249ca6-19f4-48b0-a9ae-9682ede6b601 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.970822 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e4e5cdb8-b453-4af4-bafb-113881d55672 req-66249ca6-19f4-48b0-a9ae-9682ede6b601 service nova] Creating event network-changed:55da6b15-8655-478c-9a57-53f06958a65c for instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb on nch2-master-1 Oct 29 20:49:42.976582 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e4e5cdb8-b453-4af4-bafb-113881d55672 req-66249ca6-19f4-48b0-a9ae-9682ede6b601 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049371 Oct 29 20:49:42.977383 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 386/739] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:42.983576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:42.984523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:42.991641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.992448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.993149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:42.994244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:42.994959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:42.995801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.188907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:43.198898 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c54c640-b2aa-4180-8500-8b85ad00b773 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1471 microversion: 2.1 time: 0.218621 Oct 29 20:49:43.199855 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 387/740] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:42 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:43.204687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b74f458-d310-44cb-a056-6c4e42eaac61 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1718b9c10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:43.269102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b74f458-d310-44cb-a056-6c4e42eaac61 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.068218 Oct 29 20:49:43.270073 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 388/741] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:43 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:43.276770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:43.277305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:43.284579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.285281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.285748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.288407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.288407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.288407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.308194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0dc93285-adf7-4a24-8ff9-c036400aefbc tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22/action" status: 202 len: 0 microversion: 2.1 time: 4.691797 Oct 29 20:49:43.308859 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 354/742] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:49:38 2022] POST /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22/action => generated 0 bytes in 4694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:49:43.314807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:43.318243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:43.334943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.335451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.337134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.338118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.338621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.340985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.446325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-32d867c5-d8e0-40ec-a8a9-771ac89af18f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484/action" status: 204 len: 0 microversion: 2.1 time: 0.174798 Oct 29 20:49:43.447338 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 389/743] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:49:43 2022] POST /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484/action => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:49:43.452662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:43.453497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:43.461970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.462641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.463109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.464464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.465025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.467896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.471260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:43.578996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:43.592695 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c6c805c0-fd72-482a-a207-d29a53b2f42e tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.281624 Oct 29 20:49:43.593960 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 355/744] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:43 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:43.640552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:43.648633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:43.649558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:43.650538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4363c07f-b140-4427-840a-2e3d9371d2ab tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.202094 Oct 29 20:49:43.652970 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 390/745] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:43 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:43.661066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.662733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.665276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.667759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.668154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:43.669593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.670090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:43.671266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.692920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.693434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.693900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.694619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.695073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.695500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.886135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:43.901671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:43.904724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:43.920420 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8e894b0-eb0d-4d53-835b-5b372b084d4c tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.324665 Oct 29 20:49:43.933489 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 356/746] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:43 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:43.933489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:43.933489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:43.945886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:43.949932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.953780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.954559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:43.955680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:43.958818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:43.959579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.080008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:44.091762 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f1198137-c993-40d1-8716-c198ab64d6bc tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1471 microversion: 2.1 time: 0.434938 Oct 29 20:49:44.094901 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 391/747] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:43 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:44.109617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:44.110485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:44.124853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.125712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.126526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.127448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.128078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.128695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.220322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:44.235601 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c33654c0-c69f-453a-8517-3cca4ca208d1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1292 microversion: 2.1 time: 0.312862 Oct 29 20:49:44.241506 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 357/748] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:43 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1292 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:44.286089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc36090c-99eb-42e6-b5a4-d566957be6d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171d903a0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:44.351309 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc36090c-99eb-42e6-b5a4-d566957be6d0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.069499 Oct 29 20:49:44.357561 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 358/749] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:44 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:44.365617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:44.381078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c30471e-d03b-43cb-b16b-aa6ad22a8dad tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.284861 Oct 29 20:49:44.381712 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 392/750] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:44 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:44.502412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38b7560-af3b-4b34-9b58-1579730d6484", "name": "network-vif-plugged", "status": "completed", "tag": "a21152b8-9e98-4abd-8e16-2f6e6a4bced5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:44.522454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.523092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.524286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.544228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] Creating event network-vif-plugged:a21152b8-9e98-4abd-8e16-2f6e6a4bced5 for instance c38b7560-af3b-4b34-9b58-1579730d6484 on nch1-master-1 Oct 29 20:49:44.551770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] Instance c38b7560-af3b-4b34-9b58-1579730d6484 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:49:44.571511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-28bd05f1-3768-41df-8f15-ec54ea340da9 req-aa906932-e930-463d-b65f-aad72d6fcddd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072816 Oct 29 20:49:44.572717 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 359/751] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:44.622261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:44.623580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:44.631104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.632145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.632599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.633318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.633850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.634280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.677756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:44.678901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:44.686347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.690627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.692479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.693411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.695347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.695859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.881018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:44.891613 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10c1b952-76bf-4c2f-a809-f7b2eaa0f57f tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.276361 Oct 29 20:49:44.892396 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 393/752] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:44 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:44.908153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:44.916905 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef42eab1-9049-47e2-8e6e-3ff31222bb53 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.244139 Oct 29 20:49:44.935157 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 360/753] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:44 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:44.955289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:44.956150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:44.966488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.970787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.971354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:44.972206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:44.973986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:44.974547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.085884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:45.095886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:45.097710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:45.103569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68d11fe9-414c-429f-81a1-39daea9bea55 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.154080 Oct 29 20:49:45.104910 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 394/754] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:44 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:45.123600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:45.124141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:45.136554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.137147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.137637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.138389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.138859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.139295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.261529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:45.262431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:45.270015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.270692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.271198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.272202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.272828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.273557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.672857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:45.688109 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f946129-25c3-466c-a1ef-c6ca5f3a352d tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1280 microversion: 2.1 time: 0.431546 Oct 29 20:49:45.693347 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 395/755] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:45 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1280 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:45.698356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa5dca89-6e36-416d-aa09-5b5539a3f286 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171914af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:45.749745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:45.768663 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a24edde2-e82c-43c2-b698-3138325430e0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1471 microversion: 2.1 time: 0.647964 Oct 29 20:49:45.769819 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 361/756] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:45 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1471 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:45.784546 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa5dca89-6e36-416d-aa09-5b5539a3f286 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.088711 Oct 29 20:49:45.789877 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 396/757] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:45 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:45.795033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:45.797314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:45.807905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.810962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.811803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.813123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.814135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.815218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.920979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:45.921635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:45.930598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.931015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.937094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:45.937094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:45.937362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:45.939713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.318319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:46.343528 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c985243-13c3-4e32-a340-44fa2812a441 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.570269 Oct 29 20:49:46.344663 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 362/758] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:45 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:46.352381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:46.362819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:46.385038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:46.398148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb329a3d-9f66-4f26-beff-abdc2720c4d1 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.483068 Oct 29 20:49:46.398542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:46.399298 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 397/759] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:45 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:46.411115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:46.411728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.418629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:46.419186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:46.419636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.422848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:46.423690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:46.435907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:46.436672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:46.437271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.438174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:46.438787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:46.439362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.711468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:46.720539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:46.724375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:46.737104 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93c72c06-f26b-4bec-aaa4-74d451758cf9 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.336711 Oct 29 20:49:46.737739 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 398/760] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:46 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:46.744327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:46.747775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:46.757768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:46.758492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:46.759667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.760606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:46.761862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:46.762952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:46.982675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:46.993151 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e59bf10-229a-4488-b7b8-256191e4b042 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.646528 Oct 29 20:49:47.005810 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 363/761] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:46 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:47.011165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:47.011978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:47.024590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.025372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.025845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.026690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.027053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.027473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.270347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.281803 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-203950e3-5f71-40e7-a2c9-7e0bc7d60052 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.542155 Oct 29 20:49:47.299165 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 399/762] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:46 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:47.305757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37816955-5534-43f4-9bec-7e567ed3b0eb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c4aee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:47.378863 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37816955-5534-43f4-9bec-7e567ed3b0eb tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1454 microversion: 2.1 time: 0.078527 Oct 29 20:49:47.379660 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 400/763] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:47 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:47.384894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9de74a13-9961-4465-bef1-bf6fe6f56a7f req-6b870dab-319d-44e8-a59e-2ba6066126c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a5f0f2-b498-4e74-9889-c6ea2fb68d22", "name": "network-vif-unplugged", "status": "completed", "tag": "1cd47c01-9bb9-4c88-97a5-4c4844fdf5af"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:47.391363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.394972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9de74a13-9961-4465-bef1-bf6fe6f56a7f req-6b870dab-319d-44e8-a59e-2ba6066126c6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.395440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9de74a13-9961-4465-bef1-bf6fe6f56a7f req-6b870dab-319d-44e8-a59e-2ba6066126c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.395888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9de74a13-9961-4465-bef1-bf6fe6f56a7f req-6b870dab-319d-44e8-a59e-2ba6066126c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.399251 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-979d381b-0e7f-41ac-9828-20d22678b42e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1471 microversion: 2.1 time: 0.392008 Oct 29 20:49:47.399839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 364/764] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:47 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:47.407998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:47.408808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:47.408985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9de74a13-9961-4465-bef1-bf6fe6f56a7f req-6b870dab-319d-44e8-a59e-2ba6066126c6 service nova] Creating event network-vif-unplugged:1cd47c01-9bb9-4c88-97a5-4c4844fdf5af for instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 on nch1-master-1 Oct 29 20:49:47.414103 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9de74a13-9961-4465-bef1-bf6fe6f56a7f req-6b870dab-319d-44e8-a59e-2ba6066126c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033111 Oct 29 20:49:47.414718 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 401/765] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:47.415640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.416419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.418041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.419205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.420816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.421877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.427600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:47.428495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:47.435320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.435936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.436498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.437300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.437913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.438452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.622612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.631613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bbf1d925-00d4-4e7b-874d-797718cae24a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.227226 Oct 29 20:49:47.632210 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 365/766] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:47 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:47.636208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.644798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-04306e78-2b71-448e-83e3-06ee0178a307 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.222553 Oct 29 20:49:47.645371 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 402/767] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:47 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:47.769964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:47.770475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:47.777515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.778002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.778463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.779159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:47.779611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:47.780035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:47.843615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.851674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.853123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:47.857847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-875a5ced-a5f2-4cd4-b1bb-56092f374a3a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.091865 Oct 29 20:49:47.858412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 366/768] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:47 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:48.030665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.031199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.037198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.037719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.038151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.038836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.039287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.039708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.170131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:48.179476 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cde40023-2bea-4104-bfd3-d5a8cd182ee7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.152658 Oct 29 20:49:48.180207 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 403/769] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:48.311587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.312204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.314848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:48.321258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.321757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.322205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.324197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.324676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.325110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.404857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a4105d0-f0ad-43c8-9a9a-7ca50aae184b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171974310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.467081 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a4105d0-f0ad-43c8-9a9a-7ca50aae184b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1463 microversion: 2.1 time: 0.073091 Oct 29 20:49:48.467669 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 404/770] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:48.472714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.473352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.481093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.481917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.482375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.483072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.483529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.483997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.488423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:48.497629 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9cbe0e40-5bfe-4595-9808-c834ed993a23 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.190816 Oct 29 20:49:48.498220 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 367/771] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:48.503139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9fbd4985-b791-4ac3-befe-9cb1b422be90 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa172764ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.555219 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9fbd4985-b791-4ac3-befe-9cb1b422be90 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 200 len: 1463 microversion: 2.1 time: 0.055693 Oct 29 20:49:48.563700 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 368/772] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 1463 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:48.570592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.571526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.573630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:48.580346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.580850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.581294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.582034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.582496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.582931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.676228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:48.684271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-efb674a5-f18c-457d-836f-13d725ac3815 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1471 microversion: 2.1 time: 0.215440 Oct 29 20:49:48.685081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 405/773] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:48.701904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.702558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.708798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.709539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.710167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.711029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.711665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.712288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.754090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:48.759299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:48.769493 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a366cbae-9bde-48a2-9b89-dbeda3007865 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1467 microversion: 2.1 time: 0.201491 Oct 29 20:49:48.771002 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 369/774] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1467 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:48.777424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:48.778320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.786936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.787739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.789312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.791665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.792040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.793745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.919962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:48.940177 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5dabf988-5bb6-4a10-aa05-411d97bd8ffb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.253694 Oct 29 20:49:48.941023 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 406/775] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:48.949161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1991746939"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:48.952097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:48.959794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.961521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.962183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.963489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:48.964126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:48.964751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:48.988113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.001130 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cbeaf28c-914b-4198-9902-9eafea0d9af8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.230070 Oct 29 20:49:49.002083 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 370/776] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:48 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:49.007734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.008391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:49.015450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.016159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.016600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.017305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.017790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.018224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.098860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.108560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.110304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.115680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9ded9847-d520-476f-8212-21f38ba8d2d0 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.112032 Oct 29 20:49:49.116261 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 371/777] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:49.206437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.207051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:49.220651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.221228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.222053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.222633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.223237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.223686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.250434 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39768094-d519-4672-8815-4e5522de5f26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "POST /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896/action" status: 202 len: 0 microversion: 2.1 time: 0.307753 Oct 29 20:49:49.251699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 407/778] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:49:48 2022] POST /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:49:49.263299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49470f5a-3173-48b8-906b-35c113792bf2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17189b550>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.324264 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49470f5a-3173-48b8-906b-35c113792bf2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.065440 Oct 29 20:49:49.334373 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 408/779] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:49.405216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.414075 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af51ae45-4e22-4fdc-b80b-b903a7fd0bc9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.211682 Oct 29 20:49:49.414895 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 372/780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:49.458753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a5f0f2-b498-4e74-9889-c6ea2fb68d22", "tag": "1cd47c01-9bb9-4c88-97a5-4c4844fdf5af"}, {"name": "network-changed", "server_uuid": "aa91ad81-0b7b-4aa4-87bb-6242a49198a6", "tag": "f2e912a9-aeda-401e-8cf3-3b697d8cca4f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:49.475726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.476505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.477831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.493321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] Creating event network-changed:1cd47c01-9bb9-4c88-97a5-4c4844fdf5af for instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 on nch1-master-1 Oct 29 20:49:49.494216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] Creating event network-changed:f2e912a9-aeda-401e-8cf3-3b697d8cca4f for instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 on nch2-master-1 Oct 29 20:49:49.504585 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1c84b11c-20f2-40dc-a855-3fe5d01bddd6 req-2dc6cd06-547a-40f4-a6d4-eb15fb395b2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049193 Oct 29 20:49:49.505887 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 409/781] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:49.519690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.520309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:49.527551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.528041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.528477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.529176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.529900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.530331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.680889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.691616 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a7421be1-cef3-4c75-90d8-c60906bd5838 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.175788 Oct 29 20:49:49.692344 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 373/782] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:49.708222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.708932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:49.715845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.716365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.716813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.717536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.717998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.718430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.848026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:49.850412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:49.857934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37ce79e7-4114-4b1a-bf82-0ef5296c7506 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1463 microversion: 2.1 time: 0.153877 Oct 29 20:49:49.858546 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 410/783] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:49.879809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.880425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:49.887562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.888064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.888509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.889245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.889728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.890226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.967402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:49.968325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:49.975392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.976274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.976718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:49.977426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:49.977910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:49.978548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.059012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.066745 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-224e83e3-0fef-4cfa-96c1-5bb2e4a64452 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1463 microversion: 2.1 time: 0.190777 Oct 29 20:49:50.067322 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 374/784] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:50.071750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:50.072361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:50.078917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.079687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.080211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.080986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.081553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.082051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.214708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.225965 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4332c62c-e160-46c7-846d-f2f8ebd464cd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.262948 Oct 29 20:49:50.236180 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 411/785] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:49 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:50.241276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-284e9c87-b295-4ff8-a582-96ac414fa83b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'create', calling method: .version_select at 0x7fa171c4a1f0>, body: {"keypair": {"name": "tempest-keypair-349093672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMQJHnOZ58p/rtlVRzCoVs74+J8kqspC5cjJRAUDYKH5h6l9kyIA1I/Xwl0DunM/sM8zQ2L4OjMZCnX5ZaeYrlMJXmXi8pc9uJdkmuPSsfMSJlmRSJ8cerVW8Z+ikEn8w=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:50.260255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-284e9c87-b295-4ff8-a582-96ac414fa83b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for project 3da56123652f4fb19fe782b6c32ce520. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:50.267145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-284e9c87-b295-4ff8-a582-96ac414fa83b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for user 0a554d93b7864309990e6252c09f59cc and project 3da56123652f4fb19fe782b6c32ce520. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:50.293697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-284e9c87-b295-4ff8-a582-96ac414fa83b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056094 Oct 29 20:49:50.295261 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 412/786] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:49:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:50.301608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:50.303210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:50.311019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.311792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.312331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.313167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.313834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.314335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.320562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.331863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-71b51610-4a27-4aa1-ae66-0e34e8beb41c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.263457 Oct 29 20:49:50.334042 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 375/787] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:50 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:50.343798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d06e5765-90d2-433b-866a-37b693d45ed9 req-b8565719-cea3-4077-8b0a-1ec45504a7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f23b76-3ea1-4e7b-b365-250a3e9cb2e5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b48e5f0-230f-4540-9f4c-7268b1f36419"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:50.365548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d06e5765-90d2-433b-866a-37b693d45ed9 req-b8565719-cea3-4077-8b0a-1ec45504a7bb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.367406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d06e5765-90d2-433b-866a-37b693d45ed9 req-b8565719-cea3-4077-8b0a-1ec45504a7bb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.368273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d06e5765-90d2-433b-866a-37b693d45ed9 req-b8565719-cea3-4077-8b0a-1ec45504a7bb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.391472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d06e5765-90d2-433b-866a-37b693d45ed9 req-b8565719-cea3-4077-8b0a-1ec45504a7bb service nova] Creating event network-vif-unplugged:4b48e5f0-230f-4540-9f4c-7268b1f36419 for instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 on nch1-master-1 Oct 29 20:49:50.398096 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d06e5765-90d2-433b-866a-37b693d45ed9 req-b8565719-cea3-4077-8b0a-1ec45504a7bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061159 Oct 29 20:49:50.398946 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 376/788] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:50.407470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3d5acde8-60aa-4159-90bb-22f13c2e4797 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171a370d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:50.440032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.451128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.452665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.458632 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd54b276-a3fd-4ca1-891b-32907374f68e tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.161727 Oct 29 20:49:50.459748 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 413/789] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:50 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:50.464363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:50.465166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:50.468830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3d5acde8-60aa-4159-90bb-22f13c2e4797 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.065125 Oct 29 20:49:50.472056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.472756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.473342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.474233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.474843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.475279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.478129 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 377/790] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:50 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:50.688961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.697387 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce97e585-402d-401d-ba42-3306c7a0105e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.236590 Oct 29 20:49:50.698174 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 414/791] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:50 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:50.716171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:50.716909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:50.724304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.724786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.725416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.726179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:50.726598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:50.727079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:50.967978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:50.976117 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b32a44e4-14ad-4fa3-8952-3b646fc35b37 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.264464 Oct 29 20:49:50.989943 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 378/792] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:50 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:51.252273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:51.253201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:51.257044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:51.262985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:51.263495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:51.264469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:51.265319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:51.265804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:51.266231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:51.360030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:51.364130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:51.372945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:51.373647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:51.374369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:51.375377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:51.376312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:51.376963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:51.518438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:51.536073 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bba27a8-cb9a-430b-a625-4290f3f5610f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.288629 Oct 29 20:49:51.549789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 415/793] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:51 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:51.558148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-274b8f9b-3ae2-4bbd-9cd8-0ef826fb69ee tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171974160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:51.634899 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-274b8f9b-3ae2-4bbd-9cd8-0ef826fb69ee tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.083575 Oct 29 20:49:51.644103 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 416/794] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:51 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:51.649559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:51.650372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:51.657068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:51.657818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:51.658567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:51.659159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:51.659611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:51.660231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:51.982589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:51.991228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:51.993083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:51.998089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:52.000066 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54e21d4f-683d-4bcf-b802-b1ff03d88ca4 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.354634 Oct 29 20:49:52.000724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 417/795] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:51 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:52.012884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.012884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:52.013337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:52.013859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.013951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.014476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.015046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.015503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.015928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.019059 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74ddecbe-5bc9-432c-9a17-d7ddf2f0447a tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.662915 Oct 29 20:49:52.019638 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 379/796] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:51 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:52.024044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.024665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:52.031514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.032207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.032824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.033731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.034352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.034982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.297011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:52.307072 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0e67dfe9-25cf-438b-9bb0-038db3c2d425 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.304924 Oct 29 20:49:52.309259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:52.318303 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 418/797] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:52.329688 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e2a692c2-c940-4660-a576-7af9ee7b8180 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.308952 Oct 29 20:49:52.330588 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 380/798] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:52.413287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-aa77a037-86e0-4e1f-a12e-2ca3fcc178fa req-713d292b-1a25-4899-9cf0-cba49ecda4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0f3d42-f2ec-4f60-b906-5dbb1e692deb", "name": "network-vif-plugged", "status": "completed", "tag": "55da6b15-8655-478c-9a57-53f06958a65c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:52.423214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aa77a037-86e0-4e1f-a12e-2ca3fcc178fa req-713d292b-1a25-4899-9cf0-cba49ecda4c6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.424186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aa77a037-86e0-4e1f-a12e-2ca3fcc178fa req-713d292b-1a25-4899-9cf0-cba49ecda4c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.424683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aa77a037-86e0-4e1f-a12e-2ca3fcc178fa req-713d292b-1a25-4899-9cf0-cba49ecda4c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.436152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-aa77a037-86e0-4e1f-a12e-2ca3fcc178fa req-713d292b-1a25-4899-9cf0-cba49ecda4c6 service nova] Creating event network-vif-plugged:55da6b15-8655-478c-9a57-53f06958a65c for instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb on nch2-master-1 Oct 29 20:49:52.441371 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-aa77a037-86e0-4e1f-a12e-2ca3fcc178fa req-713d292b-1a25-4899-9cf0-cba49ecda4c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032462 Oct 29 20:49:52.441996 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 419/799] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:52.564406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.565059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:52.568070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21e1fe4b-9f6e-424a-b246-82a255660420 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '.version_select at 0x7fa1719405e0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.571122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.571555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e1fe4b-9f6e-424a-b246-82a255660420 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.571675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.572052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.572304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e1fe4b-9f6e-424a-b246-82a255660420 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.572757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:52.572921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21e1fe4b-9f6e-424a-b246-82a255660420 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.573794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:52.574230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:52.589738 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21e1fe4b-9f6e-424a-b246-82a255660420 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1184 microversion: 2.1 time: 0.026295 Oct 29 20:49:52.590536 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 420/800] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/os-migrations => generated 1184 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:52.608557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8edbdcad-f77d-4ce2-bb43-e7e8d3ae1c8a tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.615252 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8edbdcad-f77d-4ce2-bb43-e7e8d3ae1c8a tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010139 Oct 29 20:49:52.615813 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 421/801] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:49:52.628386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3851d3d-e308-4e6d-a99e-8d396ca83fa7 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-416963738", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:52.647689 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3851d3d-e308-4e6d-a99e-8d396ca83fa7 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.022978 Oct 29 20:49:52.648267 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 422/802] 10.222.0.36 () {60 vars in 1146 bytes} [Sat Oct 29 20:49:52 2022] POST /compute/v2.1/flavors => generated 498 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:52.654980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edda6c29-b7a1-446c-a67c-0f443816cf4b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719744c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.699539 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edda6c29-b7a1-446c-a67c-0f443816cf4b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.048973 Oct 29 20:49:52.700178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 423/803] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:52.704504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06f7907a-4c74-4987-aa3c-b9dbf0bbf8dd tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:52.712253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06f7907a-4c74-4987-aa3c-b9dbf0bbf8dd tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011071 Oct 29 20:49:52.712815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 424/804] 10.222.0.36 () {58 vars in 1182 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:49:52.716350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:52.724901 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75730e78-ebb4-432f-b4fc-2442b87e9a7b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.164441 Oct 29 20:49:52.725490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 381/805] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:52 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:52.808532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-182778166", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "92b82b15-fbcf-4246-99da-65cb519ba4de"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:52.858072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:49:53.040787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.042153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:53.049092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.049714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.050090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.050790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.051247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.051677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.066199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:53.066634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:53.067115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:53.067531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:53.067948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:53.076823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.077320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.077797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.078533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.078995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.079425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.097366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:49:53.102868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for user 0a554d93b7864309990e6252c09f59cc and project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:49:53.117217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.118424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:49:53.121399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:49:53.125951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.127420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.132141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-506eb3b8-4f9a-43f8-be64-6122cc5d0891 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.095300 Oct 29 20:49:53.132721 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 382/806] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:49:53.137231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.137869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:53.143602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.144083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.144525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.145221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.145781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.146213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.169328 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-22e7d787-ea8e-48ae-9867-1ec72968d2c2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.365109 Oct 29 20:49:53.170241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 425/807] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:49:53.181330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a7bce4c-f5c2-4095-9fd2-f6c6b1af0415 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.181966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8a7bce4c-f5c2-4095-9fd2-f6c6b1af0415 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:53.246200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8a7bce4c-f5c2-4095-9fd2-f6c6b1af0415 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.253554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8a7bce4c-f5c2-4095-9fd2-f6c6b1af0415 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1278 microversion: 2.1 time: 0.076349 Oct 29 20:49:53.254521 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 426/808] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1278 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:53.318500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.326641 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec3b3176-d28f-43e7-aad1-f30b2dbd4f77 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.192927 Oct 29 20:49:53.327210 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 383/809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:53.332718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.333355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:53.344157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.344642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.346073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.348510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.348510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.348510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.357444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.358096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:53.364607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.365740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.366814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.367318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.367933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.368533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.569848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.576797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.583325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5bde4483-d577-4ef6-8255-5c3fa8761284 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.255671 Oct 29 20:49:53.584562 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 427/810] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:53.601205 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf8f14d2-a955-453b-9a9b-280b02e6d85f tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.250736 Oct 29 20:49:53.601851 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 384/811] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:53.715845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4124a56-fa4e-4a85-a2fc-38c392037ce1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171940a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.749085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:53.749496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:53.757525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.758203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.758648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.759389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:53.760045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:53.760969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:53.763420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4124a56-fa4e-4a85-a2fc-38c392037ce1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.052255 Oct 29 20:49:53.764841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 428/812] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:53.902883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:53.910837 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b119a0d-37f2-4b20-88d1-3ecec431e175 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.166607 Oct 29 20:49:53.911593 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 385/813] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:53 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:54.160413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.161037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:54.168423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.168907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.169747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.170463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.170923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.171348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.239222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.248065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.249532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.254529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0df725c9-346e-424b-9727-0b2bb1e51d1a tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1446 microversion: 2.75 time: 0.098048 Oct 29 20:49:54.255088 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 429/814] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:54.276528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.277301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:54.283676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.284162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.284599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.285329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.285822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.286254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.350489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.351112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:54.351809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.357562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.358297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.359143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.359885 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6baefb4-4073-4e3a-8f40-7c285b242fb1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1330 microversion: 2.1 time: 0.087639 Oct 29 20:49:54.360344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.360992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.361436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.373800 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 386/815] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:54.460909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-046cf4f9-3692-4f1a-8816-a802f40b2f2d req-3fdade60-94b1-450d-8ddb-745f43d3b9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa91ad81-0b7b-4aa4-87bb-6242a49198a6", "name": "network-vif-plugged", "status": "completed", "tag": "f2e912a9-aeda-401e-8cf3-3b697d8cca4f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:54.471057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-046cf4f9-3692-4f1a-8816-a802f40b2f2d req-3fdade60-94b1-450d-8ddb-745f43d3b9aa service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.471536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-046cf4f9-3692-4f1a-8816-a802f40b2f2d req-3fdade60-94b1-450d-8ddb-745f43d3b9aa service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.471971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-046cf4f9-3692-4f1a-8816-a802f40b2f2d req-3fdade60-94b1-450d-8ddb-745f43d3b9aa service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.483716 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-046cf4f9-3692-4f1a-8816-a802f40b2f2d req-3fdade60-94b1-450d-8ddb-745f43d3b9aa service nova] Creating event network-vif-plugged:f2e912a9-aeda-401e-8cf3-3b697d8cca4f for instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 on nch2-master-1 Oct 29 20:49:54.488647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-046cf4f9-3692-4f1a-8816-a802f40b2f2d req-3fdade60-94b1-450d-8ddb-745f43d3b9aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031317 Oct 29 20:49:54.489244 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 387/816] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:49:54.499856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.507886 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60b25aae-a31a-4997-b516-e7eb3db28acf tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1293 microversion: 2.1 time: 0.161215 Oct 29 20:49:54.508463 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 430/817] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:54.607651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.608358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:54.614555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.615036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.615474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.616162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.616616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.617048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.624166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.624873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:54.631043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.631527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.631963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.632648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.633095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.633542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.818974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.824373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:54.830317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:54.830894 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cf5c90e-1104-4241-ab11-2bb1058a3f13 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.227416 Oct 29 20:49:54.831491 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 388/818] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:54.836626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7d967d6-400c-45fa-859e-09f8a63a3bfc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa172591790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.855816 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf269ff4-0016-4d21-8bf2-90f689dbbdc2 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.235482 Oct 29 20:49:54.856839 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 431/819] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:54.887736 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7d967d6-400c-45fa-859e-09f8a63a3bfc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.054666 Oct 29 20:49:54.888310 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 389/820] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:54.934018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:54.934658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:54.940933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.941418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.941877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:54.942569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:54.943018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:54.943439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.093845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:55.101690 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61d03402-4be3-486b-96ba-047909d147cb tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.171566 Oct 29 20:49:55.102391 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 432/821] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:54 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:55.284589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:55.285416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:55.292271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.293251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.293904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.294624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.295081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.295506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.362518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:55.370560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:55.372010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:55.376800 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8276182d-e863-4121-9714-c3766884317f tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1452 microversion: 2.75 time: 0.097544 Oct 29 20:49:55.377426 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 390/822] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:55 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:55.383768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:55.384644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:55.391213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.391704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.392189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.392887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.393343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.393798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.469206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:55.476958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0b1d7a4-c164-4e3e-b866-20609ea707ef tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1336 microversion: 2.1 time: 0.097200 Oct 29 20:49:55.477640 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 433/823] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:55 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:55.533041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:55.533695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:55.540969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.541914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.542043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.543106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.544204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.544741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.774377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:55.782320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ed41765d-7c58-444d-95cb-7f96bf920e6d tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1484 microversion: 2.1 time: 0.255159 Oct 29 20:49:55.782895 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 391/824] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:55 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1484 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:55.805790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:55.806386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:55.813419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.814056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.814583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.815298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.815759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.816193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.855745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:55.856358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:55.862573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.863159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.863593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.864290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.864760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.865167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.971026 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6086ee00-aeea-4a02-bb20-74f6d0e7d6aa tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169398 Oct 29 20:49:55.971629 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 434/825] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:49:55 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:55.978401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:55.978401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:55.985517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.986096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.986726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:55.987582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:55.988118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:55.988610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.128685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.136556 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-715cd0ce-8973-4d7d-9f14-e59543fa5d1d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.285129 Oct 29 20:49:56.137136 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 392/826] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:55 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:56.173091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a32ca74-3f19-4070-b285-06337f97b7c8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719e8ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:56.191404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.203711 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-727e0403-7825-406e-b4d8-24525013a900 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1322 microversion: 2.1 time: 0.230309 Oct 29 20:49:56.205397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 435/827] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:55 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:56.230718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:56.231404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:56.238437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:56.238720 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a32ca74-3f19-4070-b285-06337f97b7c8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.085853 Oct 29 20:49:56.238946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:56.239595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 393/828] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:56 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:56.242274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.243162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:56.243727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:56.244268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.412124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:56.413343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:56.424697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:56.425437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:56.426087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.428925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:56.429616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:56.430208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.439237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.448820 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4957d7fe-ab04-46b2-9398-20192fe94dc2 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.241462 Oct 29 20:49:56.449764 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 436/829] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:56 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:56.506638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:56.507416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:56.518689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:56.519629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:56.521637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.535228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.545685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:56.546514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:56.547098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:56.550860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.553057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.566677 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-593ec791-481e-42d5-a0c8-da87f0c287d7 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1452 microversion: 2.75 time: 0.159468 Oct 29 20:49:56.567842 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 394/830] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:56 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:49:56.831136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:56.838950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:49:56.842065 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b8f41be9-456e-4f50-9873-b2d968d1fd0b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.340063 Oct 29 20:49:56.857989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 437/831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:56 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:57.159571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:57.161536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:57.176842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.177768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.178799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.180024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.180740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.181330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.210756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:57.211373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:57.224306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.228479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.230943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.231887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.237565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.238640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.615008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:57.623946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f2be59b-78ad-46bd-940a-34a2fdb38bcd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.468185 Oct 29 20:49:57.625053 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 395/832] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:57 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:57.630011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-033cb1c3-a7ad-4820-8f71-15fd250ca89c req-daf8f598-f4a6-4e3f-9359-a2e518b470b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0f3d42-f2ec-4f60-b906-5dbb1e692deb", "tag": "55da6b15-8655-478c-9a57-53f06958a65c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:57.640784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-033cb1c3-a7ad-4820-8f71-15fd250ca89c req-daf8f598-f4a6-4e3f-9359-a2e518b470b5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.641697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-033cb1c3-a7ad-4820-8f71-15fd250ca89c req-daf8f598-f4a6-4e3f-9359-a2e518b470b5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.642290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-033cb1c3-a7ad-4820-8f71-15fd250ca89c req-daf8f598-f4a6-4e3f-9359-a2e518b470b5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.643497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:57.655967 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b4f6692-c298-4d58-ba34-c80c55e2d256 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1484 microversion: 2.1 time: 0.449571 Oct 29 20:49:57.672040 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 438/833] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:57 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1484 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:57.672258 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-033cb1c3-a7ad-4820-8f71-15fd250ca89c req-daf8f598-f4a6-4e3f-9359-a2e518b470b5 service nova] Creating event network-changed:55da6b15-8655-478c-9a57-53f06958a65c for instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb on nch2-master-1 Oct 29 20:49:57.672258 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-033cb1c3-a7ad-4820-8f71-15fd250ca89c req-daf8f598-f4a6-4e3f-9359-a2e518b470b5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044747 Oct 29 20:49:57.672258 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 396/834] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:57.681493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-09d87613-3896-4568-be93-542306b483e1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719e85e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:57.684500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:57.685124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:57.701241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.701780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.702223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.702943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.703406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.703839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.753825 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-09d87613-3896-4568-be93-542306b483e1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.080154 Oct 29 20:49:57.755028 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 397/835] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:57 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:57.760069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:57.761863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:57.770251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.771778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.772458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:57.773533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:57.774811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:57.775449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.105796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.114855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8157f08a-f878-4500-8404-8593d1b5313a tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1472 microversion: 2.1 time: 0.450559 Oct 29 20:49:58.115430 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 439/836] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:57 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:58.117809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.121192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:58.121995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:58.128378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.129087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.129707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.130558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.131157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.131733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.133948 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-df5676c8-edcc-45e8-9c9e-4a5931ea3629 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.377631 Oct 29 20:49:58.134608 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 398/837] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:57 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:58.155240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:58.156598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:58.170502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.171015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.171460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.173010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.173010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.173305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.270160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.288924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.298437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.310088 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-356d307a-5ca2-4574-be3b-f20a39bbabd1 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1452 microversion: 2.75 time: 0.193413 Oct 29 20:49:58.316828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 440/838] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:58 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:58.323215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8ac63312-70bd-4140-94b7-bb9e8db4daae req-eb9e923f-02a1-4dce-970b-3ea6318a3f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:58.337119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ac63312-70bd-4140-94b7-bb9e8db4daae req-eb9e923f-02a1-4dce-970b-3ea6318a3f7a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.339953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ac63312-70bd-4140-94b7-bb9e8db4daae req-eb9e923f-02a1-4dce-970b-3ea6318a3f7a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.340988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ac63312-70bd-4140-94b7-bb9e8db4daae req-eb9e923f-02a1-4dce-970b-3ea6318a3f7a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.367207 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8ac63312-70bd-4140-94b7-bb9e8db4daae req-eb9e923f-02a1-4dce-970b-3ea6318a3f7a service nova] Creating event network-changed:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:49:58.374533 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8ac63312-70bd-4140-94b7-bb9e8db4daae req-eb9e923f-02a1-4dce-970b-3ea6318a3f7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056121 Oct 29 20:49:58.376698 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 441/839] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:58.383293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:58.383908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:58.393170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.393694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.394126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.395017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.395383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.395927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.427679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Request method failure captured: Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6/diagnostics HTTP/1.1 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZHiJjK8s82TACPHxp8bHtPHP4L-n1xwafITVlekDkSopLPJDZFys6pgDtGmJ6WtD5JK1wnZh1lPb-YQmoH-gP4LzjxQL3hTm-j23Ao9egw5yOP03bQbxYt3mU-UVQaLXyY9lQr6atfg4AdVj4DbsedEixnWpizDHnl_qgb9M0fJFNg Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 19f6c2de012941568db7fd6bbe26c5ab Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2074864168 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2074864168 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 19f6c2de012941568db7fd6bbe26c5ab Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2074864168 Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiagnosticsNegativeTest-2074864168-project Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0a91f45b10294340b057b0af59e728db Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2074864168-project Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': 'aa91ad81-0b7b-4aa4-87bb-6242a49198a6'} Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:49:58.430172 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9762d4f-1b41-49f1-91dc-3a139699cf74 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.054401 Oct 29 20:49:58.435603 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 442/840] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:49:58 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6/diagnostics => generated 117 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:49:58.445969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:58.446474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:58.454672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.455555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.456200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.457090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.457773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.458364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.491805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:49:58.586359 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-12428c60-ad5d-46c4-a6f3-0e53398d50d7 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 204 len: 0 microversion: 2.1 time: 0.145747 Oct 29 20:49:58.587217 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 443/841] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:49:58 2022] DELETE /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 20:49:58.596269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:58.597226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:58.604576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.610074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.611174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.612117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.612746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.613709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.880975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.889809 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb787250-5396-4e4f-8985-28f9ccf08f7f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.745543 Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 399/842] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:58 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.905669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:58.906383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:58.907160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:58.963274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:58.972705 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-401dbcf9-0b1e-4c6a-b709-4247e0c28f78 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1478 microversion: 2.1 time: 0.380993 Oct 29 20:49:58.973286 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 444/843] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:58 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1478 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:49:58.978153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-363bd9ec-73db-4cde-b905-56469022c9c2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171c4a820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:59.035586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-363bd9ec-73db-4cde-b905-56469022c9c2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.061020 Oct 29 20:49:59.036171 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 445/844] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:49:58 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:59.040848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-693be210-4d12-4c55-9057-7a3a3486b744 req-a8c25791-4dbc-40e4-af17-7124346b189f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "name": "network-vif-plugged", "status": "completed", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:59.052169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-693be210-4d12-4c55-9057-7a3a3486b744 req-a8c25791-4dbc-40e4-af17-7124346b189f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.052668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-693be210-4d12-4c55-9057-7a3a3486b744 req-a8c25791-4dbc-40e4-af17-7124346b189f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.053108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-693be210-4d12-4c55-9057-7a3a3486b744 req-a8c25791-4dbc-40e4-af17-7124346b189f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.064265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-693be210-4d12-4c55-9057-7a3a3486b744 req-a8c25791-4dbc-40e4-af17-7124346b189f service nova] Creating event network-vif-plugged:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:49:59.069155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-693be210-4d12-4c55-9057-7a3a3486b744 req-a8c25791-4dbc-40e4-af17-7124346b189f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Oct 29 20:49:59.069798 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 446/845] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:49:59.133786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:59.142315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-706d9db6-aa54-4d1b-91a6-4e8cbcf7de82 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.250912 Oct 29 20:49:59.142984 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 400/846] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:58 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:59.159966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:59.160674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:59.167671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.168213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.168642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.169544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.170003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.170432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.317169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:59.326025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d086a3ad-3f9a-4964-97c1-268216777c2d tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.170210 Oct 29 20:49:59.326601 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 447/847] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:59 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:49:59.343570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:59.344185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:59.350818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.351307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.351746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.352442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.352899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.353328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.419107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:59.427527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:59.428988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:49:59.434486 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b318be27-260d-47aa-aca9-19ff9aacb024 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1437 microversion: 2.75 time: 0.094867 Oct 29 20:49:59.435053 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 401/848] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:59 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:49:59.564426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:49:59.567169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:59.573911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.574469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.574899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.575582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.576145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.576612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.654479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:49:59.654903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:49:59.655400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:49:59.655805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:49:59.656210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:49:59.714272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:59.719886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.720363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.720789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.721502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.721956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.722422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.839991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:49:59.895227 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6da0cbf5-ef4f-442f-a0fb-0c57508526f8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d/action" status: 202 len: 1940 microversion: 2.75 time: 0.437417 Oct 29 20:49:59.895861 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 448/849] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:49:59 2022] POST /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d/action => generated 1940 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 29 20:49:59.912195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:59.912951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:59.919982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.920555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.921096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.921913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.922931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.923073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:49:59.923073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:49:59.923245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.929496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.929715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.930127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:49:59.930729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:49:59.931179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:49:59.931598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.055718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:00.076269 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5cebe2ec-07c3-44d9-a7e5-800f08c0fb1c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.157385 Oct 29 20:50:00.076853 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 449/850] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:49:59 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:50:00.081648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:00.082196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:00.088148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.089257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.089747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.090451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.091097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.091831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.106583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:00.116298 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8086ad8b-b4f5-4e2b-8221-86aa984af0a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.207875 Oct 29 20:50:00.117226 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 402/851] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:49:59 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:00.123694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5a91ba02-92d4-4645-9317-f7df49a1806a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171a074c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:00.177362 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5a91ba02-92d4-4645-9317-f7df49a1806a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.058045 Oct 29 20:50:00.178279 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 403/852] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:00 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:00.183476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:00.184316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:00.190431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.190932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.191380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.192089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.192552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.192987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.316354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:00.327948 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0800202e-2c8e-4897-b604-cb1c46d21aa8 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1478 microversion: 2.1 time: 0.249810 Oct 29 20:50:00.341581 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 450/853] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:00 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1478 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:00.350393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:00.351096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:00.358524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.359108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.359607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.360310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.360761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.361183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.487461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:00.499212 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a03cdf12-5262-49ed-b47a-16b09fd2bd75 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1503 microversion: 2.1 time: 0.319279 Oct 29 20:50:00.499378 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 404/854] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:00 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:00.624809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:00.632758 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a4646d9-653a-43eb-ada8-c55d39c3f20a tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.287081 Oct 29 20:50:00.633562 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 451/855] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:00 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:00.892547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-055046ab-0a7c-4931-bac9-c134903d1025 req-06993bb8-328d-40fc-a652-7e451e93bc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa91ad81-0b7b-4aa4-87bb-6242a49198a6", "name": "network-vif-deleted", "tag": "f2e912a9-aeda-401e-8cf3-3b697d8cca4f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:00.907956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-055046ab-0a7c-4931-bac9-c134903d1025 req-06993bb8-328d-40fc-a652-7e451e93bc60 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:00.908566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-055046ab-0a7c-4931-bac9-c134903d1025 req-06993bb8-328d-40fc-a652-7e451e93bc60 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:00.909211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-055046ab-0a7c-4931-bac9-c134903d1025 req-06993bb8-328d-40fc-a652-7e451e93bc60 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:00.922907 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-055046ab-0a7c-4931-bac9-c134903d1025 req-06993bb8-328d-40fc-a652-7e451e93bc60 service nova] Creating event network-vif-deleted:f2e912a9-aeda-401e-8cf3-3b697d8cca4f for instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 on nch2-master-1 Oct 29 20:50:00.927593 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-055046ab-0a7c-4931-bac9-c134903d1025 req-06993bb8-328d-40fc-a652-7e451e93bc60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038830 Oct 29 20:50:00.928201 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 405/856] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:01.105928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.107083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:01.114317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.114941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.115445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.116207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.116817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.117880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.134932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:01.141888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.142723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:01.150213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.151754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.153186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.154154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.154723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.155261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.238995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:01.253627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:01.258486 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9547de5-4ba5-4cf9-82d9-dbdba08ce243 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.156538 Oct 29 20:50:01.259109 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 452/857] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:01.268816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48b12005-1fd9-47b9-b812-66fcd3eb87f2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171974a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.322157 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48b12005-1fd9-47b9-b812-66fcd3eb87f2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.058291 Oct 29 20:50:01.323452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 453/858] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:01.354079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.354873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:01.361102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.361629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.362072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.362780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.363247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.364017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.391521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:01.396923 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1f3f726-cf26-4e3f-bb96-5ffb07905cb8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.259394 Oct 29 20:50:01.407917 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 406/859] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:01.420507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.421086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.421706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.422232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lazy-loading 'fault' on Instance uuid aa91ad81-0b7b-4aa4-87bb-6242a49198a6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:01.483215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a91f45b10294340b057b0af59e728db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f6c2de012941568db7fd6bbe26c5ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:01.492035 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26c5d2c9-95ec-40e3-b204-2dd105afa5cb tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 200 len: 1312 microversion: 2.1 time: 0.141860 Oct 29 20:50:01.492609 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 454/860] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:01.524017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.524634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:01.531042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.531525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.531960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.532649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.533098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.533556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.655938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.656776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:01.663252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.663904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.664227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.665448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.665448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.666163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.689544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:01.698017 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d819664-964b-4e67-afa6-be365fbe3c45 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1493 microversion: 2.1 time: 0.178330 Oct 29 20:50:01.698855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 407/861] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:01.723337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-900e1e1d-5fc1-4997-9314-e724c4e3a4e1 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '.version_select at 0x7fa171a72940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.727198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-900e1e1d-5fc1-4997-9314-e724c4e3a4e1 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.728305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-900e1e1d-5fc1-4997-9314-e724c4e3a4e1 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.729441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-900e1e1d-5fc1-4997-9314-e724c4e3a4e1 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.738947 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-900e1e1d-5fc1-4997-9314-e724c4e3a4e1 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1184 microversion: 2.1 time: 0.020102 Oct 29 20:50:01.739800 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 408/862] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/os-migrations => generated 1184 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:01.758328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:01.759583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:01.763232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:01.767573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.768064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.768499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.769200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:01.769686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:01.770114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:01.807254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:01.815355 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c22a423-c7a8-433c-8ebe-69ed3e55fa83 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.163456 Oct 29 20:50:01.815950 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 455/863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:01.899138 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48ddfc3c-3913-40d8-8ea5-ce94a7991264 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1644 microversion: 2.1 time: 0.146007 Oct 29 20:50:01.899708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 409/864] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:01 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1644 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:02.013908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-905579047", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "151c0760-9de5-4226-8749-cb91b64e1da1"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:02.067736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] validate_networks() for [('151c0760-9de5-4226-8749-cb91b64e1da1', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:50:02.288164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:02.288913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:02.295992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.296476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.296915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.297638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.298098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.298521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.433651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:02.461989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:50:02.462511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:50:02.464438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:50:02.465065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:50:02.465665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:50:02.476265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.476845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.477347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.478296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.478841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.480165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.502673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:50:02.504581 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4ca1e5a-6910-4c3c-ab9c-1d51cfd3ccd6 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.220107 Oct 29 20:50:02.505961 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 410/865] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:02 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:50:02.512636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27aeb122-df6f-4ba4-bb27-e75523d2875a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171aa01f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:02.518647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for user 869b7117eab8443e9cbb52400b875ebc and project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:50:02.537101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:50:02.539491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:50:02.564178 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27aeb122-df6f-4ba4-bb27-e75523d2875a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.057005 Oct 29 20:50:02.564756 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 411/866] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:02 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:02.569180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:02.569824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:02.578086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.578644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.579320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.580123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.580752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.581265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.585490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:02.591772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f242dd20-6dc1-4d09-a4b2-c946dae92dfc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582226 Oct 29 20:50:02.598431 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 456/867] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:50:02.598431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:02.598431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] [instance: aa91ad81-0b7b-4aa4-87bb-6242a49198a6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:02.604456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.604958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.605399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.606134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.606625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.607016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.621736 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] HTTP exception thrown: Instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 could not be found. Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Request method failure captured: Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 HTTP/1.1 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZHiJjK8s82TACPHxp8bHtPHP4L-n1xwafITVlekDkSopLPJDZFys6pgDtGmJ6WtD5JK1wnZh1lPb-YQmoH-gP4LzjxQL3hTm-j23Ao9egw5yOP03bQbxYt3mU-UVQaLXyY9lQr6atfg4AdVj4DbsedEixnWpizDHnl_qgb9M0fJFNg Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 19f6c2de012941568db7fd6bbe26c5ab Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2074864168 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19f6c2de012941568db7fd6bbe26c5ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2074864168 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 19f6c2de012941568db7fd6bbe26c5ab Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2074864168 Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiagnosticsNegativeTest-2074864168-project Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0a91f45b10294340b057b0af59e728db Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2074864168-project Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 could not be found. Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'aa91ad81-0b7b-4aa4-87bb-6242a49198a6'} Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 could not be found. Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 could not be found. Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:02.623572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 could not be found. Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] Returning 404 to user: Instance aa91ad81-0b7b-4aa4-87bb-6242a49198a6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:02.627975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-05fd258e-2e3f-40d3-9e8f-199420c7c4e1 tempest-ServerDiagnosticsNegativeTest-2074864168 tempest-ServerDiagnosticsNegativeTest-2074864168-project] 10.222.0.36 "GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6" status: 404 len: 111 microversion: 2.1 time: 0.031228 Oct 29 20:50:02.630432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 457/868] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:02 2022] GET /compute/v2.1/servers/aa91ad81-0b7b-4aa4-87bb-6242a49198a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:02.636610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-14f097c6-b426-4712-aa83-986f7e930e7b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:02.637231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-14f097c6-b426-4712-aa83-986f7e930e7b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:02.696913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-14f097c6-b426-4712-aa83-986f7e930e7b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:02.705408 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-14f097c6-b426-4712-aa83-986f7e930e7b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1210 microversion: 2.1 time: 0.073019 Oct 29 20:50:02.706211 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 458/869] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:02 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1210 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:02.768936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:02.778421 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4663c135-2136-43bc-a542-cb82537d6b08 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.212644 Oct 29 20:50:02.779008 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 412/870] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:02 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:02.847003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:02.847623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:02.857992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.858735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.859340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:02.860329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:02.860944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:02.861563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.129268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:03.140453 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fc6f6dce-cb8e-4a13-8786-429646d24491 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.305956 Oct 29 20:50:03.141022 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 459/871] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:02 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:03.533800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:03.534403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:03.569115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:03.569714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:03.570174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.571838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:03.574465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:03.575071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.584445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edc28986-cb7e-4bec-a9e6-10661d28123b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17180af70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:03.712636 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edc28986-cb7e-4bec-a9e6-10661d28123b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.136992 Oct 29 20:50:03.724128 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 460/872] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:03 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:03.740282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:03.743723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:03.750354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:03.750849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:03.751366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.752084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:03.755664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:03.756155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.788338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:03.810427 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4597688-0c75-4a91-b5f6-65916c272644 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.279724 Oct 29 20:50:03.811627 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 413/873] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:03 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:03.816631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:03.817449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:03.824210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:03.824932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:03.825597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.826531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:03.827267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:03.828043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:03.854449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:03.865287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e07c586a-42d3-43ee-bc4b-cdf8a887e9ee tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1262 microversion: 2.1 time: 0.138654 Oct 29 20:50:03.866443 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 461/874] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:03 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1262 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:04.034526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:04.047693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a1ab89e0-906f-4cb2-9440-b385ad57c133 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.234164 Oct 29 20:50:04.048300 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 414/875] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:03 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:04.243455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:04.244515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:04.252203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:04.264757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:04.265838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:04.268470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:04.269245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:04.270855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:04.567138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:04.585889 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73d1795d-5e41-450e-9cac-b590cfbc60bd tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.343808 Oct 29 20:50:04.601813 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 462/876] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:04 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:04.731610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8917a845-ff77-4911-8b97-d74a7964d348 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1725e20d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:04.784095 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8917a845-ff77-4911-8b97-d74a7964d348 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.056246 Oct 29 20:50:04.785010 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 415/877] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:04 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:04.844341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:04.845280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:04.866444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:04.867766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:04.875235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:04.881035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:04.883039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:04.884996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:04.894487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:04.895684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:04.922792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:04.925013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:04.926182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:04.930568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:04.931678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:04.939041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:05.104752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:05.165143 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0cc2e5cc-538a-4c25-a668-f06ced102eea tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.325622 Oct 29 20:50:05.179331 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 463/878] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:04 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:05.193963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:05.194882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:05.205900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:05.206692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:05.207320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:05.208264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:05.208879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:05.209481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:05.234924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:05.249124 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-705ee734-fb91-48b0-b976-bd3855535b32 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1268 microversion: 2.1 time: 0.361234 Oct 29 20:50:05.251820 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 416/879] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:04 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1268 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:05.512543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:05.521571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aea82903-0436-43d5-bf73-13c97fb345bb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.340750 Oct 29 20:50:05.522162 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 464/880] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:05 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:05.612858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:05.613846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:05.627405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:05.633610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:05.634836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:05.640451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:05.642115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:05.642798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:05.803437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6de519a7-29bb-42cf-9579-df86aecf393f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171955af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:05.899685 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6de519a7-29bb-42cf-9579-df86aecf393f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.101948 Oct 29 20:50:05.909843 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 465/881] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:05 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.160867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98d5550e-506b-4c34-bc04-335bffbb0deb tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.180176 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-98d5550e-506b-4c34-bc04-335bffbb0deb tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.259468 Oct 29 20:50:06.195296 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 466/882] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:06.204969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.206521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:06.224520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:06.225422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:06.226044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:06.226979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:06.227655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:06.228250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:06.232827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:06.245813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-65ea7d63-6f76-45a7-8ffa-7189e8e347a1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.638164 Oct 29 20:50:06.254499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 417/883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:05 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.264790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-349bc188-3dc6-4618-9565-c76c39fc75f7 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.308574 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-349bc188-3dc6-4618-9565-c76c39fc75f7 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3395 microversion: 2.1 time: 0.052605 Oct 29 20:50:06.309322 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 418/884] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors => generated 3395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.314122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.314971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:06.321286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:06.322126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:06.323320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:06.324253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:06.324920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:06.325560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:06.390136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:06.410778 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1a9b5af5-b758-4702-9c25-71c72a7045e9 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.214055 Oct 29 20:50:06.411621 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 467/885] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:06.416773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6987728f-a57d-44c7-8bcb-8e8b0d38109d tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.425265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6987728f-a57d-44c7-8bcb-8e8b0d38109d tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012339 Oct 29 20:50:06.425886 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 468/886] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:06.442514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31e423f9-75e8-45ed-a192-6c0b2a909829 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.457428 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31e423f9-75e8-45ed-a192-6c0b2a909829 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018801 Oct 29 20:50:06.458384 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 469/887] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:06.472498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ec66adf-d1aa-4b03-b2fb-b7a75c386f0b tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.515987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ec66adf-d1aa-4b03-b2fb-b7a75c386f0b tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.048244 Oct 29 20:50:06.517081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 470/888] 10.222.0.36 () {58 vars in 1165 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:06.549018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fde0f4e4-6275-4062-87f2-e17b1aff3c56 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.569303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fde0f4e4-6275-4062-87f2-e17b1aff3c56 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037151 Oct 29 20:50:06.581629 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 471/889] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:06.587280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.589785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:06.596591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:06.597221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:06.598201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:06.599531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:06.600091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:06.600621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:06.629916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:06.643200 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae3fe8bb-c2c5-4e89-bcac-585a6f79d68e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.332565 Oct 29 20:50:06.650959 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 419/890] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.663466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2455c347-10ba-4a25-b95a-535577934249 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.694413 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2455c347-10ba-4a25-b95a-535577934249 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040917 Oct 29 20:50:06.695576 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 420/891] 10.222.0.36 () {58 vars in 1169 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.714097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91b7f94d-e383-49b2-803f-342e4f1b0612 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.729511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91b7f94d-e383-49b2-803f-342e4f1b0612 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019845 Oct 29 20:50:06.730458 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 421/892] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:50:06.745375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35128c91-99f0-466e-9d25-75797cf0d4e4 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.756388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35128c91-99f0-466e-9d25-75797cf0d4e4 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015377 Oct 29 20:50:06.757234 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 422/893] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:06.771667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b6dc9ce0-2500-4058-aae7-facf893fecb1 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.823391 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b6dc9ce0-2500-4058-aae7-facf893fecb1 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 3400 microversion: 2.1 time: 0.055534 Oct 29 20:50:06.826250 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 423/894] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 3400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.844083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3d40ee4-5082-4374-b27f-3d339bf739eb tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.854756 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b3d40ee4-5082-4374-b27f-3d339bf739eb tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014855 Oct 29 20:50:06.863247 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 424/895] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:06.868567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f8bcb9de-3f76-4518-a656-24357e84a50b tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.903508 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f8bcb9de-3f76-4518-a656-24357e84a50b tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038692 Oct 29 20:50:06.914743 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 425/896] 10.222.0.36 () {58 vars in 1144 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:06.919871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5481bb98-5fdc-4ae3-a883-8131bd96d4a0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171951700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:06.992214 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5481bb98-5fdc-4ae3-a883-8131bd96d4a0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.076244 Oct 29 20:50:06.996935 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 426/897] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:07.009609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bb35721c-51eb-498e-a2e4-6dac9dd918aa tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.018975 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bb35721c-51eb-498e-a2e4-6dac9dd918aa tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020719 Oct 29 20:50:07.020306 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 427/898] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:07.035373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60372b23-ae8f-41cc-9a05-2d881a5aced3 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.042857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:07.050791 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-356ec0d2-73c0-44e4-8975-1df31bebb050 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.467657 Oct 29 20:50:07.061483 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60372b23-ae8f-41cc-9a05-2d881a5aced3 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.024936 Oct 29 20:50:07.061483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 428/899] 10.222.0.36 () {58 vars in 1148 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:07.069414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f0bd1048-a39f-4f01-8871-248939785507 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.081043 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 472/900] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:06 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:07.086536 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f0bd1048-a39f-4f01-8871-248939785507 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021834 Oct 29 20:50:07.087448 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 429/901] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:07.099949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e895ba5b-2149-4b27-849e-eb86ba8dca4f tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.112774 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e895ba5b-2149-4b27-849e-eb86ba8dca4f tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017123 Oct 29 20:50:07.113964 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 473/902] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:07.127178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcf05141-fdd3-4464-90a3-f7bfdabd7749 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.152935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcf05141-fdd3-4464-90a3-f7bfdabd7749 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1858 microversion: 2.1 time: 0.030518 Oct 29 20:50:07.156668 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 430/903] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/flavors?marker=452 => generated 1858 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:07.172135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ceb39c6-2a88-459e-bb02-01cdcc7ea684 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.212129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ceb39c6-2a88-459e-bb02-01cdcc7ea684 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6305 microversion: 2.1 time: 0.044514 Oct 29 20:50:07.221135 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 474/904] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/flavors/detail => generated 6305 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:07.245871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f66f75f-590e-4d46-bc1e-b564bc213707 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.263650 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7f66f75f-590e-4d46-bc1e-b564bc213707 tempest-FlavorsV2TestJSON-1504935759 tempest-FlavorsV2TestJSON-1504935759-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017987 Oct 29 20:50:07.264885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 431/905] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:07.313107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.316654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:07.329157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.333008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.333881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.336448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.337916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.341077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.447461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.448459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:07.457193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.458549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.460482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.464777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.465526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.466271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.603194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:07.657022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:07.662199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4fd542b-4e28-4fb6-a047-b3c6000b5a83 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.218867 Oct 29 20:50:07.672195 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 432/906] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:50:07.672506 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-baabdea7-972f-4a3c-8c38-2e35eb39691e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.392691 Oct 29 20:50:07.680956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-15975ba8-0964-49f9-bcca-f03ff6a37486 req-6e024439-bb15-4d23-8184-f66be7fdcdfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "name": "network-vif-plugged", "status": "completed", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:07.683044 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 475/907] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:07.705878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-15975ba8-0964-49f9-bcca-f03ff6a37486 req-6e024439-bb15-4d23-8184-f66be7fdcdfc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.706490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-15975ba8-0964-49f9-bcca-f03ff6a37486 req-6e024439-bb15-4d23-8184-f66be7fdcdfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.708332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-15975ba8-0964-49f9-bcca-f03ff6a37486 req-6e024439-bb15-4d23-8184-f66be7fdcdfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.717751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:07.722066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:07.730100 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-15975ba8-0964-49f9-bcca-f03ff6a37486 req-6e024439-bb15-4d23-8184-f66be7fdcdfc service nova] Creating event network-vif-plugged:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:50:07.738248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-15975ba8-0964-49f9-bcca-f03ff6a37486 req-6e024439-bb15-4d23-8184-f66be7fdcdfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072991 Oct 29 20:50:07.739456 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 433/908] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:07.749525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.750018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.750460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.751215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.754809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.755266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.759279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-80a3d9c9-1649-4290-8a7d-371f35c66718 req-1d037577-ea5e-4e2f-831a-23f0c02a52ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934a8859-1a93-494f-8403-638eb4b0ab5c", "tag": "febb0e89-3b18-47fb-847c-0b59f0802d9b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:07.774187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a3d9c9-1649-4290-8a7d-371f35c66718 req-1d037577-ea5e-4e2f-831a-23f0c02a52ea service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:07.775242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a3d9c9-1649-4290-8a7d-371f35c66718 req-1d037577-ea5e-4e2f-831a-23f0c02a52ea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:07.776999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a3d9c9-1649-4290-8a7d-371f35c66718 req-1d037577-ea5e-4e2f-831a-23f0c02a52ea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:07.798260 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-80a3d9c9-1649-4290-8a7d-371f35c66718 req-1d037577-ea5e-4e2f-831a-23f0c02a52ea service nova] Creating event network-changed:febb0e89-3b18-47fb-847c-0b59f0802d9b for instance 934a8859-1a93-494f-8403-638eb4b0ab5c on nch2-master-1 Oct 29 20:50:07.804586 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-80a3d9c9-1649-4290-8a7d-371f35c66718 req-1d037577-ea5e-4e2f-831a-23f0c02a52ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052377 Oct 29 20:50:07.808015 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 434/909] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:08.014733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0807f2a8-0ed9-459e-a38d-c2477093a0ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171f06430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:08.084237 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0807f2a8-0ed9-459e-a38d-c2477093a0ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.076260 Oct 29 20:50:08.085059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 435/910] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:08 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:08.094085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:08.096274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:08.106011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:08.106555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:08.106971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:08.107703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:08.108217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:08.108591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:08.252414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:08.289610 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cff62e1f-cf24-4cfd-bb11-d950b15c904e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.604723 Oct 29 20:50:08.292696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 476/911] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:07 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:08.444291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:08.457493 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ee03ac6-a7cd-4dc1-bc83-90d34d45e10d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.370963 Oct 29 20:50:08.470630 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 436/912] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:08 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:08.702899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:08.703296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:08.704258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:08.705040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:08.725523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:08.729752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:08.730816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:08.731758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:08.733295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:08.733917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:08.734778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:08.736824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:08.737288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:08.738922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:08.741064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:08.741360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:08.918795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:08.943127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfdb4b80-8bee-4dd1-a5b9-f250c872093c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.248204 Oct 29 20:50:08.944277 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 437/913] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:08 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:08.988624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:09.000347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd1e6835-d620-4344-9858-56a97d4a315b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.308373 Oct 29 20:50:09.001517 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 477/914] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:08 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:09.103411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d981ef6-c3de-4c1f-ac38-a2032828c1ca tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1720b6160>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:09.183901 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d981ef6-c3de-4c1f-ac38-a2032828c1ca tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.085194 Oct 29 20:50:09.186055 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 438/915] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:09 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:09.319250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:09.319892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:09.329721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:09.330525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:09.331417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:09.332543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:09.333110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:09.333712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:09.490880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:09.495041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:09.506678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:09.507304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:09.507808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:09.509120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:09.509720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:09.510282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:09.543273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:09.555593 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba52dce9-8382-4358-8abe-103582c856d4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.241772 Oct 29 20:50:09.556763 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 478/916] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:09 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:09.720404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:09.731490 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-42530cb5-3d28-4986-8f72-cb8c8b826868 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1378 microversion: 2.1 time: 0.248928 Oct 29 20:50:09.750442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 439/917] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:09 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1378 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:09.988831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:09.989704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:09.999126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:09.999791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.000430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.001195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.001925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.002515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.024609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:10.026290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:10.047921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.051980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.056368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.057482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.065789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.068096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.348266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:10.353750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:10.375536 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-addd4313-90c9-4dd4-9f8b-ddac11ba50e4 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.390817 Oct 29 20:50:10.376934 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 479/918] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:09 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:10.383720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d1c8465-89c0-43b7-bd5a-2ad806eb2d01 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17172bc10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:10.445113 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d1c8465-89c0-43b7-bd5a-2ad806eb2d01 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.065558 Oct 29 20:50:10.445818 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 480/919] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:10 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:10.523506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:10.533131 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-39f5e462-ab3f-444f-b691-068de6da4118 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.512350 Oct 29 20:50:10.543761 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 440/920] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:10 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:10.585188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:10.586337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:10.600409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.601262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.602258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.603292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.604587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.605538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.761834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:10.762837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:10.771907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.772799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.773477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.776018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:10.778662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:10.779480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:10.821987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:10.843324 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0bf58a7d-bdbf-4cb7-b9a1-2c0600df0c3d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.263736 Oct 29 20:50:10.848171 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 481/921] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:10 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:11.033236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:11.044207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-078130a3-d698-4f1f-8f3b-36cbbae0a2d6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1528 microversion: 2.1 time: 0.290097 Oct 29 20:50:11.063951 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 441/922] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:10 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1528 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:11.069068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:11.069726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:11.078203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.078925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.079154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.079854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.080392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.080749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.302313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:11.312265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1bb5a9bb-5344-4f83-9246-277a82f5760b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1528 microversion: 2.1 time: 0.247903 Oct 29 20:50:11.325480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 482/923] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:11 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1528 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:11.337642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3014729-fc86-4218-a91f-60aa9415c397 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:11.365023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3014729-fc86-4218-a91f-60aa9415c397 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/92b82b15-fbcf-4246-99da-65cb519ba4de" status: 202 len: 0 microversion: 2.1 time: 0.030090 Oct 29 20:50:11.366086 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 442/924] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:11 2022] DELETE /compute/v2.1/flavors/92b82b15-fbcf-4246-99da-65cb519ba4de => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:11.374535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de4f0dfc-96e2-480c-857e-4e1b27ab612d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:11.411216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:11.411842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:11.412761 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de4f0dfc-96e2-480c-857e-4e1b27ab612d tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.041809 Oct 29 20:50:11.413894 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 483/925] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:11.425902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.429939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.429939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.429939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.429939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.429939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.436893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:11.439458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:11.447939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.448691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.449326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.450244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.450874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.452024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.575148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:11.594555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Old instance type tempest-test_resize_flavor_-416963738, new instance type m1.heat {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 20:50:11.617696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:11.626397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:50:11.628231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:50:11.630797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:50:11.631342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:50:11.631837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:50:11.643529 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29081ac3-2a6c-44d3-b7c3-5d852ed7f20c tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.235956 Oct 29 20:50:11.659512 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 443/926] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:11 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:50:11.676595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f4ddfce-303e-45c8-82b6-223cf829a367 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171a1db80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:11.745566 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f4ddfce-303e-45c8-82b6-223cf829a367 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.084152 Oct 29 20:50:11.749636 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 444/927] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:11 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:11.760817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:11.761490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:11.802917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.803448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.803919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:11.804712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:11.805143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:11.805673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.004662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c054a4a3-4287-4fd1-9f2f-489a24a2684f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df/action" status: 202 len: 0 microversion: 2.1 time: 0.564057 Oct 29 20:50:12.011734 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 484/928] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:11 2022] POST /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:12.031951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:12.031951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:12.093196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:12.093196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:12.093196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.093196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:12.093196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:12.093196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.342883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:12.357660 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6c5794f8-a7e5-4593-9bd8-25572cf5ef69 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.344619 Oct 29 20:50:12.363184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:12.371842 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9d9cc6c-528e-4a67-a385-70eb6673a64b tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.621024 Oct 29 20:50:12.372811 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 485/929] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:12 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:12.376191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 445/930] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:11 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:12.382324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:12.383001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:12.390398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:12.390945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:12.391437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.392556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:12.392964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:12.393408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.492266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:12.685654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:12.692858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:12.696115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:12.707772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=26 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:12.722369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:12.729448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:12.734750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8522cbe-2d3f-4679-b446-07671cf50778 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1537 microversion: 2.1 time: 0.354897 Oct 29 20:50:12.735609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.737397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 486/931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:12 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1537 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:12.738030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:12.739364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:12.739986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:12.763453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62de369c-3138-4d75-8a50-27bb3681e1e8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17172b040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:12.829608 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62de369c-3138-4d75-8a50-27bb3681e1e8 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.071815 Oct 29 20:50:12.830204 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 487/932] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:12 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:12.939968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:12.944887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:13.025003 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b199df7-7550-47d4-a220-6f0b52c3f1f2 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.350507 Oct 29 20:50:13.026777 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 446/933] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:12 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:13.383388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:13.385381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:13.397560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:13.398439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:13.399657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:13.405133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:13.406211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:13.406778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:13.407544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:13.408194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:13.422402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:13.424243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:13.425866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:13.426893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:13.429122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:13.432439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:13.802291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:13.817923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0286fdfd-f4da-4191-8c26-2c725842201b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.438336 Oct 29 20:50:13.824068 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 488/934] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:13 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:13.832906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:13.833564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:13.850212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:13.854906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:13.855738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:13.856711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:13.857410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:13.858144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:13.879041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:13.895776 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-791628d5-bc95-46a0-bf36-e3f5669edfc1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.490656 Oct 29 20:50:13.896957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 447/935] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:13 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:13.931176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f15ce973-55b1-41c0-add9-6950006c3523 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1718660d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:14.050228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f15ce973-55b1-41c0-add9-6950006c3523 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.148858 Oct 29 20:50:14.063641 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 448/936] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:13 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:14.071482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d5501b43-62a7-4685-81ec-2d19c45c55c2 req-6ef70ea7-4d7e-4391-a662-ad49e414150c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934a8859-1a93-494f-8403-638eb4b0ab5c", "name": "network-vif-plugged", "status": "completed", "tag": "febb0e89-3b18-47fb-847c-0b59f0802d9b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:14.122185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5501b43-62a7-4685-81ec-2d19c45c55c2 req-6ef70ea7-4d7e-4391-a662-ad49e414150c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.122684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5501b43-62a7-4685-81ec-2d19c45c55c2 req-6ef70ea7-4d7e-4391-a662-ad49e414150c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.123426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5501b43-62a7-4685-81ec-2d19c45c55c2 req-6ef70ea7-4d7e-4391-a662-ad49e414150c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:14.144880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:14.156897 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d5501b43-62a7-4685-81ec-2d19c45c55c2 req-6ef70ea7-4d7e-4391-a662-ad49e414150c service nova] Creating event network-vif-plugged:febb0e89-3b18-47fb-847c-0b59f0802d9b for instance 934a8859-1a93-494f-8403-638eb4b0ab5c on nch2-master-1 Oct 29 20:50:14.158323 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c5e84982-b0cf-457e-9c7f-3fe5bbff2241 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1537 microversion: 2.1 time: 0.332853 Oct 29 20:50:14.160487 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 489/937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:13 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1537 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:14.171985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:14.174007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:14.190456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.191195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.193874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:14.196914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.198269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.200945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:14.226184 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d5501b43-62a7-4685-81ec-2d19c45c55c2 req-6ef70ea7-4d7e-4391-a662-ad49e414150c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152113 Oct 29 20:50:14.227513 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 449/938] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:14.414970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:14.453903 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7eb86ff-9e61-4802-b5b3-b33fe2a32f27 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.289207 Oct 29 20:50:14.472726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 490/939] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:14 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:14.849893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:14.851323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:14.863060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.864245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.865218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:14.866835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.867576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.868300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:14.924445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:14.925329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:14.950352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.951138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.951838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:14.953213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:14.954185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:14.955025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:15.327409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:15.336839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d1374ef-26a2-4065-86e4-285beca0b3e1 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.418149 Oct 29 20:50:15.337436 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 491/940] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:14 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:15.370117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7ce6ee20-6830-404c-b5d6-90270d99d67b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1716871f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:15.438386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:15.457120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7ce6ee20-6830-404c-b5d6-90270d99d67b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.098893 Oct 29 20:50:15.460961 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 492/941] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:15 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:15.468506 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f55a54d8-017f-4365-b230-82489a9f95e0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1310 microversion: 2.1 time: 0.622649 Oct 29 20:50:15.469629 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 450/942] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:14 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1310 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:15.470546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:15.471652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:15.477888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:15.479810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:15.480482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:15.481121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:15.482263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:15.485354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:15.486153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:15.492172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:15.493285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:15.500158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:15.503309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:15.503969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:15.506665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:15.507490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:15.508796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:15.702220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:15.777131 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-47be287b-cff9-4967-9eb9-349886dfff33 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.292549 Oct 29 20:50:15.781226 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 451/943] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:15 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:15.861678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:15.870286 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4aeda531-171d-4787-97ee-a3d540796ba2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1537 microversion: 2.1 time: 0.407982 Oct 29 20:50:15.877845 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 493/944] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:15 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1537 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:16.009144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:16.010666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:16.027366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.028129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.030962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.032151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.033909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.034544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.115503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:16.361783 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b3b193f4-6232-4798-bd7f-3ae4898656c1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 204 len: 0 microversion: 2.1 time: 0.358064 Oct 29 20:50:16.362832 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 452/945] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:16 2022] DELETE /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:16.371928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:16.372325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:16.373240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:16.375253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:16.388014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.388825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.389887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.390999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.392128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.392767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.394106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:16.395550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.396042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.396526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.397256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.397776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.398205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.823043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:16.841184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:16.843455 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-40d90fc7-880c-4d0a-b94d-93b1bd942ff1 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1711 microversion: 2.1 time: 0.476301 Oct 29 20:50:16.854544 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 453/946] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:16 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1711 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:16.854544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f514b84-47f9-4bc8-b632-565e87455da6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1719c88b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:16.878511 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3d22325-7aa9-4606-8a21-b0fea3c5c543 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1472 microversion: 2.1 time: 0.516645 Oct 29 20:50:16.889484 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 494/947] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:16 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1472 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:16.889484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:16.889484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:16.894596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.895208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.896741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.899077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.900922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.901873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.940433 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f514b84-47f9-4bc8-b632-565e87455da6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.094788 Oct 29 20:50:16.941016 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 454/948] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:16 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:16.955766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:16.959475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:16.968893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.969391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.969864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:16.970585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:16.971045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:16.971476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.150028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:17.183954 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55403748-7020-487b-830d-4d09cb1b7c17 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.232259 Oct 29 20:50:17.184572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 455/949] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:16 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:17.194041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:17.194815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:17.203702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:17.219636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.219820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.227346 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b7adb5d-b85e-4134-ae36-628121f7ba30 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1494 microversion: 2.1 time: 0.346761 Oct 29 20:50:17.229653 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 495/950] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:16 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:17.232827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.233632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.234118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.234557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.256462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:17.256462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:17.270324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.270828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.271271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.276203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.276629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.277012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.471298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:17.481038 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a586babc-32c0-4d7b-9c92-669a97fddaa7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.295597 Oct 29 20:50:17.484033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 456/951] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:17 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:17.565244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5420d26-0473-443b-b8f0-4ae44246d375 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1645 microversion: 2.1 time: 0.305111 Oct 29 20:50:17.582772 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 496/952] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:17 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1645 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:17.589981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:17.591010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:17.598023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.598876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.599543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.600491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.601166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.601840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.815056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-234375287", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "9c558784-630d-4257-bb4e-6d935eebc38c"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:17.816216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f182b861-cdf0-4604-b1d6-3a33b282c422 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1645 microversion: 2.1 time: 0.230400 Oct 29 20:50:17.817333 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 457/953] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:17 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1645 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:17.839042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:17.842737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.843262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.843685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.844434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.844889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.845319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.874291 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3787a71-8897-4a09-a7df-8321d3d283ef tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039335 Oct 29 20:50:17.878048 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 458/954] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:50:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:50:17.886925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:17.888033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:17.895925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.896533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.897017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.898068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:17.898594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:17.899094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:17.914925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] validate_networks() for [('9c558784-630d-4257-bb4e-6d935eebc38c', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:50:18.764165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:18.777255 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3488a105-5d38-4cb2-8184-a71515511b55 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1711 microversion: 2.1 time: 0.897726 Oct 29 20:50:18.782617 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 459/955] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:17 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1711 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:18.795180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:18.800201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:18.811390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:18.816839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:18.817516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:18.818529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:18.819280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:18.820064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.000064 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-49067201-94ba-45ea-a3e5-49e57b13b026 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c/action" status: 202 len: 0 microversion: 2.1 time: 0.212171 Oct 29 20:50:19.004013 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 460/956] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:18 2022] POST /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:19.028507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:19.038392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:19.060073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.060573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.061020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.066335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.067017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.069581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.314174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:50:19.314803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:50:19.315367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:50:19.315960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:50:19.316483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:50:19.332528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.333286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.333927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.335008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.335655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.336259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.362816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Getting quotas for project effef2abce4f4216a17194712351d9ce. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:50:19.382515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Getting quotas for user 4b8f025e74a74bf0b83e2b3b27062099 and project effef2abce4f4216a17194712351d9ce. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:50:19.416979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:50:19.419479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:50:19.455160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:19.470255 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16d40a58-3ed8-400d-9a44-8c96de2ea6ac tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1478 microversion: 2.1 time: 0.464945 Oct 29 20:50:19.471446 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 461/957] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:19 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1478 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:19.477178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bd7d3612-3589-4a9c-9fee-f4ed56b91c89 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171a39c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:19.495811 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b489396f-b3b0-4e82-a1f6-d0e61c9fdc89 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868508 Oct 29 20:50:19.497749 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 497/958] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:50:19.502303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:19.511985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:19.535101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.535893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.536915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bd7d3612-3589-4a9c-9fee-f4ed56b91c89 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1455 microversion: 2.1 time: 0.061790 Oct 29 20:50:19.537185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.537563 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 462/959] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:19 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:19.548733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.549539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.550738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.565198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:19.566020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:19.578474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.578996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.579447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.580170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.580636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.581071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.729248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:19.759325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f83b1c2c-3af6-4a1e-8e10-44c659cf13ba tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.260240 Oct 29 20:50:19.778203 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 498/960] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:19 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:19.782519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:19.783603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:19.804325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.804828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.805272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.806018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:19.806505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:19.806947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:19.811488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:19.936169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:19.950363 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27e68366-4af9-4088-ab7d-e67e4bfade49 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.409235 Oct 29 20:50:19.951695 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 463/961] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:19 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:19.958929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2fb92a1-dc48-41e4-800a-5ba33bfc9039 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:19.959647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2fb92a1-dc48-41e4-800a-5ba33bfc9039 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:20.039645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2fb92a1-dc48-41e4-800a-5ba33bfc9039 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:20.049475 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2fb92a1-dc48-41e4-800a-5ba33bfc9039 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1231 microversion: 2.1 time: 0.096313 Oct 29 20:50:20.053957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 464/962] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:19 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:20.059398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:20.060296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:20.070372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.071204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.071740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.072944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.073630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.074114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.099628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:20.133777 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6c766ed-d62d-4a00-a292-bce959a01b34 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1630 microversion: 2.1 time: 0.367639 Oct 29 20:50:20.138357 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 499/963] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:19 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1630 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:20.158310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:20.161650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:20.168446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.169187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.169808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.170742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.171269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.171894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.211612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lazy-loading 'flavor' on Instance uuid 934a8859-1a93-494f-8403-638eb4b0ab5c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:20.243618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Going to try to live migrate instance to nch1-master-1 {{(pid=138885) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:50:20.346337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:20.359253 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc30e0c7-cdc4-4017-9faa-46f2a1a135bd tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1711 microversion: 2.1 time: 0.303248 Oct 29 20:50:20.360499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 465/964] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:20 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1711 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:20.498688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:20.499867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:20.518066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.518652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.519773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.520723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.522136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.522652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.831920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:20.842253 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ddc1b32c-f8d1-4500-a403-8a6a0f96de34 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1478 microversion: 2.1 time: 0.350388 Oct 29 20:50:20.843358 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 466/965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:20 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1478 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:20.850719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-07bc9d13-1e43-4306-8c52-6eff866b2499 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171866af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:20.910753 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-07bc9d13-1e43-4306-8c52-6eff866b2499 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1464 microversion: 2.1 time: 0.065804 Oct 29 20:50:20.911945 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 467/966] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:20 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1464 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:20.916942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:20.918895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:20.928471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.929273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.929884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:20.931049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:20.932119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:20.932695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.040621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:21.068043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e77652fb-482f-4d51-8b38-5406ddbba148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.152226 Oct 29 20:50:21.068658 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 468/967] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:20 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:21.076249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7346e38b-fe53-4ded-bf12-2cff0018b96c req-90499c77-45ce-4f0a-90c0-80301ed22c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37204d7-69fa-4ef8-abc6-b76eca0c482c", "name": "network-vif-deleted", "tag": "cb71f2c0-f460-43a7-8ad9-bbc3adcc1363"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:21.086591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7346e38b-fe53-4ded-bf12-2cff0018b96c req-90499c77-45ce-4f0a-90c0-80301ed22c6c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.087445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7346e38b-fe53-4ded-bf12-2cff0018b96c req-90499c77-45ce-4f0a-90c0-80301ed22c6c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.088119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7346e38b-fe53-4ded-bf12-2cff0018b96c req-90499c77-45ce-4f0a-90c0-80301ed22c6c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.099723 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7346e38b-fe53-4ded-bf12-2cff0018b96c req-90499c77-45ce-4f0a-90c0-80301ed22c6c service nova] Creating event network-vif-deleted:cb71f2c0-f460-43a7-8ad9-bbc3adcc1363 for instance f37204d7-69fa-4ef8-abc6-b76eca0c482c on nch2-master-1 Oct 29 20:50:21.105843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7346e38b-fe53-4ded-bf12-2cff0018b96c req-90499c77-45ce-4f0a-90c0-80301ed22c6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034771 Oct 29 20:50:21.106453 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 469/968] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:21.115587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16d31cf9-4403-4d81-8706-d968d70e098f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17187ad30>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:21.171156 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16d31cf9-4403-4d81-8706-d968d70e098f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 200 len: 1464 microversion: 2.1 time: 0.060493 Oct 29 20:50:21.172067 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 470/969] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:21 2022] GET /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 1464 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:21.176708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:21.177649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:21.185134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.185884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.186501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.187384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.188007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.188602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.329518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:21.337575 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98367082-5ce5-4b32-96cc-4a30316e2a8c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.164359 Oct 29 20:50:21.338480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 471/970] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:21 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:21.343403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:21.344638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:21.367020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.367904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.368565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.370090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.370555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.370988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.448153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:21.458154 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5f26f29f-3041-4e90-9186-06a5508c55f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1283 microversion: 2.1 time: 0.118339 Oct 29 20:50:21.459853 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 472/971] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:21 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1283 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:21.465568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:21.466473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:21.473056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.473856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.474514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.475611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:21.476331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:21.476864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:21.962343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:21.977809 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-39b37dad-28a2-47a3-ad8e-f9c27c6f02b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1481 microversion: 2.1 time: 0.516438 Oct 29 20:50:21.979706 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 473/972] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:21 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1481 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:21.985185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:21.985185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:21.999008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.001790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.003003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.003873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.004463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.005008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.045638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.046263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.046785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.047335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lazy-loading 'fault' on Instance uuid f37204d7-69fa-4ef8-abc6-b76eca0c482c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:22.142661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f2e85461844c6db1e27a0b5d084362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30b30d07b045bb9a79cc3668a15242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:22.156215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcb0aec5-99d4-42f7-afdf-e5984aa2d153 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 200 len: 1351 microversion: 2.1 time: 0.175139 Oct 29 20:50:22.157501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 474/973] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:21 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 1351 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:22.166006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c4954d26-640b-474a-9877-c8a10e0721bb req-3a18cdb5-4e22-43d5-9b46-28e9b22ecb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "name": "network-vif-unplugged", "status": "completed", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:22.177990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c4954d26-640b-474a-9877-c8a10e0721bb req-3a18cdb5-4e22-43d5-9b46-28e9b22ecb28 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.179681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c4954d26-640b-474a-9877-c8a10e0721bb req-3a18cdb5-4e22-43d5-9b46-28e9b22ecb28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.180345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c4954d26-640b-474a-9877-c8a10e0721bb req-3a18cdb5-4e22-43d5-9b46-28e9b22ecb28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.195817 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c4954d26-640b-474a-9877-c8a10e0721bb req-3a18cdb5-4e22-43d5-9b46-28e9b22ecb28 service nova] Creating event network-vif-unplugged:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:50:22.203716 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c4954d26-640b-474a-9877-c8a10e0721bb req-3a18cdb5-4e22-43d5-9b46-28e9b22ecb28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044280 Oct 29 20:50:22.204659 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 475/974] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:22.214116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:22.215202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:22.233016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.233941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.234518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.235415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.236109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.236747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.501860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:22.512921 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc1c96ea-fbd8-41e3-b21d-d38dcb34bc43 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1478 microversion: 2.1 time: 0.305699 Oct 29 20:50:22.531905 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 476/975] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:22 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1478 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:22.544691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:22.545584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:22.566980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.568100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.568717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.569946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.571171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.571825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.668460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:22.688325 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a63bfa88-2ae9-4b12-a8a5-8392ad5d717a tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.155140 Oct 29 20:50:22.688919 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 477/976] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:22 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:22.693750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:22.694388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:22.701875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.702600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.703753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.704560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:22.705393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:22.706069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:22.981223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:22.998491 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43795dcd-74d7-489e-ad9d-7d47f76569f3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.308245 Oct 29 20:50:22.999141 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 478/977] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:22 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:23.021439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:23.022095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:23.037532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.049729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.051097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.052174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.052802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.053401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.437794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:23.456416 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90548bf8-630a-4180-b426-bf1e795862e9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.449109 Oct 29 20:50:23.457689 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 479/978] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:22 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:23.466591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:23.467411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:23.490573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.491093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.491549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.492283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.492748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.493184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.806917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:23.815865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ac53bfc2-95af-4880-82f0-c36e9a6afb09 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1468 microversion: 2.1 time: 0.356961 Oct 29 20:50:23.816542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 480/979] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:23 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:23.826779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:23.827792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:23.836335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.836841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.837283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.838608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.839070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.839500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.855570 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c HTTP/1.1 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f37204d7-69fa-4ef8-abc6-b76eca0c482c'} Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:23.857246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc61544b-f62a-4c8d-b188-6c3b5cf88cdf tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 404 len: 111 microversion: 2.1 time: 0.040644 Oct 29 20:50:23.861394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 481/980] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:23 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:23.864908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:23.865549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:23.872472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.873334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.874002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:23.874911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:23.876094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:23.876094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.046662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83a39644-0b57-4f9b-ab13-fd217f57aafd tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c/action" status: 202 len: 0 microversion: 2.1 time: 3.891748 Oct 29 20:50:24.047483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 500/981] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:20 2022] POST /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c/action => generated 0 bytes in 3894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:50:24.054835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:24.055552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:24.068187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.068769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.069781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.071041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.071555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.072025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.245045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:24.265929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:24.283693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-181ca253-69c2-4718-abb9-ce69613a6cb9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1478 microversion: 2.1 time: 0.421557 Oct 29 20:50:24.285883 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 482/982] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:23 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1478 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:24.304502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0c7b876-7598-47ac-afa1-04c300817ef7 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1724455e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:24.328649 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc62e92b-5c07-4e15-8a50-f5d41c154c41 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.277551 Oct 29 20:50:24.341634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 501/983] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:24 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:24.359255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:24.360236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:24.376778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.377613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.378225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.379772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.380755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.381378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.406497 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a HTTP/1.1 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '081ac346-df70-4c2f-803e-94f0d633b72a'} Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:24.408665 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7d771345-32ce-465f-8f00-99d47cb01607 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 404 len: 111 microversion: 2.1 time: 0.064577 Oct 29 20:50:24.414478 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 502/984] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:24 2022] DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:24.430898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:24.432111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:24.439050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.439506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.440341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.441167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.442612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.443169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.506320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d0c7b876-7598-47ac-afa1-04c300817ef7 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?changes-since=2022-10-29T20%3A47%3A55Z" status: 200 len: 1902 microversion: 2.1 time: 0.214240 Oct 29 20:50:24.507335 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 483/985] 10.222.0.36 () {58 vars in 1199 bytes} [Sat Oct 29 20:50:24 2022] GET /compute/v2.1/images?changes-since=2022-10-29T20%3A47%3A55Z => generated 1902 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:24.515612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:24.516307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:24.527158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.527722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.528237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:24.528995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:24.529662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:24.530230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.117168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:25.125112 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2ea29a2-080a-457b-957f-ee4f239cec34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.712249 Oct 29 20:50:25.139140 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 503/986] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:24 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:25.139140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.139140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:25.139140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.139140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.139634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.140092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.140742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.141176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.157080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a HTTP/1.1 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '081ac346-df70-4c2f-803e-94f0d633b72a'} Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:25.158559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:25.162488 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1941ed0d-1bb3-420f-a926-84fc5d412358 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 404 len: 111 microversion: 2.1 time: 0.033336 Oct 29 20:50:25.165768 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 504/987] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:25.171547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.173430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:25.179593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.180118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.180531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.181231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.181711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.182351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.197777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:25.208171 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-899745a2-b611-49db-817b-09ec024d1207 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.699710 Oct 29 20:50:25.208852 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 484/988] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:24 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:25.215803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b06c92a-831c-427e-9645-35cfc0f2f6ce tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171866430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.293141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b06c92a-831c-427e-9645-35cfc0f2f6ce tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1984481242" status: 200 len: 485 microversion: 2.1 time: 0.082635 Oct 29 20:50:25.293750 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 485/989] 10.222.0.36 () {58 vars in 1231 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1984481242 => generated 485 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:25.298231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2dea278f-5ce8-446e-84a8-f8394d9584f1 req-0a518327-b881-443e-bb9c-7dc481736c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1", "tag": "3e543ffe-5d96-4a35-80df-2aed220ba76f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:25.311633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2dea278f-5ce8-446e-84a8-f8394d9584f1 req-0a518327-b881-443e-bb9c-7dc481736c38 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.312116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2dea278f-5ce8-446e-84a8-f8394d9584f1 req-0a518327-b881-443e-bb9c-7dc481736c38 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.312556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2dea278f-5ce8-446e-84a8-f8394d9584f1 req-0a518327-b881-443e-bb9c-7dc481736c38 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.324495 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2dea278f-5ce8-446e-84a8-f8394d9584f1 req-0a518327-b881-443e-bb9c-7dc481736c38 service nova] Creating event network-changed:3e543ffe-5d96-4a35-80df-2aed220ba76f for instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 on nch2-master-1 Oct 29 20:50:25.329593 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2dea278f-5ce8-446e-84a8-f8394d9584f1 req-0a518327-b881-443e-bb9c-7dc481736c38 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034624 Oct 29 20:50:25.330246 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 486/990] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:25.335409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef3cf2ee-cf65-49a1-a048-cd0373b2163e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '.version_select at 0x7fa17182d550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.357075 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef3cf2ee-cf65-49a1-a048-cd0373b2163e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189153438" status: 202 len: 0 microversion: 2.1 time: 0.025492 Oct 29 20:50:25.357730 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 487/991] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 20:50:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189153438 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:25.362813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b9caddc7-4ed2-40e8-94a5-08a717f11922 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17191a8b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.478408 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b9caddc7-4ed2-40e8-94a5-08a717f11922 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?server=08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 958 microversion: 2.1 time: 0.119348 Oct 29 20:50:25.479236 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 488/992] 10.222.0.36 () {58 vars in 1209 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/images?server=08730262-0769-4c72-90c5-2c330c229896 => generated 958 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:25.501797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.503027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:25.511088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.512206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.512979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.513783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.514395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.515083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.544972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:25.557084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:25.574291 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-186c03a9-8b0f-45d6-8c34-9f82677f47bf tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.407202 Oct 29 20:50:25.588164 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 505/993] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:25.598908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.599833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:25.606926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.608357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.609166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.610239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.610942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.611585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.784200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:25.809917 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a9f2c92-e612-45c4-be69-73a32beaafd5 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.214902 Oct 29 20:50:25.827166 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 506/994] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:25.836226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dfc0392d-740f-457a-a747-4adf8404adec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17189b0d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.898209 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dfc0392d-740f-457a-a747-4adf8404adec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 484 microversion: 2.1 time: 0.069558 Oct 29 20:50:25.906741 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 507/995] 10.222.0.36 () {58 vars in 1317 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 484 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:25.911954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d9ac483b-f113-4189-9202-10b6014a75c6 req-14eb1484-37bd-4da2-9926-03d51dedcd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "name": "network-vif-plugged", "status": "completed", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:25.918948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:25.934293 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c01e5255-2546-4758-8a92-4608b32cec91 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1478 microversion: 2.1 time: 0.453228 Oct 29 20:50:25.934901 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 489/996] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1478 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:25.950075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd3e4f1f-1d2c-423e-9f0e-a11dc868d14b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171866f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:25.955653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d9ac483b-f113-4189-9202-10b6014a75c6 req-14eb1484-37bd-4da2-9926-03d51dedcd4c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:25.958275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d9ac483b-f113-4189-9202-10b6014a75c6 req-14eb1484-37bd-4da2-9926-03d51dedcd4c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:25.958818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d9ac483b-f113-4189-9202-10b6014a75c6 req-14eb1484-37bd-4da2-9926-03d51dedcd4c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:25.995138 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d9ac483b-f113-4189-9202-10b6014a75c6 req-14eb1484-37bd-4da2-9926-03d51dedcd4c service nova] Creating event network-vif-plugged:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:50:26.012783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d9ac483b-f113-4189-9202-10b6014a75c6 req-14eb1484-37bd-4da2-9926-03d51dedcd4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104325 Oct 29 20:50:26.013388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 508/997] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:26.040162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd3e4f1f-1d2c-423e-9f0e-a11dc868d14b tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 484 microversion: 2.1 time: 0.103971 Oct 29 20:50:26.044172 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 490/998] 10.222.0.36 () {58 vars in 1303 bytes} [Sat Oct 29 20:50:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 484 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:26.059572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea337cb1-f62d-48ef-9050-3d56e9d78423 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171955dc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.151292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.152303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:26.162713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.163461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.164319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.165362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.166725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.167779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.242099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea337cb1-f62d-48ef-9050-3d56e9d78423 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.190197 Oct 29 20:50:26.243812 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 509/999] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:26.248850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.249865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:26.259466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.260173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.260819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.261943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.262997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.263618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.544343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:26.555294 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1d9b94d-7ebb-4f74-9343-6db6daa34ffd tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.409418 Oct 29 20:50:26.557489 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 491/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:26.563052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25c41e8f-35d7-4674-84e5-bfcc1881dbe2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17187aee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.629486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:26.639375 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7353cfb-4830-4c7a-9623-b2faa3ab7557 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.394356 Oct 29 20:50:26.640300 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 510/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:26.644276 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25c41e8f-35d7-4674-84e5-bfcc1881dbe2 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.085406 Oct 29 20:50:26.645434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfebd7a4-f2c3-4daa-8a4d-e8ca39f10b03 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.653585 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 492/1002] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:26.658683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.659657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:26.666978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.667861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.668300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.669099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.669649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.670153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.671350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cfebd7a4-f2c3-4daa-8a4d-e8ca39f10b03 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1910888487" status: 202 len: 0 microversion: 2.1 time: 0.029546 Oct 29 20:50:26.672011 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 511/1003] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:50:26 2022] DELETE /compute/v2.1/flavors/1910888487 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:26.676734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-803ab433-c753-4521-aac0-ba941c79e07f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171706b80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.759831 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-803ab433-c753-4521-aac0-ba941c79e07f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.086541 Oct 29 20:50:26.760514 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 512/1004] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:26.766421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3445c67d-e796-42e9-9ae2-7645fd813357 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.787253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3445c67d-e796-42e9-9ae2-7645fd813357 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.025524 Oct 29 20:50:26.788232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 513/1005] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:26.793820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e80381d-5d82-4b27-ab59-f00462bee490 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1716653a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.879849 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e80381d-5d82-4b27-ab59-f00462bee490 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?changes-since=2022-10-29T20%3A47%3A49Z" status: 200 len: 6333 microversion: 2.1 time: 0.090284 Oct 29 20:50:26.880680 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 514/1006] 10.222.0.36 () {58 vars in 1220 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-29T20%3A47%3A49Z => generated 6333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:26.881720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:26.885747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe316f89-3f8b-4d1d-a098-2addd8caef78 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.892818 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-245cd818-f246-4c78-b6eb-0ff56cd6ed00 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.237884 Oct 29 20:50:26.893421 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 493/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:26.901711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.902741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:26.909765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.910308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.911038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.911649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:26.912202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:26.912672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:26.918063 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fe316f89-3f8b-4d1d-a098-2addd8caef78 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/839638491" status: 202 len: 0 microversion: 2.1 time: 0.035814 Oct 29 20:50:26.919086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 515/1008] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:50:26 2022] DELETE /compute/v2.1/flavors/839638491 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:26.926688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-78c6fa50-ffde-4c94-874f-fa471da2a27d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171940670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:26.982248 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-78c6fa50-ffde-4c94-874f-fa471da2a27d tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1984481242" status: 200 len: 665 microversion: 2.1 time: 0.060723 Oct 29 20:50:26.983037 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 516/1009] 10.222.0.36 () {58 vars in 1252 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1984481242 => generated 665 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:26.988129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7537f3d4-0626-4bcb-8659-6295bb751883 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.010324 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7537f3d4-0626-4bcb-8659-6295bb751883 tempest-ServersWithSpecificFlavorTestJSON-862508280 tempest-ServersWithSpecificFlavorTestJSON-862508280-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025932 Oct 29 20:50:27.018690 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 517/1010] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.018690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.018690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.024023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.024780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.025876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.026747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.027936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.028483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.044229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:27.071045 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23fcfefe-5fc9-4385-aee2-66aca2bc7e47 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.176365 Oct 29 20:50:27.071821 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 494/1011] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:26 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:27.077249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13594681-2031-4374-ac67-d8b30d338a53 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1720b6160>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.139145 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13594681-2031-4374-ac67-d8b30d338a53 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1466 microversion: 2.1 time: 0.065474 Oct 29 20:50:27.139729 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 495/1012] 10.222.0.36 () {58 vars in 1338 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1466 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.145062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.145820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.152941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.153673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.154626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.155631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.156006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.156476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.172557 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c HTTP/1.1 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f37204d7-69fa-4ef8-abc6-b76eca0c482c'} Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:27.174414 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3aa2925-2f99-42b2-8560-fe8f7ed08428 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 404 len: 111 microversion: 2.1 time: 0.034801 Oct 29 20:50:27.179773 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 496/1013] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:27 2022] DELETE /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:27.185764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfc9c971-27d1-4735-8cf6-d48c2315966a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171e69550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.247981 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfc9c971-27d1-4735-8cf6-d48c2315966a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1466 microversion: 2.1 time: 0.066592 Oct 29 20:50:27.248707 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 497/1014] 10.222.0.36 () {58 vars in 1324 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2F36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1466 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.254052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.255105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: f37204d7-69fa-4ef8-abc6-b76eca0c482c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.262112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.262652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.263166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.264079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.264639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.265096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.281844 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c HTTP/1.1 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f37204d7-69fa-4ef8-abc6-b76eca0c482c'} Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.283889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance f37204d7-69fa-4ef8-abc6-b76eca0c482c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:27.289071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd795e4b-10b0-4294-bc92-964f55d85f8f tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c" status: 404 len: 111 microversion: 2.1 time: 0.037714 Oct 29 20:50:27.292915 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 498/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/servers/f37204d7-69fa-4ef8-abc6-b76eca0c482c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:27.296249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3888fc9b-9ecd-4b0b-82b5-9652920837e9 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1718da790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.337421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:27.354784 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-efed6bc5-d1bc-4e02-91c8-dc6a3d4647d3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1478 microversion: 2.1 time: 0.342359 Oct 29 20:50:27.367058 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 518/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1478 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.380459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.381107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.391335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.392145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.392771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.393897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.394469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.395011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.413069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a HTTP/1.1 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '081ac346-df70-4c2f-803e-94f0d633b72a'} Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:27.415378 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3e3f0740-daef-4c49-8186-976d11f5783e tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 404 len: 111 microversion: 2.1 time: 0.049940 Oct 29 20:50:27.423477 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 519/1017] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:27 2022] DELETE /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:27.427905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b141ebbd-6fb9-4347-9c91-2baa0303b58f req-555131ac-0269-48d8-8fdc-121e90ba3a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934a8859-1a93-494f-8403-638eb4b0ab5c", "name": "network-vif-unplugged", "status": "completed", "tag": "febb0e89-3b18-47fb-847c-0b59f0802d9b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:27.430507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3888fc9b-9ecd-4b0b-82b5-9652920837e9 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.138560 Oct 29 20:50:27.431082 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 499/1018] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.435921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.436756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] [instance: 081ac346-df70-4c2f-803e-94f0d633b72a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.442945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.443634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.444240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.445132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.445786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.446373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.452722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b141ebbd-6fb9-4347-9c91-2baa0303b58f req-555131ac-0269-48d8-8fdc-121e90ba3a00 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.453674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b141ebbd-6fb9-4347-9c91-2baa0303b58f req-555131ac-0269-48d8-8fdc-121e90ba3a00 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.454389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b141ebbd-6fb9-4347-9c91-2baa0303b58f req-555131ac-0269-48d8-8fdc-121e90ba3a00 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.464475 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] HTTP exception thrown: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Request method failure captured: Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a HTTP/1.1 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZE2b-Ka4mQJ7JmSCr-mR1yl-5mtyHoTVMwmDs1ZF1NBmK28-AYqrnwj2LufJ4Z61FAnPmRyYLawnYguxM86Wy8dCG-o5OUvttx_xuIvzCs187EMA9FfRh1-scw40Klnge9XCW-n1oLj-1TSgTfjyCqkB85FQ5IGkzwG_wRhxBavYKU Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6d30b30d07b045bb9a79cc3668a15242"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6d30b30d07b045bb9a79cc3668a15242 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b9f2e85461844c6db1e27a0b5d084362 Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1752316376-project Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '081ac346-df70-4c2f-803e-94f0d633b72a'} Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.466277 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. Oct 29 20:50:27.471406 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:27.472043 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b141ebbd-6fb9-4347-9c91-2baa0303b58f req-555131ac-0269-48d8-8fdc-121e90ba3a00 service nova] Creating event network-vif-unplugged:febb0e89-3b18-47fb-847c-0b59f0802d9b for instance 934a8859-1a93-494f-8403-638eb4b0ab5c on nch2-master-1 Oct 29 20:50:27.472912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] Returning 404 to user: Instance 081ac346-df70-4c2f-803e-94f0d633b72a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:27.474085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7f6b09b1-09e9-45d5-8825-80c982fa9164 tempest-ServersWithSpecificFlavorTestJSON-1752316376 tempest-ServersWithSpecificFlavorTestJSON-1752316376-project] 10.222.0.36 "GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a" status: 404 len: 111 microversion: 2.1 time: 0.041770 Oct 29 20:50:27.479912 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 500/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/servers/081ac346-df70-4c2f-803e-94f0d633b72a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:27.483268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b141ebbd-6fb9-4347-9c91-2baa0303b58f req-555131ac-0269-48d8-8fdc-121e90ba3a00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061681 Oct 29 20:50:27.484749 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 520/1020] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:27.490996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4e2bc0a7-4769-4b9a-96c0-59b6f64a5260 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1718da700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.585216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.586514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.592520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4e2bc0a7-4769-4b9a-96c0-59b6f64a5260 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.112540 Oct 29 20:50:27.594225 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 501/1021] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.606193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.610026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.610646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.611655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.612272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.612858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.614224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1cf7a18-9fe5-4d6c-a646-84c04c1ab1b3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa1718d7f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.680110 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1cf7a18-9fe5-4d6c-a646-84c04c1ab1b3 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/1a2bec42-cf5e-436b-826e-51ea67e041f7" status: 200 len: 784 microversion: 2.1 time: 0.072322 Oct 29 20:50:27.681172 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 502/1022] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/images/1a2bec42-cf5e-436b-826e-51ea67e041f7 => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:27.686685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.687523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:27.694514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.695192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.695800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.697527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:27.698210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:27.698898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:27.854029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:27.937212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:27.945294 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-154824f9-5e45-43aa-8b57-d205429a388f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.364518 Oct 29 20:50:27.947530 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 521/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:27.952355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3508756e-fabe-4e9e-aa7a-27d7cacbe653 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17172b790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:27.996213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:28.007509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54aab722-3783-4c2b-be1d-b584e2251772 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.324898 Oct 29 20:50:28.008644 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 503/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:28.016283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:28.016979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3508756e-fabe-4e9e-aa7a-27d7cacbe653 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.068069 Oct 29 20:50:28.017110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:28.017894 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 522/1025] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:50:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:28.025525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.026568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.027569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.028526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.029797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.030507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.035019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-020dc16f-75e4-41d6-95b6-f4467ac61a82 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17180ab80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:28.344873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:28.359564 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f622c36-d76f-43bf-a251-73b6193bf0c8 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.347849 Oct 29 20:50:28.360656 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 504/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:28 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:28.366166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e4738717-153e-4e7e-b02b-6796b783daba req-c99c15df-9531-491c-bb57-504b078015c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "name": "network-vif-unplugged", "status": "completed", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:28.387689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4738717-153e-4e7e-b02b-6796b783daba req-c99c15df-9531-491c-bb57-504b078015c8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.388178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4738717-153e-4e7e-b02b-6796b783daba req-c99c15df-9531-491c-bb57-504b078015c8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.388615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4738717-153e-4e7e-b02b-6796b783daba req-c99c15df-9531-491c-bb57-504b078015c8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.420613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e4738717-153e-4e7e-b02b-6796b783daba req-c99c15df-9531-491c-bb57-504b078015c8 service nova] Creating event network-vif-unplugged:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:50:28.429233 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e4738717-153e-4e7e-b02b-6796b783daba req-c99c15df-9531-491c-bb57-504b078015c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067148 Oct 29 20:50:28.434752 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 505/1027] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:28.443300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:28.444363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:28.451984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.452606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.453343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.454098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.454628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.455184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.567372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:28.589826 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08947317-effc-4515-af4e-1248f5838c78 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.153637 Oct 29 20:50:28.590974 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 506/1028] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:28 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:28.595786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:28.598264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:28.607513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.608005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.608433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.609646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.610302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.610918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.796709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:28.809995 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5161d63e-5884-4071-847c-33aa8d9f9dfa tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1463 microversion: 2.1 time: 0.217749 Oct 29 20:50:28.810749 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 507/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:28 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1463 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:28.849544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:28.852046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:28.857372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:28.859195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.859496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.860114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.860826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.861284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.861727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.965682 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c6bf466c-532e-49b1-afc7-6b927218bbf7 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 0 microversion: 2.1 time: 0.121928 Oct 29 20:50:28.973704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 508/1030] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:28 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:28.985436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:28.986523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:28.996519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:28.997380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:28.998067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:28.999245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.000187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.000943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.059063 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-020dc16f-75e4-41d6-95b6-f4467ac61a82 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f" status: 204 len: 0 microversion: 2.1 time: 1.027658 Oct 29 20:50:29.060832 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 523/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:28 2022] DELETE /compute/v2.1/images/7e055217-3c43-4b11-a235-b9290ea6849f => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:29.067328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:29.067945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:29.079431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.080439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.081323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.091227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.093955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.095370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.156632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.157353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.157866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.163283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lazy-loading 'fault' on Instance uuid 4f981c21-556b-40cc-8edf-87f69b2e4e4e {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:29.270362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:29.283719 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d92c7d5-0180-4df5-a04b-ba1549be0df8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.305210 Oct 29 20:50:29.284313 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 509/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:28 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:29.299692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:29.300311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:29.315225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.315831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.316281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.317076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.317596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.318311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.350867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:29.360303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab0129f3-b599-4023-805c-ca2f810236e4 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1597 microversion: 2.1 time: 0.297487 Oct 29 20:50:29.379445 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 524/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:29 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1597 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:29.393093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ac9951e-c023-440a-904b-ef18d7a96be1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171706a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:29.402103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:29.491800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:29.502725 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-317c9bf0-d133-4e67-8dfc-d9e0cbd50aa6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.207041 Oct 29 20:50:29.506076 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 510/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:29 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:29.513410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:29.514064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:29.528744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.529249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.529715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.535698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.536910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.537605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.713636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:29.727885 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1cfb93a8-4077-4429-aa11-c69cae66d0b9 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.219903 Oct 29 20:50:29.729855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 511/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:29 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:29.735391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:29.738289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:29.748693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.750158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.751007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.752166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.753153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.757822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.843676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:29.879315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8ca76af1-ddb1-4054-b63a-038ac29d902c tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action" status: 202 len: 0 microversion: 2.1 time: 0.147725 Oct 29 20:50:29.881309 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 512/1036] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:29 2022] POST /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:29.888371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-dfd032eb-e317-481d-8b7e-a0635df51f17 req-fa290a8f-be50-447d-acd9-04398a613c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934a8859-1a93-494f-8403-638eb4b0ab5c", "tag": "febb0e89-3b18-47fb-847c-0b59f0802d9b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:29.901501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dfd032eb-e317-481d-8b7e-a0635df51f17 req-fa290a8f-be50-447d-acd9-04398a613c22 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.910285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dfd032eb-e317-481d-8b7e-a0635df51f17 req-fa290a8f-be50-447d-acd9-04398a613c22 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.910753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dfd032eb-e317-481d-8b7e-a0635df51f17 req-fa290a8f-be50-447d-acd9-04398a613c22 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.933830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-dfd032eb-e317-481d-8b7e-a0635df51f17 req-fa290a8f-be50-447d-acd9-04398a613c22 service nova] Creating event network-changed:febb0e89-3b18-47fb-847c-0b59f0802d9b for instance 934a8859-1a93-494f-8403-638eb4b0ab5c on nch2-master-1 Oct 29 20:50:29.944286 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-dfd032eb-e317-481d-8b7e-a0635df51f17 req-fa290a8f-be50-447d-acd9-04398a613c22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061091 Oct 29 20:50:29.945703 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 513/1037] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:29.959753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:29.961796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:29.979389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.981438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.981991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:29.985875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:29.985875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:29.985875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:30.044920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:30.133707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:30.161764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-34a5c35a-127a-415e-8ca5-76b1934d5ecf tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.208719 Oct 29 20:50:30.171250 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ac9951e-c023-440a-904b-ef18d7a96be1 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d" status: 204 len: 0 microversion: 2.1 time: 0.789442 Oct 29 20:50:30.172734 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 525/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:29 2022] DELETE /compute/v2.1/images/bc7249c2-2095-45d6-9147-de3204dc071d => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:30.178318 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 514/1039] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:29 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:30.183104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:30.190298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0829f9ae-9249-4143-b0e3-0eab73be6e26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa17182fdc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:30.198777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:30.225048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:30.234281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:30.235435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:30.239805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:30.240836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:30.241237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:30.626699 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c4b8c3db-2e7d-4bb4-8cc0-8bba4016e785 tempest-ServersAdminTestJSON-1141555242 tempest-ServersAdminTestJSON-1141555242-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1614 microversion: 2.1 time: 0.451419 Oct 29 20:50:30.641075 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 526/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:30 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1614 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:30.663362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:30.665195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:30.679496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:30.681020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:30.681493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:30.682918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:30.683334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:30.684043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:30.895585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0829f9ae-9249-4143-b0e3-0eab73be6e26 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6" status: 204 len: 0 microversion: 2.1 time: 0.714780 Oct 29 20:50:30.901607 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 515/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:30 2022] DELETE /compute/v2.1/images/6ff7da10-9643-4b5b-ac3b-c94e4c8775c6 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:30.909999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:30.911364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:30.920387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:30.922300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:30.923131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:30.924221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:30.924895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:30.925651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.340638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:31.351181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f8aa77c-80a1-4c8b-b716-edbf5aa91ab7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.447470 Oct 29 20:50:31.351876 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 516/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:30 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:31.356807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8e28818b-5edf-4309-9ba4-a7391286568b req-28173a9f-7f41-42fb-ba2a-a78c21a6e2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1", "name": "network-vif-plugged", "status": "completed", "tag": "3e543ffe-5d96-4a35-80df-2aed220ba76f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:31.366816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8e28818b-5edf-4309-9ba4-a7391286568b req-28173a9f-7f41-42fb-ba2a-a78c21a6e2be service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.368248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8e28818b-5edf-4309-9ba4-a7391286568b req-28173a9f-7f41-42fb-ba2a-a78c21a6e2be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.368946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8e28818b-5edf-4309-9ba4-a7391286568b req-28173a9f-7f41-42fb-ba2a-a78c21a6e2be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.369556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:31.378731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c30aea1-86a5-49ff-9bbb-7887f1011057 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.736318 Oct 29 20:50:31.382073 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 527/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:30 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:31.383520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8e28818b-5edf-4309-9ba4-a7391286568b req-28173a9f-7f41-42fb-ba2a-a78c21a6e2be service nova] Creating event network-vif-plugged:3e543ffe-5d96-4a35-80df-2aed220ba76f for instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 on nch2-master-1 Oct 29 20:50:31.390214 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8e28818b-5edf-4309-9ba4-a7391286568b req-28173a9f-7f41-42fb-ba2a-a78c21a6e2be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036321 Oct 29 20:50:31.390746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:31.391589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:31.391892 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 517/1044] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:31.398284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:31.399175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:31.403969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.404857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.405109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.406403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.407187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.407683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.412824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:31.414722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.415628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.415944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.416791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.417389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.418116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.443571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:31.578720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f812fb1-1c59-4d33-aa06-53c4f332ae41 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 204 len: 0 microversion: 2.1 time: 0.194231 Oct 29 20:50:31.580562 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 528/1045] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:31 2022] DELETE /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:31.593675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:31.594642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:31.602377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.603414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.604347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.605264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.605848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.606917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.642824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:31.724252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:31.737191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f400b561-178f-4382-a849-c9e2b083691f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 204 len: 0 microversion: 2.1 time: 0.154675 Oct 29 20:50:31.737933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 529/1046] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:31 2022] DELETE /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:31.749577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:31.750334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:31.762746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.763610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.764340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.765409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.766161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.766742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.799944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:31.814659 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5ed7bf30-2d10-4d21-a367-0bd294e002d5 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.421248 Oct 29 20:50:31.815561 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 518/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:31 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:31.843279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:31.844828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:31.857326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.858266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.859964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.860827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.862440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.863798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.864777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:31.897836 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdbd0ac4-b2f2-44a9-9269-edf3fbc81357 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1927 microversion: 2.75 time: 0.154464 Oct 29 20:50:31.905113 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 530/1048] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:31 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:31.923082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:31.924073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:31.934751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.936046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.936660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:31.937924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:31.938558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:31.939186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.183576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:32.184137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:32.193670 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e0259730-604f-4d8b-8c99-8ba81adab8b6 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1473 microversion: 2.1 time: 0.286118 Oct 29 20:50:32.194299 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 531/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:31 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:32.196126 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60af813d-66bc-48c9-bae5-973918517e32 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1470 microversion: 2.1 time: 0.375381 Oct 29 20:50:32.198648 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 519/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:31 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1470 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:32.375203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:32.375922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:32.382049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.382545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.383205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.383935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.384436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.385385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.404174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:32.405566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:32.421586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.422146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.424163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.424163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.424163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.424163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.757839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:32.768796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b99952b-5336-436b-9bca-e5ae1f88d899 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.397199 Oct 29 20:50:32.782609 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 532/1051] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:32 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:32.800507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:32.819436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f3e2e69c-e88e-4b08-805a-c60b5c01d50a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.420964 Oct 29 20:50:32.820768 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 520/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:32 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:32.844792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:32.844792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:32.849128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.849664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.850216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.850954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.851408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.851836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.935302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:32.935887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:32.942682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.943152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.943592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:32.944300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:32.944949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:32.945560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.073565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:33.093691 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7f217df-311a-49bf-9b1a-c1996593d148 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1933 microversion: 2.75 time: 0.162693 Oct 29 20:50:33.094209 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 521/1053] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:32 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1933 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:50:33.127341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:33.137917 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f7e6ec3-d1bc-48c6-9709-a2842b9622fa tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.302208 Oct 29 20:50:33.152382 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 533/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:32 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:33.221738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:33.222329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:33.236578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:33.237377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:33.245055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.247139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.249861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.250653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.252264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.252857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.253401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.257975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.258523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.259264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.259795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.260284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.592827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:33.602787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:33.606457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e3e402d-d4cd-4b26-9be2-308e95c8b133 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1473 microversion: 2.1 time: 0.392658 Oct 29 20:50:33.607049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 522/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:33 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:33.611434 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8bde82e1-0e25-4465-98c8-9b8da4882d2f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1470 microversion: 2.1 time: 0.379596 Oct 29 20:50:33.618093 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 534/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:33 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1470 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:33.794275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:33.794892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:33.800703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.801200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.801683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.802384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.802927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.803269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.847377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:33.847894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:33.853987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.854674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.855273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:33.856158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:33.856772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:33.857354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.028308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:34.038990 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-47a5c9f3-e456-42b8-ab3d-3bbb031c03f0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.248931 Oct 29 20:50:34.040637 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 523/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:33 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:34.072379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:34.080579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d78d923-33cc-4b08-bc14-ead0847182e8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.237116 Oct 29 20:50:34.093931 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 535/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:33 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:34.124032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:34.125433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:34.131208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.131692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.132137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.132841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.133327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.133786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.162738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:34.163701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:34.170397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.170894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.171333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.172034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.172703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.173135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.235836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:34.308252 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-207245f8-c83a-4ead-86bd-38325c0c9f42 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1933 microversion: 2.75 time: 0.186000 Oct 29 20:50:34.310759 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 524/1059] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:34 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1933 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:34.370615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:34.388890 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7d37caa-6959-4b79-ba6f-1fce3de72f05 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1331 microversion: 2.1 time: 0.229478 Oct 29 20:50:34.389802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 536/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:34 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1331 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:50:34.637325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:34.641050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:34.641706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:34.643275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:34.654041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.654915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.655461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.657093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.657828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.658853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.659923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.660418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.661022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.661908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:34.662524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:34.663134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:34.898068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:34.908013 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c493f39e-d233-4cc8-8978-7263936087c3 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1470 microversion: 2.1 time: 0.274468 Oct 29 20:50:34.909298 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 537/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:34 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1470 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:34.925476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:34.936591 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31385d92-3180-47d9-a0a3-13807d792543 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1473 microversion: 2.1 time: 0.308911 Oct 29 20:50:34.953875 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 525/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:34 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:35.070211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:35.070839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:35.088850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.089360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.090235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.091200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.091837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.092279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.107651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:35.108683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:35.117639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.118573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.119804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.120943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.122025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.122769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.440313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:35.459482 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-111eee27-191d-48af-85fa-d7b183ec7562 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.356237 Oct 29 20:50:35.476639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 526/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:35 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:35.484488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:35.485121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:35.491582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.492080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.492519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.493234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.494285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.494906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.612604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] Lazy-loading 'services' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:35.633912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:35.648072 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a86a59f-2c2d-490c-b00a-952deb1e2225 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.583384 Oct 29 20:50:35.668213 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 538/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:35 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:35.675158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:35.676489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:35.684951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.685768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81b0fd58-ad77-4f82-a080-6d696d6838a8 tempest-ServersAdmin275Test-1142521529 tempest-ServersAdmin275Test-1142521529-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1918 microversion: 2.75 time: 0.204272 Oct 29 20:50:35.685960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.686688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.687580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.688213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.688601 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 527/1065] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:35 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1918 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:35.689176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.726545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:35.727335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:35.734631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.735480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.736185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.737439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.739179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.739881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.789182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:35.848641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:35.943382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ef01c99-68bd-464a-aa76-e65a03b252ac tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 204 len: 0 microversion: 2.75 time: 0.220420 Oct 29 20:50:35.947656 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 528/1066] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:50:35 2022] DELETE /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:50:35.959355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:35.960631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:35.970598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.971375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.972232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:35.973790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:35.974578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:35.975765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:36.363490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:36.379586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-11fd0ceb-b471-4e34-91d6-6191358b657b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1536 microversion: 2.1 time: 0.709844 Oct 29 20:50:36.395024 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 539/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:35 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1536 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:36.395024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:36.395024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:36.395024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:36.395024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:36.395757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:36.396765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:36.397434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:36.398181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:36.626075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:36.637797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:36.643157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:36.655714 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f117b52-f375-4367-bc5e-e52a334a9756 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1443 microversion: 2.75 time: 0.273314 Oct 29 20:50:36.658151 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 540/1068] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:36 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1443 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:36.676363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:36.677637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:36.685379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:36.695344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9f5c98c-9047-4599-b70e-e13341ad7303 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1470 microversion: 2.1 time: 0.749952 Oct 29 20:50:36.699217 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 529/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:35 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1470 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:36.704904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca2e49b6-e93c-4c65-9dda-a4c4ad3e78eb tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'create', calling method: .version_select at 0x7fa171853af0>, body: {"pool": "8514a6d3-b6d8-4910-be17-acf3d6ae61b7"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:36.711260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:36.712049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:36.714729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:36.715688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:36.716376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:36.717015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:36.720431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:37.780388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:37.794758 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e8c57242-4ceb-44e6-abcc-bcba4357d38f tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 200 len: 1473 microversion: 2.1 time: 1.129954 Oct 29 20:50:37.796611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 541/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:36 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 1473 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:37.856119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:37.858928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:37.879786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:37.888602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:37.889517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:37.890601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:37.891418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:37.892169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:38.498220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:38.517172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-580687d5-add1-48c4-9c9e-0915a4b9d115 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.716113 Oct 29 20:50:38.524128 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 542/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:37 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:38.534800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:38.535428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:38.576385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:38.577497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:38.585659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:38.588296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:38.590117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:38.591436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.082666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:39.095193 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-612b2f8a-cacb-4cac-b0be-cde7e01bbda8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1504 microversion: 2.1 time: 0.569266 Oct 29 20:50:39.097025 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 543/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:38 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:39.102619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a64b0b63-e455-4edf-af95-46d2c7a5c1c6 req-ecb0a87d-37b1-4118-b4af-7ac56604bdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f23b76-3ea1-4e7b-b365-250a3e9cb2e5", "name": "network-vif-deleted", "tag": "4b48e5f0-230f-4540-9f4c-7268b1f36419"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:39.114851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a64b0b63-e455-4edf-af95-46d2c7a5c1c6 req-ecb0a87d-37b1-4118-b4af-7ac56604bdc7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.115562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a64b0b63-e455-4edf-af95-46d2c7a5c1c6 req-ecb0a87d-37b1-4118-b4af-7ac56604bdc7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.116517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a64b0b63-e455-4edf-af95-46d2c7a5c1c6 req-ecb0a87d-37b1-4118-b4af-7ac56604bdc7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.136111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a64b0b63-e455-4edf-af95-46d2c7a5c1c6 req-ecb0a87d-37b1-4118-b4af-7ac56604bdc7 service nova] Creating event network-vif-deleted:4b48e5f0-230f-4540-9f4c-7268b1f36419 for instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 on nch1-master-1 Oct 29 20:50:39.143311 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a64b0b63-e455-4edf-af95-46d2c7a5c1c6 req-ecb0a87d-37b1-4118-b4af-7ac56604bdc7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044685 Oct 29 20:50:39.145067 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 544/1073] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:39.154267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:39.155251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:39.163563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.164150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.164660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.165676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.166635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.168158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.235941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.236450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.237244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.240285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lazy-loading 'fault' on Instance uuid 8c32cd14-2eb8-4563-83fa-3aafae14461d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:39.340059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:39.351244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:39.353794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '859b2544443d42cc9ef5ecc6f1e26f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b08ea740b7543c8b50c67c6b82a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:39.360907 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3cf0cb5-61cd-4c5f-a061-646a93b9da14 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 200 len: 1448 microversion: 2.75 time: 0.214049 Oct 29 20:50:39.361851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 545/1074] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:39 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 1448 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:50:39.367857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:39.369120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:39.377004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.378555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.379245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.380209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.380920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.381885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.434319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.434800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.435246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.435732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lazy-loading 'fault' on Instance uuid d7dd6eeb-269e-423e-927e-921572b1522b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:39.578507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:39.608710 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00961cf7-60e5-4a2b-aaa4-a9cfc023fe8e tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 200 len: 1304 microversion: 2.1 time: 0.243711 Oct 29 20:50:39.612607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 546/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:39 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:39.628481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1edf7ffe-189e-444d-875b-bd1db98ac323 req-65c42654-d871-453a-b8fb-fee091b1f0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dd6eeb-269e-423e-927e-921572b1522b", "name": "network-vif-deleted", "tag": "f083a1fd-24f3-436d-b01b-b7c6837bee8b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:39.651110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1edf7ffe-189e-444d-875b-bd1db98ac323 req-65c42654-d871-453a-b8fb-fee091b1f0f3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.651600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1edf7ffe-189e-444d-875b-bd1db98ac323 req-65c42654-d871-453a-b8fb-fee091b1f0f3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.652997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1edf7ffe-189e-444d-875b-bd1db98ac323 req-65c42654-d871-453a-b8fb-fee091b1f0f3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.673576 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1edf7ffe-189e-444d-875b-bd1db98ac323 req-65c42654-d871-453a-b8fb-fee091b1f0f3 service nova] Creating event network-vif-deleted:f083a1fd-24f3-436d-b01b-b7c6837bee8b for instance d7dd6eeb-269e-423e-927e-921572b1522b on nch1-master-1 Oct 29 20:50:39.679540 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1edf7ffe-189e-444d-875b-bd1db98ac323 req-65c42654-d871-453a-b8fb-fee091b1f0f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064699 Oct 29 20:50:39.680560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 547/1076] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:39.686628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:39.687570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:39.694265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.695082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.695587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.696412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.697323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.697895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.713737 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] HTTP exception thrown: Instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 could not be found. Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Request method failure captured: Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 HTTP/1.1 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZF0-BEPXpyC-S6398c_LMkdjO8Qcc86NwYGFB-AgXJy070SfdsmIl92jlTY2zceDIHXJDHqcPcAJDfW6___VS5CRGCEioAvUXbi90JB-ZkyB7SEHj0RyJRdo7McV16M9MXYgucUkMhb3nW0iFs-xepFXflnwkNXMOZtFAJAPg-HsoU Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c07b27294cb2456c98c092ff73c7dd66 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ListImageFiltersTestJSON-1090996456 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ListImageFiltersTestJSON-1090996456 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c07b27294cb2456c98c092ff73c7dd66 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1090996456 Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ListImageFiltersTestJSON-1090996456-project Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 66082eeadd4942d69d772b686aebd48f Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ListImageFiltersTestJSON-1090996456-project Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 could not be found. Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '36f23b76-3ea1-4e7b-b365-250a3e9cb2e5'} Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 could not be found. Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 could not be found. Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:39.715688 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 could not be found. Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Returning 404 to user: Instance 36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdf2f99d-ed22-418a-bcbb-35ba9b6406ec tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5" status: 404 len: 111 microversion: 2.1 time: 0.034819 Oct 29 20:50:39.720911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 548/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:39 2022] GET /compute/v2.1/servers/36f23b76-3ea1-4e7b-b365-250a3e9cb2e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:39.723060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:39.723667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:39.730573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.731331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.731923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:39.732823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:39.733272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:39.733939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.186559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:40.206268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ecf4179-8a77-4128-b60f-5e54ad64ddbf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.486858 Oct 29 20:50:40.219080 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 549/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:39 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:40.237204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:40.237825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:40.248625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.249532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.250288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.251240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.251780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.252332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.306379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:40.415917 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea4da2f3-53d5-4bd4-915e-cf3f7573ffa0 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 204 len: 0 microversion: 2.1 time: 0.183857 Oct 29 20:50:40.416491 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 550/1079] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:40 2022] DELETE /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:40.425704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:40.427408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:40.435088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.435628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.436073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.436796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.437302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.438008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.755944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:40.766702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4ee3569-8eae-4d3c-b520-f287cd7d15c0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1479 microversion: 2.1 time: 0.348194 Oct 29 20:50:40.767742 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 551/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:40 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1479 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:40.778125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:40.778780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] [instance: 8c32cd14-2eb8-4563-83fa-3aafae14461d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:40.786582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.787838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.789296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.790519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.791126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.791611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.812498 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] HTTP exception thrown: Instance 8c32cd14-2eb8-4563-83fa-3aafae14461d could not be found. Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Request method failure captured: Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d HTTP/1.1 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZHH2kmp1YN8zp7-DUVNMku4WSkqHBz2iquAeQAmmz1eMUR5NebZxH0_1n3HH3CkycR40qkdwvbq8qaN9GQ0mkgKu0FgTGpyc2649WgsNuTIuC6ONECxat8HULRD3trdzxkvx7NwJSTFeOYnF2yJCft3M60QAcoTdSU4_mic6GGa__4 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.75 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4b08ea740b7543c8b50c67c6b82a4d17 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAdmin275Test-1497537270 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b08ea740b7543c8b50c67c6b82a4d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4b08ea740b7543c8b50c67c6b82a4d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4b08ea740b7543c8b50c67c6b82a4d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4b08ea740b7543c8b50c67c6b82a4d17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAdmin275Test-1497537270 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4b08ea740b7543c8b50c67c6b82a4d17 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAdmin275Test-1497537270 Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAdmin275Test-1497537270-project Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 859b2544443d42cc9ef5ecc6f1e26f4f Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAdmin275Test-1497537270-project Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8c32cd14-2eb8-4563-83fa-3aafae14461d could not be found. Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8c32cd14-2eb8-4563-83fa-3aafae14461d'} Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c32cd14-2eb8-4563-83fa-3aafae14461d could not be found. Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c32cd14-2eb8-4563-83fa-3aafae14461d could not be found. Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:40.814879 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c32cd14-2eb8-4563-83fa-3aafae14461d could not be found. Oct 29 20:50:40.820018 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:50:40.822483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] Returning 404 to user: Instance 8c32cd14-2eb8-4563-83fa-3aafae14461d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:40.823633 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83bacf9e-5831-46f2-b1d3-3b192e027614 tempest-ServersAdmin275Test-1497537270 tempest-ServersAdmin275Test-1497537270-project] 10.222.0.36 "GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d" status: 404 len: 111 microversion: 2.75 time: 0.052644 Oct 29 20:50:40.824399 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 552/1081] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:50:40 2022] GET /compute/v2.1/servers/8c32cd14-2eb8-4563-83fa-3aafae14461d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:50:40.829787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:40.830474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:40.839245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.840181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.841134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.843731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.844892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:40.846778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:40.970204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca2e49b6-e93c-4c65-9dda-a4c4ad3e78eb tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.269560 Oct 29 20:50:40.971242 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 530/1082] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:50:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:40.981732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:40.983009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: d7dd6eeb-269e-423e-927e-921572b1522b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:40.995452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:40.997385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.005899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.008024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.008530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.008985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.034720 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] HTTP exception thrown: Instance d7dd6eeb-269e-423e-927e-921572b1522b could not be found. Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Request method failure captured: Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b HTTP/1.1 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFu2tlPy6ywwe9QJSY9jDwGRIjd5nKeKaeBlUY4e86ZN_FKa-oDzXMV5VYELZx56l_I9UrZqHOBuqTXBo1Q49G3HmB7MaFZCJJiBP978ZOgkgaPKbncMWCwmo55hlBZKLxfBh01AVHNXHQf4atNr9BogRGxYmWCMBDydI_t-ksY8lo Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4fd6966959864b80b945ae69a275ca8f Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4fd6966959864b80b945ae69a275ca8f Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminTestJSON-1207019514-project Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 027a78fcee5a4f44b47fc5e187f6da67 Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminTestJSON-1207019514-project Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance d7dd6eeb-269e-423e-927e-921572b1522b could not be found. Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'd7dd6eeb-269e-423e-927e-921572b1522b'} Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7dd6eeb-269e-423e-927e-921572b1522b could not be found. Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7dd6eeb-269e-423e-927e-921572b1522b could not be found. Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:41.037530 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7dd6eeb-269e-423e-927e-921572b1522b could not be found. Oct 29 20:50:41.044800 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:41.047419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Returning 404 to user: Instance d7dd6eeb-269e-423e-927e-921572b1522b could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:41.048901 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-424c64d8-ba67-452d-9552-0fc1d7393296 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b" status: 404 len: 111 microversion: 2.1 time: 0.075375 Oct 29 20:50:41.049964 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 531/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:40 2022] GET /compute/v2.1/servers/d7dd6eeb-269e-423e-927e-921572b1522b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:41.055747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-372b2c3d-d8a5-4ebb-abc1-e072df90214a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '.version_select at 0x7fa17182fa60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:41.060874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-372b2c3d-d8a5-4ebb-abc1-e072df90214a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.061990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-372b2c3d-d8a5-4ebb-abc1-e072df90214a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.062448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-372b2c3d-d8a5-4ebb-abc1-e072df90214a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.074991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:41.076124 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-372b2c3d-d8a5-4ebb-abc1-e072df90214a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.1 time: 0.024425 Oct 29 20:50:41.076606 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 532/1084] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:50:41 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:41.076606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'action', calling method: .version_select at 0x7fa173535820>, body: {"addFloatingIp": {"address": "172.35.5.216"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:41.089239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-03f86fa1-1194-4260-9bfb-dcc99b5c222a tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1474 microversion: 2.1 time: 0.261981 Oct 29 20:50:41.089702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:41.092053 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 553/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:40 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1474 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:41.097630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:41.098401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:41.105782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.106508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.107178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.108145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.108877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.110160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.114566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.115540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.116220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.117185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.117659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.118095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.164284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:41.233394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:50:41.234721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquired lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:50:41.382114 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ffbc61b-8951-4221-953b-ffdd72feea6f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "DELETE /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 204 len: 0 microversion: 2.1 time: 0.287815 Oct 29 20:50:41.383184 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 554/1086] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:41 2022] DELETE /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:41.390072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:41.390072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:41.398713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.400453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.401037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.401945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.402423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.402861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.707203 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-559a307c-3e7a-4eb2-a14a-1b31d58992c8 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1630 microversion: 2.1 time: 0.322758 Oct 29 20:50:41.708417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 555/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:41 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1630 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:41.713985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:41.714687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:41.720959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.721965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.722706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.724075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:41.724816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:41.725490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:41.745292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:42.452235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:42.465648 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60866ef5-9259-49e6-9858-0957d9925869 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.755283 Oct 29 20:50:42.467015 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 556/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:41 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:42.474870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:42.475968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:42.485262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:42.485979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:42.486497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:42.487313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:42.487822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:42.488926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:42.817957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:42.832436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee6358d2-6fbe-4731-a1fe-b2b039f00e06 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1468 microversion: 2.1 time: 0.364242 Oct 29 20:50:42.835704 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 557/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:42 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1468 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:42.840830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ac493b4-77d6-4ebf-9cf7-96bc4eb072bc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Action: 'create', calling method: .version_select at 0x7fa171617820>, body: {"keypair": {"name": "tempest-keypair-1412802578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv0zSwziov3pZ2EZsVaAdPBsvNiDlKnYuTE+x9p24XW8PX89y410UnpxpwZ31DDxAsk9XMvrdh6khdqsb9aBL1sC/a2Ji2DAg/XFpBhc2w2roXbhfW84g24Bbw1NLhlbg=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:42.894801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8ac493b4-77d6-4ebf-9cf7-96bc4eb072bc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for project d373d98fd667430fac145e2e63249419. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:50:42.914555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8ac493b4-77d6-4ebf-9cf7-96bc4eb072bc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for user 869b7117eab8443e9cbb52400b875ebc and project d373d98fd667430fac145e2e63249419. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:50:42.962535 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ac493b4-77d6-4ebf-9cf7-96bc4eb072bc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119921 Oct 29 20:50:42.963757 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 558/1090] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:50:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:42.969369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:42.972589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:42.986100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:42.986747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:42.987438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:42.988431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:42.989878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:42.990747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:43.578650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:43.591824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0125e755-5730-479a-bfea-2f9e71105273 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1474 microversion: 2.1 time: 0.625734 Oct 29 20:50:43.594300 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 559/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:42 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1474 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:43.610119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:43.611188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:43.622520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:43.623017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:43.624164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:43.625196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:43.626056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:43.626498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:44.317853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:44.335561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b7588707-5d6f-49ad-86cc-ca9742053f42 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.739616 Oct 29 20:50:44.336917 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 560/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:43 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:44.358541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c40eebe3-c652-428d-b2a4-8ed814e39d70 req-e17f25ce-342f-4c5a-942e-000deeee1585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "478e2710-ed11-4485-ac45-9cc2a0d2dbe0", "name": "network-vif-deleted", "tag": "5ce528cf-59a6-435c-874a-3136ca6415b3"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:44.378223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c40eebe3-c652-428d-b2a4-8ed814e39d70 req-e17f25ce-342f-4c5a-942e-000deeee1585 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:44.380580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c40eebe3-c652-428d-b2a4-8ed814e39d70 req-e17f25ce-342f-4c5a-942e-000deeee1585 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:44.381205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c40eebe3-c652-428d-b2a4-8ed814e39d70 req-e17f25ce-342f-4c5a-942e-000deeee1585 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:44.397790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:50:44.410870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c40eebe3-c652-428d-b2a4-8ed814e39d70 req-e17f25ce-342f-4c5a-942e-000deeee1585 service nova] Creating event network-vif-deleted:5ce528cf-59a6-435c-874a-3136ca6415b3 for instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 on nch2-master-1 Oct 29 20:50:44.420237 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c40eebe3-c652-428d-b2a4-8ed814e39d70 req-e17f25ce-342f-4c5a-942e-000deeee1585 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065409 Oct 29 20:50:44.421941 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 561/1093] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:44.440508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:44.441580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:44.443935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:44.460674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:44.461622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:44.463506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:44.464416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:44.465047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:44.465675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:44.521753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:44.523241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:44.523707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:44.524180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lazy-loading 'fault' on Instance uuid 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:44.624602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:44.640114 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e24392e0-dd62-4d82-b047-0b324799fda9 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 200 len: 1303 microversion: 2.1 time: 0.207018 Oct 29 20:50:44.653638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 562/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:44 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:45.151378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ccba9ceb-e037-44a7-a86b-6e9da9f6cb72 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-424187119", "id": 414271896, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:45.192473 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ccba9ceb-e037-44a7-a86b-6e9da9f6cb72 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.535086 Oct 29 20:50:45.194600 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 563/1095] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:44 2022] POST /compute/v2.1/flavors => generated 426 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:45.210872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-335ea22e-0405-4bee-8378-76655ccf2da6 req-2556c199-49dd-46f8-a77e-e26583587774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1", "tag": "3e543ffe-5d96-4a35-80df-2aed220ba76f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:45.243011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-335ea22e-0405-4bee-8378-76655ccf2da6 req-2556c199-49dd-46f8-a77e-e26583587774 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:45.244497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-335ea22e-0405-4bee-8378-76655ccf2da6 req-2556c199-49dd-46f8-a77e-e26583587774 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:45.245658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-335ea22e-0405-4bee-8378-76655ccf2da6 req-2556c199-49dd-46f8-a77e-e26583587774 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:45.264432 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-335ea22e-0405-4bee-8378-76655ccf2da6 req-2556c199-49dd-46f8-a77e-e26583587774 service nova] Creating event network-changed:3e543ffe-5d96-4a35-80df-2aed220ba76f for instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 on nch2-master-1 Oct 29 20:50:45.289851 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-335ea22e-0405-4bee-8378-76655ccf2da6 req-2556c199-49dd-46f8-a77e-e26583587774 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077683 Oct 29 20:50:45.300054 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 564/1096] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:45.316977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:45.326644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:45.347762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:45.349032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:45.349908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:45.351693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:45.354351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:45.355081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:45.443110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:45.443616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:45.444895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:45.446015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lazy-loading 'fault' on Instance uuid 08730262-0769-4c72-90c5-2c330c229896 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:50:45.606055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66082eeadd4942d69d772b686aebd48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07b27294cb2456c98c092ff73c7dd66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:45.615670 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e120196e-a1b3-4214-9886-74c4e7cc6489 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 200 len: 1308 microversion: 2.1 time: 0.313261 Oct 29 20:50:45.619802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 565/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:45 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:45.629653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ea84bc7-aaa2-43ef-961d-df55073bad94 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:45.714830 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ea84bc7-aaa2-43ef-961d-df55073bad94 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/414271896" status: 202 len: 0 microversion: 2.1 time: 0.093666 Oct 29 20:50:45.718847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 566/1098] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:50:45 2022] DELETE /compute/v2.1/flavors/414271896 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:45.736973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:45.737983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:45.769038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:45.769573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:45.771831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:45.772806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:45.773629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:45.774220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:45.947255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Updating instance_info_cache with network_info: [{"id": "3e543ffe-5d96-4a35-80df-2aed220ba76f", "address": "fa:16:3e:dd:21:10", "network": {"id": "9c558784-630d-4257-bb4e-6d935eebc38c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1504408250-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "effef2abce4f4216a17194712351d9ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e543ffe-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:50:45.971493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Releasing lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:50:45.972498 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a9c8758-13de-495d-a43c-75778c96980f tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action" status: 202 len: 0 microversion: 2.1 time: 4.893500 Oct 29 20:50:45.973563 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 533/1099] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:41 2022] POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action => generated 0 bytes in 4895 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:50:45.985893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:45.988083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 478e2710-ed11-4485-ac45-9cc2a0d2dbe0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:46.003304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:46.009237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:46.010023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:46.011559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:46.012276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:46.012877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:46.059852 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] HTTP exception thrown: Instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 could not be found. Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Request method failure captured: Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 HTTP/1.1 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFu2tlPy6ywwe9QJSY9jDwGRIjd5nKeKaeBlUY4e86ZN_FKa-oDzXMV5VYELZx56l_I9UrZqHOBuqTXBo1Q49G3HmB7MaFZCJJiBP978ZOgkgaPKbncMWCwmo55hlBZKLxfBh01AVHNXHQf4atNr9BogRGxYmWCMBDydI_t-ksY8lo Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4fd6966959864b80b945ae69a275ca8f Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4fd6966959864b80b945ae69a275ca8f Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminTestJSON-1207019514-project Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 027a78fcee5a4f44b47fc5e187f6da67 Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminTestJSON-1207019514-project Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 could not be found. Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '478e2710-ed11-4485-ac45-9cc2a0d2dbe0'} Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 could not be found. Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 could not be found. Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:46.061996 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 could not be found. Oct 29 20:50:46.067663 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:46.070007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Returning 404 to user: Instance 478e2710-ed11-4485-ac45-9cc2a0d2dbe0 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:46.072726 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2852ff5c-4007-4e70-8f30-ddc244eea6f8 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0" status: 404 len: 111 microversion: 2.1 time: 0.096752 Oct 29 20:50:46.077033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 534/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:45 2022] GET /compute/v2.1/servers/478e2710-ed11-4485-ac45-9cc2a0d2dbe0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:46.086157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e1dc3900-ccfa-4965-b7a0-f5ef9f56920a tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:46.119496 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e1dc3900-ccfa-4965-b7a0-f5ef9f56920a tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040331 Oct 29 20:50:46.121957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 535/1101] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:46.162203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:46.172940 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cafb157b-29f7-4d0d-a46a-15940b28fcf2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.451286 Oct 29 20:50:46.174843 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 567/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:45 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:46.180113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-372d819f-7914-4e5a-9a1c-affced2b02b7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'create', calling method: .version_select at 0x7fa1715c4f70>, body: {"pool": "8514a6d3-b6d8-4910-be17-acf3d6ae61b7"} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:46.304373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85f66d58-a457-421f-a7a8-e5627bdfa119 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:46.317342 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85f66d58-a457-421f-a7a8-e5627bdfa119 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.193488 Oct 29 20:50:46.317896 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 536/1103] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:50:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:46.330165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:46.337888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:46.346422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:46.347312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:46.347756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:46.348505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:46.349329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:46.350026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:46.393767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:50:46.559551 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29d93daf-9d76-4ad9-b517-11afbaf32054 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 204 len: 0 microversion: 2.1 time: 0.239517 Oct 29 20:50:46.560810 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 537/1104] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:46 2022] DELETE /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:46.572917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-143652c1-7f14-459c-9a13-3d2df72590b7 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-393526698", "id": 1239208342, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:46.611831 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-143652c1-7f14-459c-9a13-3d2df72590b7 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.048722 Oct 29 20:50:46.622347 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 538/1105] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:46 2022] POST /compute/v2.1/flavors => generated 416 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:46.628899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:46.630606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:46.643589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:46.644447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:46.645333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:46.646455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:46.647128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:46.647757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:47.242693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:47.252680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a03b591-aef9-44f7-bb21-7be6111ea187 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1469 microversion: 2.1 time: 0.629140 Oct 29 20:50:47.253354 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 539/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:46 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1469 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:47.258439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ded73103-743a-45fa-aa65-8704a46d6313 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:47.283246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ded73103-743a-45fa-aa65-8704a46d6313 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.028622 Oct 29 20:50:47.283960 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 540/1107] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:47 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:47.288943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:47.289805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] [instance: 08730262-0769-4c72-90c5-2c330c229896] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:47.297707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:47.298419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:47.299035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:47.300430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:47.300894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:47.301330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:47.317532 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] HTTP exception thrown: Instance 08730262-0769-4c72-90c5-2c330c229896 could not be found. Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Request method failure captured: Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 HTTP/1.1 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZF0-BEPXpyC-S6398c_LMkdjO8Qcc86NwYGFB-AgXJy070SfdsmIl92jlTY2zceDIHXJDHqcPcAJDfW6___VS5CRGCEioAvUXbi90JB-ZkyB7SEHj0RyJRdo7McV16M9MXYgucUkMhb3nW0iFs-xepFXflnwkNXMOZtFAJAPg-HsoU Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c07b27294cb2456c98c092ff73c7dd66 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListImageFiltersTestJSON-1090996456 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c07b27294cb2456c98c092ff73c7dd66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListImageFiltersTestJSON-1090996456 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c07b27294cb2456c98c092ff73c7dd66 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1090996456 Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListImageFiltersTestJSON-1090996456-project Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 66082eeadd4942d69d772b686aebd48f Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListImageFiltersTestJSON-1090996456-project Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 08730262-0769-4c72-90c5-2c330c229896 could not be found. Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '08730262-0769-4c72-90c5-2c330c229896'} Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08730262-0769-4c72-90c5-2c330c229896 could not be found. Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08730262-0769-4c72-90c5-2c330c229896 could not be found. Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:47.319292 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08730262-0769-4c72-90c5-2c330c229896 could not be found. Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Returning 404 to user: Instance 08730262-0769-4c72-90c5-2c330c229896 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcc4ffaf-2640-4c6f-bcd1-39bf39658fb5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896" status: 404 len: 111 microversion: 2.1 time: 0.035578 Oct 29 20:50:47.326369 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 541/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:47 2022] GET /compute/v2.1/servers/08730262-0769-4c72-90c5-2c330c229896 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:47.327517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1674652238", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "151c0760-9de5-4226-8749-cb91b64e1da1"}], "security_groups": [{"name": "tempest-securitygroup--1269918385"}], "key_name": "tempest-keypair-1412802578", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:47.488952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] validate_networks() for [('151c0760-9de5-4226-8749-cb91b64e1da1', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:50:48.139718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:50:48.140235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:50:48.141326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:50:48.142059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:50:48.142558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:50:48.152248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.152906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.153367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.154200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.154855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.155328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.177094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:50:48.183556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for user 869b7117eab8443e9cbb52400b875ebc and project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:50:48.203969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:50:48.206510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:50:48.228927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:48.267796 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-893c718a-27ca-4a14-b15f-7309fe445843 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.944856 Oct 29 20:50:48.269620 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 542/1109] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:50:48.278690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0991fb77-2e07-4c8a-8d4f-1f6b4c4bc759 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1846314336", "imageRef": "0713790a-63aa-4e10-96f2-ec8e4cb2e5e1", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:48.332623 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-372d819f-7914-4e5a-9a1c-affced2b02b7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.156536 Oct 29 20:50:48.333484 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 568/1110] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:50:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:48.339279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:48.340099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:48.341335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-0991fb77-2e07-4c8a-8d4f-1f6b4c4bc759 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:50:48.359338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.360213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.360817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.361776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.362408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.362869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.599211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:48.611141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96c6eb1c-3c19-4988-9142-1588bc814297 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.276121 Oct 29 20:50:48.612145 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 569/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:48 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:48.629736 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0991fb77-2e07-4c8a-8d4f-1f6b4c4bc759 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0991fb77-2e07-4c8a-8d4f-1f6b4c4bc759 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] Request method failure captured: Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 143 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIlgHGfx65whu5rAO2t3rn1KEdDBU6mvh0v2-Z9QsQb6maYyZffday-jrjcuYepus9aqZyBxyrW8h9GGJhTiuElq-2YMxYVSModIFTL4k_vCRszbt0ohRjN7WvvoxiVJ1R8pBRvhPTx0QYv4US1ubfh8HyhqjWKwK07PnIvjqSgyVE Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c3f4e273b138454192362e0f077bbc86 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsV2NegativeTest-1974182832 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3f4e273b138454192362e0f077bbc86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c3f4e273b138454192362e0f077bbc86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3f4e273b138454192362e0f077bbc86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c3f4e273b138454192362e0f077bbc86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsV2NegativeTest-1974182832 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c3f4e273b138454192362e0f077bbc86 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1974182832 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsV2NegativeTest-1974182832-project Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 817eb39ddb9345ad9e7bb78c80d30d59 Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsV2NegativeTest-1974182832-project Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1846314336", "imageRef": "0713790a-63aa-4e10-96f2-ec8e4cb2e5e1", "flavorRef": "452"}} Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: exception: Flavor's memory is too small for requested image. Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1846314336', 'imageRef': '0713790a-63aa-4e10-96f2-ec8e4cb2e5e1', 'flavorRef': '452'}}} Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:48.631841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0991fb77-2e07-4c8a-8d4f-1f6b4c4bc759 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0991fb77-2e07-4c8a-8d4f-1f6b4c4bc759 tempest-FlavorsV2NegativeTest-1974182832 tempest-FlavorsV2NegativeTest-1974182832-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.362633 Oct 29 20:50:48.640500 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 543/1112] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:48 2022] POST /compute/v2.1/servers => generated 93 bytes in 364 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:50:48.648078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0da31b34-3555-4570-804d-2b42cc041dff tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:48.648574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-80a6bb76-98ed-467c-a5ea-ebb64e647f42 req-5acde271-d1ab-455f-87cd-e0f8159eb8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08730262-0769-4c72-90c5-2c330c229896", "name": "network-vif-deleted", "tag": "bb08c566-0dff-48cc-bcba-e49b26107cf4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:48.657961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a6bb76-98ed-467c-a5ea-ebb64e647f42 req-5acde271-d1ab-455f-87cd-e0f8159eb8de service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.658451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a6bb76-98ed-467c-a5ea-ebb64e647f42 req-5acde271-d1ab-455f-87cd-e0f8159eb8de service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.658893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a6bb76-98ed-467c-a5ea-ebb64e647f42 req-5acde271-d1ab-455f-87cd-e0f8159eb8de service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.662116 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0da31b34-3555-4570-804d-2b42cc041dff tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1239208342" status: 202 len: 0 microversion: 2.1 time: 0.037549 Oct 29 20:50:48.663573 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 570/1113] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:50:48 2022] DELETE /compute/v2.1/flavors/1239208342 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:48.669541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb7ac355-4063-4773-979a-e730214f5228 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171914a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:48.670357 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-80a6bb76-98ed-467c-a5ea-ebb64e647f42 req-5acde271-d1ab-455f-87cd-e0f8159eb8de service nova] Creating event network-vif-deleted:bb08c566-0dff-48cc-bcba-e49b26107cf4 for instance 08730262-0769-4c72-90c5-2c330c229896 on nch1-master-1 Oct 29 20:50:48.675271 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-80a6bb76-98ed-467c-a5ea-ebb64e647f42 req-5acde271-d1ab-455f-87cd-e0f8159eb8de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039832 Oct 29 20:50:48.679125 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 544/1114] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:48.684682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:48.685618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:48.691770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.692508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.693025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.693831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.694291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.694725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.866277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:48.875480 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-88b5e712-58d0-4705-a6c8-1731513c4583 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1469 microversion: 2.1 time: 0.194864 Oct 29 20:50:48.876094 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 545/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:48 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:48.880777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:48.881388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:48.888419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.889131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.889766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.890643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.891265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.891851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.965341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:48.980627 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74dd42a5-856b-4710-af0a-b5a811855422 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1239 microversion: 2.1 time: 0.103256 Oct 29 20:50:48.981824 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 546/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:48 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:48.987288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.233"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:48.990252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:48.997169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:48.997966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:48.998588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:48.999485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:49.000118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:49.000929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:49.016636 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb7ac355-4063-4773-979a-e730214f5228 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/images/cb17e22e-aad6-4677-8d7f-88cd0f3c538f" status: 204 len: 0 microversion: 2.1 time: 0.351794 Oct 29 20:50:49.017328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 571/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:48 2022] DELETE /compute/v2.1/images/cb17e22e-aad6-4677-8d7f-88cd0f3c538f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:49.023417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da1b005d-491d-408d-ab36-acaca2a40c2a tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:49.034127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:50:49.035121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquired lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:50:49.046516 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da1b005d-491d-408d-ab36-acaca2a40c2a tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027858 Oct 29 20:50:49.048291 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 572/1118] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:49.057574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28633305-ebe4-4460-9eb2-28c53de037dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171940790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:49.504123 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-28633305-ebe4-4460-9eb2-28c53de037dc tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/images/003f7c57-2945-4fea-9d13-dec1db4e30cc" status: 204 len: 0 microversion: 2.1 time: 0.454151 Oct 29 20:50:49.505954 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 573/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:49 2022] DELETE /compute/v2.1/images/003f7c57-2945-4fea-9d13-dec1db4e30cc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:49.506102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7.", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:50:49.506823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Releasing lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:50:49.507392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] HTTP exception thrown: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.507392 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Request method failure captured: Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action HTTP/1.1 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 46 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIJTJdNYLDlMoqq2I__KNtOpHIs612UTcDuMDjwmeZg2N_3ciy4xzavEjmAhugWgDmgtEeA19l-CD_IeltLDLr_Be13m3c9k3abvy8pciy92hFtJxt47TDK9lP6dQOa95dwgJhUOi_CcnRH5TbchF8JlD2vnoJchIokO_TMrEguZkg Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_effef2abce4f4216a17194712351d9ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/effef2abce4f4216a17194712351d9ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4b8f025e74a74bf0b83e2b3b27062099 Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: {"addFloatingIp": {"address": "172.35.5.233"}} Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1', 'body': {'addFloatingIp': {'address': '172.35.5.233'}}} Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:50:49.510765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] Oct 29 20:50:49.515772 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:49.519932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Returning 400 to user: Cannot associate floating IP 172.35.5.233 (3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4) with port 3e543ffe-5d96-4a35-80df-2aed220ba76f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 8514a6d3-b6d8-4910-be17-acf3d6ae61b7. Oct 29 20:50:49.519932 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-898ce9a9-0755-43bc-bf13-d3906aebfa8a'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:49.519932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3031209b-adea-475b-b61f-c5c5e20160c7 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action" status: 400 len: 382 microversion: 2.1 time: 0.529269 Oct 29 20:50:49.519932 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 547/1120] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:48 2022] POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action => generated 382 bytes in 530 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:50:49.520683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4937045-2efd-4a6e-a0bf-b58930c4b047 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-144238578", "id": 859512134, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:49.523185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c342ff5-66be-419d-bc7a-b2c1b18762f5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] Calling method '.version_select at 0x7fa171853430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:49.543860 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4937045-2efd-4a6e-a0bf-b58930c4b047 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.033867 Oct 29 20:50:49.544677 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 574/1121] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:49 2022] POST /compute/v2.1/flavors => generated 425 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:49.550990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-430153b2-ddde-4aee-bd31-a1e38928be63 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '.version_select at 0x7fa17172b790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:49.851170 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c342ff5-66be-419d-bc7a-b2c1b18762f5 tempest-ListImageFiltersTestJSON-1090996456 tempest-ListImageFiltersTestJSON-1090996456-project] 10.222.0.36 "DELETE /compute/v2.1/images/e2ae2504-65c3-44ac-a655-b8d2e7e4b5a6" status: 204 len: 0 microversion: 2.1 time: 0.336234 Oct 29 20:50:49.855008 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 548/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:49 2022] DELETE /compute/v2.1/images/e2ae2504-65c3-44ac-a655-b8d2e7e4b5a6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:50:49.860514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e73f3ca-1bad-4462-9bd1-5f0f8ddd4e2b tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:49.900706 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e73f3ca-1bad-4462-9bd1-5f0f8ddd4e2b tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/859512134" status: 202 len: 0 microversion: 2.1 time: 0.043904 Oct 29 20:50:49.904705 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 549/1123] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:50:49 2022] DELETE /compute/v2.1/flavors/859512134 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:49.910066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:49.910945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:49.919151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:49.920645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:49.921530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:49.922471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:49.923426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:49.924153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:50.447746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:50.465915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06f63dff-684e-4fed-8afb-04dcc5685e05 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1542 microversion: 2.1 time: 0.559724 Oct 29 20:50:50.483125 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 550/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:49 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1542 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:50.492040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:50.492957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:50.512413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:50.513887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:50.514621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:50.515593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:50.516257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:50.516904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:51.510665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '027a78fcee5a4f44b47fc5e187f6da67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd6966959864b80b945ae69a275ca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:51.527811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-24eafdac-f299-4efb-abc3-3df0fa02b264 tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 200 len: 1469 microversion: 2.1 time: 1.041439 Oct 29 20:50:51.528568 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 551/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:50 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 1469 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:51.540842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba7c7e3c-b45b-48d1-9543-3c8f67c9ded2 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:51.615523 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ba7c7e3c-b45b-48d1-9543-3c8f67c9ded2 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084988 Oct 29 20:50:51.619727 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 552/1126] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:51.652398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:51.654658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:51.666171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:51.666819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:51.667839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:51.669421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:51.670639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:51.671379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.232672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:52.260216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1073d1f5-afa4-4256-adc7-cf39e21bc43e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1361 microversion: 2.1 time: 0.637829 Oct 29 20:50:52.260834 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 553/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:51 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:52.283292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:52.283734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:52.290981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.291475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.291984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.292965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.293490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.294021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.409012 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-430153b2-ddde-4aee-bd31-a1e38928be63 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4" status: 202 len: 0 microversion: 2.1 time: 2.862893 Oct 29 20:50:52.413127 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 575/1128] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:50:49 2022] DELETE /compute/v2.1/os-floating-ips/3241f2d6-9cc8-4fec-9731-75f2b4b1a0e4 => generated 0 bytes in 2868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:52.429041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a31a4224-2f59-43c7-a519-6b162e692ceb tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-278523311", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:52.456373 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a31a4224-2f59-43c7-a519-6b162e692ceb tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.037866 Oct 29 20:50:52.465967 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 576/1129] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:52 2022] POST /compute/v2.1/flavors => generated 506 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:52.483148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7f7d688b-d33b-4ddb-beb8-06c7f8ed2c55 req-2a322004-12b9-4a5e-bbe8-15256c508dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f981c21-556b-40cc-8edf-87f69b2e4e4e", "name": "network-vif-deleted", "tag": "e4fd07bb-302c-4d19-a1b2-a9eb51a9437d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:52.504262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7f7d688b-d33b-4ddb-beb8-06c7f8ed2c55 req-2a322004-12b9-4a5e-bbe8-15256c508dea service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.505724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7f7d688b-d33b-4ddb-beb8-06c7f8ed2c55 req-2a322004-12b9-4a5e-bbe8-15256c508dea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.506647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7f7d688b-d33b-4ddb-beb8-06c7f8ed2c55 req-2a322004-12b9-4a5e-bbe8-15256c508dea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.528951 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7f7d688b-d33b-4ddb-beb8-06c7f8ed2c55 req-2a322004-12b9-4a5e-bbe8-15256c508dea service nova] Creating event network-vif-deleted:e4fd07bb-302c-4d19-a1b2-a9eb51a9437d for instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e on nch1-master-1 Oct 29 20:50:52.535945 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7f7d688b-d33b-4ddb-beb8-06c7f8ed2c55 req-2a322004-12b9-4a5e-bbe8-15256c508dea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067539 Oct 29 20:50:52.537218 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 577/1130] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:52.544108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "name": "network-vif-unplugged", "status": "completed", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:52.556721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.557332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.558355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.571406 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] Creating event network-vif-unplugged:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:50:52.577987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] Instance 953407b6-c139-4c24-95f1-0bd2c94f07df is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:50:52.585448 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-18749f10-5268-4c0a-8293-a91b369cd127 req-2a90b84e-a012-48d4-8daa-b6192adce6d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046547 Oct 29 20:50:52.586765 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 578/1131] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:52.593647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'action', calling method: .version_select at 0x7fa173536700>, body: {"removeFloatingIp": {"address": "172.35.5.216"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:52.816244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:52.834904 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2dfe08d7-027f-42a1-98ce-1217ed7147b8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1541 microversion: 2.1 time: 0.572833 Oct 29 20:50:52.836776 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 554/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:52 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1541 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:52.844225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-788dd67a-5633-4752-a197-62c849bf4f3c req-c3480bae-9158-4a32-af79-c0908e8f48ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fa038d-5a82-452d-bde6-eaa0b790d7cc", "tag": "437d3157-cf84-48ff-88d0-d082479a661b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:52.875501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-788dd67a-5633-4752-a197-62c849bf4f3c req-c3480bae-9158-4a32-af79-c0908e8f48ca service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.876093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-788dd67a-5633-4752-a197-62c849bf4f3c req-c3480bae-9158-4a32-af79-c0908e8f48ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.876673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-788dd67a-5633-4752-a197-62c849bf4f3c req-c3480bae-9158-4a32-af79-c0908e8f48ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.892465 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-788dd67a-5633-4752-a197-62c849bf4f3c req-c3480bae-9158-4a32-af79-c0908e8f48ca service nova] Creating event network-changed:437d3157-cf84-48ff-88d0-d082479a661b for instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc on nch2-master-1 Oct 29 20:50:52.898935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-788dd67a-5633-4752-a197-62c849bf4f3c req-c3480bae-9158-4a32-af79-c0908e8f48ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059837 Oct 29 20:50:52.900175 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 555/1133] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:52.906898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be508ed0-2ea4-4ad4-9184-07360a669c6f tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:52.930126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:52.933320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be508ed0-2ea4-4ad4-9184-07360a669c6f tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/58a186d6-c404-4e88-a91e-61dda9b07f42" status: 202 len: 0 microversion: 2.1 time: 0.031125 Oct 29 20:50:52.934865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 556/1134] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:52 2022] DELETE /compute/v2.1/flavors/58a186d6-c404-4e88-a91e-61dda9b07f42 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:52.941210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:52.942243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] [instance: 4f981c21-556b-40cc-8edf-87f69b2e4e4e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:52.948722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.949383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.949985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.950794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:52.951493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:52.951927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:52.966530 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] HTTP exception thrown: Instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e could not be found. Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Request method failure captured: Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e HTTP/1.1 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFu2tlPy6ywwe9QJSY9jDwGRIjd5nKeKaeBlUY4e86ZN_FKa-oDzXMV5VYELZx56l_I9UrZqHOBuqTXBo1Q49G3HmB7MaFZCJJiBP978ZOgkgaPKbncMWCwmo55hlBZKLxfBh01AVHNXHQf4atNr9BogRGxYmWCMBDydI_t-ksY8lo Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4fd6966959864b80b945ae69a275ca8f Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4fd6966959864b80b945ae69a275ca8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4fd6966959864b80b945ae69a275ca8f Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminTestJSON-1207019514 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminTestJSON-1207019514-project Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 027a78fcee5a4f44b47fc5e187f6da67 Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminTestJSON-1207019514-project Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e could not be found. Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4f981c21-556b-40cc-8edf-87f69b2e4e4e'} Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e could not be found. Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e could not be found. Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:52.968191 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e could not be found. Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] Returning 404 to user: Instance 4f981c21-556b-40cc-8edf-87f69b2e4e4e could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8bd4701-fe2d-43d8-96b0-1d7cf878107f tempest-ServersAdminTestJSON-1207019514 tempest-ServersAdminTestJSON-1207019514-project] 10.222.0.36 "GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e" status: 404 len: 111 microversion: 2.1 time: 0.033506 Oct 29 20:50:52.972509 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 557/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:52 2022] GET /compute/v2.1/servers/4f981c21-556b-40cc-8edf-87f69b2e4e4e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:50:52.974637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53b9f4e1-d3a9-4f09-bba8-459ad04b5050 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:52.993054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:52.996555 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53b9f4e1-d3a9-4f09-bba8-459ad04b5050 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025366 Oct 29 20:50:52.997734 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 558/1136] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:53.020072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f34b6a0-a22a-46cf-9b48-b1a4afb0319e tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-700489599", "id": "0291f1b6-e3f9-4713-888c-00f978fb0ddb", "os-flavor-access:is_public": "True"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:53.027529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:53.030097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:53.033340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:53.034726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:53.038977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:53.041422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:53.066438 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f34b6a0-a22a-46cf-9b48-b1a4afb0319e tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.052155 Oct 29 20:50:53.069375 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 559/1137] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:53 2022] POST /compute/v2.1/flavors => generated 506 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:53.092552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-514ea58b-805d-46c5-93ab-9aef08314f56 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:53.137345 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-514ea58b-805d-46c5-93ab-9aef08314f56 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/0291f1b6-e3f9-4713-888c-00f978fb0ddb" status: 202 len: 0 microversion: 2.1 time: 0.058511 Oct 29 20:50:53.138438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 560/1138] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:50:53 2022] DELETE /compute/v2.1/flavors/0291f1b6-e3f9-4713-888c-00f978fb0ddb => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:53.149871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8aa151e6-f849-429c-904a-d30cdd22d57c tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:53.182159 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8aa151e6-f849-429c-904a-d30cdd22d57c tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036245 Oct 29 20:50:53.201608 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 561/1139] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:53.208784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6f59222-cc75-4ee9-b28f-5b1885d83175 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2049487480", "id": 1982067411, "os-flavor-access:is_public": "True"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:53.231727 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6f59222-cc75-4ee9-b28f-5b1885d83175 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028360 Oct 29 20:50:53.232671 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 562/1140] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:53 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:53.244110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0315ee34-fa43-462c-b968-e084a0935aba tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:53.250865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0315ee34-fa43-462c-b968-e084a0935aba tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1982067411" status: 200 len: 414 microversion: 2.1 time: 0.010334 Oct 29 20:50:53.251918 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 563/1141] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:50:53 2022] GET /compute/v2.1/flavors/1982067411 => generated 414 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:50:53.538016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:50:53.538530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquired lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:50:53.659926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-383736e6-4a0d-4f55-a233-80ec08b365da tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:53.695823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-383736e6-4a0d-4f55-a233-80ec08b365da tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.434808 Oct 29 20:50:53.697777 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 564/1142] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:53 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:53.703581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:53.704533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:53.712902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:53.713689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:53.714404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:53.716130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:53.716828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:53.717484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:53.756963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:54.203869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:54.221336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cdc22470-8fc0-464c-b60b-af2fad4482d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1361 microversion: 2.1 time: 0.521895 Oct 29 20:50:54.222732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 565/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:53 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1361 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:54.228725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9bf5ddaf-d3f6-49d6-be9d-57d2bfebf124 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:54.263670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9bf5ddaf-d3f6-49d6-be9d-57d2bfebf124 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1982067411" status: 202 len: 0 microversion: 2.1 time: 0.038336 Oct 29 20:50:54.270839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 566/1144] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:50:54 2022] DELETE /compute/v2.1/flavors/1982067411 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:54.278472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:54.279646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:54.292446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:54.293368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:54.294207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:54.295383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:54.296331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:54.297319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:54.840902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:54.851336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5880d31-2d97-418e-866a-43751135fd37 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1473 microversion: 2.1 time: 0.579107 Oct 29 20:50:54.851921 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 567/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:54 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1473 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:54.871622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5599e794-0c9e-4cdf-801a-9a07578f49d6 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:54.908996 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5599e794-0c9e-4cdf-801a-9a07578f49d6 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055588 Oct 29 20:50:54.910210 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 568/1146] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:54.936792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa3b1e11-9090-43d0-8dd8-570edee704bc tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1573859324", "id": 99270848, "os-flavor-access:is_public": "False"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:54.963765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa3b1e11-9090-43d0-8dd8-570edee704bc tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.033805 Oct 29 20:50:54.967099 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 569/1147] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:54 2022] POST /compute/v2.1/flavors => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:54.990765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c06f527-7350-45a4-b7bd-012267e0c587 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "99270848"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:55.039216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4c06f527-7350-45a4-b7bd-012267e0c587 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] HTTP exception thrown: Flavor 99270848 could not be found. Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c06f527-7350-45a4-b7bd-012267e0c587 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] Request method failure captured: Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 105 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIieFMU_Bf23TtNJ1-GghnHo-Y21rbN0YH2qETIDTbkZaGhIGpc5uZ85Dt9j4bb_vRrbRJl9LONcNxxWiXh_IzkU2A9cmkDiL_2Yv1j2FzK_yTrBAc4sE2d8-fz0gsm2290b54KjItwLtGbbo1Udc3JNZanECLgUvHxaDtoGvq3bLk Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 0a455cee6d49426e89d1c5dfaaaee010 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FlavorsAdminTestJSON-531915549 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0a455cee6d49426e89d1c5dfaaaee010"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0a455cee6d49426e89d1c5dfaaaee010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0a455cee6d49426e89d1c5dfaaaee010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0a455cee6d49426e89d1c5dfaaaee010"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FlavorsAdminTestJSON-531915549 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 0a455cee6d49426e89d1c5dfaaaee010 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-531915549 Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FlavorsAdminTestJSON-531915549-project Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: a6153e5650e6489cb8fae95c770f360f Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FlavorsAdminTestJSON-531915549-project Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "test", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "99270848"}} Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: exception: Flavor 99270848 could not be found. Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '99270848'}}} Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 99270848 could not be found. Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:55.047467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 99270848 could not be found. Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 99270848 could not be found. Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c06f527-7350-45a4-b7bd-012267e0c587 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] Returning 400 to user: Flavor 99270848 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:50:55.052377 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c06f527-7350-45a4-b7bd-012267e0c587 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.071604 Oct 29 20:50:55.056769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 570/1148] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:54 2022] POST /compute/v2.1/servers => generated 79 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:50:55.068660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04b8f5cd-d0bd-4f74-8ea9-fb345a140ea1 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:55.154640 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04b8f5cd-d0bd-4f74-8ea9-fb345a140ea1 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/99270848" status: 202 len: 0 microversion: 2.1 time: 0.097534 Oct 29 20:50:55.156029 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 571/1149] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 20:50:55 2022] DELETE /compute/v2.1/flavors/99270848 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:50:55.169683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c6bc239a-cf6a-481e-a2cc-559e12eb7e01 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:55.265599 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c6bc239a-cf6a-481e-a2cc-559e12eb7e01 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103113 Oct 29 20:50:55.268785 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 572/1150] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:50:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:55.298539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:55.299820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:55.314953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:55.315845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:55.316786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:55.319123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:55.319841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:55.322708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:55.820284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Building network info cache for instance {{(pid=138885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:50:56.246759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:56.258526 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f79e8e54-4d6d-4bc4-be16-0e8f9870954a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1361 microversion: 2.1 time: 0.986570 Oct 29 20:50:56.279250 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 573/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:55 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1361 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:56.288080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21170c20-75f4-48d9-9151-eee561b7831c tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1066238712", "id": 661449868, "os-flavor-access:is_public": "False"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:56.347828 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-21170c20-75f4-48d9-9151-eee561b7831c tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.064046 Oct 29 20:50:56.348949 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 574/1152] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:56 2022] POST /compute/v2.1/flavors => generated 412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:56.360392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-53bdc69f-b5dd-459e-9ce3-a87eed349659 req-25eccadc-7e1b-4c14-960f-d0236ff2e113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1", "tag": "3e543ffe-5d96-4a35-80df-2aed220ba76f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:56.405497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-53bdc69f-b5dd-459e-9ce3-a87eed349659 req-25eccadc-7e1b-4c14-960f-d0236ff2e113 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:56.407099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-53bdc69f-b5dd-459e-9ce3-a87eed349659 req-25eccadc-7e1b-4c14-960f-d0236ff2e113 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:56.407574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-53bdc69f-b5dd-459e-9ce3-a87eed349659 req-25eccadc-7e1b-4c14-960f-d0236ff2e113 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:56.439634 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-53bdc69f-b5dd-459e-9ce3-a87eed349659 req-25eccadc-7e1b-4c14-960f-d0236ff2e113 service nova] Creating event network-changed:3e543ffe-5d96-4a35-80df-2aed220ba76f for instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 on nch2-master-1 Oct 29 20:50:56.453758 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-53bdc69f-b5dd-459e-9ce3-a87eed349659 req-25eccadc-7e1b-4c14-960f-d0236ff2e113 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099797 Oct 29 20:50:56.456380 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 575/1153] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:56.471462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:56.472817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:56.488863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=80,nova_api:DELETE=15 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:56.501714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:56.503539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:56.504353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:56.505134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:56.505652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:56.506076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:57.076986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:57.101919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6019156c-11f1-46d4-8097-ceaeadc627a8 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1473 microversion: 2.1 time: 0.642390 Oct 29 20:50:57.105626 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 576/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:56 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1473 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:57.122774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-56b5041b-ad01-492e-b0d4-6920b27d4db0 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-947324037", "id": 1412524063, "os-flavor-access:is_public": "True"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:57.163389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-56b5041b-ad01-492e-b0d4-6920b27d4db0 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.053797 Oct 29 20:50:57.170922 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 577/1155] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:50:57 2022] POST /compute/v2.1/flavors => generated 413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:57.179915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12522475-c731-4603-a645-923efbdf5cc9 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:57.213649 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12522475-c731-4603-a645-923efbdf5cc9 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.040833 Oct 29 20:50:57.226763 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 578/1156] 10.222.0.36 () {58 vars in 1169 bytes} [Sat Oct 29 20:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:57.250089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8050b248-e3f6-4e82-9720-d701da7981b9 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:57.298254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8050b248-e3f6-4e82-9720-d701da7981b9 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.067531 Oct 29 20:50:57.311412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 579/1157] 10.222.0.36 () {58 vars in 1177 bytes} [Sat Oct 29 20:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:57.328088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:57.332031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:57.347870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:57.348550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:57.350749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:57.352081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:57.357382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:57.358211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:57.764307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Updating instance_info_cache with network_info: [{"id": "3e543ffe-5d96-4a35-80df-2aed220ba76f", "address": "fa:16:3e:dd:21:10", "network": {"id": "9c558784-630d-4257-bb4e-6d935eebc38c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1504408250-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "effef2abce4f4216a17194712351d9ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e543ffe-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:50:57.794785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Releasing lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:50:57.795809 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91ed4f49-5529-49a7-b359-87f0ebe402f4 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action" status: 202 len: 0 microversion: 2.1 time: 5.207451 Oct 29 20:50:57.796696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 579/1158] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:52 2022] POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action => generated 0 bytes in 5210 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:50:57.807003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:57.812076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0c381fe6-e053-4b45-9232-d4f48ace7f01 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:57.822239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48b083d5-0635-44de-a3ea-40064ed0a8e7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1361 microversion: 2.1 time: 0.505104 Oct 29 20:50:57.823611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 580/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:57 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1361 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:57.831483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afa4e28b-c367-4875-8847-98e393b520ce tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '.version_select at 0x7fa171853670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:57.879041 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0c381fe6-e053-4b45-9232-d4f48ace7f01 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.077388 Oct 29 20:50:57.888905 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 580/1160] 10.222.0.36 () {58 vars in 1171 bytes} [Sat Oct 29 20:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:57.912715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe823035-f35e-44fe-99aa-ef4041fa23e5 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:57.939101 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fe823035-f35e-44fe-99aa-ef4041fa23e5 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.038335 Oct 29 20:50:57.943025 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 581/1161] 10.222.0.36 () {58 vars in 1169 bytes} [Sat Oct 29 20:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:50:57.959728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d353bdf1-48cd-4746-99fe-841a4289a1fc tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:58.030543 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d353bdf1-48cd-4746-99fe-841a4289a1fc tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.075150 Oct 29 20:50:58.033413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 582/1162] 10.222.0.36 () {58 vars in 1169 bytes} [Sat Oct 29 20:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:58.059881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30753ec1-7afb-40db-9643-d2175b4afd1c tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:58.165571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:58.190813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:50:58.608580 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30753ec1-7afb-40db-9643-d2175b4afd1c tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.554922 Oct 29 20:50:58.610710 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 583/1163] 10.222.0.36 () {58 vars in 1175 bytes} [Sat Oct 29 20:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:58.615979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:58.616782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:58.624451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:58.625251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:58.625914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:58.626973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:58.627591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:58.628168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:59.226686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:59.238987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64050e64-022a-4d90-b3ed-791462f7ea99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1470 microversion: 2.1 time: 0.625638 Oct 29 20:50:59.259897 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 584/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:58 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1470 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:59.270366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f7f1800-21b4-4383-815d-58bb9f84b3e5 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:59.331067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f7f1800-21b4-4383-815d-58bb9f84b3e5 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.069360 Oct 29 20:50:59.332043 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 585/1165] 10.222.0.36 () {58 vars in 1173 bytes} [Sat Oct 29 20:50:59 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:59.343455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:50:59.344315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:59.365240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:59.367060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:59.367761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:59.368574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:59.369041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:59.369551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:59.874956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:50:59.892545 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65852e06-3777-456d-b3c0-3d3881534d16 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1361 microversion: 2.1 time: 0.557611 Oct 29 20:50:59.893903 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 586/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:50:59 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1361 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:50:59.900908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:50:59.909669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:50:59.929719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:59.931181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:59.933015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:50:59.935343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:50:59.937409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:50:59.937962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:00.061637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:00.063317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:00.065110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:00.067874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:00.069107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:00.070286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:00.108704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:00.115527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for user 0a554d93b7864309990e6252c09f59cc and project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:00.267233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:00.372016 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-720e791c-99df-46a4-ba2d-b8aa961462a4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df/action" status: 202 len: 0 microversion: 2.1 time: 0.475850 Oct 29 20:51:00.375928 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 587/1167] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:50:59 2022] POST /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:00.750070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-712480848", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:00.900071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:51:01.026856 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afa4e28b-c367-4875-8847-98e393b520ce tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/bb3a0f2d-40e3-4d88-b343-48f199e27b70" status: 202 len: 0 microversion: 2.1 time: 3.200809 Oct 29 20:51:01.028435 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 581/1168] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:50:57 2022] DELETE /compute/v2.1/os-floating-ips/bb3a0f2d-40e3-4d88-b343-48f199e27b70 => generated 0 bytes in 3204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:01.033575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-730be389-20e0-41b1-b6bd-0c940443510a tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:01.114193 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-730be389-20e0-41b1-b6bd-0c940443510a tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.082412 Oct 29 20:51:01.116429 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 582/1169] 10.222.0.36 () {58 vars in 1169 bytes} [Sat Oct 29 20:51:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:01.138173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:01.139541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:01.148118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:01.148953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:01.152335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:01.153594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:01.154459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:01.155263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.043049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:02.052321 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-820bdfd3-9f2b-4e9e-96ca-32ef845fc38e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1469 microversion: 2.1 time: 0.934177 Oct 29 20:51:02.053146 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 583/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:01 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1469 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:02.081328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:02.082247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:02.097665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.098854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.099349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.100060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.102808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.103653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.192153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:51:02.193120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:51:02.194081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:51:02.194728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:51:02.195585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:51:02.216233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.217164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.217326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.218048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.218584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.219051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.250511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Getting quotas for project 674fcd08bc2c486aa00c64db594cabdd. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:02.256639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Getting quotas for user 531843035bb54ec9aabbe4cf1d240fbd and project 674fcd08bc2c486aa00c64db594cabdd. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:02.276803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:51:02.279417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:51:02.335941 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3761829-8fa8-4c5d-beb1-45c8459e9ce9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.961191 Oct 29 20:51:02.337696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 588/1171] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:51:02.342946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc520e60-97ab-448f-b92a-ba37ac8c279b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'action', calling method: .version_select at 0x7fa173536820>, body: {"addFloatingIp": {"address": ""}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc520e60-97ab-448f-b92a-ba37ac8c279b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Request method failure captured: Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action HTTP/1.1 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 34 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZIJTJdNYLDlMoqq2I__KNtOpHIs612UTcDuMDjwmeZg2N_3ciy4xzavEjmAhugWgDmgtEeA19l-CD_IeltLDLr_Be13m3c9k3abvy8pciy92hFtJxt47TDK9lP6dQOa95dwgJhUOi_CcnRH5TbchF8JlD2vnoJchIokO_TMrEguZkg Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_effef2abce4f4216a17194712351d9ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/effef2abce4f4216a17194712351d9ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4b8f025e74a74bf0b83e2b3b27062099 Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: {"addFloatingIp": {"address": ""}} Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1', 'body': {'addFloatingIp': {'address': ''}}} Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '' Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:51:02.348067 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 20:51:02.353543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:02.369000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc520e60-97ab-448f-b92a-ba37ac8c279b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:02.370574 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc520e60-97ab-448f-b92a-ba37ac8c279b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action" status: 400 len: 142 microversion: 2.1 time: 0.031627 Oct 29 20:51:02.373203 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 589/1172] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:51:02 2022] POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action => generated 142 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:51:02.379525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-231ea138-1ece-4d23-8170-bdaf095535da tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:02.403030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:02.412032 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-231ea138-1ece-4d23-8170-bdaf095535da tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1412524063" status: 202 len: 0 microversion: 2.1 time: 0.037162 Oct 29 20:51:02.413570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 590/1173] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:51:02 2022] DELETE /compute/v2.1/flavors/1412524063 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:02.427444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-072b6911-e04f-4491-8928-afbad4e6f997 req-d817c0bd-48e4-4554-aef0-707b3e45f7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fa038d-5a82-452d-bde6-eaa0b790d7cc", "name": "network-vif-plugged", "status": "completed", "tag": "437d3157-cf84-48ff-88d0-d082479a661b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:02.441959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-072b6911-e04f-4491-8928-afbad4e6f997 req-d817c0bd-48e4-4554-aef0-707b3e45f7c2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.442839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-072b6911-e04f-4491-8928-afbad4e6f997 req-d817c0bd-48e4-4554-aef0-707b3e45f7c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.443710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-072b6911-e04f-4491-8928-afbad4e6f997 req-d817c0bd-48e4-4554-aef0-707b3e45f7c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.457341 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-072b6911-e04f-4491-8928-afbad4e6f997 req-d817c0bd-48e4-4554-aef0-707b3e45f7c2 service nova] Creating event network-vif-plugged:437d3157-cf84-48ff-88d0-d082479a661b for instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc on nch2-master-1 Oct 29 20:51:02.465108 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-072b6911-e04f-4491-8928-afbad4e6f997 req-d817c0bd-48e4-4554-aef0-707b3e45f7c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049653 Oct 29 20:51:02.466027 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 591/1174] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:02.553530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1392017736", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "c0f21c63-d525-4dc0-89e4-ec653151e278"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:02.625130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] validate_networks() for [('c0f21c63-d525-4dc0-89e4-ec653151e278', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:51:02.782673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:02.795910 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8aaf4d10-8776-42e8-93d1-e53557c8e1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1361 microversion: 2.1 time: 0.726633 Oct 29 20:51:02.797939 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 584/1175] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:02 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1361 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:02.819327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9de1010-14b0-4e66-a81f-d34c96a9f240 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:02.820777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9de1010-14b0-4e66-a81f-d34c96a9f240 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:02.958285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c9de1010-14b0-4e66-a81f-d34c96a9f240 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:02.967219 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9de1010-14b0-4e66-a81f-d34c96a9f240 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1221 microversion: 2.1 time: 0.167815 Oct 29 20:51:02.968481 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 585/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:02 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:02.973872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:02.976731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:02.986685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.987641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.988561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:02.990429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:02.991320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:02.992025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.040741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:51:03.040741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquired lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:51:03.346643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Releasing lock "refresh_cache-c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:51:03.351020 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] HTTP exception thrown: floating IP not found Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Request method failure captured: Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action HTTP/1.1 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 41 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIJTJdNYLDlMoqq2I__KNtOpHIs612UTcDuMDjwmeZg2N_3ciy4xzavEjmAhugWgDmgtEeA19l-CD_IeltLDLr_Be13m3c9k3abvy8pciy92hFtJxt47TDK9lP6dQOa95dwgJhUOi_CcnRH5TbchF8JlD2vnoJchIokO_TMrEguZkg Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_effef2abce4f4216a17194712351d9ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/effef2abce4f4216a17194712351d9ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4b8f025e74a74bf0b83e2b3b27062099 Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: exception: floating IP not found Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 29 20:51:03.355178 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 29 20:51:03.362443 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:03.365100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Returning 404 to user: floating IP not found {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:03.366296 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5461dc6f-7073-4232-80dd-c55b7b5d743a tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action" status: 404 len: 67 microversion: 2.1 time: 0.396642 Oct 29 20:51:03.367183 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 586/1177] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:51:02 2022] POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action => generated 67 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:03.377563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31a4bf45-935f-420a-9fea-fed88dc21fbb tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:03.408451 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31a4bf45-935f-420a-9fea-fed88dc21fbb tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039050 Oct 29 20:51:03.409141 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 587/1178] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:03.415996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:03.422395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:03.423293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Searching by: {'deleted': False, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:51:03.453029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:03.453824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:03.457494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.458443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:03.459017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:03.461969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.595159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:51:03.698060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:51:03.698629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:51:03.698984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:51:03.699618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:51:03.700884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:51:03.730234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:03.734344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:03.736966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.738997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:03.740602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:03.742450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.776052 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bba6e1f9-9003-4f9d-98d0-b14d6b2e4df6 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.365083 Oct 29 20:51:03.779478 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 588/1179] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:51:03 2022] GET /compute/v2.1/servers => generated 344 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:03.800220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:03.800507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Getting quotas for project da5abdc9b77f409dae205a3d7e3e913c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:03.801076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:03.810787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Getting quotas for user 84799edfc2fd40b2ad004d9c080dde40 and project da5abdc9b77f409dae205a3d7e3e913c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:03.813102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:03.817243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:03.817892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.818746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:03.819321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:03.830222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:03.834407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:51:03.841939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:51:03.983772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6734f303-ea94-48ca-a38b-a6e3f452cf0b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.515870 Oct 29 20:51:03.985335 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 592/1180] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:51:03.990794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c032a87-c338-41b8-8f6a-5b7d1edb8092 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:04.093905 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6c032a87-c338-41b8-8f6a-5b7d1edb8092 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c032a87-c338-41b8-8f6a-5b7d1edb8092 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Request method failure captured: Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action HTTP/1.1 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 44 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZIJTJdNYLDlMoqq2I__KNtOpHIs612UTcDuMDjwmeZg2N_3ciy4xzavEjmAhugWgDmgtEeA19l-CD_IeltLDLr_Be13m3c9k3abvy8pciy92hFtJxt47TDK9lP6dQOa95dwgJhUOi_CcnRH5TbchF8JlD2vnoJchIokO_TMrEguZkg Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_effef2abce4f4216a17194712351d9ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/effef2abce4f4216a17194712351d9ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4b8f025e74a74bf0b83e2b3b27062099 Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: exception: Floating IP not found for address 0.0.0.0. Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 29 20:51:04.097332 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c032a87-c338-41b8-8f6a-5b7d1edb8092 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6c032a87-c338-41b8-8f6a-5b7d1edb8092 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action" status: 404 len: 88 microversion: 2.1 time: 0.112695 Oct 29 20:51:04.107416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 593/1181] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:51:03 2022] POST /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1/action => generated 88 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:04.114206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1e2be460-da46-46c1-937a-fed49f4bdb8f tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:04.183831 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1e2be460-da46-46c1-937a-fed49f4bdb8f tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/661449868" status: 202 len: 0 microversion: 2.1 time: 0.082371 Oct 29 20:51:04.184407 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 594/1182] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:51:04 2022] DELETE /compute/v2.1/flavors/661449868 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:04.215342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:04.221496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:04.223720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Searching by: {'deleted': False, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:51:04.229926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.230731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.231330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.232265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.232899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.235493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.251873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:04.265817 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90599c2b-0654-4a76-86cb-a6d4cab2328d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1469 microversion: 2.1 time: 0.483569 Oct 29 20:51:04.269020 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 589/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:03 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:04.282095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:04.282714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:04.293035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:51:04.296818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.297369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.303489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.304389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.304758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.308942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.373286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:04.398700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.400955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.401432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.809720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:04.830533 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94a02d11-5536-4afe-8964-1d8a6d8b2771 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1545 microversion: 2.1 time: 0.560190 Oct 29 20:51:04.833811 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 590/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:04 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1545 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:04.847790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:04.848673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:04.865733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.866590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.867220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.868941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:04.869963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:04.874911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:04.876612 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ecbe4f83-bdda-4487-9583-b4a69226c27c tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.672121 Oct 29 20:51:04.877826 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 595/1185] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:04 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:04.903383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2efd012f-b4ef-4c37-a801-36fa08cf443f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:04.904815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2efd012f-b4ef-4c37-a801-36fa08cf443f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:04.988718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:05.002472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05289b45-348a-4fa0-ba8d-0b48e87ad1a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1281 microversion: 2.1 time: 0.165303 Oct 29 20:51:05.004671 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 591/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:04 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:05.008447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2efd012f-b4ef-4c37-a801-36fa08cf443f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:05.013085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.013860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:05.017728 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2efd012f-b4ef-4c37-a801-36fa08cf443f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1224 microversion: 2.1 time: 0.124964 Oct 29 20:51:05.031131 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 596/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:04 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:05.035667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.038130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.038409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a3ba80bb-ab4c-4a66-ae2e-fc119bf6a0d2 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.038802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.041697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.042183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.043312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.062866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a3ba80bb-ab4c-4a66-ae2e-fc119bf6a0d2 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030507 Oct 29 20:51:05.064082 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 597/1188] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:05.068981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "name": "network-vif-plugged", "status": "completed", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:05.084723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.085230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.085678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.111841 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] Creating event network-vif-plugged:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:51:05.118990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] Instance 953407b6-c139-4c24-95f1-0bd2c94f07df is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:51:05.123124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:51:05.126820 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-eca7ed20-d6f6-49ab-a478-e62a8abd0d7d req-919abdea-58c0-43d9-a4b5-d699186a0f5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061280 Oct 29 20:51:05.128012 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 598/1189] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:05.136414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.137301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:05.145426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.146292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.146922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.147987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.148846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.149638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.332728 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-72c8f2e6-e629-4b47-9661-855558bd6258 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 204 len: 0 microversion: 2.1 time: 0.324423 Oct 29 20:51:05.340378 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 592/1190] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:51:05 2022] DELETE /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:51:05.354445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-537d04f7-7151-4ddd-83f7-6d5c1a112a85 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.364095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dac4465d-2d43-449c-92e4-5273ff376e58 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234544 Oct 29 20:51:05.364831 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 599/1191] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:05.380168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86e2bfe1-4f81-4253-98b9-952d7a6f1bf6 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-274182468", "id": 1001171188, "os-flavor-access:is_public": "False"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:05.392454 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-537d04f7-7151-4ddd-83f7-6d5c1a112a85 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050380 Oct 29 20:51:05.403419 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 593/1192] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:05.409983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.411118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:05.432213 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86e2bfe1-4f81-4253-98b9-952d7a6f1bf6 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.056494 Oct 29 20:51:05.432845 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 600/1193] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:05.443216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.445989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.446861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.447985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.448773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.449734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.453616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.454599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:05.471529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.472206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.472666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.473382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.473880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.476368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.874659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:05.885312 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ed74afb3-3b1e-43ee-8694-1acaf4b8c40d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1469 microversion: 2.1 time: 0.480690 Oct 29 20:51:05.888664 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 594/1194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:05.896883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:05.909577 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca22ee6d-2467-421d-b5e7-b64e42bbb1dc tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1542 microversion: 2.1 time: 0.474650 Oct 29 20:51:05.912293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bdf709b9-c5cf-43c7-bd7e-2396aceb15cf tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.914183 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 601/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1542 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:05.924188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:05.926866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:05.951384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.952061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.952561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.953387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:05.954097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:05.955648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:05.968406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bdf709b9-c5cf-43c7-bd7e-2396aceb15cf tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076729 Oct 29 20:51:05.969025 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 595/1196] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:05.992448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:51:06.000160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e06bd50-c495-4979-87d0-1f6ffdec76a6 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.067493 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e06bd50-c495-4979-87d0-1f6ffdec76a6 tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046167 Oct 29 20:51:06.068169 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 596/1197] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:06.077280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.078151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:06.097966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.098714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.099346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.100234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.100856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.101442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.219539 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d30b77fd-75a9-404b-b7a6-31531780c7bd tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 204 len: 0 microversion: 2.1 time: 0.302357 Oct 29 20:51:06.220665 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 602/1198] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:51:05 2022] DELETE /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:51:06.228834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.229909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:06.240986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.242243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.243212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.244119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.245099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.246132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.265049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:06.267552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:06.278863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35fbf610-100c-4130-8fd0-ced6aa7b4200 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1279 microversion: 2.1 time: 0.209380 Oct 29 20:51:06.289254 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 597/1199] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:06.299978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14295d91-fe1a-4c36-9df5-67e7565f29ab tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.356242 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14295d91-fe1a-4c36-9df5-67e7565f29ab tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1001171188" status: 202 len: 0 microversion: 2.1 time: 0.075418 Oct 29 20:51:06.356835 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 598/1200] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:51:06 2022] DELETE /compute/v2.1/flavors/1001171188 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:06.366079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.366701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:06.384096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.384902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.385576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.386515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.387166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.387776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.406089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:06.414378 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ebe23f03-d9c0-4d5f-b11b-3d489955ba5b tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1276 microversion: 2.1 time: 0.192202 Oct 29 20:51:06.415010 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 603/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:06.452762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a577952-8662-4f0c-8fcb-13e2a6047eed tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.504102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a577952-8662-4f0c-8fcb-13e2a6047eed tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065404 Oct 29 20:51:06.504774 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 604/1202] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:06.525274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8729249c-0be9-4d89-bce6-663f6947a241 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1579703545", "id": 1932457875, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:06.563069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8729249c-0be9-4d89-bce6-663f6947a241 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040577 Oct 29 20:51:06.563069 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 605/1203] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:06 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:06.580053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5c275b23-bea4-4e8a-be0e-56934fa4aa3b tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.629251 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5c275b23-bea4-4e8a-be0e-56934fa4aa3b tempest-FlavorsAdminTestJSON-531915549 tempest-FlavorsAdminTestJSON-531915549-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.058378 Oct 29 20:51:06.637814 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 606/1204] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:06.660325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f993c95e-7d71-46a7-b34e-5b11bc0c58ce tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.703794 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f993c95e-7d71-46a7-b34e-5b11bc0c58ce tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1932457875" status: 202 len: 0 microversion: 2.1 time: 0.047128 Oct 29 20:51:06.704913 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 607/1205] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 20:51:06 2022] DELETE /compute/v2.1/flavors/1932457875 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:51:06.713236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31f8012d-bb90-4ce1-9c3b-97bdc2e200e1 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.715082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:06.737746 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-34b35104-85cc-4afa-acf8-2be89c6f58ad tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1608 microversion: 2.1 time: 0.372996 Oct 29 20:51:06.739002 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 599/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1608 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:06.751989 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31f8012d-bb90-4ce1-9c3b-97bdc2e200e1 tempest-FlavorsAdminTestJSON-600342193 tempest-FlavorsAdminTestJSON-600342193-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042954 Oct 29 20:51:06.775483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 608/1207] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:06.914361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.915075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:06.934016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.935282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.939798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.941568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:06.942941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:06.950509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.953070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.954566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.959109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.959460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.960317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:06.961147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:06.961794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:06.962482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:07.501868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:07.511854 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-645dd877-590b-4b8e-816e-9adf89d72317 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1542 microversion: 2.1 time: 0.574202 Oct 29 20:51:07.522184 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 609/1208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1542 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:07.522583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:07.527582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:07.528207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:07.541815 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8d271a3-5bad-44e3-8158-6853d09728f5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1535 microversion: 2.1 time: 0.631589 Oct 29 20:51:07.542229 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 600/1209] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:06 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1535 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:07.548676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:07.549449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:07.555730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:07.556540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:07.557376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:07.558302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:07.559163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:07.560319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:07.574477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:07.575826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:07.576283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:07.580171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:07.580670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:07.582478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:07.873852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:07.874301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:07.889158 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f7300a3-b20e-4e43-bc43-6e34ef283641 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1279 microversion: 2.1 time: 0.365725 Oct 29 20:51:07.895456 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc70da27-8e7a-48c4-951a-0ccf8f6f6089 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1282 microversion: 2.1 time: 0.351507 Oct 29 20:51:07.896049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 601/1210] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:07 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:07.906282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:07.907536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:07.909396 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 610/1211] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:07 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1279 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:07.918571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:07.920445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:07.920909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:07.923137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:07.923815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:07.924462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:08.091744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "name": "network-vif-unplugged", "status": "completed", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:08.110170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:08.111032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:08.111707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:08.127976 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] Creating event network-vif-unplugged:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:51:08.135220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] Instance 953407b6-c139-4c24-95f1-0bd2c94f07df is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:51:08.147545 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4a5b23ea-01c5-4dbb-a1fb-1b9e5cbe5ff4 req-df30cb7d-19c0-4401-8b9e-3e820b86317b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056573 Oct 29 20:51:08.149618 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 611/1212] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:08.421595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:08.431007 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91d39896-40d1-404a-96c9-1708368d8626 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1608 microversion: 2.1 time: 0.533108 Oct 29 20:51:08.447875 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 602/1213] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:07 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1608 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:08.551987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:08.553062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:08.564742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:08.565733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:08.573783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:08.574776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:08.575478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:08.576109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:08.577051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:08.577940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:08.578615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:08.579254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:08.579885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:08.581019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:08.586114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:08.586594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:09.955305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:09.988295 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e870205b-1c3b-488a-b5af-980776e4480f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1535 microversion: 2.1 time: 1.420956 Oct 29 20:51:09.988967 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 603/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:08 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1535 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:10.003551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:10.005860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:10.035302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:10.035614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:10.036064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:10.049434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:10.051094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:10.066128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:10.337187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b8f025e74a74bf0b83e2b3b27062099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effef2abce4f4216a17194712351d9ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:10.347850 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ccb1547-059c-4b98-8a97-b807cab1ef5d tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 200 len: 1542 microversion: 2.1 time: 1.806125 Oct 29 20:51:10.357989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 612/1215] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:08 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 1542 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:10.363137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:10.370860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:10.388720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:10.391683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:10.392148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:10.398121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:10.398632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:10.399791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:10.904675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:10.920815 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-719d9a4b-a4b2-47c8-a341-eddfefb49f62 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.561407 Oct 29 20:51:10.934599 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 613/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:10 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:10.943058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-574ba06b-f7cc-4c42-9c00-ba5520ea20d4 req-8f36f1d1-c006-4ef4-9209-d94b30f1de60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5fa038d-5a82-452d-bde6-eaa0b790d7cc", "tag": "437d3157-cf84-48ff-88d0-d082479a661b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:10.961745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-574ba06b-f7cc-4c42-9c00-ba5520ea20d4 req-8f36f1d1-c006-4ef4-9209-d94b30f1de60 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:10.962641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-574ba06b-f7cc-4c42-9c00-ba5520ea20d4 req-8f36f1d1-c006-4ef4-9209-d94b30f1de60 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:10.963654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-574ba06b-f7cc-4c42-9c00-ba5520ea20d4 req-8f36f1d1-c006-4ef4-9209-d94b30f1de60 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:10.987048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-574ba06b-f7cc-4c42-9c00-ba5520ea20d4 req-8f36f1d1-c006-4ef4-9209-d94b30f1de60 service nova] Creating event network-changed:437d3157-cf84-48ff-88d0-d082479a661b for instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc on nch2-master-1 Oct 29 20:51:10.996126 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-574ba06b-f7cc-4c42-9c00-ba5520ea20d4 req-8f36f1d1-c006-4ef4-9209-d94b30f1de60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059790 Oct 29 20:51:10.997945 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 614/1217] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:11.026382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:11.029384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:11.044650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.045074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.047125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.057017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.059630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.061268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.190689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:11.198854 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-541cca9a-a552-4e58-91cf-09db3abdf63e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 1.208437 Oct 29 20:51:11.218907 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 604/1218] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:09 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:11.233754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:11.237177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:11.251438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.253129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.254204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.257093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.257914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.260882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.386862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:11.400844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e158dd5c-8215-4c4e-882f-9414279e6706 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1608 microversion: 2.1 time: 0.400778 Oct 29 20:51:11.402072 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 615/1219] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:10 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1608 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:11.418417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:11.419383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] [instance: c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:11.431501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.437067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.437823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.438743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.442005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.443298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.484687 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] HTTP exception thrown: Instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 could not be found. Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Request method failure captured: Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 HTTP/1.1 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZIJTJdNYLDlMoqq2I__KNtOpHIs612UTcDuMDjwmeZg2N_3ciy4xzavEjmAhugWgDmgtEeA19l-CD_IeltLDLr_Be13m3c9k3abvy8pciy92hFtJxt47TDK9lP6dQOa95dwgJhUOi_CcnRH5TbchF8JlD2vnoJchIokO_TMrEguZkg Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_effef2abce4f4216a17194712351d9ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/effef2abce4f4216a17194712351d9ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/effef2abce4f4216a17194712351d9ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: effef2abce4f4216a17194712351d9ce Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4b8f025e74a74bf0b83e2b3b27062099 Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 could not be found. Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1'} Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 could not be found. Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 could not be found. Oct 29 20:51:11.508801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 could not be found. Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] Returning 404 to user: Instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:11.513396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed071074-e0f9-49ee-be27-5b934f0f8d1b tempest-FloatingIPsAssociationNegativeTestJSON-1311757481 tempest-FloatingIPsAssociationNegativeTestJSON-1311757481-project] 10.222.0.36 "GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1" status: 404 len: 111 microversion: 2.1 time: 0.108985 Oct 29 20:51:11.514804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 616/1220] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:11 2022] GET /compute/v2.1/servers/c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:11.643492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:11.673895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2edcae01-e1b3-4ea1-810e-b3a7c16b9a2f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1535 microversion: 2.1 time: 0.436616 Oct 29 20:51:11.676044 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 605/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:11 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1535 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:11.946049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:11.947118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:11.954858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.955685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.956598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.957563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:11.958226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:11.958858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:11.986550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:12.231939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:12.232767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:12.254872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:12.255120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:12.255379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:12.256114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:12.256677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:12.257806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:12.724503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:12.741897 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7209f353-5329-4f99-bf06-d1274c24bb32 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.793864 Oct 29 20:51:12.742934 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 617/1222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:11 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:12.747960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:12.750132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:12.766784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:12.767648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:12.768951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:12.769991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:12.770989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:12.771638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:12.966954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:13.107258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe32b0a32524e2bbaa26501305d418b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:13.139944 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f05a6f6-cd3f-40f6-b2ae-42b2371c9fff tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 200 len: 1252 microversion: 2.1 time: 0.394805 Oct 29 20:51:13.141562 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 618/1223] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:12 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 1252 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:13.147853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1171aad0-ced1-43bd-89fe-ed5a2b604358 req-613291db-0f33-41d6-8fd1-e9c3da1ec15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0f3d42-f2ec-4f60-b906-5dbb1e692deb", "name": "network-vif-deleted", "tag": "55da6b15-8655-478c-9a57-53f06958a65c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:13.161846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1171aad0-ced1-43bd-89fe-ed5a2b604358 req-613291db-0f33-41d6-8fd1-e9c3da1ec15d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.162640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1171aad0-ced1-43bd-89fe-ed5a2b604358 req-613291db-0f33-41d6-8fd1-e9c3da1ec15d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.163724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1171aad0-ced1-43bd-89fe-ed5a2b604358 req-613291db-0f33-41d6-8fd1-e9c3da1ec15d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.185097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1171aad0-ced1-43bd-89fe-ed5a2b604358 req-613291db-0f33-41d6-8fd1-e9c3da1ec15d service nova] Creating event network-vif-deleted:55da6b15-8655-478c-9a57-53f06958a65c for instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb on nch2-master-1 Oct 29 20:51:13.194436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1171aad0-ced1-43bd-89fe-ed5a2b604358 req-613291db-0f33-41d6-8fd1-e9c3da1ec15d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048529 Oct 29 20:51:13.203640 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 619/1224] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:13.220346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:13.221063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:13.235467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.236167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.237669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.238341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.238879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.239517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.297099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:13.316664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aee7004a-a8c4-4ad6-b427-d86fcb71f106 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 1.088497 Oct 29 20:51:13.338536 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 606/1225] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:12 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:13.348370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1", "name": "network-vif-deleted", "tag": "3e543ffe-5d96-4a35-80df-2aed220ba76f"}, {"name": "network-changed", "server_uuid": "c17fc63e-a4d9-45ff-afff-b8d82e66114f", "tag": "d93ec6dd-9908-406f-b7db-942fadc1f241"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:13.373032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.373607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.374369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.396018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] Creating event network-vif-deleted:3e543ffe-5d96-4a35-80df-2aed220ba76f for instance c0f5d701-e3b1-4ce5-bb03-bbf0b668d2e1 on nch2-master-1 Oct 29 20:51:13.396824 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] Creating event network-changed:d93ec6dd-9908-406f-b7db-942fadc1f241 for instance c17fc63e-a4d9-45ff-afff-b8d82e66114f on nch2-master-1 Oct 29 20:51:13.405193 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-08f8f01b-cd33-4544-bd5b-9098c9e4e951 req-7f47471f-4412-4069-9619-400e0a68212d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064892 Oct 29 20:51:13.406455 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 607/1226] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:13.648304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:13.678737 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59c8b024-b845-41f4-ae69-92f54cd40a6f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1528 microversion: 2.1 time: 0.472182 Oct 29 20:51:13.680157 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 620/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:13 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1528 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:13.709666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:13.712642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:13.714845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:13.734193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.734695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.735137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.740809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.740809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.741048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.780018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:13.780656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:13.815581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.820485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.823345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:13.828148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:13.831083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:13.832619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:14.220086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:14.229117 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-141b17df-4e5a-4a35-a6fe-d39652e519d7 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.466890 Oct 29 20:51:14.246167 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 621/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:13 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:14.265415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:14.265663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:14.266309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] [instance: 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:14.273548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=9 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:14.275293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:14.286511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:14.287612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:14.288095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:14.289027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:14.289559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:14.290221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:14.297223 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95bd4b65-62c2-4e21-bc89-c369dcca949e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1528 microversion: 2.1 time: 0.592400 Oct 29 20:51:14.311031 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] HTTP exception thrown: Instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb could not be found. Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Request method failure captured: Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb HTTP/1.1 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGsbJMtAiNkEO-DUuNwEtX4QH-7wCNZ4a5RD-iVnHNCh4x9xDOCZWBsOM9oFWkiyPO3pwnotCzR4Ox4JCTLZYGH8fMqzWr0qQgRVsUVBg_0HybZ3HG75Z0JIRB_HwRpYqwi0UxlbZIoFi0qYkofFI-Mg6a1FxyZkR-JjPrd06pyrVg Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: dfe32b0a32524e2bbaa26501305d418b Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestBootFromVolume-735731105 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfe32b0a32524e2bbaa26501305d418b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dfe32b0a32524e2bbaa26501305d418b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dfe32b0a32524e2bbaa26501305d418b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dfe32b0a32524e2bbaa26501305d418b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestBootFromVolume-735731105 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: dfe32b0a32524e2bbaa26501305d418b Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestBootFromVolume-735731105 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestBootFromVolume-735731105-project Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 91932364eb4e4742b5f7fc998d202a70 Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestBootFromVolume-735731105-project Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb could not be found. Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5b0f3d42-f2ec-4f60-b906-5dbb1e692deb'} Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb could not be found. Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb could not be found. Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:14.313085 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb could not be found. Oct 29 20:51:14.317360 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.317828 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 608/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:13 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1528 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:14.319565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Returning 404 to user: Instance 5b0f3d42-f2ec-4f60-b906-5dbb1e692deb could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:14.321916 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83945b21-73a3-4704-8e35-a92f39916bf8 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb" status: 404 len: 111 microversion: 2.1 time: 0.073110 Oct 29 20:51:14.326638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 622/1230] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:14 2022] GET /compute/v2.1/servers/5b0f3d42-f2ec-4f60-b906-5dbb1e692deb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:14.330797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e113dec9-37b3-434a-addc-f065a6f100f6 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:14.332566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3bd3d462-ab66-44be-88d0-29d687e723b9 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] Calling method '.version_select at 0x7fa171609430>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:14.347740 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e113dec9-37b3-434a-addc-f065a6f100f6 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] HTTP exception thrown: Flavor 92b82b15-fbcf-4246-99da-65cb519ba4de could not be found. Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e113dec9-37b3-434a-addc-f065a6f100f6 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Request method failure captured: Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/flavors/92b82b15-fbcf-4246-99da-65cb519ba4de HTTP/1.1 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFVu2h86yoGReGd7gLcVXDPwd9LfiZIptz4r67hrug35HmfdUNh4n20wObqkczOrCSIvpukh60Y2EFDreaGj1jerqBMy6ihA9FQ77OIqMz6ZczCx14Fidc3o2PZZnw7HTqrR5tDUzudM07LIp9xskhq99lUKwIiKofIp2LsasRY5ME Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4716859cce98493db25853e5b5f08651 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-MigrationsAdminTest-481628936 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4716859cce98493db25853e5b5f08651"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4716859cce98493db25853e5b5f08651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4716859cce98493db25853e5b5f08651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4716859cce98493db25853e5b5f08651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-MigrationsAdminTest-481628936 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4716859cce98493db25853e5b5f08651 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-MigrationsAdminTest-481628936 Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-MigrationsAdminTest-481628936-project-admin Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c2d52662206f426aa458635417493e5e Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-MigrationsAdminTest-481628936-project-admin Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: exception: Flavor 92b82b15-fbcf-4246-99da-65cb519ba4de could not be found. Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '92b82b15-fbcf-4246-99da-65cb519ba4de'} Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 92b82b15-fbcf-4246-99da-65cb519ba4de could not be found. Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 92b82b15-fbcf-4246-99da-65cb519ba4de could not be found. Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.350465 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 92b82b15-fbcf-4246-99da-65cb519ba4de could not be found. Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e113dec9-37b3-434a-addc-f065a6f100f6 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Returning 404 to user: Flavor 92b82b15-fbcf-4246-99da-65cb519ba4de could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:14.356109 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e113dec9-37b3-434a-addc-f065a6f100f6 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/92b82b15-fbcf-4246-99da-65cb519ba4de" status: 404 len: 109 microversion: 2.1 time: 0.028265 Oct 29 20:51:14.362096 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 609/1231] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:51:14 2022] DELETE /compute/v2.1/flavors/92b82b15-fbcf-4246-99da-65cb519ba4de => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:51:14.374512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:14.375482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:14.381310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3bd3d462-ab66-44be-88d0-29d687e723b9 tempest-ServersTestBootFromVolume-735731105 tempest-ServersTestBootFromVolume-735731105-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476162476" status: 202 len: 0 microversion: 2.1 time: 0.052452 Oct 29 20:51:14.384553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 623/1232] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 20:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476162476 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:14.388745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:14.389587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:14.390651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:14.391608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:14.392102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:14.392864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:14.573247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1144131360", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:14.639246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:51:15.014006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=16 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:15.068238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:15.076937 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2da9fd52-1111-4360-9b02-3cce8d97bff8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 0.713387 Oct 29 20:51:15.090142 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 610/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:14 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:15.260276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:15.260907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:15.283694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:15.284199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:15.287083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:15.288049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:15.290222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:15.293521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:16.031265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:16.038015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:51:16.039010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:51:16.039699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:51:16.040273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:51:16.040876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:51:16.042419 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ca97191-1ade-470f-84ec-50763bdf76d4 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.786023 Oct 29 20:51:16.043943 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 611/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:15 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:16.052425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:16.053145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:16.053916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:16.054820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:16.056000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:16.056593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:16.057606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9b63b49f-b9e5-414f-a0b9-42f0a962a92e req-7d1a9deb-3136-45d6-87f2-1334dabcf1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:16.085521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9b63b49f-b9e5-414f-a0b9-42f0a962a92e req-7d1a9deb-3136-45d6-87f2-1334dabcf1d4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:16.089193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9b63b49f-b9e5-414f-a0b9-42f0a962a92e req-7d1a9deb-3136-45d6-87f2-1334dabcf1d4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:16.090356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9b63b49f-b9e5-414f-a0b9-42f0a962a92e req-7d1a9deb-3136-45d6-87f2-1334dabcf1d4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:16.100486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:16.109857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Getting quotas for user 0a554d93b7864309990e6252c09f59cc and project 3da56123652f4fb19fe782b6c32ce520. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:16.127113 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9b63b49f-b9e5-414f-a0b9-42f0a962a92e req-7d1a9deb-3136-45d6-87f2-1334dabcf1d4 service nova] Creating event network-changed:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:51:16.127571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:51:16.130196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:51:16.138389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9b63b49f-b9e5-414f-a0b9-42f0a962a92e req-7d1a9deb-3136-45d6-87f2-1334dabcf1d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089313 Oct 29 20:51:16.140520 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 612/1235] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:16.152518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:16.153338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:16.173277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:16.174247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:16.174643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:16.176145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:16.177699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:16.181594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:16.222277 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e97adc97-3c8f-4c54-91dd-ac3861912643 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656158 Oct 29 20:51:16.223581 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 624/1236] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 20:51:16.439189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:16.451141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-746d506d-53df-4230-a0fe-dc42d8bd4769 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-277612147", "ram": 512, "vcpus": 1, "disk": 10, "id": 591406995, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:16.456271 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b77342c4-b8c8-461b-9cd1-6b8eb15a46ae tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 0.309999 Oct 29 20:51:16.460193 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 613/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:16 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:16.476747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd96f1ad-b616-416f-94c0-e7046aede817 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:16.479889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd96f1ad-b616-416f-94c0-e7046aede817 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:16.483410 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-746d506d-53df-4230-a0fe-dc42d8bd4769 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.258504 Oct 29 20:51:16.485311 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 625/1238] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:16 2022] POST /compute/v2.1/flavors => generated 412 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:16.499775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c5f4fe26-245c-4d89-a4b6-950eb5caa65c tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:16.538725 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c5f4fe26-245c-4d89-a4b6-950eb5caa65c tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043889 Oct 29 20:51:16.540675 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 626/1239] 10.222.0.36 () {60 vars in 1221 bytes} [Sat Oct 29 20:51:16 2022] POST /compute/v2.1/flavors/591406995/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:16.562332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd96f1ad-b616-416f-94c0-e7046aede817 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:16.570960 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd96f1ad-b616-416f-94c0-e7046aede817 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1213 microversion: 2.1 time: 0.105700 Oct 29 20:51:16.572209 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 614/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:16 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:16.757504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f289ef31-70e8-4ba9-b57d-e0cc2e0f4dae tempest-FlavorsExtraSpecsTestJSON-490938285 tempest-FlavorsExtraSpecsTestJSON-490938285-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:16.777101 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f289ef31-70e8-4ba9-b57d-e0cc2e0f4dae tempest-FlavorsExtraSpecsTestJSON-490938285 tempest-FlavorsExtraSpecsTestJSON-490938285-project] 10.222.0.36 "GET /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.230423 Oct 29 20:51:16.783215 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 627/1241] 10.222.0.36 () {58 vars in 1200 bytes} [Sat Oct 29 20:51:16 2022] GET /compute/v2.1/flavors/591406995/os-extra_specs => generated 66 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:16.790434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c8c48aae-28bb-48ac-9298-ebbf65062104 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:16.823915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:16.826693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c8c48aae-28bb-48ac-9298-ebbf65062104 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041339 Oct 29 20:51:16.827378 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 615/1242] 10.222.0.36 () {60 vars in 1221 bytes} [Sat Oct 29 20:51:16 2022] POST /compute/v2.1/flavors/591406995/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:16.838834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d11a7d1-fad2-4eca-95e3-131d8271f097 tempest-FlavorsExtraSpecsTestJSON-490938285 tempest-FlavorsExtraSpecsTestJSON-490938285-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:16.859265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d11a7d1-fad2-4eca-95e3-131d8271f097 tempest-FlavorsExtraSpecsTestJSON-490938285 tempest-FlavorsExtraSpecsTestJSON-490938285-project] 10.222.0.36 "GET /compute/v2.1/flavors/591406995/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.025719 Oct 29 20:51:16.859872 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 628/1243] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:51:16 2022] GET /compute/v2.1/flavors/591406995/os-extra_specs/hw:numa_nodes => generated 22 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:16.872014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08fd879c-00ae-49aa-9aba-5cdd556164aa tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:16.923169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08fd879c-00ae-49aa-9aba-5cdd556164aa tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056407 Oct 29 20:51:16.924092 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 616/1244] 10.222.0.36 () {60 vars in 1221 bytes} [Sat Oct 29 20:51:16 2022] POST /compute/v2.1/flavors/591406995/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:16.935142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01e1aa16-53dc-4451-a16b-67cdcfe8240c tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:16.944067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01e1aa16-53dc-4451-a16b-67cdcfe8240c tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014183 Oct 29 20:51:16.945448 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 629/1245] 10.222.0.36 () {58 vars in 1200 bytes} [Sat Oct 29 20:51:16 2022] GET /compute/v2.1/flavors/591406995/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:16.966507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8308c3bb-6871-4a30-9f54-7a9f812765d9 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:17.023212 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8308c3bb-6871-4a30-9f54-7a9f812765d9 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/591406995/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.071961 Oct 29 20:51:17.024685 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 617/1246] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:51:16 2022] PUT /compute/v2.1/flavors/591406995/os-extra_specs/hw:numa_nodes => generated 22 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:17.033933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81bc278f-56c1-4076-a6dc-92a04170c455 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.066998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.068193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:17.087089 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81bc278f-56c1-4076-a6dc-92a04170c455 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056700 Oct 29 20:51:17.090086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:17.090686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:17.091529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:17.093167 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 630/1247] 10.222.0.36 () {58 vars in 1200 bytes} [Sat Oct 29 20:51:17 2022] GET /compute/v2.1/flavors/591406995/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:17.093808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:17.094641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:17.095430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:17.103173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-861baf3c-cb9a-488b-bc00-bf607e8e6ada tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.189984 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-861baf3c-cb9a-488b-bc00-bf607e8e6ada tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/591406995/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.090559 Oct 29 20:51:17.193531 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 631/1248] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 20:51:17 2022] DELETE /compute/v2.1/flavors/591406995/os-extra_specs/hw:numa_nodes => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 20:51:17.206561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3916035d-304f-40fc-a927-7a3b5d30c48f tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.253984 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3916035d-304f-40fc-a927-7a3b5d30c48f tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/591406995/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.056950 Oct 29 20:51:17.278886 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 632/1249] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 20:51:17 2022] DELETE /compute/v2.1/flavors/591406995/os-extra_specs/hw:cpu_policy => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 20:51:17.302185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4cbfa79-f529-4001-9569-3a0d440f1c15 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.332401 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4cbfa79-f529-4001-9569-3a0d440f1c15 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/591406995/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.049355 Oct 29 20:51:17.333024 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 633/1250] 10.222.0.36 () {58 vars in 1200 bytes} [Sat Oct 29 20:51:17 2022] GET /compute/v2.1/flavors/591406995/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:51:17.355760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1a53fba-5d6a-46de-849a-952624101837 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.417127 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f1a53fba-5d6a-46de-849a-952624101837 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/591406995" status: 202 len: 0 microversion: 2.1 time: 0.077379 Oct 29 20:51:17.421268 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 634/1251] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:51:17 2022] DELETE /compute/v2.1/flavors/591406995 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:51:17.425925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b8a7130-c19e-42ba-8d83-1c121d1cebf4 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.484120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b8a7130-c19e-42ba-8d83-1c121d1cebf4 tempest-FlavorsExtraSpecsTestJSON-372811609 tempest-FlavorsExtraSpecsTestJSON-372811609-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061351 Oct 29 20:51:17.497875 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 635/1252] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:51:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:17.517561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.518151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:17.521631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:17.532078 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9234abe8-089f-44f9-a8d2-dabf6f5ce944 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.469980 Oct 29 20:51:17.533170 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 618/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:17 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:17.555691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:17.557804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:17.559454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:17.560369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:17.565524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:17.567489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:17.595977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:17.596953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:17.615291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:17.617424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:17.619266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:17.621936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:17.622882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:17.624336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:17.865066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:17.874610 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dd9a86b0-e1ee-47c4-8a0f-45a156398def tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 0.375400 Oct 29 20:51:17.889876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:17.890323 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-40e96fda-e172-4ce7-8458-d647bc03acfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1265 microversion: 2.1 time: 0.299074 Oct 29 20:51:17.891189 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 619/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:17 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:17.891306 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 636/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:17 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:18.559509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:18.561233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:18.568299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:18.569121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:18.569807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:18.571782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:18.572791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:18.573656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:18.871989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:18.898492 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba268722-2a27-4f1d-a34c-d7d36562f6cb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.342732 Oct 29 20:51:18.900197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:18.900818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:18.914862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:18.915508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:18.915954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:18.916667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:18.917126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:18.917587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:18.920642 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 637/1256] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:18 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:18.928535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:18.929180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:18.939530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:18.940210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:18.946394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:18.947661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:18.951827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:18.952372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:19.170761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:19.184181 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a52e91f-b316-4964-a683-51067c953c60 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1271 microversion: 2.1 time: 0.262300 Oct 29 20:51:19.186125 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 638/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:18 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:19.195485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-49227f60-8f29-4418-8d42-d9d737fafae6 req-0ce0fcab-54ef-45ef-a92c-2729097124e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "name": "network-vif-plugged", "status": "completed", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:19.220892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-49227f60-8f29-4418-8d42-d9d737fafae6 req-0ce0fcab-54ef-45ef-a92c-2729097124e7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:19.221385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-49227f60-8f29-4418-8d42-d9d737fafae6 req-0ce0fcab-54ef-45ef-a92c-2729097124e7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:19.225766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-49227f60-8f29-4418-8d42-d9d737fafae6 req-0ce0fcab-54ef-45ef-a92c-2729097124e7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:19.251129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-49227f60-8f29-4418-8d42-d9d737fafae6 req-0ce0fcab-54ef-45ef-a92c-2729097124e7 service nova] Creating event network-vif-plugged:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:51:19.257834 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-49227f60-8f29-4418-8d42-d9d737fafae6 req-0ce0fcab-54ef-45ef-a92c-2729097124e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069034 Oct 29 20:51:19.259050 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 639/1258] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:19.281857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:19.298351 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6237b354-2bf6-4ba2-8b56-69feb0ec9231 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 0.401836 Oct 29 20:51:19.299074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 620/1259] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:18 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:19.927986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:19.930930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:19.997718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:19.998421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:19.998931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:20.003698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:20.004070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:20.004575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:20.215512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:20.215976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:20.234941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:20.235451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:20.235902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:20.236627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:20.237091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:20.237546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:20.275304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:20.287005 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-450a0e9d-bf8f-4f94-badf-f16d5de0dc21 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.364381 Oct 29 20:51:20.288603 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 640/1260] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:19 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:20.324444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:20.325181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:20.333644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:20.334735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:20.335212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:20.337070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:20.337836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:20.338372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:20.367983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:20.370472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:20.384216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9cedf510-d345-4e5b-b464-94c32e906dcf tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1271 microversion: 2.1 time: 0.173136 Oct 29 20:51:20.389075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 621/1261] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:20 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:20.756805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:20.769871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6be9dd65-7f96-40c7-96f3-c0ff78fff74b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 0.451597 Oct 29 20:51:20.771716 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 641/1262] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:20 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:21.313652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:21.314287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:21.322606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:21.323097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:21.323745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:21.327340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:21.328299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:21.329064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:21.372186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-885c6f90-f421-4d42-9663-8070a1c4f840 req-940bbdba-37ac-4fbb-85dc-7bcbc42221dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17fc63e-a4d9-45ff-afff-b8d82e66114f", "name": "network-vif-plugged", "status": "completed", "tag": "d93ec6dd-9908-406f-b7db-942fadc1f241"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:21.419774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-885c6f90-f421-4d42-9663-8070a1c4f840 req-940bbdba-37ac-4fbb-85dc-7bcbc42221dd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:21.420263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-885c6f90-f421-4d42-9663-8070a1c4f840 req-940bbdba-37ac-4fbb-85dc-7bcbc42221dd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:21.420705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-885c6f90-f421-4d42-9663-8070a1c4f840 req-940bbdba-37ac-4fbb-85dc-7bcbc42221dd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:21.466279 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-885c6f90-f421-4d42-9663-8070a1c4f840 req-940bbdba-37ac-4fbb-85dc-7bcbc42221dd service nova] Creating event network-vif-plugged:d93ec6dd-9908-406f-b7db-942fadc1f241 for instance c17fc63e-a4d9-45ff-afff-b8d82e66114f on nch2-master-1 Oct 29 20:51:21.477996 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-885c6f90-f421-4d42-9663-8070a1c4f840 req-940bbdba-37ac-4fbb-85dc-7bcbc42221dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120407 Oct 29 20:51:21.479559 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 642/1263] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:21.509786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:21.513149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:21.522812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:21.524595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:21.525320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:21.526478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:21.527418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:21.529444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:21.984627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:21.998586 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-382b8ebc-e867-471f-9b71-4f618490c2f6 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.686493 Oct 29 20:51:21.999125 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 622/1264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:21 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:22.011185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:22.014513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:22.015505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:22.026786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d946c80d-2107-4ec8-88a5-117e4de8c25d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 0.544070 Oct 29 20:51:22.037212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:22.037984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:22.042228 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 643/1265] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:21 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:22.043280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:22.044107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:22.045189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:22.045633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:22.522669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Calling method '.version_select at 0x7fa17172bca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:22.538078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:22.540661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:22.541370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:22.544733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:22.546237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:22.546943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:22.594626 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-176af848-413f-43fe-ade2-e31566179010 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.369426 Oct 29 20:51:22.596781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 644/1266] 10.222.0.36 () {58 vars in 1128 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:51:22.665027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:22.673181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca014697-b5d7-4aec-9631-5b3f1b53c9f9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1321 microversion: 2.1 time: 0.671582 Oct 29 20:51:22.673803 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 623/1267] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:22.854089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1fe8c10-f547-426b-b6d6-05486d58df86 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Calling method '.version_select at 0x7fa171609670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:22.858048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1fe8c10-f547-426b-b6d6-05486d58df86 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '66e9e2108a764bfdab8506708a6dd521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b5c123f67d4b35a596dd8fcf1a2d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1fe8c10-f547-426b-b6d6-05486d58df86 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Request method failure captured: Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJJkg34MAFNisJ2LidfAUV3Kgbgy7JVYuwo-38tFt6OqFO-Limufn1dMvf8DmhecHlWmbto8JjvJhxCvdX5LyhV70M8b1O9n-QcgYdelnEqgbF752A_2NJ3VB34azXkhX5L73niwH_j3Y9R15a0r9najZZunswDh4-W_3q25Iprw54 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 66e9e2108a764bfdab8506708a6dd521 Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: action_args: {} Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:22.870392 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 20:51:22.877063 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.880092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1fe8c10-f547-426b-b6d6-05486d58df86 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:22.884945 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1fe8c10-f547-426b-b6d6-05486d58df86 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.276787 Oct 29 20:51:22.892459 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 645/1268] 10.222.0.36 () {58 vars in 1128 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 288 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:22.896909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8498e0f-27da-4a77-be14-ea2fc3a5e29e tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Calling method '.version_select at 0x7fa17166a9d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:22.899493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8498e0f-27da-4a77-be14-ea2fc3a5e29e tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '66e9e2108a764bfdab8506708a6dd521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b5c123f67d4b35a596dd8fcf1a2d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8498e0f-27da-4a77-be14-ea2fc3a5e29e tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Request method failure captured: Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJJkg34MAFNisJ2LidfAUV3Kgbgy7JVYuwo-38tFt6OqFO-Limufn1dMvf8DmhecHlWmbto8JjvJhxCvdX5LyhV70M8b1O9n-QcgYdelnEqgbF752A_2NJ3VB34azXkhX5L73niwH_j3Y9R15a0r9najZZunswDh4-W_3q25Iprw54 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 66e9e2108a764bfdab8506708a6dd521 Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ncdv-master-1'} Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.903060 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.909524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8498e0f-27da-4a77-be14-ea2fc3a5e29e tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:22.911541 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8498e0f-27da-4a77-be14-ea2fc3a5e29e tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016503 Oct 29 20:51:22.912223 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 624/1269] 10.222.0.36 () {58 vars in 1191 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:51:22.923609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7945e1c2-cbb0-4c91-a166-4314ce09a87a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Calling method '.version_select at 0x7fa1716620d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:22.936115 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7945e1c2-cbb0-4c91-a166-4314ce09a87a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7945e1c2-cbb0-4c91-a166-4314ce09a87a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'nonexistent_hostname'} Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.938366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7945e1c2-cbb0-4c91-a166-4314ce09a87a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:22.944570 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7945e1c2-cbb0-4c91-a166-4314ce09a87a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.025411 Oct 29 20:51:22.954154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5faa2a40-9745-4898-9011-0ca22fb4c1ad tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Calling method '.version_select at 0x7fa1716cadc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:22.956539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5faa2a40-9745-4898-9011-0ca22fb4c1ad tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '66e9e2108a764bfdab8506708a6dd521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b5c123f67d4b35a596dd8fcf1a2d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5faa2a40-9745-4898-9011-0ca22fb4c1ad tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Request method failure captured: Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJJkg34MAFNisJ2LidfAUV3Kgbgy7JVYuwo-38tFt6OqFO-Limufn1dMvf8DmhecHlWmbto8JjvJhxCvdX5LyhV70M8b1O9n-QcgYdelnEqgbF752A_2NJ3VB34azXkhX5L73niwH_j3Y9R15a0r9najZZunswDh4-W_3q25Iprw54 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 66e9e2108a764bfdab8506708a6dd521 Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ncdv-master-1'} Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.958347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:22.963013 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:22.963013 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:22.963013 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:51:22.963013 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:51:22.963013 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 20:51:22.963013 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:22.964721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5faa2a40-9745-4898-9011-0ca22fb4c1ad tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:22.965230 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 646/1270] 10.222.0.36 () {58 vars in 1212 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:22.966306 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5faa2a40-9745-4898-9011-0ca22fb4c1ad tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.016322 Oct 29 20:51:22.989046 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 625/1271] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:22.994477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93e6cd82-36a5-4eb0-aca2-8000f56f1047 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Calling method '.version_select at 0x7fa172295ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.005213 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-93e6cd82-36a5-4eb0-aca2-8000f56f1047 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93e6cd82-36a5-4eb0-aca2-8000f56f1047 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'nonexistent_hostname'} Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.009289 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.014148 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.035747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.036894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93e6cd82-36a5-4eb0-aca2-8000f56f1047 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.038798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:23.039723 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93e6cd82-36a5-4eb0-aca2-8000f56f1047 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.066575 Oct 29 20:51:23.047035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 647/1272] 10.222.0.36 () {58 vars in 1191 bytes} [Sat Oct 29 20:51:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:23.058768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.060006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.060506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.060942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.061688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.062158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.062568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.066093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:23.077233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.077835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.078293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.081286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.081788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.082226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.427288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:23.441724 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e38224ae-a288-4e17-bb73-eeb1d676e9eb tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.423957 Oct 29 20:51:23.445223 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 626/1273] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:23.453253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb7f818b-9201-46d2-b774-0e4817a67597 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Calling method '.version_select at 0x7fa17166e9d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.456086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb7f818b-9201-46d2-b774-0e4817a67597 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '66e9e2108a764bfdab8506708a6dd521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b5c123f67d4b35a596dd8fcf1a2d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb7f818b-9201-46d2-b774-0e4817a67597 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Request method failure captured: Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJJkg34MAFNisJ2LidfAUV3Kgbgy7JVYuwo-38tFt6OqFO-Limufn1dMvf8DmhecHlWmbto8JjvJhxCvdX5LyhV70M8b1O9n-QcgYdelnEqgbF752A_2NJ3VB34azXkhX5L73niwH_j3Y9R15a0r9najZZunswDh4-W_3q25Iprw54 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 66e9e2108a764bfdab8506708a6dd521 Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ncdv-master-1'} Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.459169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.465720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.465720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.465720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:51:23.465720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:51:23.465720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 20:51:23.465720 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.468807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb7f818b-9201-46d2-b774-0e4817a67597 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.470318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb7f818b-9201-46d2-b774-0e4817a67597 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.022619 Oct 29 20:51:23.476182 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 627/1274] 10.222.0.36 () {58 vars in 1197 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:23.477127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:23.492199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5575f5c0-ca4a-498b-a3b9-3182ecf6836d tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Calling method '.version_select at 0x7fa1716b2b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.493212 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-77a837c9-ea25-4361-a658-3b6a61dd2c34 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 0.439461 Oct 29 20:51:23.493945 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 648/1275] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:23.504296 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5575f5c0-ca4a-498b-a3b9-3182ecf6836d tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5575f5c0-ca4a-498b-a3b9-3182ecf6836d tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'nonexistent_hostname'} Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.506177 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5575f5c0-ca4a-498b-a3b9-3182ecf6836d tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.512049 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5575f5c0-ca4a-498b-a3b9-3182ecf6836d tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027481 Oct 29 20:51:23.514644 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 628/1276] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:23.518107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d916ff6-789c-4cc3-b1cc-f5628272cac5 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Calling method '.version_select at 0x7fa171619ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.519903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1d916ff6-789c-4cc3-b1cc-f5628272cac5 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '66e9e2108a764bfdab8506708a6dd521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b5c123f67d4b35a596dd8fcf1a2d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:23.527450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-445ca673-739a-4838-9343-5f92917f2c92 req-2d8d6ee8-5b68-41ea-ac5c-dd0981ce4d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "name": "network-vif-plugged", "status": "completed", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d916ff6-789c-4cc3-b1cc-f5628272cac5 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Request method failure captured: Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJJkg34MAFNisJ2LidfAUV3Kgbgy7JVYuwo-38tFt6OqFO-Limufn1dMvf8DmhecHlWmbto8JjvJhxCvdX5LyhV70M8b1O9n-QcgYdelnEqgbF752A_2NJ3VB34azXkhX5L73niwH_j3Y9R15a0r9najZZunswDh4-W_3q25Iprw54 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 66e9e2108a764bfdab8506708a6dd521 Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ncdv-master-1'} Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.533840 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d916ff6-789c-4cc3-b1cc-f5628272cac5 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1d916ff6-789c-4cc3-b1cc-f5628272cac5 tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.021283 Oct 29 20:51:23.538775 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 649/1277] 10.222.0.36 () {58 vars in 1194 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:23.545308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c8209ce-e64f-4f9f-973e-9be323c02bc9 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Calling method '.version_select at 0x7fa171617040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.549570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:23.570148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-2c8209ce-e64f-4f9f-973e-9be323c02bc9 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.571498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-445ca673-739a-4838-9343-5f92917f2c92 req-2d8d6ee8-5b68-41ea-ac5c-dd0981ce4d8a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.572277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-445ca673-739a-4838-9343-5f92917f2c92 req-2d8d6ee8-5b68-41ea-ac5c-dd0981ce4d8a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c8209ce-e64f-4f9f-973e-9be323c02bc9 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'nonexistent_hostname'} Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.572467 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.576514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.577881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-445ca673-739a-4838-9343-5f92917f2c92 req-2d8d6ee8-5b68-41ea-ac5c-dd0981ce4d8a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.582020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c8209ce-e64f-4f9f-973e-9be323c02bc9 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.587981 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c8209ce-e64f-4f9f-973e-9be323c02bc9 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.041905 Oct 29 20:51:23.589303 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 650/1278] 10.222.0.36 () {58 vars in 1215 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:51:23.598625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b16081f6-92bb-40b5-8fee-a1350752d1ac tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Action: 'update', calling method: .version_select at 0x7fa171955e50>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b16081f6-92bb-40b5-8fee-a1350752d1ac tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 51 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: {"status": "enable", "maintenance_mode": "invalid"} Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance: Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:51:23.612357 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.618543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.619695 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-445ca673-739a-4838-9343-5f92917f2c92 req-2d8d6ee8-5b68-41ea-ac5c-dd0981ce4d8a service nova] Creating event network-vif-plugged:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:51:23.619794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b16081f6-92bb-40b5-8fee-a1350752d1ac tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.625631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b16081f6-92bb-40b5-8fee-a1350752d1ac tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.025955 Oct 29 20:51:23.625631 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 651/1279] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:51:23 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:51:23.630353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98eeb1dd-690d-44ee-b61b-3ac3380b643a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Action: 'update', calling method: .version_select at 0x7fa171617310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:23.637647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-445ca673-739a-4838-9343-5f92917f2c92 req-2d8d6ee8-5b68-41ea-ac5c-dd0981ce4d8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114478 Oct 29 20:51:23.638268 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 629/1280] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98eeb1dd-690d-44ee-b61b-3ac3380b643a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 51 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: {"status": "invalid", "maintenance_mode": "enable"} Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance: Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:51:23.641822 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 20:51:23.646079 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.648663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98eeb1dd-690d-44ee-b61b-3ac3380b643a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.649840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-98eeb1dd-690d-44ee-b61b-3ac3380b643a tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.023179 Oct 29 20:51:23.650995 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 652/1281] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:51:23 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:51:23.662060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e77020c-77d2-4902-8205-5f0a1c34355b tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Action: 'update', calling method: .version_select at 0x7fa171e69550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:23.673059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5e77020c-77d2-4902-8205-5f0a1c34355b tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '66e9e2108a764bfdab8506708a6dd521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b5c123f67d4b35a596dd8fcf1a2d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e77020c-77d2-4902-8205-5f0a1c34355b tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Request method failure captured: Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 50 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJJkg34MAFNisJ2LidfAUV3Kgbgy7JVYuwo-38tFt6OqFO-Limufn1dMvf8DmhecHlWmbto8JjvJhxCvdX5LyhV70M8b1O9n-QcgYdelnEqgbF752A_2NJ3VB34azXkhX5L73niwH_j3Y9R15a0r9najZZunswDh4-W_3q25Iprw54 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a3b5c123f67d4b35a596dd8fcf1a2d46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a3b5c123f67d4b35a596dd8fcf1a2d46 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-318623674 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 66e9e2108a764bfdab8506708a6dd521 Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-318623674-project Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 20:51:23.687422 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.693091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e77020c-77d2-4902-8205-5f0a1c34355b tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.693933 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e77020c-77d2-4902-8205-5f0a1c34355b tempest-HostsAdminNegativeTestJSON-318623674 tempest-HostsAdminNegativeTestJSON-318623674-project] 10.222.0.36 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.036903 Oct 29 20:51:23.696558 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 630/1282] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:51:23 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:23.703384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:23.704859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:23.720646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d016670-8f78-42d8-b58b-602f899ce604 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Action: 'update', calling method: .version_select at 0x7fa1716b2a60>, body: {"status": null, "maintenance_mode": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:23.733026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.735618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.739255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d016670-8f78-42d8-b58b-602f899ce604 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 42 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: {"status": null, "maintenance_mode": null} Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance: Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi None Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:51:23.740436 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 20:51:23.747778 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.751192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d016670-8f78-42d8-b58b-602f899ce604 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.751585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:23.752444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:23.753703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:23.755293 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d016670-8f78-42d8-b58b-602f899ce604 tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.045716 Oct 29 20:51:23.755997 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 631/1283] 10.222.0.36 () {60 vars in 1190 bytes} [Sat Oct 29 20:51:23 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:51:23.771244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53aa1ff0-a057-4f40-9bc5-412483281f4e tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Action: 'update', calling method: .version_select at 0x7fa1717d1f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:23.786752 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.hosts [None req-53aa1ff0-a057-4f40-9bc5-412483281f4e tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Enabling host nonexistent_hostname. Oct 29 20:51:23.808536 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-53aa1ff0-a057-4f40-9bc5-412483281f4e tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53aa1ff0-a057-4f40-9bc5-412483281f4e tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Request method failure captured: Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 50 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJK-L02NSUrfEKzL2Z9nBsU2QAAd0kfAighVlkK1JywTTe7krXAS69xiAKgYPegEOOjFTU8MC4I2ilSCxNzB_taCv40tqZoAq-1Rl96ch978SrtLd8whlPl7HwF78OSo9fxFOuXeyxUmTMrnBK_BrNpMDDLm-xbIGNXCCCnjna6RhU Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca3e589e8eb14cd7b3f084eb860623f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ca3e589e8eb14cd7b3f084eb860623f6 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1297526903 Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d2eb3cbce5204c1285448296274649ec Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1297526903-project-admin Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.810795 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:23.815957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53aa1ff0-a057-4f40-9bc5-412483281f4e tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:23.819248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53aa1ff0-a057-4f40-9bc5-412483281f4e tempest-HostsAdminNegativeTestJSON-1297526903 tempest-HostsAdminNegativeTestJSON-1297526903-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.053766 Oct 29 20:51:23.819248 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 632/1284] 10.222.0.36 () {60 vars in 1211 bytes} [Sat Oct 29 20:51:23 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:24.088091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:24.107792 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37e001bf-4d52-4923-8e84-a8abcf03f5ec tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1471 microversion: 2.1 time: 0.408460 Oct 29 20:51:24.108908 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 653/1285] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:23 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:24.382144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ac7c2e-645f-4e72-a6cf-b104957bf9b6 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:24.382868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55ac7c2e-645f-4e72-a6cf-b104957bf9b6 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] [instance: 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:24.395594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-55ac7c2e-645f-4e72-a6cf-b104957bf9b6 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] HTTP exception thrown: Instance 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61 could not be found. Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ac7c2e-645f-4e72-a6cf-b104957bf9b6 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Request method failure captured: Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/94ed1a06-cb3e-4330-a2e9-c5cf06b16a61/action HTTP/1.1 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 15 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIyHhnjnnTmm41q94qg-po-6CEsC4bESo5j1hFW6Sa7bVrTFOUIO5HwNOmD3CvxneUgGbcqStvidWc01NeWgnqtsm5mK09o2_1trs7ROZfRDwromvoHUO0nvxY7dz4on8K3vVg2YaHE3w6NpHIIvfScxoZR4CUUuv5PJtWpK15G1zI Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b6c680dbd550440aa9548f1b4ffee6dc Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: {"migrate": {}} Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61 could not be found. Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '94ed1a06-cb3e-4330-a2e9-c5cf06b16a61', 'body': {'migrate': {}}} Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61 could not be found. Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61 could not be found. Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:24.406310 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:24.410671 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:24.410671 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:24.410671 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:24.410671 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:24.410671 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61 could not be found. Oct 29 20:51:24.410671 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:24.411057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ac7c2e-645f-4e72-a6cf-b104957bf9b6 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Returning 404 to user: Instance 94ed1a06-cb3e-4330-a2e9-c5cf06b16a61 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:24.412062 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55ac7c2e-645f-4e72-a6cf-b104957bf9b6 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/94ed1a06-cb3e-4330-a2e9-c5cf06b16a61/action" status: 404 len: 111 microversion: 2.1 time: 0.280917 Oct 29 20:51:24.423232 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 633/1286] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:51:24 2022] POST /compute/v2.1/servers/94ed1a06-cb3e-4330-a2e9-c5cf06b16a61/action => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:24.469521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:24.470530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:24.490252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:24.492520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:24.494073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:24.497632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:24.498119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:24.498562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:24.531736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:24.532353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:24.548452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:24.549242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:24.551107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:24.552034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:24.557368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:24.558215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:25.122091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:25.144227 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6cda59c8-d49d-4731-bd77-27fbf39a845b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 0.616557 Oct 29 20:51:25.148612 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 634/1287] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:24 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:25.165558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-308884969", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:25.249538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:51:25.376407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:25.387720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ef68f06-575b-48b0-aa65-4d2e63a6b4d8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1324 microversion: 2.1 time: 0.921974 Oct 29 20:51:25.390771 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 654/1288] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:24 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1324 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:25.676735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3d3dccaf-5c40-4656-bcb2-8b9d6cdb69e6 req-c46194e0-b68d-400c-82d1-02e1912cf13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:25.699327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3d3dccaf-5c40-4656-bcb2-8b9d6cdb69e6 req-c46194e0-b68d-400c-82d1-02e1912cf13c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:25.699819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3d3dccaf-5c40-4656-bcb2-8b9d6cdb69e6 req-c46194e0-b68d-400c-82d1-02e1912cf13c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:25.700259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3d3dccaf-5c40-4656-bcb2-8b9d6cdb69e6 req-c46194e0-b68d-400c-82d1-02e1912cf13c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:25.741325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3d3dccaf-5c40-4656-bcb2-8b9d6cdb69e6 req-c46194e0-b68d-400c-82d1-02e1912cf13c service nova] Creating event network-changed:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch2-master-1 Oct 29 20:51:25.751034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3d3dccaf-5c40-4656-bcb2-8b9d6cdb69e6 req-c46194e0-b68d-400c-82d1-02e1912cf13c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084026 Oct 29 20:51:25.752202 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 655/1289] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:26.167902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:26.178616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:26.180496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:26.218963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:26.219730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:26.221309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:26.229048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:26.230133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:26.231042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:26.540462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:51:26.541635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:51:26.542462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:51:26.543341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:51:26.543912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:51:26.563602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:26.566594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:26.569430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:26.575918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:26.576492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:26.579119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:26.627793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Getting quotas for project 674fcd08bc2c486aa00c64db594cabdd. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:26.645049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Getting quotas for user 531843035bb54ec9aabbe4cf1d240fbd and project 674fcd08bc2c486aa00c64db594cabdd. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:26.663271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:51:26.666615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:51:26.765575 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcd47c8c-02b8-4e08-9e92-9dbbca252862 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614045 Oct 29 20:51:26.767268 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 635/1290] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:51:26.778247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:26.779249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:26.790047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:26.792392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:26.793090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:26.794673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:26.795146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:26.800409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:26.845245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:26.854018 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a52b638-8e0d-4c6f-94e7-2bdfed500ef3 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 0.687167 Oct 29 20:51:26.854543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 656/1291] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:26 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:26.889552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6ba5cf4-c823-40fa-9a9d-a3ca1aefb37d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:26.890958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b6ba5cf4-c823-40fa-9a9d-a3ca1aefb37d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:27.055544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6ba5cf4-c823-40fa-9a9d-a3ca1aefb37d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:27.066566 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6ba5cf4-c823-40fa-9a9d-a3ca1aefb37d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1221 microversion: 2.1 time: 0.182961 Oct 29 20:51:27.072877 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 657/1292] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:26 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:27.283536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:27.295292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3255b7b-69ba-473f-9e62-edb428ce5efe tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1519 microversion: 2.1 time: 0.526804 Oct 29 20:51:27.296470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 636/1293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:26 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1519 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:27.321863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f096ee81-a4d1-4317-8b7e-aa749ea1284a tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'create', calling method: .version_select at 0x7fa171619790>, body: {"pool": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:27.879551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:27.880422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:27.889879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:27.890673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:27.891647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:27.892556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:27.893875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:27.894478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:28.484370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:28.498164 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32d2abbf-9a03-4dbe-a77e-0c46ecd07720 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 0.625773 Oct 29 20:51:28.500422 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 637/1294] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:27 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:28.513863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:28.515394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:28.532635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:28.534777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:28.536203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:28.538551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:28.539953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:28.540609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:29.519752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:29.535007 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ce29f34-aa9a-4b79-9533-5ac42671ad1d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1273 microversion: 2.1 time: 1.031654 Oct 29 20:51:29.549926 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 638/1295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:28 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1273 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:29.567461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:29.568374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:29.583638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:29.586908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:29.592609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:29.594403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:29.595864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:29.598479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:30.180557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:30.197832 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e60b7705-b155-4552-a1b3-d2a6d9b32e9c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 0.652889 Oct 29 20:51:30.216842 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 639/1296] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:29 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:30.564389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:30.565020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:30.579466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:30.580112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:30.583481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:30.584262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:30.584743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:30.585177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:31.035269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:31.045868 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7891af41-6151-46f3-a193-84f2504cab2e tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1279 microversion: 2.1 time: 0.485493 Oct 29 20:51:31.055395 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 640/1297] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:30 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1279 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:31.071085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-42f8af56-4781-4684-8318-e2e2b9c7a951 req-40fbb57b-5170-4841-be8e-602d35516e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "name": "network-vif-plugged", "status": "completed", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:31.093911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-42f8af56-4781-4684-8318-e2e2b9c7a951 req-40fbb57b-5170-4841-be8e-602d35516e1d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:31.094681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-42f8af56-4781-4684-8318-e2e2b9c7a951 req-40fbb57b-5170-4841-be8e-602d35516e1d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:31.097339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-42f8af56-4781-4684-8318-e2e2b9c7a951 req-40fbb57b-5170-4841-be8e-602d35516e1d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:31.126236 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-42f8af56-4781-4684-8318-e2e2b9c7a951 req-40fbb57b-5170-4841-be8e-602d35516e1d service nova] Creating event network-vif-plugged:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch2-master-1 Oct 29 20:51:31.151470 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-42f8af56-4781-4684-8318-e2e2b9c7a951 req-40fbb57b-5170-4841-be8e-602d35516e1d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091044 Oct 29 20:51:31.152176 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 641/1298] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:31.224857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:31.225810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:31.232941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:31.244594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:31.245040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:31.245838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:31.246623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:31.247059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:32.298442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:32.314526 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eef73163-316a-4efb-b760-3c3d099b061f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1313 microversion: 2.1 time: 1.092831 Oct 29 20:51:32.331323 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 642/1299] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:31 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1313 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:32.567034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:32.930301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Calling method '.version_select at 0x7fa1716a8dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:32.932445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:32.933122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:32.933928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:32.978628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:32.979347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:32.981411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.010418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.011258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.011943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.020518 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f292b3ef-9c98-43f9-a8ba-d19df01e2d82 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.686660 Oct 29 20:51:33.022024 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 643/1300] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 20:51:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:51:33.036604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:33.037667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:33.050375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.051074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.051913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.053158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.054018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.054798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.460906 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f096ee81-a4d1-4317-8b7e-aa749ea1284a tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.144680 Oct 29 20:51:33.462347 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 658/1301] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:51:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:33.476220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Calling method '.version_select at 0x7fa171955e50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:33.517373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.522856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.529502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.569026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.573374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.574206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.597674 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea89a17f-fd85-4163-8c12-c602d0e36953 tempest-HypervisorAdminV228Test-109650082 tempest-HypervisorAdminV228Test-109650082-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.132272 Oct 29 20:51:33.602737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 659/1302] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 20:51:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:51:33.636688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:33.642352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:33.669255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.675110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.681064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.686223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:33.690064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:33.698157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:33.704585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:34.454317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:34.463864 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3641d46f-cf5f-4b45-bd0c-6f20953452f8 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 1.440168 Oct 29 20:51:34.477480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 644/1303] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:33 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:34.477480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-83939330", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "c0f21c63-d525-4dc0-89e4-ec653151e278"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:34.544778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] validate_networks() for [('c0f21c63-d525-4dc0-89e4-ec653151e278', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:51:34.582542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:34.592646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e32c794-d246-4e21-a8e4-23bd2baa0a95 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1462 microversion: 2.1 time: 0.988405 Oct 29 20:51:34.593905 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 660/1304] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:33 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1462 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:34.615303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:34.615953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:34.628648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:34.629546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:34.630125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:34.631132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:34.631822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:34.632479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:35.142870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b89cca1-0430-40fb-bd4a-962c7f13ba00 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1613 microversion: 2.1 time: 0.531369 Oct 29 20:51:35.144577 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 661/1305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:34 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1613 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:35.189603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:35.190886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:35.198287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:35.199304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:35.199998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:35.205743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:35.206862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:35.207473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:35.254055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c2d52662206f426aa458635417493e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4716859cce98493db25853e5b5f08651', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:35.255222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] flavor_id is None. Assuming migration. {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 20:51:35.255903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 20:51:35.422589 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdeeb92e-4928-4ddd-ba46-e4c8e8a29a73 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4/action" status: 202 len: 0 microversion: 2.1 time: 0.257053 Oct 29 20:51:35.423174 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 662/1306] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:51:35 2022] POST /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:51:35.432824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:35.433759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:35.441296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:35.442196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:35.442894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:35.445062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:35.446382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:35.446923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:36.601713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:36.643914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:36.658710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:36.659218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bb8c35d6-e8cb-4fe2-a3e0-3ff287154af2 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1471 microversion: 2.1 time: 1.231151 Oct 29 20:51:36.660645 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 663/1307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:35 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1471 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:36.669171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:36.670320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:36.680294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:36.681206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:36.682257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:36.683198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:36.683898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:36.684703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:37.065120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:37.154923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:51:37.155403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:51:37.155884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:51:37.156970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:51:37.157449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:51:37.174880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:37.175656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:37.178640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:37.184165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:37.184877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:37.185510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:37.250190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:37.250432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Getting quotas for project da5abdc9b77f409dae205a3d7e3e913c. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:37.257114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Getting quotas for user 84799edfc2fd40b2ad004d9c080dde40 and project da5abdc9b77f409dae205a3d7e3e913c. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:37.259250 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d14ec215-ed8e-481d-9d0f-25f0def71657 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.596782 Oct 29 20:51:37.259840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 664/1308] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:36 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:37.290642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:51:37.293476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:51:37.355573 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bfc17a1c-3319-4f7e-8ab4-c346006f18d2 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.889343 Oct 29 20:51:37.357631 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 645/1309] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:51:37.368182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68d0e09f-bd72-4653-aab4-924ce982c11d tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:37.369204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68d0e09f-bd72-4653-aab4-924ce982c11d tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:37.606782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68d0e09f-bd72-4653-aab4-924ce982c11d tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:37.619187 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68d0e09f-bd72-4653-aab4-924ce982c11d tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1222 microversion: 2.1 time: 0.254540 Oct 29 20:51:37.619441 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 665/1310] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:37 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:37.688872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:37.689687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:37.701684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:37.708045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:37.712743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:37.713476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:37.714749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:37.723886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:37.724370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:38.173700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-bb14bab5-0bb6-4ee3-a465-89e208709793 req-1df0f4a8-a94a-4806-bac9-65c117ddc154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c238626-ddf8-4cb1-9ae4-ea89be023b72", "tag": "d56f2b2e-6606-498c-8694-cc170ee581d5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:38.203543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bb14bab5-0bb6-4ee3-a465-89e208709793 req-1df0f4a8-a94a-4806-bac9-65c117ddc154 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:38.204060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bb14bab5-0bb6-4ee3-a465-89e208709793 req-1df0f4a8-a94a-4806-bac9-65c117ddc154 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:38.204508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bb14bab5-0bb6-4ee3-a465-89e208709793 req-1df0f4a8-a94a-4806-bac9-65c117ddc154 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:38.280032 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-bb14bab5-0bb6-4ee3-a465-89e208709793 req-1df0f4a8-a94a-4806-bac9-65c117ddc154 service nova] Creating event network-changed:d56f2b2e-6606-498c-8694-cc170ee581d5 for instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 on nch1-master-1 Oct 29 20:51:38.296816 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-bb14bab5-0bb6-4ee3-a465-89e208709793 req-1df0f4a8-a94a-4806-bac9-65c117ddc154 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127845 Oct 29 20:51:38.297738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 666/1311] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:51:38.308034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:38.314196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:38.327905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:38.331917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:38.332378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:38.334768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:38.335272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:38.335709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:38.696987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:38.708150 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8f7cffa-8848-418d-b4fe-ecdb8bb6f22c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1471 microversion: 2.1 time: 1.023690 Oct 29 20:51:38.727348 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 646/1312] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:37 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1471 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:38.759482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:38.760515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:38.779839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:38.780532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:38.780989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:38.781759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:38.785736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:38.786524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:38.988111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:39.007060 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87764986-1811-463f-b9df-74a2585abbcf tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1274 microversion: 2.1 time: 0.278462 Oct 29 20:51:39.007692 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 647/1313] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:38 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:39.630709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:39.641787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4e72dbc-6bba-4a00-969b-598e65247165 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 1.340378 Oct 29 20:51:39.654090 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 667/1314] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:38 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:39.746622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:39.748133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:39.755731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:39.757046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:39.758272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:39.759334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:39.760141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:39.760752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:40.034248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:40.035270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:40.042158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:40.043247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:40.045511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:40.046513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:40.050014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:40.050725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:40.290937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:40.312763 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55c3a8be-6954-4275-b1c5-20a8b4a63103 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1280 microversion: 2.1 time: 0.280040 Oct 29 20:51:40.316395 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 668/1315] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:40 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:40.597098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:40.621029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-390d9b73-bfef-40d0-a817-26b750544470 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1471 microversion: 2.1 time: 0.881989 Oct 29 20:51:40.638349 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 648/1316] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:39 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1471 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:40.672640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:40.674210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:40.693222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:40.693746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:40.694419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:40.695417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:40.696042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:40.696657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:41.109785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:41.118785 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aaf787d9-77e1-45b0-b54e-8ac33cd5c360 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.451597 Oct 29 20:51:41.119649 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 669/1317] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:40 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:41.341982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:41.343223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:41.350524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:41.351253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:41.352455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:41.353355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:41.354004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:41.354602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:41.359144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:41.644619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:41.645854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:41.660991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:41.661860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:41.662537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:41.664262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:41.665872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:41.669356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:42.244361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:42.255494 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-143fc212-94f1-4fc9-a972-2eedce55c908 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 0.917297 Oct 29 20:51:42.256425 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 649/1318] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:41 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:42.271382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:42.272344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:42.284802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:42.285702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:42.286405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:42.287466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:42.288193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:42.288865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:42.910437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:42.963644 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e29f4fe5-8684-4df2-9287-1e035ec6d08f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 1.322638 Oct 29 20:51:42.983089 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 670/1319] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:41 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:43.293415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:43.294910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:43.295904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:43.310748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:43.311754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:43.312519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:43.312820 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02f83993-fe15-4f74-9060-b2da88891e0b tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 1.052310 Oct 29 20:51:43.313775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 650/1320] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:42 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:43.326414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:43.334197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:43.335234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:43.540707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c6642d2e-90ba-4eb7-a340-fd2f8fba2f45 req-8610e9da-83bf-4b9a-87c9-3380dc52464c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc17887b-64ba-4ef8-939e-1fedc1f62bbe", "tag": "a0644f39-124b-4732-ad57-fe231fbd7267"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:43.559878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c6642d2e-90ba-4eb7-a340-fd2f8fba2f45 req-8610e9da-83bf-4b9a-87c9-3380dc52464c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:43.560363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c6642d2e-90ba-4eb7-a340-fd2f8fba2f45 req-8610e9da-83bf-4b9a-87c9-3380dc52464c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:43.561042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c6642d2e-90ba-4eb7-a340-fd2f8fba2f45 req-8610e9da-83bf-4b9a-87c9-3380dc52464c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:43.587539 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c6642d2e-90ba-4eb7-a340-fd2f8fba2f45 req-8610e9da-83bf-4b9a-87c9-3380dc52464c service nova] Creating event network-changed:a0644f39-124b-4732-ad57-fe231fbd7267 for instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe on nch2-master-1 Oct 29 20:51:43.604465 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c6642d2e-90ba-4eb7-a340-fd2f8fba2f45 req-8610e9da-83bf-4b9a-87c9-3380dc52464c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060996 Oct 29 20:51:43.606059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 651/1321] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:43.731343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:43.743840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-191709f9-fc5b-4105-8786-5ea85f186df5 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 0.467716 Oct 29 20:51:43.747890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 671/1322] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:43 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:43.995477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:43.996486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:44.012000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:44.018283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:44.018887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:44.023931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:44.024573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:44.025177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:44.143342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:44.144130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:44.161305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:44.161938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:44.162483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:44.164529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:44.165264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:44.165830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:45.318156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:45.340708 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5c74a721-cd71-4eef-aba9-d1e2375d81da tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1815 microversion: 2.1 time: 1.203126 Oct 29 20:51:45.343250 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ffbfbee-9aaa-45ec-bdf3-f6cc2d782a99 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 1.347483 Oct 29 20:51:45.359293 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 652/1323] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:43 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:45.392241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 672/1324] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:44 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1815 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:45.401892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:45.408656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:45.409778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:45.412393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:45.425701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:45.426201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:45.426644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:45.435461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:45.436025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:45.436485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:45.437277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:45.438430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:45.438985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:45.439481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:45.444750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:45.445326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:46.748433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:46.757030 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-07a00454-84cc-4aae-93b9-2b1461607c67 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 1.396255 Oct 29 20:51:46.758872 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 653/1325] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:45 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:46.766750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:46.780263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:46.781799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:46.783366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:46.784239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:46.784691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:46.785119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:46.808869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:46.828801 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-af677600-4df0-4358-baa3-ae781e984b39 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 1.435064 Oct 29 20:51:46.847322 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 673/1326] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:45 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:46.853166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:46.857684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:46.883023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:46.883442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:46.883903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:46.884658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:46.885111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:46.889100 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e525d91-96e4-473b-8407-cebbd1ffe578 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.128509 Oct 29 20:51:46.900696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:46.900925 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 654/1327] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:51:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:47.616607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:47.785314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:47.785951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:47.795499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:47.799389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:47.800435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:47.801217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:47.802297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:47.802964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:47.805437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:48.184059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:48.197805 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-02c289aa-a835-4b75-98b1-d4a676bb3ba7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 1.347576 Oct 29 20:51:48.214887 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 674/1328] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:46 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:48.220148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:48.220819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:48.228695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:48.229195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:48.229732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:48.230897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:48.231770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:48.232372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:48.331612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:48.342785 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e84e0b11-df99-432b-b1ec-632b8da4ed9c tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.561593 Oct 29 20:51:48.362392 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 655/1329] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:47 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:48.656249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:48.665029 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd9292d0-9318-4fcb-b4ae-bc19ae3af174 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 0.448874 Oct 29 20:51:48.677548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 675/1330] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:48 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:48.942265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc75a1bd-8bf7-49a6-adb1-547033153d04", "device": "/dev/xvdb"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:48.946219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:48.967903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:48.968839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:48.969438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:48.972791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:48.973445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:48.974064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:49.509989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d23a8dbf-e8c0-4abe-80a5-709abf7afe31 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Calling method '.version_select at 0x7fa171955b80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:49.607427 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "POST /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669505 Oct 29 20:51:49.617167 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 656/1331] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 20:51:48 2022] POST /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:49.642533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:49.647164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:49.669752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:49.670257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:49.674434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:49.675672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d23a8dbf-e8c0-4abe-80a5-709abf7afe31 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.548498 Oct 29 20:51:49.676405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:49.678887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:49.682168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:49.687762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 676/1332] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:51:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:51:49.693092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:49.694763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:49.716213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:49.719343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:49.720249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:49.721289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:49.723094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:49.724275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:50.246923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:50.253124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:50.266769 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d37d4e2-b7f0-4f4b-b5b6-7522096020d6 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.575372 Oct 29 20:51:50.270118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 677/1333] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:49 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:50.285068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:50.287955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:50.310929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:50.314895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:50.317079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:50.320045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:50.323163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:50.325625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:50.501025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:50.518756 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7364cbde-21c2-48a5-a33e-552fae4da59a tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 0.897426 Oct 29 20:51:50.519369 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 657/1334] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:49 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:50.530068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-184e31c0-5ef7-42a2-b01d-a58d50cbc492 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Action: 'create', calling method: .version_select at 0x7fa17166e430>, body: {"pool": "non_exist_pool"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:50.730098 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-184e31c0-5ef7-42a2-b01d-a58d50cbc492 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] HTTP exception thrown: Floating IP pool not found. Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-184e31c0-5ef7-42a2-b01d-a58d50cbc492 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Request method failure captured: Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 26 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJkDL7x27SSMC7up1OhtT2OyVCP0SfmZdoCVwNtFDGQ7zfeXmkRLEsT-dcl5X2DX-WmCC228nLGgO_3_-KWgiw_JkoxU91YGNYJ7I1cNjQ3t4Gy1Gr0qXMqDZ-Z6rEc_9yKLEto-sIu5_8lq7DXM7gT5UcV2AJ_iPDw_R6rlNGajLc Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 2b6befbae4bc4ddaa85e25e5d221a187 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1610567712 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1610567712 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 2b6befbae4bc4ddaa85e25e5d221a187 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1610567712 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsNegativeTestJSON-1610567712-project Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4cafc3e8e54c4eb69f508b2cb7d33e58 Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1610567712-project Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: {"pool": "non_exist_pool"} Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: exception: Floating IP pool not found. Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:50.735442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:50.740888 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 29 20:51:50.740888 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:50.743429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-184e31c0-5ef7-42a2-b01d-a58d50cbc492 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Returning 404 to user: Floating IP pool not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:50.745053 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-184e31c0-5ef7-42a2-b01d-a58d50cbc492 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.224545 Oct 29 20:51:50.747471 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 658/1335] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:51:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:51:50.764058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe3fe108-c90d-4e1d-a92b-52e74a2bf0c3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Action: 'create', calling method: .version_select at 0x7fa1718daf70>, body: {"keypair": {"name": "tempest-keypair-45205272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL15seYv6lGBfP9e21BBmdcpaTQakqtEa1ywsY+ooXGOC+yKZ4Jo7rHMTnNcyZBAKFnm4Pj3+k6ttXKvtYzsPJ3PzLYeHOM2WkZ+ln/Vdbursiyiq4vyYws6qqgaHXoq+g=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:50.831656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-fe3fe108-c90d-4e1d-a92b-52e74a2bf0c3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Getting quotas for project 7ddac3a85fca49df9c83c7863e9d3ac3. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:50.848136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-fe3fe108-c90d-4e1d-a92b-52e74a2bf0c3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Getting quotas for user 47e571be08a14d40951a503df48a7c3d and project 7ddac3a85fca49df9c83c7863e9d3ac3. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:50.905507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe3fe108-c90d-4e1d-a92b-52e74a2bf0c3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.152241 Oct 29 20:51:50.906444 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 659/1336] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 20:51:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 20:51:50.912127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f490e497-e469-455a-9465-c6fc2c766e43 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Calling method '.version_select at 0x7fa17166e550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:51.100542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-f490e497-e469-455a-9465-c6fc2c766e43 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 95fd7704-55a8-4e42-846f-e1395e5d3312 could not be found", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:51:51.102062 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f490e497-e469-455a-9465-c6fc2c766e43 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] HTTP exception thrown: Floating IP not found for ID 95fd7704-55a8-4e42-846f-e1395e5d3312 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f490e497-e469-455a-9465-c6fc2c766e43 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Request method failure captured: Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-floating-ips/95fd7704-55a8-4e42-846f-e1395e5d3312 HTTP/1.1 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJkDL7x27SSMC7up1OhtT2OyVCP0SfmZdoCVwNtFDGQ7zfeXmkRLEsT-dcl5X2DX-WmCC228nLGgO_3_-KWgiw_JkoxU91YGNYJ7I1cNjQ3t4Gy1Gr0qXMqDZ-Z6rEc_9yKLEto-sIu5_8lq7DXM7gT5UcV2AJ_iPDw_R6rlNGajLc Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 2b6befbae4bc4ddaa85e25e5d221a187 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1610567712 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2b6befbae4bc4ddaa85e25e5d221a187"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1610567712 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 2b6befbae4bc4ddaa85e25e5d221a187 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1610567712 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsNegativeTestJSON-1610567712-project Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4cafc3e8e54c4eb69f508b2cb7d33e58 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1610567712-project Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: exception: Floating IP not found for ID 95fd7704-55a8-4e42-846f-e1395e5d3312 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '95fd7704-55a8-4e42-846f-e1395e5d3312'} Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 95fd7704-55a8-4e42-846f-e1395e5d3312 could not be found Oct 29 20:51:51.105145 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e03458a3-8ac3-47fd-a957-b54de98e236c'] Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 95fd7704-55a8-4e42-846f-e1395e5d3312. Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 95fd7704-55a8-4e42-846f-e1395e5d3312 Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 95fd7704-55a8-4e42-846f-e1395e5d3312 Oct 29 20:51:51.109999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:51:51.113834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f490e497-e469-455a-9465-c6fc2c766e43 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] Returning 404 to user: Floating IP not found for ID 95fd7704-55a8-4e42-846f-e1395e5d3312 {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:51:51.114949 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f490e497-e469-455a-9465-c6fc2c766e43 tempest-FloatingIPsNegativeTestJSON-1610567712 tempest-FloatingIPsNegativeTestJSON-1610567712-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/95fd7704-55a8-4e42-846f-e1395e5d3312" status: 404 len: 111 microversion: 2.1 time: 0.206954 Oct 29 20:51:51.115838 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 660/1337] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:51:50 2022] DELETE /compute/v2.1/os-floating-ips/95fd7704-55a8-4e42-846f-e1395e5d3312 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:51:51.296851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:51.297968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:51.324029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:51.325826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:51.327256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:51.329173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:51.331630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:51.332522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:51.725527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:51.739844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d846eec0-a741-423d-a332-7eeef5641126 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 1.466446 Oct 29 20:51:51.740910 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 678/1338] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:50 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:51.757976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:51.759354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:51.766366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:51.777884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:51.779391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:51.780493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:51.781119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:51.781744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:52.259682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:52.269106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:52.298407 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-82d5bbb2-ea7c-48a4-9f5c-1bda2979a782 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 0.552931 Oct 29 20:51:52.298811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7165a44b-a219-41e1-bd26-d5deea9b70ed tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 1.009735 Oct 29 20:51:52.300990 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 679/1340] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:51 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:52.301224 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 661/1340] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:51 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:51:52.765268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:52.765940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:52.787599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:52.788388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:52.789042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:52.790015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:52.790644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:52.791278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:53.281920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:53.297010 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d0244c6-913b-4994-a602-a77f0c948356 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 0.536711 Oct 29 20:51:53.299921 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 680/1341] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:52 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:53.322757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:53.323675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:53.326947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:53.327984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:53.336469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:53.338522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:53.339981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:53.343312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:53.344765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:53.346081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:53.346689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:53.348614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:53.349338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:53.350950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:53.353189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:53.354103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:53.834677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:53.855709 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ae1e763-51e3-4b59-97f7-b586f20ab4a9 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.536838 Oct 29 20:51:53.861504 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 681/1342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:53 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:53.861693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:53.870988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7479bee1-371d-4cfc-984f-6f466a7e007b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 0.552214 Oct 29 20:51:53.871560 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 662/1343] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:53 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:54.092696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d31b12b5-6f9d-4f4a-8f4e-87c994e5e340 req-99227c47-038c-4dd2-ae60-04e59e0262ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc17887b-64ba-4ef8-939e-1fedc1f62bbe", "name": "network-vif-plugged", "status": "completed", "tag": "a0644f39-124b-4732-ad57-fe231fbd7267"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:54.111060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=61 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:51:54.118000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d31b12b5-6f9d-4f4a-8f4e-87c994e5e340 req-99227c47-038c-4dd2-ae60-04e59e0262ed service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:54.120965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d31b12b5-6f9d-4f4a-8f4e-87c994e5e340 req-99227c47-038c-4dd2-ae60-04e59e0262ed service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:54.122663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d31b12b5-6f9d-4f4a-8f4e-87c994e5e340 req-99227c47-038c-4dd2-ae60-04e59e0262ed service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:54.159637 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d31b12b5-6f9d-4f4a-8f4e-87c994e5e340 req-99227c47-038c-4dd2-ae60-04e59e0262ed service nova] Creating event network-vif-plugged:a0644f39-124b-4732-ad57-fe231fbd7267 for instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe on nch2-master-1 Oct 29 20:51:54.178071 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d31b12b5-6f9d-4f4a-8f4e-87c994e5e340 req-99227c47-038c-4dd2-ae60-04e59e0262ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102237 Oct 29 20:51:54.181800 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 682/1344] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:51:54.322393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:54.324220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:54.341253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:54.347735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:54.372192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:54.386789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:54.387455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:54.388132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:54.572228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ccc077e2-ce7a-4d4a-b280-af034238d5dc tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Action: 'create', calling method: .version_select at 0x7fa17187a310>, body: {"keypair": {"name": "tempest-keypair-1143922817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiyfczXpbmAO8+B9FPlmlzslX8e1DdA/5AdgTnUXuKZqZL0gT0KY8hmiXmLeYoH/Ejwj/D0BLiy/8AqZUnoLqN6aWkqvhvlCrWspU4DGQ4VBZhafqClhAsAvmaTAEBB6A=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:54.621521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-ccc077e2-ce7a-4d4a-b280-af034238d5dc tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Getting quotas for project 05d859f9584140aca702ebc0cd656cab. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:51:54.635394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-ccc077e2-ce7a-4d4a-b280-af034238d5dc tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Getting quotas for user 76bb8b2a3e654f4ea4b4543df0b9cf6a and project 05d859f9584140aca702ebc0cd656cab. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:51:54.692177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ccc077e2-ce7a-4d4a-b280-af034238d5dc tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.416828 Oct 29 20:51:54.693751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 663/1345] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:51:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:51:54.699822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:54.700753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:54.708366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:54.709093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:54.709797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:54.711351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:54.711973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:54.712562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:54.948118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:54.956968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3b33ef0-132a-48d9-89fe-d5e155fcdd06 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1322 microversion: 2.1 time: 0.640277 Oct 29 20:51:54.972898 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 683/1346] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:54 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:54.983509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:54.985137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:54.994710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:54.995807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:54.997014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:54.999326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:55.001044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:55.001713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:55.150247 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d9ded658-e809-4f95-b5df-eaac3f72d2c2 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1861 microversion: 2.1 time: 0.454992 Oct 29 20:51:55.151570 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 664/1347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:54 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1861 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:55.156717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:51:55.157692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:55.167335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:55.176059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:55.176777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:55.179341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:55.180174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:55.180880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:55.349259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:55.361931 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-818fca8f-aaa1-497c-a312-c1beb2d74483 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.387370 Oct 29 20:51:55.363261 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 684/1348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:54 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:55.374864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:55.378909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:51:55.391687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:55.392921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:55.394503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:55.395891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:51:55.397267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:51:55.399432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:51:55.447200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lazy-loading 'flavor' on Instance uuid f5fa038d-5a82-452d-bde6-eaa0b790d7cc {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:51:55.496967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Going to try to live migrate instance to nch1-master-1 {{(pid=138885) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:51:55.771907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:51:55.784208 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a75f2f34-4dad-4415-9481-c6457c51b51e tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1476 microversion: 2.1 time: 0.631120 Oct 29 20:51:55.786866 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 665/1349] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:51:55 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1476 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:51:55.830378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1238981727", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ab420d7d-a998-49f0-b164-eadc36601153"}, {"port": "d69628a0-7168-4d48-8d30-4c1874e6521f", "tag": "port-1"}, {"port": "49ec4cbb-94ed-4be0-9d76-f85aebad0a87", "tag": "port-2"}, {"uuid": "d89c330d-feb9-46b2-bb80-eb317eb08ac4", "tag": "net-1"}, {"uuid": "d89c330d-feb9-46b2-bb80-eb317eb08ac4"}, {"uuid": "fe71a1d7-df24-4b3d-a26b-f97dd9726c48", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fe71a1d7-df24-4b3d-a26b-f97dd9726c48", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "336b3749-7436-45c4-b9f6-b8dd40a60951", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2f4a8a96-dc7e-47f8-b92d-9dd0700c950a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "56ccb44a-a3fa-40da-ab2a-b3e0884aaba6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1802873807"}], "key_name": "tempest-keypair-45205272", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:51:56.081247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] validate_networks() for [('ab420d7d-a998-49f0-b164-eadc36601153', None, None, None, None, None), (None, None, 'd69628a0-7168-4d48-8d30-4c1874e6521f', None, None, None), (None, None, '49ec4cbb-94ed-4be0-9d76-f85aebad0a87', None, None, None), ('d89c330d-feb9-46b2-bb80-eb317eb08ac4', None, None, None, None, None), ('d89c330d-feb9-46b2-bb80-eb317eb08ac4', None, None, None, None, None), ('fe71a1d7-df24-4b3d-a26b-f97dd9726c48', '10.2.2.100', None, None, None, None), ('fe71a1d7-df24-4b3d-a26b-f97dd9726c48', '10.2.2.200', None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:51:56.847335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:00.307447 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/action" status: 202 len: 0 microversion: 2.1 time: 4.936393 Oct 29 20:52:00.310176 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 685/1350] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:51:55 2022] POST /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/action => generated 0 bytes in 4946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:52:00.322715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:00.328359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:00.357048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:00.359366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:00.359898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:00.360731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:00.374176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:00.374747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:01.719476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:01.732635 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c5c1d10d-c6cb-4930-97b6-43eb8653d8e3 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 200 len: 1517 microversion: 2.1 time: 1.420400 Oct 29 20:52:01.734461 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 686/1351] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:00 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 1517 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:01.753572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0c847afb-4d47-43cd-a11e-e539b5e44498 req-acc784aa-985c-45fa-8b23-a22553d44b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c238626-ddf8-4cb1-9ae4-ea89be023b72", "name": "network-vif-plugged", "status": "completed", "tag": "d56f2b2e-6606-498c-8694-cc170ee581d5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:01.774872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c847afb-4d47-43cd-a11e-e539b5e44498 req-acc784aa-985c-45fa-8b23-a22553d44b69 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:01.775635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c847afb-4d47-43cd-a11e-e539b5e44498 req-acc784aa-985c-45fa-8b23-a22553d44b69 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:01.776232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c847afb-4d47-43cd-a11e-e539b5e44498 req-acc784aa-985c-45fa-8b23-a22553d44b69 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:01.795256 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0c847afb-4d47-43cd-a11e-e539b5e44498 req-acc784aa-985c-45fa-8b23-a22553d44b69 service nova] Creating event network-vif-plugged:d56f2b2e-6606-498c-8694-cc170ee581d5 for instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 on nch1-master-1 Oct 29 20:52:01.801199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0c847afb-4d47-43cd-a11e-e539b5e44498 req-acc784aa-985c-45fa-8b23-a22553d44b69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059750 Oct 29 20:52:01.802191 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 687/1352] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:01.808472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:01.809362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:01.816945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:01.817162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:01.817480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:01.818746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:01.819367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:01.820500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:02.428701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:02.446110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40863739-dcbd-428b-a1cb-ad90e51bbcb2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.639694 Oct 29 20:52:02.447134 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 688/1353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:01 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:02.459071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:02.460736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:02.476455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:02.477010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:02.477505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:02.479594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:02.480248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:02.483478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:03.056727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:03.068574 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae7a4a7c-2e44-4242-8188-9a08b7329d3c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1475 microversion: 2.1 time: 0.619906 Oct 29 20:52:03.089606 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 689/1354] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:02 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1475 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:03.095132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "name": "network-vif-unplugged", "status": "completed", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:03.111909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:03.116877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:03.117554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:03.140742 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] Creating event network-vif-unplugged:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch1-master-1 Oct 29 20:52:03.148403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:52:03.165944 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1ae56e73-29e4-4e37-a433-afdc9fda24e1 req-4ca0df10-4cc5-43fd-b1a1-5af676070746 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072634 Oct 29 20:52:03.166802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 690/1355] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:03.180205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1540239727", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9b7ce265-7ab7-4cbc-9e69-65aa38073a69"}], "security_groups": [{"name": "tempest-securitygroup--1777620033"}], "key_name": "tempest-keypair-1143922817", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:03.378728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] validate_networks() for [('9b7ce265-7ab7-4cbc-9e69-65aa38073a69', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:52:04.316511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:52:04.321295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:52:04.322729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:52:04.323334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:52:04.325541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:52:04.363836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:04.364578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:04.365201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:04.370077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:04.370818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:04.371995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:04.431915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Getting quotas for project 7ddac3a85fca49df9c83c7863e9d3ac3. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:04.441471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Getting quotas for user 47e571be08a14d40951a503df48a7c3d and project 7ddac3a85fca49df9c83c7863e9d3ac3. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:04.766532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:52:04.770144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='336b3749-7436-45c4-b9f6-b8dd40a60951',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2f4a8a96-dc7e-47f8-b92d-9dd0700c950a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56ccb44a-a3fa-40da-ab2a-b3e0884aaba6',volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:52:04.939011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Getting quotas for project 05d859f9584140aca702ebc0cd656cab. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:04.952342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Getting quotas for user 76bb8b2a3e654f4ea4b4543df0b9cf6a and project 05d859f9584140aca702ebc0cd656cab. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:04.995169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:52:04.995605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:52:04.998110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:52:04.998563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:52:04.998995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:52:05.024071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.026202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.028070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.029038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.033322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.033780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.090740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Getting quotas for project 05d859f9584140aca702ebc0cd656cab. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:05.103521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Getting quotas for user 76bb8b2a3e654f4ea4b4543df0b9cf6a and project 05d859f9584140aca702ebc0cd656cab. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:05.121444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:52:05.124113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:52:05.236436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6527276-cba8-44a8-8c39-707266b2e1db tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.064136 Oct 29 20:52:05.242932 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 691/1356] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:52:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:52:05.248124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:05.259910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:05.289764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.290848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.291770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.293838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.294706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.295517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.496112 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b6a6aac-fcfb-4845-a874-376392d185d5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 9.671708 Oct 29 20:52:05.498817 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 666/1357] 10.222.0.36 () {62 vars in 1189 bytes} [Sat Oct 29 20:51:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 9676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 20:52:05.504000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.78"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:05.519316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:05.525728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:05.533503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-79ac7ae9-57de-4c42-8f9f-a6e6de28f5cc tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.287262 Oct 29 20:52:05.534361 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 692/1358] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:05 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:05.551347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:05.551983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:05.553808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.554444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.557491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.558386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.558938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.559453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.572620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.574339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.574866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.579452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:05.579955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:05.582532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:05.623642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:52:05.624294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquired lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:52:06.138673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:06.146708 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3cb0716-9bba-4cb8-a291-c5a291e96816 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1321 microversion: 2.1 time: 0.610158 Oct 29 20:52:06.155968 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 693/1359] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:05 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:06.161597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:06.162741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:06.170326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:06.171262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:06.171802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:06.172904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:06.173427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:06.173955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:07.216654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:07.220370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:07.230584 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21a1e585-f7a9-419f-9f4f-37e4484d4498 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1473 microversion: 2.1 time: 1.073150 Oct 29 20:52:07.231177 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 694/1360] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:06 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1473 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:07.238788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:07.239612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:07.252532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:07.253738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:07.254395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:07.255132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:07.255596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:07.256331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:07.377281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:07.388381 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91e95970-03ca-48c9-aca2-b0fa0db4d5e3 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1330 microversion: 2.1 time: 0.155685 Oct 29 20:52:07.394239 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 695/1361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:07 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1330 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:07.561940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:07.577804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:07.578647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:07.580133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:07.593245 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] Creating event network-changed:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch1-master-1 Oct 29 20:52:07.602100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:52:07.614760 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8effb4b6-7a1b-4f1c-918f-d810f9776987 req-0765e23f-df4b-4285-a9e9-f2f874eeaa31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218851 Oct 29 20:52:07.615739 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 696/1362] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:07.768723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-214121027", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:07.847034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] validate_networks() for [('dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:52:09.519796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:52:09.520458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:52:09.520793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:52:09.521198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:52:09.521650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:52:09.542117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:09.542929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:09.543820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:09.545022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:09.545694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:09.546316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:09.576302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:09.583751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for user d3e4d267d3b344928a2ca0a6e79eadb4 and project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:09.607757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:52:09.625168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:52:09.739553 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23ffd4d4-e6a6-480b-9fc3-21658da55a43 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.121874 Oct 29 20:52:09.743288 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 697/1363] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:52:09.748648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:09.750791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:09.764696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:09.765483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:09.766085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:09.767555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:09.768250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:09.776766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:10.153817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:10.171618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:10.182782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:10.184145 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3b8e4db-469a-4ad5-bd69-bc2c53018ace tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1592 microversion: 2.32 time: 0.439411 Oct 29 20:52:10.185275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 698/1364] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:09 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1592 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:10.198524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:10.202309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:10.220809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:10.221319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:10.221792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:10.222520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:10.222984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:10.223417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:10.431761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:52:11.746794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:11.782802 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67daa9ad-f91c-430a-a034-dfd48e148c0b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 1.594651 Oct 29 20:52:11.785291 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 699/1365] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:10 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:11.811621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:11.812946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:11.845933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:11.847769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:11.849599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:11.850748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:11.852005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:11.853820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:12.605418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:12.615202 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8fbf9517-b2cc-48e2-8250-40eb6152116d tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1471 microversion: 2.1 time: 0.828373 Oct 29 20:52:12.622603 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 700/1366] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:11 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1471 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:12.648492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:12.650451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:12.700633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:12.709042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:12.710941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:12.711166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:12.715259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:12.716301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:13.440695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:13.454467 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ffa8d2d7-a3f4-4639-a3a7-823e1513f41d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1470 microversion: 2.1 time: 0.829606 Oct 29 20:52:13.455177 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 701/1367] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:12 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1470 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:13.470193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:13.471109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:13.495923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:13.496429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:13.496872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:13.497627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:13.498119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:13.498554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:13.538495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Updating instance_info_cache with network_info: [{"id": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c", "address": "fa:16:3e:b0:a1:68", "network": {"id": "c0f21c63-d525-4dc0-89e4-ec653151e278", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-995545677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "da5abdc9b77f409dae205a3d7e3e913c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf4331d37-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:52:13.556974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:13.559888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Releasing lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:52:13.561065 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e55308a-43b6-4404-baab-d0ed8873f772 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action" status: 202 len: 0 microversion: 2.1 time: 8.060993 Oct 29 20:52:13.562482 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 667/1368] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:05 2022] POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action => generated 0 bytes in 8063 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:52:13.569368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:13.570905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:13.577267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:13.586556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:13.588718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:13.589363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:13.590350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:13.591591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:13.592417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.029699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.046065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.051841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.053542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-042decc3-2ca1-4772-9962-089c7df13a09 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1319 microversion: 2.25 time: 0.489489 Oct 29 20:52:14.055398 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 668/1369] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:13 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:14.061172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-088df6ec-efcc-4b08-8c42-7ded6259f4c6 req-0b179aaf-69f7-4207-a897-3d31525b0d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:14.072773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-088df6ec-efcc-4b08-8c42-7ded6259f4c6 req-0b179aaf-69f7-4207-a897-3d31525b0d3f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.073794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-088df6ec-efcc-4b08-8c42-7ded6259f4c6 req-0b179aaf-69f7-4207-a897-3d31525b0d3f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.074508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-088df6ec-efcc-4b08-8c42-7ded6259f4c6 req-0b179aaf-69f7-4207-a897-3d31525b0d3f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.092347 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-088df6ec-efcc-4b08-8c42-7ded6259f4c6 req-0b179aaf-69f7-4207-a897-3d31525b0d3f service nova] Creating event network-changed:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:52:14.100136 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-088df6ec-efcc-4b08-8c42-7ded6259f4c6 req-0b179aaf-69f7-4207-a897-3d31525b0d3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042809 Oct 29 20:52:14.104976 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 669/1370] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:14.113849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:14.115578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:14.130525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.131763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.132875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.134029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.136011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.137253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.256021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.272315 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-191b5461-a825-4047-8e7d-f47d7ce6223b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1404 microversion: 2.1 time: 0.815909 Oct 29 20:52:14.283494 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 702/1371] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:13 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1404 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:14.300796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "name": "network-vif-plugged", "status": "completed", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:14.339104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.341317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.342526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.384605 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] Creating event network-vif-plugged:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch1-master-1 Oct 29 20:52:14.393159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:52:14.405890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:14.421398 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f9224b21-e863-4e5c-a31c-2b666425712e req-d75fadf4-6928-4110-a872-cef2316406e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136169 Oct 29 20:52:14.423083 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 703/1372] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:14.434942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:14.435951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:14.457083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.457732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.458114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.458773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.459236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.459664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.461170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=14 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:14.526960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lazy-loading 'flavor' on Instance uuid 2c238626-ddf8-4cb1-9ae4-ea89be023b72 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:14.719021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.734483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.736007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:14.737139 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f563e1fb-63b1-49a8-81bf-7af46855e4b3 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1660 microversion: 2.32 time: 0.630241 Oct 29 20:52:14.742529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72e2b08d-e2d5-4f3e-b794-464fb2b7dcd7 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72/action" status: 202 len: 0 microversion: 2.1 time: 0.315328 Oct 29 20:52:14.746614 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 704/1373] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:14 2022] POST /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:52:14.748704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 670/1374] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:14 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1660 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:14.753939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:14.774109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:14.776270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:14.776889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:14.786342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.797023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.797538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.797996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.798722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.799180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.800014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.801527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.802430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:14.804028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:14.804847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:14.808590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:15.051961 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa90cb74-f4bb-4564-841b-e406e4186ed5 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "POST /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4/action" status: 202 len: 0 microversion: 2.1 time: 0.301651 Oct 29 20:52:15.052666 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 671/1375] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:14 2022] POST /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:52:15.080245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.78"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:15.085041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:15.100985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:15.101550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:15.102020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:15.102696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:15.103330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:15.103951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:15.143444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "refresh_cache-cc17887b-64ba-4ef8-939e-1fedc1f62bbe" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:52:15.144235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquired lock "refresh_cache-cc17887b-64ba-4ef8-939e-1fedc1f62bbe" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:52:15.727167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:15.746368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6379353-b391-4a4c-a2f0-b96f47391694 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.998033 Oct 29 20:52:15.747298 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 705/1376] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:14 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:15.756729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:15.757878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:15.766413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:15.767104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:15.767835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:15.769345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:15.770463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:15.771536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:17.061974 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b94f03be-8d6d-4216-9edd-97685184578e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1630 microversion: 2.1 time: 1.312174 Oct 29 20:52:17.064697 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 706/1377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:15 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1630 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:17.070621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:17.071470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:17.079187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:17.079882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:17.080479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:17.082390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:17.083048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:17.083648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:17.782411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:17.795279 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b6555df-29be-4d6b-83bd-14d93d4b39b4 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1469 microversion: 2.1 time: 0.728921 Oct 29 20:52:17.801161 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 707/1378] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:17 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1469 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:17.807234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:17.807853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:17.828959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:17.830820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:17.831811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:17.834407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:17.835688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:17.837068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:18.166185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.188829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.193996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.213046 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2f32af9-96f8-4d73-a34b-2c7ed0967f54 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1361 microversion: 2.25 time: 0.392648 Oct 29 20:52:18.219163 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 708/1379] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:17 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:18.227360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:18.228775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:18.245040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:18.246643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:18.248028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:18.250044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:18.250862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:18.251479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:18.646627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.655079 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23bc20b7-1caa-401a-a68d-2fc947d305fe tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1404 microversion: 2.1 time: 0.434869 Oct 29 20:52:18.656219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 709/1380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:18 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:18.678475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:18.679661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:18.686814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:18.687693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:18.688131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:18.689273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:18.689920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:18.690516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:18.955155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.973155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.976664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:18.978631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e6e9ecb6-bbcc-4a2e-85bd-49633e200fa6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1742 microversion: 2.32 time: 0.304054 Oct 29 20:52:18.980662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 710/1381] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:18 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1742 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:18.989666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f575672d-d02c-4f18-bd2e-9de788bcb0d2 req-2bdfbc98-0eaa-4fab-8b9b-ff9172455b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b7ce09-5c63-4a63-80c2-e8251952d218", "tag": "beda8d49-3f5d-434f-b721-bcad16331053"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:19.006213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f575672d-d02c-4f18-bd2e-9de788bcb0d2 req-2bdfbc98-0eaa-4fab-8b9b-ff9172455b6a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:19.007257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f575672d-d02c-4f18-bd2e-9de788bcb0d2 req-2bdfbc98-0eaa-4fab-8b9b-ff9172455b6a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:19.008251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f575672d-d02c-4f18-bd2e-9de788bcb0d2 req-2bdfbc98-0eaa-4fab-8b9b-ff9172455b6a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:19.013701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:19.026257 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f575672d-d02c-4f18-bd2e-9de788bcb0d2 req-2bdfbc98-0eaa-4fab-8b9b-ff9172455b6a service nova] Creating event network-changed:beda8d49-3f5d-434f-b721-bcad16331053 for instance a2b7ce09-5c63-4a63-80c2-e8251952d218 on nch1-master-1 Oct 29 20:52:19.032264 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f575672d-d02c-4f18-bd2e-9de788bcb0d2 req-2bdfbc98-0eaa-4fab-8b9b-ff9172455b6a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049081 Oct 29 20:52:19.033312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 711/1382] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:19.043914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:19.044942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:19.049444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:19.056411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:19.058120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:19.058789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:19.059879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:19.060552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:19.061367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:19.321179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:19.339586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d992a5c-3285-4e9a-beff-1a8eb5280652 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.303536 Oct 29 20:52:19.340608 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 712/1383] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:19 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:19.349326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-545b8956-1fe6-4e77-bcc5-f8a6bbe7c628 req-cdea22a2-2f0e-4f04-b5cc-7ba98f3c5762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828d0c05-713e-47b5-a8d5-369061b2c2d7", "tag": "3b65ac57-f1c5-439c-8011-36c2b01a3c62"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:19.362558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-545b8956-1fe6-4e77-bcc5-f8a6bbe7c628 req-cdea22a2-2f0e-4f04-b5cc-7ba98f3c5762 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:19.363328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-545b8956-1fe6-4e77-bcc5-f8a6bbe7c628 req-cdea22a2-2f0e-4f04-b5cc-7ba98f3c5762 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:19.363998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-545b8956-1fe6-4e77-bcc5-f8a6bbe7c628 req-cdea22a2-2f0e-4f04-b5cc-7ba98f3c5762 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:19.430392 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-545b8956-1fe6-4e77-bcc5-f8a6bbe7c628 req-cdea22a2-2f0e-4f04-b5cc-7ba98f3c5762 service nova] Creating event network-changed:3b65ac57-f1c5-439c-8011-36c2b01a3c62 for instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 on nch2-master-1 Oct 29 20:52:19.446749 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-545b8956-1fe6-4e77-bcc5-f8a6bbe7c628 req-cdea22a2-2f0e-4f04-b5cc-7ba98f3c5762 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102700 Oct 29 20:52:19.449510 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 713/1384] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:19.469839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:19.470723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:19.485812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:19.489383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:19.490079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:19.492614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:19.496375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:19.496926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:19.589218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:19.602685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=16 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:19.685355 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.network.neutron [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] re-assign floating IP 172.35.5.78 from instance 5deded58-6d73-4dc1-81aa-679f48319c25 Oct 29 20:52:19.780795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:52:20.060667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d93474c-c010-4677-b3b4-c6e44728a912 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1613 microversion: 2.1 time: 0.608965 Oct 29 20:52:20.061081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 714/1385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:19 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1613 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:20.173239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2049879233", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "755ff50a-afe6-4046-876c-0b19c0bb1d49"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:20.408422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] validate_networks() for [('755ff50a-afe6-4046-876c-0b19c0bb1d49', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:52:20.839074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Updating instance_info_cache with network_info: [{"id": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c", "address": "fa:16:3e:b0:a1:68", "network": {"id": "c0f21c63-d525-4dc0-89e4-ec653151e278", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-995545677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "da5abdc9b77f409dae205a3d7e3e913c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf4331d37-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:52:20.855894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:52:21.295125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:52:21.295857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:52:21.296415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:52:21.296771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:52:21.297136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:52:21.316875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:21.320845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:21.321833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:21.322858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:21.325763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:21.330860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:21.383672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:21.394296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for user 68212c49a188473ca9f523c46fd9cba2 and project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:21.417246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:52:21.421984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:52:21.515772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-857e9d75-d68c-4d63-acb9-07a74313c3a8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438664 Oct 29 20:52:21.521555 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 715/1386] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:52:21.820470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:21.821669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:21.836412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:21.856660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:21.861289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:21.865260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:21.870612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:21.870793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:22.849266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:22.865248 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f644fd6d-b749-481c-97ac-c34a80c82e76 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1469 microversion: 2.1 time: 1.336625 Oct 29 20:52:22.882509 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 716/1387] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:21 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1469 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:22.894779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:22.895621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:22.908813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:22.911294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:22.913848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:22.915618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:22.919030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:22.919488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.411937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.426580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.428138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.430860 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7dc43919-c12c-4897-9de0-64ad135b01d4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1361 microversion: 2.25 time: 0.546975 Oct 29 20:52:23.438345 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 717/1388] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:22 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:23.443571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:23.449550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:23.462027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.463002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.463698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.465061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.465845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.466477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.620724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Updating instance_info_cache with network_info: [{"id": "a0644f39-124b-4732-ad57-fe231fbd7267", "address": "fa:16:3e:d1:4e:53", "network": {"id": "c0f21c63-d525-4dc0-89e4-ec653151e278", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-995545677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "da5abdc9b77f409dae205a3d7e3e913c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0644f39-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:52:23.640135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Releasing lock "refresh_cache-cc17887b-64ba-4ef8-939e-1fedc1f62bbe" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:52:23.644668 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11d5b077-a7d4-4cfd-87d6-52f73f349368 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe/action" status: 202 len: 0 microversion: 2.1 time: 8.571856 Oct 29 20:52:23.645427 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 672/1389] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:15 2022] POST /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe/action => generated 0 bytes in 8592 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:52:23.658609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:23.660825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:23.673868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.675196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.675793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.676697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.677235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.677811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.713681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.724920 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-05d3fd2e-d6ea-4d0e-a209-8cf37679dd49 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1404 microversion: 2.1 time: 0.285006 Oct 29 20:52:23.742291 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 718/1390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:23 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1404 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:23.754045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:23.755179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:23.770111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.771648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.772450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.773592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.774293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.774962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.830778 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 while it is in vm_state suspended Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Request method failure captured: Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72/action HTTP/1.1 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 15 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZIyHhnjnnTmm41q94qg-po-6CEsC4bESo5j1hFW6Sa7bVrTFOUIO5HwNOmD3CvxneUgGbcqStvidWc01NeWgnqtsm5mK09o2_1trs7ROZfRDwromvoHUO0nvxY7dz4on8K3vVg2YaHE3w6NpHIIvfScxoZR4CUUuv5PJtWpK15G1zI Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b6c680dbd550440aa9548f1b4ffee6dc Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: {"migrate": {}} Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'migrate' instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 while it is in vm_state suspended Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2c238626-ddf8-4cb1-9ae4-ea89be023b72', 'body': {'migrate': {}}} Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 in vm_state suspended. Cannot resize while the instance is in this state. Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:23.832614 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 while it is in vm_state suspended Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 while it is in vm_state suspended Oct 29 20:52:23.842889 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:23.851726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Returning 409 to user: Cannot 'migrate' instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 while it is in vm_state suspended {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:23.851726 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08d936bc-0e49-4f23-aaac-8f18ef416427 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72/action" status: 409 len: 148 microversion: 2.1 time: 0.100573 Oct 29 20:52:23.851726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 719/1391] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:23 2022] POST /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72/action => generated 148 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:52:23.855311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:23.855637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:23.865928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.866461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.874553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.875366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.876852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.877518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.930625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.947985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.951081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:23.953783 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d77e5f3-753a-46b3-bc48-239d79c46681 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1836 microversion: 2.32 time: 0.303672 Oct 29 20:52:23.955044 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 673/1392] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:23 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1836 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:23.962346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fa038d-5a82-452d-bde6-eaa0b790d7cc", "name": "network-vif-unplugged", "status": "completed", "tag": "437d3157-cf84-48ff-88d0-d082479a661b"}, {"name": "network-changed", "server_uuid": "f5fa038d-5a82-452d-bde6-eaa0b790d7cc", "tag": "437d3157-cf84-48ff-88d0-d082479a661b"}, {"name": "network-changed", "server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}, {"name": "network-changed", "server_uuid": "cc17887b-64ba-4ef8-939e-1fedc1f62bbe", "tag": "a0644f39-124b-4732-ad57-fe231fbd7267"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:23.976347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:23.977321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:23.978167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:23.995734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Creating event network-vif-unplugged:437d3157-cf84-48ff-88d0-d082479a661b for instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc on nch2-master-1 Oct 29 20:52:23.996586 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Creating event network-changed:437d3157-cf84-48ff-88d0-d082479a661b for instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc on nch2-master-1 Oct 29 20:52:23.997289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Creating event network-changed:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:52:23.997943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] Creating event network-changed:a0644f39-124b-4732-ad57-fe231fbd7267 for instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe on nch2-master-1 Oct 29 20:52:24.009138 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9bb992e5-7c4b-4b9e-adc7-f30ab1e16e31 req-b7e543d1-e39e-4563-8060-f5a265226d07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 686 microversion: 2.1 time: 0.052382 Oct 29 20:52:24.010470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 674/1393] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 686 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:24.017038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:24.018600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:24.028854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.029706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.031554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.033570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.034433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.035099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.171505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:24.180745 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0ae714b-4933-4075-9a55-c01de074cb21 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1283 microversion: 2.1 time: 0.168802 Oct 29 20:52:24.181922 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 675/1394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:24 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:24.219851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:24.228749 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a30761eb-1051-41c1-bc9c-decfaa1c5c9f tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.377746 Oct 29 20:52:24.229782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 720/1395] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:23 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:24.239699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.78"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:24.264453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0ef6cd8f-f85c-4a1f-aecb-31f24b7a382c req-4503e5c4-a5e4-49eb-b3d8-852612105276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828d0c05-713e-47b5-a8d5-369061b2c2d7", "name": "network-vif-plugged", "status": "completed", "tag": "3b65ac57-f1c5-439c-8011-36c2b01a3c62"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:24.275322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0ef6cd8f-f85c-4a1f-aecb-31f24b7a382c req-4503e5c4-a5e4-49eb-b3d8-852612105276 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.276155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0ef6cd8f-f85c-4a1f-aecb-31f24b7a382c req-4503e5c4-a5e4-49eb-b3d8-852612105276 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.276841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0ef6cd8f-f85c-4a1f-aecb-31f24b7a382c req-4503e5c4-a5e4-49eb-b3d8-852612105276 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.291054 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0ef6cd8f-f85c-4a1f-aecb-31f24b7a382c req-4503e5c4-a5e4-49eb-b3d8-852612105276 service nova] Creating event network-vif-plugged:3b65ac57-f1c5-439c-8011-36c2b01a3c62 for instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 on nch2-master-1 Oct 29 20:52:24.296518 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0ef6cd8f-f85c-4a1f-aecb-31f24b7a382c req-4503e5c4-a5e4-49eb-b3d8-852612105276 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112482 Oct 29 20:52:24.297264 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 676/1396] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:24.311073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1cfc8d9c-aa6c-4e7a-8faf-b70b1c913a7e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1cfc8d9c-aa6c-4e7a-8faf-b70b1c913a7e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Request method failure captured: Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f/action HTTP/1.1 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 39 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIyHhnjnnTmm41q94qg-po-6CEsC4bESo5j1hFW6Sa7bVrTFOUIO5HwNOmD3CvxneUgGbcqStvidWc01NeWgnqtsm5mK09o2_1trs7ROZfRDwromvoHUO0nvxY7dz4on8K3vVg2YaHE3w6NpHIIvfScxoZR4CUUuv5PJtWpK15G1zI Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b6c680dbd550440aa9548f1b4ffee6dc Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: {"os-resetState": {"state": "invalid"}} Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c17fc63e-a4d9-45ff-afff-b8d82e66114f', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:52:24.318143 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1cfc8d9c-aa6c-4e7a-8faf-b70b1c913a7e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1cfc8d9c-aa6c-4e7a-8faf-b70b1c913a7e tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f/action" status: 400 len: 144 microversion: 2.1 time: 0.023604 Oct 29 20:52:24.327289 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 677/1397] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:24 2022] POST /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:52:24.333162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:24.333947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:24.345708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.346215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.346722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.347662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.348135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.348574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.556065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:24.578020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.578828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.579298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.580009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.586721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.588484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.814456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:24.828931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0625b0e2-ebcd-46f7-8890-900e48a5a346 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1469 microversion: 2.1 time: 0.503512 Oct 29 20:52:24.850272 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 678/1398] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:24 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:24.862405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e0c21c9-2cad-41e7-9eb7-48a78c9ff0a1 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e0c21c9-2cad-41e7-9eb7-48a78c9ff0a1 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Request method failure captured: Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f/action HTTP/1.1 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 31 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIyHhnjnnTmm41q94qg-po-6CEsC4bESo5j1hFW6Sa7bVrTFOUIO5HwNOmD3CvxneUgGbcqStvidWc01NeWgnqtsm5mK09o2_1trs7ROZfRDwromvoHUO0nvxY7dz4on8K3vVg2YaHE3w6NpHIIvfScxoZR4CUUuv5PJtWpK15G1zI Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b6c680dbd550440aa9548f1b4ffee6dc Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: {"os-resetState": {"state": 1}} Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c17fc63e-a4d9-45ff-afff-b8d82e66114f', 'body': {'os-resetState': {'state': 1}}} Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 1 Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 20:52:24.868058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 20:52:24.872616 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:24.877115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e0c21c9-2cad-41e7-9eb7-48a78c9ff0a1 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:24.878321 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e0c21c9-2cad-41e7-9eb7-48a78c9ff0a1 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f/action" status: 400 len: 120 microversion: 2.1 time: 0.025532 Oct 29 20:52:24.879894 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 679/1399] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:24 2022] POST /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f/action => generated 120 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:52:24.888793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:24.890115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:24.902622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.903285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.904382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:24.906409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:24.906996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:24.908550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.224321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] HTTP exception thrown: Floating IP 172.35.5.78 is not associated with instance 5deded58-6d73-4dc1-81aa-679f48319c25. Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Request method failure captured: Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action HTTP/1.1 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 48 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZI15JsmT_84hTE-Cb9cGabfsYqt2wFqf2axBRWouFfpoDJk1-9LON34sAqnrdK8jdkYqbccJelx1YrOjrWrgD3b20ZEPz6WpUJV8eWywtUf6Wptn6WseRbSMTr9Xz8fB-M6znFAi8PV1BuCBsdYD--5NPbwA9raFP9f-4IOFSfT1fE Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 84799edfc2fd40b2ad004d9c080dde40 Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: {"removeFloatingIp": {"address": "172.35.5.78"}} Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: exception: Floating IP 172.35.5.78 is not associated with instance 5deded58-6d73-4dc1-81aa-679f48319c25. Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5deded58-6d73-4dc1-81aa-679f48319c25', 'body': {'removeFloatingIp': {'address': '172.35.5.78'}}} Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.5.78 is not associated with instance 5deded58-6d73-4dc1-81aa-679f48319c25. Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.5.78 is not associated with instance 5deded58-6d73-4dc1-81aa-679f48319c25. Oct 29 20:52:25.227578 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.234166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Returning 409 to user: Floating IP 172.35.5.78 is not associated with instance 5deded58-6d73-4dc1-81aa-679f48319c25. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:25.235293 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30ee6ce0-2603-4dfa-bfcc-9ff7922f608f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action" status: 409 len: 145 microversion: 2.1 time: 1.004401 Oct 29 20:52:25.236059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 721/1400] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:24 2022] POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action => generated 145 bytes in 1006 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:52:25.246941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:25.246941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:25.253831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.254441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.254896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.255622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.256304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.256975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.294106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.309746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.312255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.313634 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fab5f6b1-65ae-4f9c-887d-2af0be6715ca tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1361 microversion: 2.25 time: 0.431888 Oct 29 20:52:25.315235 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 680/1401] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:24 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:25.324458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b286a18-aee7-478e-bfb0-b61fbd46a311 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:25.328881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b286a18-aee7-478e-bfb0-b61fbd46a311 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Failed to fetch instance by id 999 {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 20:52:25.330219 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4b286a18-aee7-478e-bfb0-b61fbd46a311 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b286a18-aee7-478e-bfb0-b61fbd46a311 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Request method failure captured: Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 37 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZIyHhnjnnTmm41q94qg-po-6CEsC4bESo5j1hFW6Sa7bVrTFOUIO5HwNOmD3CvxneUgGbcqStvidWc01NeWgnqtsm5mK09o2_1trs7ROZfRDwromvoHUO0nvxY7dz4on8K3vVg2YaHE3w6NpHIIvfScxoZR4CUUuv5PJtWpK15G1zI Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14fc0b0998434dda9bd95a8a9f22b6b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 14fc0b0998434dda9bd95a8a9f22b6b9 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720645581 Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b6c680dbd550440aa9548f1b4ffee6dc Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720645581-project-admin Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: {"os-resetState": {"state": "error"}} Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 999 could not be found. Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:25.332413 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:25.337272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:25.337272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 20:52:25.337272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:25.339839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b286a18-aee7-478e-bfb0-b61fbd46a311 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:25.341146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b286a18-aee7-478e-bfb0-b61fbd46a311 tempest-ServersAdminNegativeTestJSON-720645581 tempest-ServersAdminNegativeTestJSON-720645581-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.024551 Oct 29 20:52:25.342789 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 681/1402] 10.222.0.36 () {60 vars in 1179 bytes} [Sat Oct 29 20:52:25 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:52:25.349345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:25.350245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:25.359045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.359687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.360143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.360859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.362118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.362568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.552930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.564315 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2984b7f3-c9de-4450-bc5b-f5f2fccb7531 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1404 microversion: 2.1 time: 0.323510 Oct 29 20:52:25.565326 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 722/1403] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:25 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1404 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:25.635346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7e093e9e-9d96-4ac6-92b7-64751664683c req-c1db1892-f9a1-4461-99f5-4d8ee3801ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "8143b14b-a1cc-4d09-b1ee-95d78e193450"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:25.646154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7e093e9e-9d96-4ac6-92b7-64751664683c req-c1db1892-f9a1-4461-99f5-4d8ee3801ece service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.647066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7e093e9e-9d96-4ac6-92b7-64751664683c req-c1db1892-f9a1-4461-99f5-4d8ee3801ece service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.648311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7e093e9e-9d96-4ac6-92b7-64751664683c req-c1db1892-f9a1-4461-99f5-4d8ee3801ece service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.649876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.663695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7e093e9e-9d96-4ac6-92b7-64751664683c req-c1db1892-f9a1-4461-99f5-4d8ee3801ece service nova] Creating event network-changed:8143b14b-a1cc-4d09-b1ee-95d78e193450 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:25.666029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.668135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:25.670025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7e093e9e-9d96-4ac6-92b7-64751664683c req-c1db1892-f9a1-4461-99f5-4d8ee3801ece service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103032 Oct 29 20:52:25.671009 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 723/1404] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:25.672287 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8d7e432-f976-4cdf-a2b9-03c34043e060 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1836 microversion: 2.32 time: 0.327510 Oct 29 20:52:25.672959 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 682/1405] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:25 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1836 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:25.676981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:25.677935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:25.681919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'action', calling method: .version_select at 0x7fa1735358b0>, body: {"removeFloatingIp": {"address": "172.35.5.78"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:25.692962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.693492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.693922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:25.694899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:25.695356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:25.695783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:26.064152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:26.072710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:26.079596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:26.080106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:26.080557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:26.081286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:26.081778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:26.082216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:26.082340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d5d3d61-1fa5-4ddd-a701-bf95d23a4f89 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1325 microversion: 2.1 time: 0.408783 Oct 29 20:52:26.090629 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 724/1406] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:25 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:26.095569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:26.102404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:26.117036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:26.124994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:26.125726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:26.127530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:26.128067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:26.128554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:26.931800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "refresh_cache-cc17887b-64ba-4ef8-939e-1fedc1f62bbe" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:52:26.932229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquired lock "refresh_cache-cc17887b-64ba-4ef8-939e-1fedc1f62bbe" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:52:26.936716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:26.946215 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-78ead76a-8f29-4bd1-8786-4b631d7a5439 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.854419 Oct 29 20:52:26.960828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 725/1407] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:26 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:26.969421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:26.970117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:26.977420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:26.978067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:26.978703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:26.979445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:26.980190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:26.981105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.012928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:27.124515 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f9985b9-7931-4ae6-9d9a-f522830703a4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 204 len: 0 microversion: 2.1 time: 0.161778 Oct 29 20:52:27.128470 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 726/1408] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:26 2022] DELETE /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:27.134038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:27.135028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:27.141483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.142314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.142821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.143741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.144273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.144769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.559431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:27.569317 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6066f767-45bb-465e-9019-4df9172bdf58 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1469 microversion: 2.1 time: 0.439538 Oct 29 20:52:27.569908 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 727/1409] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:27 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:27.593177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-dd1730b3-d479-49cc-baf3-66fec72e9953 req-d117b134-ba13-407c-97e8-1a6b4df5e8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b7ce09-5c63-4a63-80c2-e8251952d218", "name": "network-vif-plugged", "status": "completed", "tag": "beda8d49-3f5d-434f-b721-bcad16331053"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:27.603308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dd1730b3-d479-49cc-baf3-66fec72e9953 req-d117b134-ba13-407c-97e8-1a6b4df5e8d5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.603786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dd1730b3-d479-49cc-baf3-66fec72e9953 req-d117b134-ba13-407c-97e8-1a6b4df5e8d5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.604224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dd1730b3-d479-49cc-baf3-66fec72e9953 req-d117b134-ba13-407c-97e8-1a6b4df5e8d5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.619093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-dd1730b3-d479-49cc-baf3-66fec72e9953 req-d117b134-ba13-407c-97e8-1a6b4df5e8d5 service nova] Creating event network-vif-plugged:beda8d49-3f5d-434f-b721-bcad16331053 for instance a2b7ce09-5c63-4a63-80c2-e8251952d218 on nch1-master-1 Oct 29 20:52:27.624139 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-dd1730b3-d479-49cc-baf3-66fec72e9953 req-d117b134-ba13-407c-97e8-1a6b4df5e8d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Oct 29 20:52:27.624965 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 728/1410] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:27.630830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:27.631519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:27.641072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.641596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.642110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.642745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.643379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.643984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.857396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:27.866999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:27.868575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:27.869855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2639d81-5d49-43e5-9950-f9dc756532fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1556 microversion: 2.25 time: 0.243376 Oct 29 20:52:27.870496 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 729/1411] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:27 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:27.890905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:27.891649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:27.898351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.898934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.899498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.900232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:27.900680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:27.901105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:27.905244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:28.060261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:52:28.119117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:28.127737 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e1789e8c-e663-40dc-a457-e1ae519121a0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1404 microversion: 2.1 time: 0.241222 Oct 29 20:52:28.128510 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 730/1412] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:27 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1404 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:28.133876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:28.135235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:28.141637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.142371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.142992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:28.143928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.144624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.145369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:28.410455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:28.422276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:28.423719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:28.425085 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-045c1049-3ae7-41a5-845f-0bc6ca5bd1f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1857 microversion: 2.32 time: 0.295555 Oct 29 20:52:28.425823 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 731/1413] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:28 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1857 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:28.432036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:28.432970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:28.441447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.442673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.443299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:28.449007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.450482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.451105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:28.753972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:28.763362 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25f2f69f-1587-4547-bf9f-b2028f765619 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1325 microversion: 2.1 time: 0.336079 Oct 29 20:52:28.764054 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 732/1414] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:28 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:28.769491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:28.770370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:28.783863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.785038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.785038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:28.785552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.786013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.786617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:28.926904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Updating instance_info_cache with network_info: [{"id": "a0644f39-124b-4732-ad57-fe231fbd7267", "address": "fa:16:3e:d1:4e:53", "network": {"id": "c0f21c63-d525-4dc0-89e4-ec653151e278", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-995545677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "da5abdc9b77f409dae205a3d7e3e913c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa0644f39-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:52:28.936826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=6,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:28.945420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Releasing lock "refresh_cache-cc17887b-64ba-4ef8-939e-1fedc1f62bbe" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:52:28.946760 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cab1b340-a766-471f-b39a-e22dad398990 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe/action" status: 202 len: 0 microversion: 2.1 time: 3.272510 Oct 29 20:52:28.948092 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 683/1415] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:25 2022] POST /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe/action => generated 0 bytes in 3274 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:52:28.960311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:28.967781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "name": "network-vif-unplugged", "status": "completed", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}, {"name": "network-changed", "server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}, {"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "d69628a0-7168-4d48-8d30-4c1874e6521f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:28.970486 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a719cb7f-cc9a-4036-94be-756312d2db27 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1468 microversion: 2.1 time: 0.205032 Oct 29 20:52:28.983083 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 733/1416] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:28 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1468 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:28.986781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:28.987451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:28.988096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.006067 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Creating event network-vif-unplugged:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch2-master-1 Oct 29 20:52:29.007568 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Creating event network-changed:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch2-master-1 Oct 29 20:52:29.008090 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Creating event network-changed:d69628a0-7168-4d48-8d30-4c1874e6521f for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:29.017239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 20:52:29.037061 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-95f6d828-5942-46a5-9bbb-4585ccbd7608 req-3641b5fa-a096-4f9b-a702-27fefe02aff0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.086728 Oct 29 20:52:29.038635 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 684/1417] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:29.045017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.046004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.063458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.064353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.064808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.064991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.065654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.065925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.066593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.067257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.078423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.080008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.081930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.083661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.085646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.086227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.316011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:29.326726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 828d0c05-713e-47b5-a8d5-369061b2c2d7 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:29.327764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bb003017-6c9f-4062-86a8-969c32684a05 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.288468 Oct 29 20:52:29.334581 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 685/1418] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:29 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:29.346833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-29cd4044-176d-4171-a8a1-d7cfc5904ba8 req-bc3f0f2d-6d8a-432f-b52b-cbac75c76c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc17887b-64ba-4ef8-939e-1fedc1f62bbe", "tag": "a0644f39-124b-4732-ad57-fe231fbd7267"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:29.354642 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4212e0ab-5c37-4be8-84cf-696064d42634 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 2048 microversion: 2.25 time: 0.369501 Oct 29 20:52:29.358028 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 734/1419] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:28 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 2048 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:29.364604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-29cd4044-176d-4171-a8a1-d7cfc5904ba8 req-bc3f0f2d-6d8a-432f-b52b-cbac75c76c42 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.367728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-29cd4044-176d-4171-a8a1-d7cfc5904ba8 req-bc3f0f2d-6d8a-432f-b52b-cbac75c76c42 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.368246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-29cd4044-176d-4171-a8a1-d7cfc5904ba8 req-bc3f0f2d-6d8a-432f-b52b-cbac75c76c42 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.371288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.371993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.380206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.380783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.381297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.382712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.383247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.383769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.385335 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-29cd4044-176d-4171-a8a1-d7cfc5904ba8 req-bc3f0f2d-6d8a-432f-b52b-cbac75c76c42 service nova] Creating event network-changed:a0644f39-124b-4732-ad57-fe231fbd7267 for instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe on nch2-master-1 Oct 29 20:52:29.390853 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-29cd4044-176d-4171-a8a1-d7cfc5904ba8 req-bc3f0f2d-6d8a-432f-b52b-cbac75c76c42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054655 Oct 29 20:52:29.395947 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 686/1420] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:29.401977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.403200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.413401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.413925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.414377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.415093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.415560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.415979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.450322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:29.555737 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e2472d5b-ba34-4be2-9643-67f92ae9b5ce tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 204 len: 0 microversion: 2.1 time: 0.158207 Oct 29 20:52:29.557542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 687/1421] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:29 2022] DELETE /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:29.559632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:29.567069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.568427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.568715 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24d74f77-38ff-431d-8273-36e2bf0ce383 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1469 microversion: 2.1 time: 0.207447 Oct 29 20:52:29.570211 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 735/1422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:29 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:29.576300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.576512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.577055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.578126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.578711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.578842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.579462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.580403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.589953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.591224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.601334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.602394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.603042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.603652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.823956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:29.833134 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e0abc5e-b1c5-477f-812d-0540d930627b tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1404 microversion: 2.1 time: 0.274042 Oct 29 20:52:29.833784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 688/1423] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:29 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:29.840824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 828d0c05-713e-47b5-a8d5-369061b2c2d7 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:29.841263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:29.841968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.849283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.849947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.851033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.851741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.852199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.852806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.855132 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6eb28429-b514-4379-99d3-fde12116de6a tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 2048 microversion: 2.25 time: 0.283536 Oct 29 20:52:29.855716 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 736/1424] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:29 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 2048 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:29.860262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.78"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:29.862804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:29.869299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.869816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.870264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.870937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:29.871572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:29.871999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:29.897157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:52:29.897627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquired lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:52:30.159778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:30.170324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:30.171810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:30.172984 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-63c248f2-e87d-4e33-abb6-9473e4dc6caa tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.335923 Oct 29 20:52:30.173568 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 689/1425] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:29 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:30.177960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:30.179118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:30.185390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:30.185910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:30.186982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:30.188311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:30.188778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:30.189219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:31.001665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:31.019043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-56bfffc5-73fb-4152-998c-8d93bc6a18f8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1325 microversion: 2.1 time: 0.843634 Oct 29 20:52:31.032816 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 690/1426] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:30 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1325 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:31.049294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:31.053429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:31.054565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:31.066097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:31.067059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:31.067581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:31.068243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:31.097270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2517003b-1367-4612-af64-2352abbcd4e6 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.061681 Oct 29 20:52:31.104190 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 691/1427] 10.222.0.36 () {60 vars in 1217 bytes} [Sat Oct 29 20:52:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:52:31.109438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:31.112636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:31.119628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:31.120492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:31.121118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:31.122088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:31.122736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:31.123377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:31.357292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:31.412093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:31.721144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:31.733637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bebd1651-bb34-4e59-a6b2-dcef7accd5eb tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 200 len: 1468 microversion: 2.1 time: 0.627268 Oct 29 20:52:31.734904 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 692/1428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:31 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 1468 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:31.743203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:31.744681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:31.754314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:31.755517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:31.757359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:31.758331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:31.759132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:31.759725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:32.299413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:32.322251 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94af83aa-a7b9-4ffb-bd8f-ba9c21e2b605 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.585983 Oct 29 20:52:32.324195 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 693/1429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:31 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:32.371975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:32.372810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:32.382413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:32.383202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:32.383825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:32.384895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:32.385681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:32.386652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:32.764785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:32.784234 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-834d5643-4718-4577-8651-d2fb2725ad72 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1462 microversion: 2.1 time: 0.426650 Oct 29 20:52:32.786254 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 694/1430] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:32 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1462 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:32.792543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:32.793366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:32.800486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:32.800987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:32.801436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:32.802179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:32.802644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:32.803681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:33.049943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:33.063678 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11749714-12c7-4cac-a5d5-936a88c6ed53 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1590 microversion: 2.1 time: 0.275526 Oct 29 20:52:33.065557 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 695/1431] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:32 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1590 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:33.073538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:33.092394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:33.102679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:33.104135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:33.105264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:33.108422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:33.109166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:33.113350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:33.196037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'flavor' on Instance uuid 828d0c05-713e-47b5-a8d5-369061b2c2d7 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:33.226189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Going to try to live migrate instance to nch1-master-1 {{(pid=138884) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:52:33.874701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Building network info cache for instance {{(pid=138885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:52:34.750529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Updating instance_info_cache with network_info: [{"id": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c", "address": "fa:16:3e:b0:a1:68", "network": {"id": "c0f21c63-d525-4dc0-89e4-ec653151e278", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-995545677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "da5abdc9b77f409dae205a3d7e3e913c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf4331d37-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:52:34.775149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Releasing lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:52:34.776647 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-abbd6dcd-6b72-4472-a781-72aba2b72578 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action" status: 202 len: 0 microversion: 2.1 time: 4.919803 Oct 29 20:52:34.777512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 737/1432] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:29 2022] POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action => generated 0 bytes in 4921 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:52:34.787291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b8f36e-7013-4af8-a273-85bbe0cdb117", "tag": "f58dbb64-beaa-47c1-a364-7f25626be626"}, {"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "49ec4cbb-94ed-4be0-9d76-f85aebad0a87"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:34.806077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:34.806760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:34.807660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:34.830127 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] Creating event network-changed:f58dbb64-beaa-47c1-a364-7f25626be626 for instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 on nch2-master-1 Oct 29 20:52:34.830958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] Creating event network-changed:49ec4cbb-94ed-4be0-9d76-f85aebad0a87 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:34.840831 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-92a4f445-ae2f-4c23-a198-0f00cac00c5e req-49a0e24d-1100-48d5-bb32-caa56f298b4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061650 Oct 29 20:52:34.842404 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 738/1433] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:34.851678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:34.852660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:34.863054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:34.864114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:34.865445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:34.867112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:34.868864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:34.869608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:35.415164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:35.445697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:35.452795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:35.464120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f31e9e6-fc10-429a-8ff3-7738a7478d15 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.610488 Oct 29 20:52:35.465980 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 739/1434] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:34 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:35.472931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:35.478499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:35.493874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:35.494892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:35.496745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:35.500797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:35.502261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:35.505026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:35.888987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:35.896001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d7e2fef-0f0c-41da-b7e7-4a6663ebf6d3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7/action" status: 202 len: 0 microversion: 2.25 time: 2.829102 Oct 29 20:52:35.896715 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 696/1435] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:52:33 2022] POST /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7/action => generated 0 bytes in 2830 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:35.903375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1e030ba1-583f-4d87-9141-bf4f65487e4a req-e78aba67-38e7-4fcf-815d-cc7331dd51a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c238626-ddf8-4cb1-9ae4-ea89be023b72", "name": "network-vif-deleted", "tag": "d56f2b2e-6606-498c-8694-cc170ee581d5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:35.903897 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24e33123-0c26-40f9-998f-583410c88abc tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1325 microversion: 2.1 time: 0.436410 Oct 29 20:52:35.906385 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 740/1436] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:35 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1325 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:35.919306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:35.920452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: 2c238626-ddf8-4cb1-9ae4-ea89be023b72] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:35.933584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:35.934451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:35.935118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:35.936668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:35.938164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:35.938848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:35.952103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1e030ba1-583f-4d87-9141-bf4f65487e4a req-e78aba67-38e7-4fcf-815d-cc7331dd51a1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:35.952598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1e030ba1-583f-4d87-9141-bf4f65487e4a req-e78aba67-38e7-4fcf-815d-cc7331dd51a1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:35.953048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1e030ba1-583f-4d87-9141-bf4f65487e4a req-e78aba67-38e7-4fcf-815d-cc7331dd51a1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:35.965350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] HTTP exception thrown: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 could not be found. Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Request method failure captured: Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 HTTP/1.1 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZIxLDsW0l8z9CQaqy6IcUkLa1G2Xm8KccHZBaorooBv4yPQ7l9XF0HJYjFg4-ZBDX6Sh1LWSbZ4ZLDiVcV3-wCg-Vl3W1sMKdntCCHzj_gIC5a6zbNxkYGaLW1FEcPfRpdStZtVJPwRhx1K5mw-DHJmkE5c1JP2lpdylOeALo4u2mg Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 674fcd08bc2c486aa00c64db594cabdd Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1889669018 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1889669018 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 674fcd08bc2c486aa00c64db594cabdd Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1889669018 Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAdminNegativeTestJSON-1889669018-project Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 531843035bb54ec9aabbe4cf1d240fbd Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1889669018-project Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 could not be found. Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2c238626-ddf8-4cb1-9ae4-ea89be023b72'} Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 could not be found. Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 could not be found. Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:35.969233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 could not be found. Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:35.975304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Returning 404 to user: Instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:35.982664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1e030ba1-583f-4d87-9141-bf4f65487e4a req-e78aba67-38e7-4fcf-815d-cc7331dd51a1 service nova] Creating event network-vif-deleted:d56f2b2e-6606-498c-8694-cc170ee581d5 for instance 2c238626-ddf8-4cb1-9ae4-ea89be023b72 on nch1-master-1 Oct 29 20:52:35.990339 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cafc925-c0e5-4514-ae03-9461496cb131 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72" status: 404 len: 111 microversion: 2.1 time: 0.082041 Oct 29 20:52:35.994608 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 741/1437] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:35 2022] GET /compute/v2.1/servers/2c238626-ddf8-4cb1-9ae4-ea89be023b72 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:35.994787 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1e030ba1-583f-4d87-9141-bf4f65487e4a req-e78aba67-38e7-4fcf-815d-cc7331dd51a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095597 Oct 29 20:52:35.996882 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 697/1438] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:36.014977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7c506539-725d-456a-9dd4-246b888e0016 req-e71d5621-fdcd-4b3e-a212-84ac0bc00d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "name": "network-vif-plugged", "status": "completed", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:36.045211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7c506539-725d-456a-9dd4-246b888e0016 req-e71d5621-fdcd-4b3e-a212-84ac0bc00d21 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.045893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7c506539-725d-456a-9dd4-246b888e0016 req-e71d5621-fdcd-4b3e-a212-84ac0bc00d21 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.046438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7c506539-725d-456a-9dd4-246b888e0016 req-e71d5621-fdcd-4b3e-a212-84ac0bc00d21 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.059409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7c506539-725d-456a-9dd4-246b888e0016 req-e71d5621-fdcd-4b3e-a212-84ac0bc00d21 service nova] Creating event network-vif-plugged:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch2-master-1 Oct 29 20:52:36.065820 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7c506539-725d-456a-9dd4-246b888e0016 req-e71d5621-fdcd-4b3e-a212-84ac0bc00d21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067472 Oct 29 20:52:36.066754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 698/1439] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:36.074585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:36.075539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:36.088897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.089693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.090453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.092081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.092953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.094178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.165857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:36.166571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:36.173191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.173946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.174461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.175234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.175907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.176504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.202315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-39842ec7-aa8e-4e03-9359-635d9448d40c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133347 Oct 29 20:52:36.202912 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 699/1440] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:52:36 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:36.207731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:36.208579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:36.216456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.217263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.217730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.219340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.219656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.221514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.235402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:36.743823 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-224330a1-873d-41af-ac54-65a71306e714 tempest-MigrationsAdminTest-481628936 tempest-MigrationsAdminTest-481628936-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1613 microversion: 2.1 time: 0.751314 Oct 29 20:52:36.746428 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 742/1441] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:35 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1613 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:36.753745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53b7c603-8d56-4c19-bfc6-a155a39d40b1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '.version_select at 0x7fa1714f1ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:36.795546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:36.804700 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84b16ed4-60b2-4f20-b8e2-b76f34939630 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1720 microversion: 2.1 time: 0.600587 Oct 29 20:52:36.805543 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 700/1442] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:36 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1720 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:36.810917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:36.811677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:36.819947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.820662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.821252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:36.822166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:36.822777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:36.823364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.572158 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53b7c603-8d56-4c19-bfc6-a155a39d40b1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/fb91db52-67c6-44c4-a6d8-6b045a6d3b40" status: 200 len: 183 microversion: 2.1 time: 0.824025 Oct 29 20:52:37.572757 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 743/1443] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:52:36 2022] GET /compute/v2.1/os-floating-ips/fb91db52-67c6-44c4-a6d8-6b045a6d3b40 => generated 183 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:37.580454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:37.585836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:37.586349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:37.592508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:37.594125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:37.594847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.595349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.595801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.596310 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8590f60e-843e-405c-9a63-2728f6870903 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.789364 Oct 29 20:52:37.596508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.597138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.598625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 701/1444] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:36 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.613688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.615017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.644844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:37.738664 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1d470ef5-098c-4bda-ba2b-6ac2c653f836 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 204 len: 0 microversion: 2.1 time: 0.156359 Oct 29 20:52:37.742779 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 744/1445] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:37 2022] DELETE /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:37.745645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:37.746505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:37.752490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.753060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.753610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.754394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.754927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.755441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.790939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:37.815070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:37.896796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:37.906086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acebead7-b55d-46e9-af3e-a1f605a1d1ae tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 204 len: 0 microversion: 2.1 time: 0.165036 Oct 29 20:52:37.909823 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 745/1446] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:37 2022] DELETE /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:37.912757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:37.913179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:37.913913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:37.914540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:37.916388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-467da727-09b8-4bdc-8606-3d14372703b2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.317888 Oct 29 20:52:37.920272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.920948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.921713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.922701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.923463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.924085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.931751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 702/1447] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:37 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:37.943110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "63d60491-c21a-48b5-a73d-567ca98d992e"}, {"server_uuid": "cc17887b-64ba-4ef8-939e-1fedc1f62bbe", "name": "network-vif-deleted", "tag": "a0644f39-124b-4732-ad57-fe231fbd7267"}, {"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "04b9470e-35a4-48e8-9216-737abadca683"}, {"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "80432d50-130e-4119-9603-19dd672ae1bd"}, {"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "350a15b5-cd02-426b-b837-13daafa16f6e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:37.955037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:37.955834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:37.956463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:37.972630 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Creating event network-changed:63d60491-c21a-48b5-a73d-567ca98d992e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:37.973700 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Creating event network-vif-deleted:a0644f39-124b-4732-ad57-fe231fbd7267 for instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe on nch2-master-1 Oct 29 20:52:37.974292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Creating event network-changed:04b9470e-35a4-48e8-9216-737abadca683 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:37.974867 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Creating event network-changed:80432d50-130e-4119-9603-19dd672ae1bd for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:37.975476 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] Creating event network-changed:350a15b5-cd02-426b-b837-13daafa16f6e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:52:37.986353 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a41c6272-c7cb-4575-a46a-09aab2d6d8bf req-1f7ab862-bc1b-40cb-b927-3234db034b02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 851 microversion: 2.1 time: 0.053212 Oct 29 20:52:37.987044 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 703/1448] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 851 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:37.992847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.78"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:38.286982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:38.299665 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c17361e9-a3e8-49e1-86f9-ba6e9b92c0f3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1325 microversion: 2.1 time: 0.390810 Oct 29 20:52:38.300438 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 746/1449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:37 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:38.305317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:38.307171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:38.307171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:38.308748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:38.314688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:38.314880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:38.315379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:38.315711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:38.316979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:38.318287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:38.318910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:38.320484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:38.323920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:38.327100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:38.327606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:38.328054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:38.686424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:38.702450 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bd781231-8213-4309-8407-5a80ea97def2 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1477 microversion: 2.1 time: 0.400278 Oct 29 20:52:38.703233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 747/1450] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:38 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:38.708429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:38.709569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:38.717960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:38.718669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:38.719507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:38.721038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:38.721693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:38.724380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:38.728692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 20:52:38.729216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquired lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 20:52:38.956825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:38.969008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90cce7a3-7553-43ba-b7d6-a2031c0377e1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1710 microversion: 2.1 time: 0.264363 Oct 29 20:52:38.971851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 748/1451] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:38 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1710 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:38.980564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:38.981317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:39.002158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.002776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.003453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.004536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.006124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.007649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.308845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:39.318910 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-09511341-e0a7-4905-9abf-629ee8ec9df7 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1468 microversion: 2.1 time: 0.345497 Oct 29 20:52:39.320918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 749/1452] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:38 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:39.326139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9e403f75-390b-4591-9360-6abeb0aed8d7 req-5147175b-ee4d-43f5-880e-ee4f1ed7fd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:39.340868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e403f75-390b-4591-9360-6abeb0aed8d7 req-5147175b-ee4d-43f5-880e-ee4f1ed7fd05 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.341476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e403f75-390b-4591-9360-6abeb0aed8d7 req-5147175b-ee4d-43f5-880e-ee4f1ed7fd05 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.342936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e403f75-390b-4591-9360-6abeb0aed8d7 req-5147175b-ee4d-43f5-880e-ee4f1ed7fd05 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.360997 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9e403f75-390b-4591-9360-6abeb0aed8d7 req-5147175b-ee4d-43f5-880e-ee4f1ed7fd05 service nova] Creating event network-changed:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:52:39.371368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9e403f75-390b-4591-9360-6abeb0aed8d7 req-5147175b-ee4d-43f5-880e-ee4f1ed7fd05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049162 Oct 29 20:52:39.372865 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 750/1453] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:39.380271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7d83a37b-205d-407b-ae99-dc1ce6d9c7a0 req-23d1915e-95b6-4628-a7cd-7251fb0cf68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b8f36e-7013-4af8-a273-85bbe0cdb117", "name": "network-vif-plugged", "status": "completed", "tag": "f58dbb64-beaa-47c1-a364-7f25626be626"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:39.394204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7d83a37b-205d-407b-ae99-dc1ce6d9c7a0 req-23d1915e-95b6-4628-a7cd-7251fb0cf68e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.395009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7d83a37b-205d-407b-ae99-dc1ce6d9c7a0 req-23d1915e-95b6-4628-a7cd-7251fb0cf68e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.395768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7d83a37b-205d-407b-ae99-dc1ce6d9c7a0 req-23d1915e-95b6-4628-a7cd-7251fb0cf68e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.448787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7d83a37b-205d-407b-ae99-dc1ce6d9c7a0 req-23d1915e-95b6-4628-a7cd-7251fb0cf68e service nova] Creating event network-vif-plugged:f58dbb64-beaa-47c1-a364-7f25626be626 for instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 on nch2-master-1 Oct 29 20:52:39.457267 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7d83a37b-205d-407b-ae99-dc1ce6d9c7a0 req-23d1915e-95b6-4628-a7cd-7251fb0cf68e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081719 Oct 29 20:52:39.459064 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 751/1454] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:39.470202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:39.471292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:39.489026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.489569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.490024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.490740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.491258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.491835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.849166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:39.873786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:39.875822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:39.877957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f058dee4-5e81-4203-9252-139a98e05673 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.416667 Oct 29 20:52:39.897058 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 752/1455] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:39 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:39.906671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:39.907612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:39.910145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 20:52:39.919770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.920596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.921292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:39.922187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:39.923007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:39.923591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:40.164019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:40.172987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd5b622b-2776-4505-aac5-4f4fd276d98c tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1590 microversion: 2.1 time: 0.274367 Oct 29 20:52:40.173642 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 753/1456] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:39 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1590 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:40.186053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:40.186053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:40.193348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:40.193348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:40.193348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:40.193348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:40.193348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:40.193348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:40.577193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:40.587532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:40.589118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:40.590410 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc1d5e6d-5bdd-4649-9b2a-fa9fa9c8f7ea tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.415791 Oct 29 20:52:40.602183 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 754/1457] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:40 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:40.615480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-27b764c5-de21-4d31-b0f9-d7cc97200c8f tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '.version_select at 0x7fa171523f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:40.626186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27b764c5-de21-4d31-b0f9-d7cc97200c8f tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:40.626691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27b764c5-de21-4d31-b0f9-d7cc97200c8f tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:40.627187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27b764c5-de21-4d31-b0f9-d7cc97200c8f tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:40.648250 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-27b764c5-de21-4d31-b0f9-d7cc97200c8f tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 3117 microversion: 2.1 time: 0.044727 Oct 29 20:52:40.659121 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 755/1458] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:52:40 2022] GET /compute/v2.1/os-migrations => generated 3117 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:40.659121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:40.659121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:40.660787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:40.661277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:40.661996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:40.662707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:40.664320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:40.664580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.081872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:41.278183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Updating instance_info_cache with network_info: [{"id": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c", "address": "fa:16:3e:b0:a1:68", "network": {"id": "c0f21c63-d525-4dc0-89e4-ec653151e278", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-995545677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "da5abdc9b77f409dae205a3d7e3e913c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf4331d37-e5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 20:52:41.302526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Releasing lock "refresh_cache-5deded58-6d73-4dc1-81aa-679f48319c25" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 20:52:41.303473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc39a409-47da-4019-8bd1-55fc3cf595c1 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action" status: 202 len: 0 microversion: 2.1 time: 3.315239 Oct 29 20:52:41.304106 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 704/1459] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:37 2022] POST /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25/action => generated 0 bytes in 3317 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 20:52:41.317131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:41.317850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:41.345175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.346119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.349831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.351502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.354157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.354815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.447385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:41.464153 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f0dddd7-6b59-4871-9735-b73d138f3849 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1325 microversion: 2.1 time: 0.804907 Oct 29 20:52:41.480069 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 756/1460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:40 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1325 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:41.488758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:41.490205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:41.498055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.500423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.501626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.502928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.503850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.504451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.555874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.556360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.557265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.557910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lazy-loading 'fault' on Instance uuid 7a0ce51c-2842-4396-a37a-cef951983cf4 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:41.653256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:41.670039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e1a1faef-29a8-4070-87ca-ac34a88541be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 200 len: 1303 microversion: 2.1 time: 0.186787 Oct 29 20:52:41.671122 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 757/1461] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:41 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:41.685035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:41.686057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:41.695193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.696239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.696764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.697674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:41.698128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:41.698557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:41.988421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '531843035bb54ec9aabbe4cf1d240fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '674fcd08bc2c486aa00c64db594cabdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.005623 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b137d75b-8741-4d93-a2ce-0812a43e94e4 tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 200 len: 1477 microversion: 2.1 time: 0.692735 Oct 29 20:52:42.006412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 705/1462] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:41 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 1477 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:42.022665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.023324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.030960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.031701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.032333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.033228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.033939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.034615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.252979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d42f3dba-568a-45bd-81d1-351395632609 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1861 microversion: 2.1 time: 0.580348 Oct 29 20:52:42.254180 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 758/1463] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:41 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1861 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:42.259889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-95c27a81-3cb3-457f-a06c-54341e37ca48 req-96a6f995-47c4-4eb4-8aa2-2d7785b454e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ce51c-2842-4396-a37a-cef951983cf4", "name": "network-vif-deleted", "tag": "0f0dcbe2-0cfc-440f-b131-5d9056eee137"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:42.273489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-95c27a81-3cb3-457f-a06c-54341e37ca48 req-96a6f995-47c4-4eb4-8aa2-2d7785b454e9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.273988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-95c27a81-3cb3-457f-a06c-54341e37ca48 req-96a6f995-47c4-4eb4-8aa2-2d7785b454e9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.274427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-95c27a81-3cb3-457f-a06c-54341e37ca48 req-96a6f995-47c4-4eb4-8aa2-2d7785b454e9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.288438 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-95c27a81-3cb3-457f-a06c-54341e37ca48 req-96a6f995-47c4-4eb4-8aa2-2d7785b454e9 service nova] Creating event network-vif-deleted:0f0dcbe2-0cfc-440f-b131-5d9056eee137 for instance 7a0ce51c-2842-4396-a37a-cef951983cf4 on nch2-master-1 Oct 29 20:52:42.294026 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-95c27a81-3cb3-457f-a06c-54341e37ca48 req-96a6f995-47c4-4eb4-8aa2-2d7785b454e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038103 Oct 29 20:52:42.295164 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 759/1464] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:42.300696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.302639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.312445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.312960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.313346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.314771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.316019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.316790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.348643 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] HTTP exception thrown: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Request method failure captured: Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe HTTP/1.1 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZI15JsmT_84hTE-Cb9cGabfsYqt2wFqf2axBRWouFfpoDJk1-9LON34sAqnrdK8jdkYqbccJelx1YrOjrWrgD3b20ZEPz6WpUJV8eWywtUf6Wptn6WseRbSMTr9Xz8fB-M6znFAi8PV1BuCBsdYD--5NPbwA9raFP9f-4IOFSfT1fE Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 84799edfc2fd40b2ad004d9c080dde40 Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'cc17887b-64ba-4ef8-939e-1fedc1f62bbe'} Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:42.350984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Returning 404 to user: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:42.357728 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d91f28c-eb68-447e-aa59-828082fcb617 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 404 len: 111 microversion: 2.1 time: 0.056400 Oct 29 20:52:42.374732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 760/1465] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:42 2022] DELETE /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:42.382817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b7ce09-5c63-4a63-80c2-e8251952d218", "tag": "beda8d49-3f5d-434f-b721-bcad16331053"}, {"name": "network-changed", "server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:42.400757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.401247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.401784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.422473 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] Creating event network-changed:beda8d49-3f5d-434f-b721-bcad16331053 for instance a2b7ce09-5c63-4a63-80c2-e8251952d218 on nch1-master-1 Oct 29 20:52:42.423415 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] Creating event network-changed:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:52:42.433083 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-16dca08e-f868-4567-a0be-6d276cc731e9 req-f3b4b9b9-2ce5-4316-b39c-de220c633cba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056136 Oct 29 20:52:42.434117 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 761/1466] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:42.439528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.440479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.448934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.450109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.450756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.452693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.453651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.454240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.463934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.479126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.480904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.483641 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b02ea890-8c87-4d6f-8eda-eef6dc6221ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.473960 Oct 29 20:52:42.486751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 706/1467] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:42 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:42.495069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.497131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.518432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.520154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.520685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.521949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.522521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.523026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.870631 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b077565e-df84-48e7-a73b-f8151f809b14 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1861 microversion: 2.1 time: 0.382586 Oct 29 20:52:42.871227 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 707/1468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:42 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1861 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:42.875398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.875687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.876486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: cc17887b-64ba-4ef8-939e-1fedc1f62bbe] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.882669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.883272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.883816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.884674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.885236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.886587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.886771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.888514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:42.890752 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1467eca4-5afb-4e24-9f6e-fa45bf7fac63 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.455161 Oct 29 20:52:42.905479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 762/1469] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:42 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:42.905479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.905479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.906518 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] HTTP exception thrown: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Request method failure captured: Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe HTTP/1.1 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZI15JsmT_84hTE-Cb9cGabfsYqt2wFqf2axBRWouFfpoDJk1-9LON34sAqnrdK8jdkYqbccJelx1YrOjrWrgD3b20ZEPz6WpUJV8eWywtUf6Wptn6WseRbSMTr9Xz8fB-M6znFAi8PV1BuCBsdYD--5NPbwA9raFP9f-4IOFSfT1fE Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 84799edfc2fd40b2ad004d9c080dde40 Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'cc17887b-64ba-4ef8-939e-1fedc1f62bbe'} Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.908034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Returning 404 to user: Instance cc17887b-64ba-4ef8-939e-1fedc1f62bbe could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1945a300-a31f-43a6-a17b-5d33c0eddf91 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe" status: 404 len: 111 microversion: 2.1 time: 0.037952 Oct 29 20:52:42.912109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 708/1470] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:42 2022] GET /compute/v2.1/servers/cc17887b-64ba-4ef8-939e-1fedc1f62bbe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:42.916969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:42.917360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 7a0ce51c-2842-4396-a37a-cef951983cf4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:42.917574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.918341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.919492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.920681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.921449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.922188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.923664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.924142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.924578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.925273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:42.925755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:42.926212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:42.945163 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] HTTP exception thrown: Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 could not be found. Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Request method failure captured: Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 HTTP/1.1 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFThGEhtohnjLqroLp-J0j-DKPY8jfznTS3mEM6kDwZhJeLWXG_QO6U0cYc60yCHtj4pUg02-VzGdn1ugqvlJdOmtJzMs1UWG7yvEpRNyvyCfP23Y273aH4FnMiI_sDy7T7IXYwoOD6nAgaQX-boA2FOlB5qJL4ODuRzhKnKcrAKYA Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-MigrationsAdminTest-1765316182 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 0a554d93b7864309990e6252c09f59cc Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 could not be found. Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7a0ce51c-2842-4396-a37a-cef951983cf4'} Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 could not be found. Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 could not be found. Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:42.946883 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 could not be found. Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Returning 404 to user: Instance 7a0ce51c-2842-4396-a37a-cef951983cf4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c94a3084-13fb-47da-9998-7828286f484f tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4" status: 404 len: 111 microversion: 2.1 time: 0.036367 Oct 29 20:52:42.951024 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 709/1471] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:42 2022] GET /compute/v2.1/servers/7a0ce51c-2842-4396-a37a-cef951983cf4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:42.953705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d793adb-cab5-49b0-89ea-ce0f77903427 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '.version_select at 0x7fa171879310>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:43.188061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:43.196387 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bbc4e2a-e4c9-4849-a20c-9a9bad4072e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.303395 Oct 29 20:52:43.197323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 763/1472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:42 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:43.202122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:43.202995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:43.220358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.220865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.221314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.222072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.222535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.222966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.249906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:43.253299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:43.336639 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-203f5b97-ea6f-48b3-9821-e65f3b87d4be tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "DELETE /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 204 len: 0 microversion: 2.1 time: 0.137782 Oct 29 20:52:43.337241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 764/1473] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:43 2022] DELETE /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:43.342733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:43.343321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:43.349094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.349625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.350066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.350800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.351253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.351682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.505224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lazy-loading 'services' on Instance uuid f5fa038d-5a82-452d-bde6-eaa0b790d7cc {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:43.615354 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a11d36c-2916-4c95-a9df-4979da13a1c7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments/dc75a1bd-8bf7-49a6-adb1-547033153d04" status: 202 len: 0 microversion: 2.1 time: 0.276704 Oct 29 20:52:43.619133 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 765/1474] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 20:52:43 2022] DELETE /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments/dc75a1bd-8bf7-49a6-adb1-547033153d04 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:52:43.622077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:43.622786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] [instance: c17fc63e-a4d9-45ff-afff-b8d82e66114f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:43.628916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.629398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.629890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.630977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.631114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.631599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.645141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] HTTP exception thrown: Instance c17fc63e-a4d9-45ff-afff-b8d82e66114f could not be found. Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Request method failure captured: Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f HTTP/1.1 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZIxLDsW0l8z9CQaqy6IcUkLa1G2Xm8KccHZBaorooBv4yPQ7l9XF0HJYjFg4-ZBDX6Sh1LWSbZ4ZLDiVcV3-wCg-Vl3W1sMKdntCCHzj_gIC5a6zbNxkYGaLW1FEcPfRpdStZtVJPwRhx1K5mw-DHJmkE5c1JP2lpdylOeALo4u2mg Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 674fcd08bc2c486aa00c64db594cabdd Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1889669018 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/674fcd08bc2c486aa00c64db594cabdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1889669018 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 674fcd08bc2c486aa00c64db594cabdd Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1889669018 Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAdminNegativeTestJSON-1889669018-project Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 531843035bb54ec9aabbe4cf1d240fbd Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1889669018-project Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance c17fc63e-a4d9-45ff-afff-b8d82e66114f could not be found. Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c17fc63e-a4d9-45ff-afff-b8d82e66114f'} Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c17fc63e-a4d9-45ff-afff-b8d82e66114f could not be found. Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c17fc63e-a4d9-45ff-afff-b8d82e66114f could not be found. Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:43.646831 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c17fc63e-a4d9-45ff-afff-b8d82e66114f could not be found. Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] Returning 404 to user: Instance c17fc63e-a4d9-45ff-afff-b8d82e66114f could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:43.651516 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-814bf882-443a-4780-8b09-9fdcc633a4db tempest-ServersAdminNegativeTestJSON-1889669018 tempest-ServersAdminNegativeTestJSON-1889669018-project] 10.222.0.36 "GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f" status: 404 len: 111 microversion: 2.1 time: 0.031255 Oct 29 20:52:43.652941 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 766/1475] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:43 2022] GET /compute/v2.1/servers/c17fc63e-a4d9-45ff-afff-b8d82e66114f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:43.657070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:43.657668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:43.663672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.664155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.664593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.665285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.665784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.666751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.887842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:43.896536 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90b3e0c4-1e56-40ec-ad95-fa1bac12a620 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.243009 Oct 29 20:52:43.897353 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 767/1476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:43 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:43.902339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:43.902938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:43.908766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.909603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.910229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:43.911097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:43.911706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:43.912287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.132603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.141876 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d96fcdd2-fa45-4155-a19e-45cf98ba4399 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1534 microversion: 2.1 time: 0.243140 Oct 29 20:52:44.142639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 768/1477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:43 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1534 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:44.153710 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d793adb-cab5-49b0-89ea-ce0f77903427 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/fb91db52-67c6-44c4-a6d8-6b045a6d3b40" status: 202 len: 0 microversion: 2.1 time: 1.199472 Oct 29 20:52:44.153710 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 710/1478] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:52:42 2022] DELETE /compute/v2.1/os-floating-ips/fb91db52-67c6-44c4-a6d8-6b045a6d3b40 => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:52:44.159704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:44.159704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:44.164641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:44.166149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.166317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:44.166568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.167580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.168328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.169087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.169238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:44.169481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.182930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.183559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.184154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.185117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.185746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.186237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.228051 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94920bcf-f719-4f66-bf27-ae9ea2c213a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067289 Oct 29 20:52:44.228796 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 769/1479] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:44 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:44.234411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2312f140-643d-4c3f-91f4-cb1948341d4d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1352818051", "metadata": {"": ""}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2312f140-643d-4c3f-91f4-cb1948341d4d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action HTTP/1.1 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 107 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1352818051", "metadata": {"": ""}}} Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1352818051', 'metadata': {'': ''}}}} Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'': ''} Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:44.241786 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2312f140-643d-4c3f-91f4-cb1948341d4d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:44.246469 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2312f140-643d-4c3f-91f4-cb1948341d4d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action" status: 400 len: 170 microversion: 2.1 time: 0.013531 Oct 29 20:52:44.249345 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 770/1480] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Oct 29 20:52:44 2022] POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:52:44.254875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:44.255495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:44.262559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.263280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.264013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.264835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.265539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.266103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.438262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.448435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.450376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.451578 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32ac7b1a-5e09-4e63-bbec-6f42b1a5b641 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.300362 Oct 29 20:52:44.452571 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 711/1481] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:44 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:44.466522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:44.467575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:44.474378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.475096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.476129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.476984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.477551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.478543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.489384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.502531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.504410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:44.505647 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8deeb22-5f4e-4ccd-b1ab-e2cd8b89d899 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.255466 Oct 29 20:52:44.506258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:44.506467 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 771/1482] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:44 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:44.510938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:44.511564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:44.517921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.518422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.518976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.519593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.520055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.520488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.622074 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e6984f5c-6ace-4bba-a030-dd8745087cc9 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 204 len: 0 microversion: 2.1 time: 0.167535 Oct 29 20:52:44.622995 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 712/1483] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:44 2022] DELETE /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:44.629624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-da76d34f-123d-4cea-a143-f02c507b7eee req-0adf23f0-01da-47ff-b75a-c4b75e49be12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17fc63e-a4d9-45ff-afff-b8d82e66114f", "name": "network-vif-deleted", "tag": "d93ec6dd-9908-406f-b7db-942fadc1f241"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:44.640447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-da76d34f-123d-4cea-a143-f02c507b7eee req-0adf23f0-01da-47ff-b75a-c4b75e49be12 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.641207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-da76d34f-123d-4cea-a143-f02c507b7eee req-0adf23f0-01da-47ff-b75a-c4b75e49be12 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.641940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-da76d34f-123d-4cea-a143-f02c507b7eee req-0adf23f0-01da-47ff-b75a-c4b75e49be12 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.654951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-da76d34f-123d-4cea-a143-f02c507b7eee req-0adf23f0-01da-47ff-b75a-c4b75e49be12 service nova] Creating event network-vif-deleted:d93ec6dd-9908-406f-b7db-942fadc1f241 for instance c17fc63e-a4d9-45ff-afff-b8d82e66114f on nch2-master-1 Oct 29 20:52:44.660542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-da76d34f-123d-4cea-a143-f02c507b7eee req-0adf23f0-01da-47ff-b75a-c4b75e49be12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035931 Oct 29 20:52:44.661564 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 713/1484] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:44.667776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:44.668383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:44.675024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.675524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.675968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:44.676678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:44.677291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:44.677945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.101831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.110597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b8a5f5ab-231e-41c1-864b-3d2472ec9747 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.603198 Oct 29 20:52:45.111284 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 772/1485] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:44 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:45.137275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.138080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.144643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.145440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.145930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.146762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.147282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.147848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.240346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.250340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4238023e-370e-4b42-b5cb-e178b4a84190 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1525 microversion: 2.1 time: 0.587585 Oct 29 20:52:45.250913 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 714/1486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:44 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1525 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:45.255607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.256217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.263573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.264065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.264507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.265219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.265705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.266314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.327529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.336218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-587b8d50-e21e-4a43-a4f7-d0539cb05671 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.202954 Oct 29 20:52:45.336814 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 773/1487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:52:45.342029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.344422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.351263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.352022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.352633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.353558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.354176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.354774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.390325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf84cc9d-579a-47b0-b67f-f45aa2094e49 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052084 Oct 29 20:52:45.390912 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 774/1488] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:45.395897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88967370-6aab-4357-90df-c1dc9fa139fb tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1217613824", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88967370-6aab-4357-90df-c1dc9fa139fb tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action HTTP/1.1 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 619 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1217613824", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1217613824', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:52:45.399994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 20:52:45.403291 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.406123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88967370-6aab-4357-90df-c1dc9fa139fb tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:45.406123 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-88967370-6aab-4357-90df-c1dc9fa139fb tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action" status: 400 len: 938 microversion: 2.1 time: 0.009298 Oct 29 20:52:45.406123 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 775/1489] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Oct 29 20:52:45 2022] POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:52:45.410809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.411540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.419465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.420077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.420609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.421398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.422055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.422483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.428426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.437167 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b13635b-ce34-443a-a58a-70771b4dd62c tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1534 microversion: 2.1 time: 0.185093 Oct 29 20:52:45.438256 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 715/1490] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1534 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:45.478484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.480065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.489284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.489829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.490282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.491840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.493053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.493053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.590475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.599285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e34668d0-9f6f-4f0c-99a0-3b98ddcf4aa6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.191715 Oct 29 20:52:45.599875 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 776/1491] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:45.605022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.605663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.611438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.611926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.612365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.613059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.613638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.614046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.680876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.699717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.702213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.703642 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b5dc6f15-093b-48ec-b008-73fb860856cd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.229977 Oct 29 20:52:45.704399 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 716/1492] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:52:45.709294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.710621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.717085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.717911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.718641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.719513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.720129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.720774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.906213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.921579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.926333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.938023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3bf4cc3c-f2f3-417d-b354-4803e6beb542 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.232109 Oct 29 20:52:45.939327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:45.941105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7117afce-1f6a-484e-8348-8aa3fd2bba8f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.339601 Oct 29 20:52:45.943209 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 777/1493] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:45.943557 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 717/1494] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:45.967865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-944608d1-c75f-4d33-b667-183c1b16417f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-944608d1-c75f-4d33-b667-183c1b16417f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action HTTP/1.1 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 285 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:45.971545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-944608d1-c75f-4d33-b667-183c1b16417f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-944608d1-c75f-4d33-b667-183c1b16417f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action" status: 400 len: 619 microversion: 2.1 time: 0.009191 Oct 29 20:52:45.976399 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 778/1495] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Oct 29 20:52:45 2022] POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:52:45.983530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:45.984878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:45.991671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.992165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.992614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.993325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:45.993816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:45.994254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:45.998434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:46.172647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.180440 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce1f7619-236b-4b8c-926f-e7eb08c0e797 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.202090 Oct 29 20:52:46.181015 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 718/1496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:45 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:46.203784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:46.204426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.212128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.212746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.213317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.214910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.215444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.215947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.274455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:46.275078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.281256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.281930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.282475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.283321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.283914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.284442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.399573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.408472 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a65588d-b08e-45e1-a122-dc368d55206f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.208519 Oct 29 20:52:46.409313 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 779/1497] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:46 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:46.414094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:46.416259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.422301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.423117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.423721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.424581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.425198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.425814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.461692 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1fdf551c-f954-400e-8750-4a2ac1342f4e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050967 Oct 29 20:52:46.462552 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 780/1498] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:46 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:46.467684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-680217046"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:46.470258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.473705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.486424 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de8586b3-aa51-4ed3-a981-1b6c7f4d1531 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1525 microversion: 2.1 time: 0.213963 Oct 29 20:52:46.486829 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 719/1499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:46 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1525 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:52:46.493862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:46.495826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.496394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.496893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.497695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.498218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.498702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.499395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.510884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.511476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.511921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.521106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.521831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.522482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.671073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.679549 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8eadfd89-01cc-494b-bc15-0da0a307d859 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1534 microversion: 2.1 time: 0.190109 Oct 29 20:52:46.680119 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 720/1500] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:46 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1534 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:46.704573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:46.733855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8a84055-2073-44b2-95bc-c68442cf4508 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action" status: 202 len: 0 microversion: 2.1 time: 0.269655 Oct 29 20:52:46.740437 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 781/1501] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:46 2022] POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:52:46.741533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:46.742739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.749103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.749616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.750063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.750801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.751265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.751701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.834157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-2121897098", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:46.891088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:52:46.891925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:52:46.892173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:52:46.892668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:52:46.893203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:52:46.902380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.902602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.903072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.903596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.904606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.905156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.906270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.911061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.912570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:46.914286 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff30d486-c57d-417c-a525-9cd8f855f31f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.178280 Oct 29 20:52:46.915059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 782/1502] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:46 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:46.921530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1810037977"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:46.923797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.925972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Getting quotas for project b9971a4c060c460ab18788a4d41cec48. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:46.931121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.931761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.932268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Getting quotas for user 6550a74432294bf986cb02f6f73ed556 and project b9971a4c060c460ab18788a4d41cec48. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:46.932542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.933251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.933737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.934158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.947221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:52:46.949642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:52:46.968224 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Cannot 'createImage' instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 while it is in task_state image_snapshot Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action HTTP/1.1 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 85 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1810037977"}} Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'createImage' instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 while it is in task_state image_snapshot Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1810037977'}}} Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 20:52:46.969895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 while it is in task_state image_snapshot Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 while it is in task_state image_snapshot Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 409 to user: Cannot 'createImage' instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 while it is in task_state image_snapshot {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e6615420-7487-4e5b-a40b-21cc2b826248 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action" status: 409 len: 159 microversion: 2.1 time: 0.055122 Oct 29 20:52:46.974572 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 783/1503] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:52:46 2022] POST /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117/action => generated 159 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:52:46.977007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:46.977636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:46.983845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.984225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.984664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:46.985355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:46.985853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:46.986367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.011614 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91b9d5f8-16b6-4366-b46b-464067934100 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.330236 Oct 29 20:52:47.017622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 721/1504] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:52:47.026895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95892bf4-4842-4ed3-84d7-fa1a89ce6ae1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '.version_select at 0x7fa1719b5c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:47.174585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95892bf4-4842-4ed3-84d7-fa1a89ce6ae1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/images/e13df63b-8991-45a1-a35f-10175e565ddc" status: 204 len: 0 microversion: 2.1 time: 0.155748 Oct 29 20:52:47.175928 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 722/1505] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:47 2022] DELETE /compute/v2.1/images/e13df63b-8991-45a1-a35f-10175e565ddc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:47.185292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-70890426-bd3c-4e11-b3d5-cc99aa36bd30 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:47.185835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-70890426-bd3c-4e11-b3d5-cc99aa36bd30 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:47.332800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.345420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.347606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.351688 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d19f91c-6e0b-4a09-8db9-2ebb20918373 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.378632 Oct 29 20:52:47.352809 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 784/1506] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:46 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:47.358841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:47.359690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:47.367177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.368065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.368740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.369648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.370413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.371053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.386852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-70890426-bd3c-4e11-b3d5-cc99aa36bd30 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.398344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-70890426-bd3c-4e11-b3d5-cc99aa36bd30 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.404072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-70890426-bd3c-4e11-b3d5-cc99aa36bd30 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.416288 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-70890426-bd3c-4e11-b3d5-cc99aa36bd30 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1454 microversion: 2.91 time: 0.238325 Oct 29 20:52:47.421933 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 723/1507] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:47 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:47.476903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:47.482694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:47.489844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.490455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.491065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.492295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.493640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.494502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.537423 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-768aef64-c661-46a9-bc48-c95a11a66565 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066705 Oct 29 20:52:47.539423 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 724/1508] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:47 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:52:47.549315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:47.550283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:47.558254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.559056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.559712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.561658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.562796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.563434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.785115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:47.809248 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3f51b6db-7779-419b-a83b-956b25eed6cd tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1534 microversion: 2.1 time: 0.448802 Oct 29 20:52:47.812940 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 785/1509] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:47 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1534 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:47.831122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:47.832194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:47.846646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.847350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.847978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:47.848779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:47.850079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:47.852223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.037922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.048338 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-755e9175-692f-42fd-890e-e9b835f526b0 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1492 microversion: 2.1 time: 0.234068 Oct 29 20:52:48.049430 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 786/1510] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:47 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1492 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:48.053966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.061971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:48.062849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:48.065499 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f99e3fc-5caa-43ba-a3a3-87cfc11bd307 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1525 microversion: 2.1 time: 0.520616 Oct 29 20:52:48.066335 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 725/1511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:47 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1525 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:48.069834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.075450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.078916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.079714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.080195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.080640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.083419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cddd72d4-f6db-4e82-85e9-95ffcaf86f0e req-02eecb72-9642-465d-9bc3-05eaa0fe7583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953407b6-c139-4c24-95f1-0bd2c94f07df", "name": "network-vif-deleted", "tag": "e4f2108f-a545-45a5-877e-af0cb6881ebf"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:48.104571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cddd72d4-f6db-4e82-85e9-95ffcaf86f0e req-02eecb72-9642-465d-9bc3-05eaa0fe7583 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.105489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cddd72d4-f6db-4e82-85e9-95ffcaf86f0e req-02eecb72-9642-465d-9bc3-05eaa0fe7583 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.106029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cddd72d4-f6db-4e82-85e9-95ffcaf86f0e req-02eecb72-9642-465d-9bc3-05eaa0fe7583 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.120943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cddd72d4-f6db-4e82-85e9-95ffcaf86f0e req-02eecb72-9642-465d-9bc3-05eaa0fe7583 service nova] Creating event network-vif-deleted:e4f2108f-a545-45a5-877e-af0cb6881ebf for instance 953407b6-c139-4c24-95f1-0bd2c94f07df on nch1-master-1 Oct 29 20:52:48.126497 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cddd72d4-f6db-4e82-85e9-95ffcaf86f0e req-02eecb72-9642-465d-9bc3-05eaa0fe7583 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047633 Oct 29 20:52:48.128434 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 726/1512] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:48.314453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-afb4fcdd-5129-4aad-8ca0-744689e9b6d8 req-f88ba139-9c8b-4142-bb14-52e06dd6e19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828d0c05-713e-47b5-a8d5-369061b2c2d7", "name": "network-vif-unplugged", "status": "completed", "tag": "3b65ac57-f1c5-439c-8011-36c2b01a3c62"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:48.325727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-afb4fcdd-5129-4aad-8ca0-744689e9b6d8 req-f88ba139-9c8b-4142-bb14-52e06dd6e19d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.326481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-afb4fcdd-5129-4aad-8ca0-744689e9b6d8 req-f88ba139-9c8b-4142-bb14-52e06dd6e19d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.327308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-afb4fcdd-5129-4aad-8ca0-744689e9b6d8 req-f88ba139-9c8b-4142-bb14-52e06dd6e19d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.339506 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-afb4fcdd-5129-4aad-8ca0-744689e9b6d8 req-f88ba139-9c8b-4142-bb14-52e06dd6e19d service nova] Creating event network-vif-unplugged:3b65ac57-f1c5-439c-8011-36c2b01a3c62 for instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 on nch2-master-1 Oct 29 20:52:48.345084 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-afb4fcdd-5129-4aad-8ca0-744689e9b6d8 req-f88ba139-9c8b-4142-bb14-52e06dd6e19d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036659 Oct 29 20:52:48.345966 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 727/1513] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:52:48.390534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:48.392117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:48.398984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.399694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.400352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.401074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.401735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.402329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.421260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.438071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.442545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.444663 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e82e489-c9ba-422c-8ea5-fcd637c10dcc tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.386592 Oct 29 20:52:48.446011 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 787/1514] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:48 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:48.451311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:48.451978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:48.458750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.459551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.460475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.461706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.462493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.464009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.597889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.607338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.608816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.614762 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-35a398fc-544b-437d-a767-909eeb1ec8c2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1514 microversion: 2.91 time: 0.167532 Oct 29 20:52:48.615518 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 788/1515] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:48 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:48.621311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:48.623580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:48.629868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.630729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.632082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.632616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.633064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.633518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.666268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60b0583d-0bd7-477d-9526-458c7597a9eb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Oct 29 20:52:48.666828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 789/1516] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:48 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:48.841767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:48.843344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:48.849374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.850685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.851390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.852035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.852737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:48.853344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:48.853952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:48.859514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.861289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:48.863671 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6af2b912-7bd3-4848-83b0-939a0ecd6e51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.477567 Oct 29 20:52:48.878623 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 728/1517] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:48 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:49.073345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:49.074456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:49.093167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.098176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.099396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.100965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.102670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.103604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3877d757-4440-4d53-908e-df5e0b2620e9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1540 microversion: 2.1 time: 0.267282 Oct 29 20:52:49.104201 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 790/1518] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:48 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1540 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:49.112676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.113755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.121593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:49.122613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:49.131831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.132333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.132774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.133520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.133981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.134410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.239311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.242033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.248039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6897f557-2a23-4c87-92f5-fde67e40c04f tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1483 microversion: 2.1 time: 0.140254 Oct 29 20:52:49.249337 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 791/1519] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:49 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1483 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:49.251580 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b1cf862-9317-4138-86fd-7ea00fa2368b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1492 microversion: 2.1 time: 0.183514 Oct 29 20:52:49.252155 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 729/1520] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:49 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1492 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:52:49.470290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:49.470932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:49.477641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.478038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.478474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.479165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.479645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.480042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.605881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.613964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.615407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.616554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-810bc7a3-2f99-44c8-a275-bd5761e50651 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.150168 Oct 29 20:52:49.617118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 792/1521] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:49 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:49.646235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:49.646851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:49.653630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.654124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.654574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.655311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.655774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.656238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.678907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:49.681330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:49.687300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.687783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.688218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.688911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.689402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.689849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.720254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.720838 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15ba84e6-c877-438d-b27f-eee0602d09ce tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Oct 29 20:52:49.721406 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 793/1522] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:49 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:52:49.729478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.730922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:49.735800 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1db2c9d5-30b1-406b-a9c4-162b39c3bad3 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1512 microversion: 2.91 time: 0.093469 Oct 29 20:52:49.736376 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 730/1523] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:49 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:49.891084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:49.891690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:49.898278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.898756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.899191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:49.899939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:49.900394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:49.900816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.120445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.128807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:50.129735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:50.133792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.135246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.136419 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45128413-d6cc-410f-ab7b-ad963063bb5f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.249208 Oct 29 20:52:50.136982 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 794/1524] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:49 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:50.147976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.148718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.150050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.154045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.154696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.155329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.272352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:50.272889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:50.279225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.279886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.280322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.281016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.281624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.282212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.325744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:50.339901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.342770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.343246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.347083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lazy-loading 'fault' on Instance uuid 5deded58-6d73-4dc1-81aa-679f48319c25 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:50.473552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.475009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84799edfc2fd40b2ad004d9c080dde40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5abdc9b77f409dae205a3d7e3e913c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.488292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e77a690-f107-428b-8b89-653d292facb9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1540 microversion: 2.1 time: 0.363475 Oct 29 20:52:50.490266 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 731/1525] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:50 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1540 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:52:50.496226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:50.497046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:50.497611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e4ff4ae8-dafb-4ffe-b330-4caa15389d74 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 200 len: 1314 microversion: 2.1 time: 0.229512 Oct 29 20:52:50.498204 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 795/1526] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:50 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:52:50.507219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5deded58-6d73-4dc1-81aa-679f48319c25", "name": "network-vif-deleted", "tag": "f4331d37-e5c6-46e9-8fbe-4133b15b5e3c"}, {"name": "network-changed", "server_uuid": "828d0c05-713e-47b5-a8d5-369061b2c2d7", "tag": "3b65ac57-f1c5-439c-8011-36c2b01a3c62"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:50.521573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.522215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.522813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.523578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.524139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.524673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.526744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.527229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.527657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.542286 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] Creating event network-vif-deleted:f4331d37-e5c6-46e9-8fbe-4133b15b5e3c for instance 5deded58-6d73-4dc1-81aa-679f48319c25 on nch1-master-1 Oct 29 20:52:50.543241 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] Creating event network-changed:3b65ac57-f1c5-439c-8011-36c2b01a3c62 for instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 on nch2-master-1 Oct 29 20:52:50.555648 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-27a2ad85-bfd7-47c9-8628-6c510307c28c req-da58256a-ff4f-4c79-b5bf-43bab6857577 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056268 Oct 29 20:52:50.556804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 796/1527] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:50.565136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.565698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.566210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.566878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lazy-loading 'fault' on Instance uuid 953407b6-c139-4c24-95f1-0bd2c94f07df {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:50.641951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:50.642810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:50.649921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.650687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.651356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.652067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.652929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.653663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.654336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.678864 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b77b505-8e38-4c28-8140-5819832ea679 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 200 len: 1368 microversion: 2.1 time: 0.186132 Oct 29 20:52:50.694079 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 732/1528] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:50 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:50.734121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:50.736737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:50.751120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.752123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.752803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.754175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.755879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.759052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.796316 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d96a5c7b-95ce-4937-8436-266b178f68d3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066998 Oct 29 20:52:50.797660 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 733/1529] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:52:50 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:52:50.803834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:50.804948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:50.812154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.812727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.813172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.820132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.820624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.821068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.914198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.927090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.930429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.934469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.938263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e284d13f-1d29-4200-a4b7-88015b071063 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1512 microversion: 2.91 time: 0.138845 Oct 29 20:52:50.939711 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 734/1530] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:50 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1512 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:50.945211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9f9a0488-fe96-4c12-abda-244b33c996f1 req-65ee7ef7-f93c-4cf7-bd68-a5dc85db7316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b8f36e-7013-4af8-a273-85bbe0cdb117", "name": "network-vif-plugged", "status": "completed", "tag": "f58dbb64-beaa-47c1-a364-7f25626be626"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:50.959381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9f9a0488-fe96-4c12-abda-244b33c996f1 req-65ee7ef7-f93c-4cf7-bd68-a5dc85db7316 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:50.961843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9f9a0488-fe96-4c12-abda-244b33c996f1 req-65ee7ef7-f93c-4cf7-bd68-a5dc85db7316 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:50.962753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9f9a0488-fe96-4c12-abda-244b33c996f1 req-65ee7ef7-f93c-4cf7-bd68-a5dc85db7316 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:50.970206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.971686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:50.972873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16e6564b-1a4c-4af2-b9dc-810da7ddb7bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.335041 Oct 29 20:52:50.979183 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9f9a0488-fe96-4c12-abda-244b33c996f1 req-65ee7ef7-f93c-4cf7-bd68-a5dc85db7316 service nova] Creating event network-vif-plugged:f58dbb64-beaa-47c1-a364-7f25626be626 for instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 on nch2-master-1 Oct 29 20:52:50.986601 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9f9a0488-fe96-4c12-abda-244b33c996f1 req-65ee7ef7-f93c-4cf7-bd68-a5dc85db7316 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045002 Oct 29 20:52:50.987663 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 735/1532] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:50.990184 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 797/1532] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:50 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:52:51.167441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:51.168162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:51.181683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:51.182193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:51.182622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:51.183342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:51.183802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:51.184231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:51.518848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:51.521025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:51.548350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:51.552306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:51.552835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:51.562669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:51.563842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:51.565619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:51.651967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:52.336823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.341323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.345302 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5fd21410-b36a-4c65-919d-e377c0b72406 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1535 microversion: 2.1 time: 0.833284 Oct 29 20:52:52.351034 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 798/1533] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:51 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1535 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:52.354059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.355627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.356350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.356980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] [instance: 5deded58-6d73-4dc1-81aa-679f48319c25] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:52.357130 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79223223-c53e-4b0d-b2a9-1ea95b1f35f7 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 1.196317 Oct 29 20:52:52.357872 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 736/1534] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:51 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:52.363313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.364060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.364758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.366407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.369916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.370425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.371099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.371964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: 953407b6-c139-4c24-95f1-0bd2c94f07df] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:52.378310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.378936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.379503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.380317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.380885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.381418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.385555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] HTTP exception thrown: Instance 5deded58-6d73-4dc1-81aa-679f48319c25 could not be found. Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Request method failure captured: Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 HTTP/1.1 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZI15JsmT_84hTE-Cb9cGabfsYqt2wFqf2axBRWouFfpoDJk1-9LON34sAqnrdK8jdkYqbccJelx1YrOjrWrgD3b20ZEPz6WpUJV8eWywtUf6Wptn6WseRbSMTr9Xz8fB-M6znFAi8PV1BuCBsdYD--5NPbwA9raFP9f-4IOFSfT1fE Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/da5abdc9b77f409dae205a3d7e3e913c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: da5abdc9b77f409dae205a3d7e3e913c Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-683553593 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 84799edfc2fd40b2ad004d9c080dde40 Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-683553593-project Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 5deded58-6d73-4dc1-81aa-679f48319c25 could not be found. Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5deded58-6d73-4dc1-81aa-679f48319c25'} Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5deded58-6d73-4dc1-81aa-679f48319c25 could not be found. Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5deded58-6d73-4dc1-81aa-679f48319c25 could not be found. Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.387460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5deded58-6d73-4dc1-81aa-679f48319c25 could not be found. Oct 29 20:52:52.392671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.394214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] Returning 404 to user: Instance 5deded58-6d73-4dc1-81aa-679f48319c25 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:52.395198 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8eb9f98a-9050-4671-a7d7-a879138ccfd8 tempest-FloatingIPsAssociationTestJSON-683553593 tempest-FloatingIPsAssociationTestJSON-683553593-project] 10.222.0.36 "GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25" status: 404 len: 111 microversion: 2.1 time: 0.042711 Oct 29 20:52:52.397237 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 799/1535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:52 2022] GET /compute/v2.1/servers/5deded58-6d73-4dc1-81aa-679f48319c25 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:52.398563 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] HTTP exception thrown: Instance 953407b6-c139-4c24-95f1-0bd2c94f07df could not be found. Oct 29 20:52:52.401793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.402556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:52.409403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.409930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Request method failure captured: Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df HTTP/1.1 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZFThGEhtohnjLqroLp-J0j-DKPY8jfznTS3mEM6kDwZhJeLWXG_QO6U0cYc60yCHtj4pUg02-VzGdn1ugqvlJdOmtJzMs1UWG7yvEpRNyvyCfP23Y273aH4FnMiI_sDy7T7IXYwoOD6nAgaQX-boA2FOlB5qJL4ODuRzhKnKcrAKYA Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-MigrationsAdminTest-1765316182 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 0a554d93b7864309990e6252c09f59cc Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 953407b6-c139-4c24-95f1-0bd2c94f07df could not be found. Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '953407b6-c139-4c24-95f1-0bd2c94f07df'} Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953407b6-c139-4c24-95f1-0bd2c94f07df could not be found. Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953407b6-c139-4c24-95f1-0bd2c94f07df could not be found. Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:52.410094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953407b6-c139-4c24-95f1-0bd2c94f07df could not be found. Oct 29 20:52:52.415815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:52:52.416378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.416378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.416378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.416378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.416741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Returning 404 to user: Instance 953407b6-c139-4c24-95f1-0bd2c94f07df could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:52.417436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-187ae1b2-aafc-4941-89c6-f510c2251bd6 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df" status: 404 len: 111 microversion: 2.1 time: 0.058389 Oct 29 20:52:52.420235 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 737/1536] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:52 2022] GET /compute/v2.1/servers/953407b6-c139-4c24-95f1-0bd2c94f07df => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:52.425025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.425694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:52.433078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.433656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.434094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.434799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.435252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.435678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.536818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.548296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.550007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.555889 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30758edd-63cf-40e7-b5c4-86f4609cc5a1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1533 microversion: 2.91 time: 0.158988 Oct 29 20:52:52.556554 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 800/1537] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:52 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1533 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:52.565352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e2e89db-cbc6-438d-a816-73a77f701c97 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '.version_select at 0x7fa1713a5280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.598121 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0e2e89db-cbc6-438d-a816-73a77f701c97 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349093672" status: 202 len: 0 microversion: 2.1 time: 0.039860 Oct 29 20:52:52.602880 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 801/1538] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 20:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349093672 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:52:52.664737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.665657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:52.672827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.673630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.674281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.675173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.677336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.678009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.747424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.756285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.759473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:52.760899 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-65866388-914c-4dd8-b885-dba7f6fd681a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.341077 Oct 29 20:52:52.775008 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 738/1539] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:52 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:52.906598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lazy-loading 'services' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:52.926488 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d75b0714-2e27-4c48-85c5-4e27f023a58f tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1938 microversion: 2.91 time: 0.322162 Oct 29 20:52:52.927001 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 802/1540] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:52 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1938 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:52.956715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:52.957919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:52.985089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.985650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.986533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:52.987465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:52.987929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:52.988603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.158322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:53.165274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lazy-loading 'services' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:53.223603 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6759c940-4038-44ac-81e4-fda742332a27 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1938 microversion: 2.91 time: 0.269245 Oct 29 20:52:53.239603 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 739/1541] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:52 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1938 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:53.262503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:53.270720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.273908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.275595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.278402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.280610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.281285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.337055 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-abf9e2d7-17b9-467e-a7bb-1df2226406e6 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.088114 Oct 29 20:52:53.338717 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 803/1542] 10.222.0.36 () {60 vars in 1217 bytes} [Sat Oct 29 20:52:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:52:53.354195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:53.361777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:53.376032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:53.376394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:53.384666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.385360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.387428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.387903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.388490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.389679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.390505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.391187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.391877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.392126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.394700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.395403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.427488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lazy-loading 'flavor' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:53.688308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:53.702445 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4499d66-72da-40fa-b439-2815b9f7fe7b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1522 microversion: 2.1 time: 0.329125 Oct 29 20:52:53.705591 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 804/1543] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:53 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:53.718706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:53.719694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:53.742396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.743336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.743972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.744885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.745536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.746123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.770450 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a03046cd-976f-4ded-a774-359badf73931 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action" status: 202 len: 0 microversion: 2.91 time: 0.421298 Oct 29 20:52:53.777020 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 740/1544] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:52:53 2022] POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:53.782642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:53.783635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:53.801607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.802117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.802565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.803883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:53.804354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:53.804787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:53.867324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:54.034562 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-19f29185-64e5-44f0-9eef-7c0a46fbc0d3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 204 len: 0 microversion: 2.1 time: 0.255012 Oct 29 20:52:54.035791 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 741/1545] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:53 2022] DELETE /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:54.046094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:54.047910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:54.056132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.056896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.057669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.059169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.059891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.060497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.084680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.095228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.097175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.098910 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7756f10c-18a1-4c99-8beb-391e78395c41 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.391865 Oct 29 20:52:54.100147 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 805/1546] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:53 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:54.105427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:54.106330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:54.120018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.120878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.121049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.121680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.122334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.122941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.174167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.190343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.192558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.196981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:54.200220 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-656114f9-4873-422b-a0e3-8486bd9a2519 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.162935 Oct 29 20:52:54.201112 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 742/1547] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:54 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:54.206328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:54.207114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:54.225170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.230021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.230777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.231742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.232388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.233187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.265621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:52:54.315877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.329553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.332370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.334526 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-344ec023-d50f-4602-82c4-bdce5a81c7ff tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.232718 Oct 29 20:52:54.335930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 806/1548] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:54 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:54.343498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1561733526", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "151c0760-9de5-4226-8749-cb91b64e1da1"}], "block_device_mapping_v2": [{"uuid": "2a8a70f6-4db6-4c78-9864-0595400e6ea2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:54.391820 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c8be0bf-10f7-4fe0-bbe7-21e3d0cfb6a1 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 204 len: 0 microversion: 2.1 time: 0.186428 Oct 29 20:52:54.392640 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 743/1549] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:52:54 2022] DELETE /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:52:54.401182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:54.402540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:54.409111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.409756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.410482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.411937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.413260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.413965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.440433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] validate_networks() for [('151c0760-9de5-4226-8749-cb91b64e1da1', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:52:54.663567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.676358 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75a8d7b9-f167-4442-9e0e-df6a0959bcad tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1528 microversion: 2.1 time: 0.279437 Oct 29 20:52:54.676962 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 744/1550] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:54 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1528 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:54.681692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:54.682643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:54.691964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.692390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.692839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.693609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:54.696009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:54.696462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:54.902694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:54.911323 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aba8b06a-52e3-4336-b973-166ec0764d7d tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1469 microversion: 2.1 time: 0.233236 Oct 29 20:52:54.912120 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 745/1551] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:54 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:55.128320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:55.129032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:55.136777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.137929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.138400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.139141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.140234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.140234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.149539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:52:55.151490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:52:55.152152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:52:55.152726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:52:55.153823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:52:55.166610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.167594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.168567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.169794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.170842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.172301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.202553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:55.209057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Getting quotas for user 869b7117eab8443e9cbb52400b875ebc and project d373d98fd667430fac145e2e63249419. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:55.291009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:52:55.293285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a8a70f6-4db6-4c78-9864-0595400e6ea2',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:52:55.381226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.399111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.401793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.403705 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d7edd734-b2bc-4363-a559-f2004c0726be tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.279894 Oct 29 20:52:55.423707 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 746/1552] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:55 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:52:55.431764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:55.432393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:55.440229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.441105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.441897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.442941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.443717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.444505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.518968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dea4362a-53de-4e17-8031-06a5bf7ce606 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181165 Oct 29 20:52:55.534363 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 807/1553] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:52:55.543940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.548289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:55.555372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.556818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:55.556948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.562895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae4ea02b-2bba-410f-a3e1-c3eadb018c01 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.137738 Oct 29 20:52:55.570426 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 747/1554] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:55 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:55.577411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d3976a93-4800-40ce-a06b-28f82dc43615 req-d1c4fc12-e23f-40b9-9711-845663c6234b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b8f36e-7013-4af8-a273-85bbe0cdb117", "name": "network-vif-unplugged", "status": "completed", "tag": "f58dbb64-beaa-47c1-a364-7f25626be626"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:55.583212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.588765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.589502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.590602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.591228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.592428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.592913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d3976a93-4800-40ce-a06b-28f82dc43615 req-d1c4fc12-e23f-40b9-9711-845663c6234b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.593397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d3976a93-4800-40ce-a06b-28f82dc43615 req-d1c4fc12-e23f-40b9-9711-845663c6234b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.593867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d3976a93-4800-40ce-a06b-28f82dc43615 req-d1c4fc12-e23f-40b9-9711-845663c6234b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.613734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d3976a93-4800-40ce-a06b-28f82dc43615 req-d1c4fc12-e23f-40b9-9711-845663c6234b service nova] Creating event network-vif-unplugged:f58dbb64-beaa-47c1-a364-7f25626be626 for instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 on nch2-master-1 Oct 29 20:52:55.620331 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d3976a93-4800-40ce-a06b-28f82dc43615 req-d1c4fc12-e23f-40b9-9711-845663c6234b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047882 Oct 29 20:52:55.621612 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 748/1555] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:55.635072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b6f92e6-80d1-4800-b06c-755abf05b4c9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:55.636387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b6f92e6-80d1-4800-b06c-755abf05b4c9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:55.762170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b6f92e6-80d1-4800-b06c-755abf05b4c9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:55.775519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b6f92e6-80d1-4800-b06c-755abf05b4c9 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1053 microversion: 2.1 time: 0.152491 Oct 29 20:52:55.778081 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 749/1556] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:55 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1053 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:55.788953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:55.792928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:55.806766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.811090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.811825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:55.814744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:55.816883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:55.821817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:56.204456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:56.230174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:56.231720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:56.232933 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2956e7f-67df-48d6-bf2a-df734431cb6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.695614 Oct 29 20:52:56.240571 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 808/1557] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:55 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:56.249506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:56.250053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:56.274038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:56.274417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:56.274943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:56.275576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:56.286714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:56.287214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:56.429503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:56.445791 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-358632a1-5520-472d-9f63-1e66f409df83 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1528 microversion: 2.1 time: 0.666405 Oct 29 20:52:56.446774 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 750/1558] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:55 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1528 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:56.452748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:56.453876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:56.475842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:56.476622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:56.477799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:56.478789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:56.479469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:56.480116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:56.842045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:56.863298 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a45bb95-2b8f-4dd8-b827-1a588f7bfb44 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1469 microversion: 2.1 time: 0.621089 Oct 29 20:52:56.867686 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 809/1559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:56 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1469 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:56.883389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:56.887832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:56.915748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:56.916937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:56.923279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:56.924191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:56.925339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:56.928060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:56.929731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.001030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.015820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.018058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.019823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-69744d36-6701-4142-9768-95cbd3a07e18 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.571798 Oct 29 20:52:57.021096 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 751/1560] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:56 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:57.031872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:57.032797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:57.043977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.044750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.045419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.046474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.047099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.047631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.100932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:52:57.334495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.342755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.344638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6e3539d-3400-4302-bff4-ef513663c8bd tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1151 microversion: 2.1 time: 0.322284 Oct 29 20:52:57.357392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.359229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.367068 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 752/1561] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:57 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:57.372901 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1eb923d8-fb46-49d2-8a9b-ef1423711225 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.498943 Oct 29 20:52:57.384958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:57.386059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 810/1562] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:56 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:57.386179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:57.399338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.399338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.399338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.403346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.403859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.407919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.474274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:57.475635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:57.483932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.484522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.485025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.485836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.486381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.487040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.591687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.603380 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b24ba72-6644-4a43-b9a6-d56c0c784740 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 200 len: 1486 microversion: 2.1 time: 0.134802 Oct 29 20:52:57.609514 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 811/1563] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:57 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 1486 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:52:57.697342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ff61d96c-bf1f-4018-a5b5-f053306a7cfd req-e06b22c2-6af9-44a1-912d-840f29e85a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b8f36e-7013-4af8-a273-85bbe0cdb117", "name": "network-vif-deleted", "tag": "f58dbb64-beaa-47c1-a364-7f25626be626"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:57.717445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ff61d96c-bf1f-4018-a5b5-f053306a7cfd req-e06b22c2-6af9-44a1-912d-840f29e85a28 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.718386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ff61d96c-bf1f-4018-a5b5-f053306a7cfd req-e06b22c2-6af9-44a1-912d-840f29e85a28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.719353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ff61d96c-bf1f-4018-a5b5-f053306a7cfd req-e06b22c2-6af9-44a1-912d-840f29e85a28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.737380 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ff61d96c-bf1f-4018-a5b5-f053306a7cfd req-e06b22c2-6af9-44a1-912d-840f29e85a28 service nova] Creating event network-vif-deleted:f58dbb64-beaa-47c1-a364-7f25626be626 for instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 on nch2-master-1 Oct 29 20:52:57.759562 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ff61d96c-bf1f-4018-a5b5-f053306a7cfd req-e06b22c2-6af9-44a1-912d-840f29e85a28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067174 Oct 29 20:52:57.760989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 812/1564] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:52:57.782560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.795530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.797552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:57.799238 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9274a168-f973-4266-8544-2f1c51bae4d7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.431091 Oct 29 20:52:57.817575 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 753/1565] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:57 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:57.897563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:57.899176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:57.907911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.908748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.909408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:57.910341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:57.910993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:57.911658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.022886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.046170 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62a7c69b-4f63-4a06-a932-dca53c623f30 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1427 microversion: 2.1 time: 0.154422 Oct 29 20:52:58.050390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:58.051205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:58.052477 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 813/1566] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:57 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:58.063977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.064475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.064911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.066885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.071495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.071959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.288098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.298476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.299953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.301135 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f296a079-fec9-4fd8-9020-a33364e80d51 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.256320 Oct 29 20:52:58.301989 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 754/1567] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:58 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:52:58.369257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:58.369616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:58.383473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.385780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.386562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.387478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.393475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.394262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.415538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:58.416426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:58.434206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.435707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.438561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.440429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.443906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.445775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.550261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.563345 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f98406d6-b614-4398-8d7b-d2eef799b589 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1169 microversion: 2.1 time: 0.194275 Oct 29 20:52:58.564892 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 814/1568] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:58 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:58.629781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.632097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:58.634978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:58.650776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.653203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.657396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.658079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.661314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.662355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:58.664911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.672412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.687007 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a9fe89f-119b-464c-8f1c-5fcc4e7f90e2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.285069 Oct 29 20:52:58.711493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 755/1569] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:58 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:52:58.746709 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 HTTP/1.1 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117'} Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:58.749732 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:52:58.757389 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:52:58.759096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:52:58.761002 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d4d32eb-69fa-4a5c-b6c2-6fbbe533eca1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 404 len: 111 microversion: 2.1 time: 0.135332 Oct 29 20:52:58.761727 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 815/1570] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:58 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:52:58.774980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9b91cbf-4b32-4580-a2bf-d017a4644b79 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'create', calling method: .version_select at 0x7fa171a39ca0>, body: {"keypair": {"name": "tempest-keypair-1333864863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmuhIQWo9NM9UBeiqBEnH9881bdVDeym8j0PDkIu3WChyZ3pOPrnzeR2IemhESJIn6H9LXO9oQHAf1g29xwK9gN/j3fB2qsgJRKz+RK2UZeSr1tsFi26ZMueSF6WnaCug=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:52:58.811682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a9b91cbf-4b32-4580-a2bf-d017a4644b79 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:52:58.826992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:58.827989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:58.829521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a9b91cbf-4b32-4580-a2bf-d017a4644b79 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for user 68212c49a188473ca9f523c46fd9cba2 and project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:52:58.835535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.836248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.836869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.837992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:58.838768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:58.839377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:58.883501 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9b91cbf-4b32-4580-a2bf-d017a4644b79 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113340 Oct 29 20:52:58.889639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 756/1571] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:52:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:52:59.074044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:59.075058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:59.105024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.108359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.110364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:59.111429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.112323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.114080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:59.204078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.204945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.205857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:59.208286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lazy-loading 'fault' on Instance uuid c38b7560-af3b-4b34-9b58-1579730d6484 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:52:59.226138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:59.239117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:59.241492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:59.243505 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2ffd197-19be-48d4-9d2e-45ca4f1717ec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.421481 Oct 29 20:52:59.244873 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 816/1572] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:58 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:52:59.306406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:52:59.322940 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-59f8a703-35c0-4a1e-96f3-19c5366603ac tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 200 len: 1303 microversion: 2.1 time: 0.254566 Oct 29 20:52:59.323880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 757/1573] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:59 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 1303 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:52:59.344745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:59.345351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:59.367544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.368056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.368897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:59.369917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.370582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.371287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:59.597807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:52:59.598863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:52:59.610898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.616675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.617449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:52:59.621471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:52:59.623036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:52:59.624362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.301967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.317662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.320262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.321935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-79a567c0-9690-43a3-ad9e-05f7859ad52b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.981148 Oct 29 20:53:00.338887 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 817/1574] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:52:59 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:00.347187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:00.348148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:00.356749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.357655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.360297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.361264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.362508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.363181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.413432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.430062 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-117ca67a-c15f-4099-ba2e-3cdcf2f19245 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1211 microversion: 2.1 time: 0.841480 Oct 29 20:53:00.434765 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 758/1575] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:52:59 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1211 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:00.445000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-243f4675-ffca-40e1-9e3a-435ea8bf3aaa req-ecfa003d-4029-406e-b3a4-60f0b887b165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38b7560-af3b-4b34-9b58-1579730d6484", "name": "network-vif-deleted", "tag": "a21152b8-9e98-4abd-8e16-2f6e6a4bced5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:00.469649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-243f4675-ffca-40e1-9e3a-435ea8bf3aaa req-ecfa003d-4029-406e-b3a4-60f0b887b165 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.473412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-243f4675-ffca-40e1-9e3a-435ea8bf3aaa req-ecfa003d-4029-406e-b3a4-60f0b887b165 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.474453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-243f4675-ffca-40e1-9e3a-435ea8bf3aaa req-ecfa003d-4029-406e-b3a4-60f0b887b165 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.510448 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-243f4675-ffca-40e1-9e3a-435ea8bf3aaa req-ecfa003d-4029-406e-b3a4-60f0b887b165 service nova] Creating event network-vif-deleted:a21152b8-9e98-4abd-8e16-2f6e6a4bced5 for instance c38b7560-af3b-4b34-9b58-1579730d6484 on nch1-master-1 Oct 29 20:53:00.547515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.559337 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-243f4675-ffca-40e1-9e3a-435ea8bf3aaa req-ecfa003d-4029-406e-b3a4-60f0b887b165 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106542 Oct 29 20:53:00.560095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 759/1576] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:00.577413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.582218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:00.588864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:00.590303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:00.606422 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a667f2d8-3cb9-4026-bb57-ca91417421bc tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.265903 Oct 29 20:53:00.618922 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 818/1577] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:00 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:00.626869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.631940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.635184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:00.635406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.636273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.637385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.639965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.645028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: c38b7560-af3b-4b34-9b58-1579730d6484] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:00.692423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.694268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.697907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.698755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.703489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.705064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.748133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:00.749891 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] HTTP exception thrown: Instance c38b7560-af3b-4b34-9b58-1579730d6484 could not be found. Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Request method failure captured: Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 HTTP/1.1 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFThGEhtohnjLqroLp-J0j-DKPY8jfznTS3mEM6kDwZhJeLWXG_QO6U0cYc60yCHtj4pUg02-VzGdn1ugqvlJdOmtJzMs1UWG7yvEpRNyvyCfP23Y273aH4FnMiI_sDy7T7IXYwoOD6nAgaQX-boA2FOlB5qJL4ODuRzhKnKcrAKYA Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MigrationsAdminTest-1765316182 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0a554d93b7864309990e6252c09f59cc Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance c38b7560-af3b-4b34-9b58-1579730d6484 could not be found. Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c38b7560-af3b-4b34-9b58-1579730d6484'} Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38b7560-af3b-4b34-9b58-1579730d6484 could not be found. Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38b7560-af3b-4b34-9b58-1579730d6484 could not be found. Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:00.751969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38b7560-af3b-4b34-9b58-1579730d6484 could not be found. Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Returning 404 to user: Instance c38b7560-af3b-4b34-9b58-1579730d6484 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:53:00.757972 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cbe92cc9-f1dc-46e5-94e2-f2d7cffdd072 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484" status: 404 len: 111 microversion: 2.1 time: 0.133706 Oct 29 20:53:00.758815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 819/1578] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:00 2022] GET /compute/v2.1/servers/c38b7560-af3b-4b34-9b58-1579730d6484 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:53:00.765437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:00.765985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:00.774591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.775308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.775786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.776897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:00.777624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:00.778138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:00.815155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:53:00.932652 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e8b876e-994f-4a22-9eaf-8b97c08a2731 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 204 len: 0 microversion: 2.1 time: 0.171953 Oct 29 20:53:00.934795 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 820/1579] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:53:00 2022] DELETE /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:00.948302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a42efbed-74dc-46b1-a7c8-fe23ee92e884 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa1713485e0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:01.003240 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a42efbed-74dc-46b1-a7c8-fe23ee92e884 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19" status: 200 len: 636 microversion: 2.1 time: 0.065596 Oct 29 20:53:01.012841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 821/1580] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:00 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19 => generated 636 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:01.019575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e7f2b97f-7747-4bf0-a263-e8adccd319bd req-b0ddffb8-a1f8-47e1-ad9e-a9853d091d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "d69628a0-7168-4d48-8d30-4c1874e6521f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:01.035994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e7f2b97f-7747-4bf0-a263-e8adccd319bd req-b0ddffb8-a1f8-47e1-ad9e-a9853d091d0e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.037377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e7f2b97f-7747-4bf0-a263-e8adccd319bd req-b0ddffb8-a1f8-47e1-ad9e-a9853d091d0e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.038569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e7f2b97f-7747-4bf0-a263-e8adccd319bd req-b0ddffb8-a1f8-47e1-ad9e-a9853d091d0e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.078761 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e7f2b97f-7747-4bf0-a263-e8adccd319bd req-b0ddffb8-a1f8-47e1-ad9e-a9853d091d0e service nova] Creating event network-vif-plugged:d69628a0-7168-4d48-8d30-4c1874e6521f for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:01.085134 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e7f2b97f-7747-4bf0-a263-e8adccd319bd req-b0ddffb8-a1f8-47e1-ad9e-a9853d091d0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079319 Oct 29 20:53:01.086681 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 822/1581] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:01.092820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:01.093582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:01.119311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.120371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.120371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.122304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.124022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.126208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.142957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.154891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.156759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.158199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bea7860d-ffb6-4549-b3af-a2a81c526f80 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.593418 Oct 29 20:53:01.159269 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 760/1582] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:00 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:01.164088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-270fff21-2a77-45df-8d48-d325fc18aab0 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa171a39700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:01.232106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-270fff21-2a77-45df-8d48-d325fc18aab0 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:01.238322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-270fff21-2a77-45df-8d48-d325fc18aab0 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:01.365820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.383215 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d776cf65-5500-49ba-b3a8-973c85b95e1b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1468 microversion: 2.1 time: 0.294584 Oct 29 20:53:01.384933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 823/1583] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:01 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:01.390778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-64126c3c-0c0c-418b-a880-b05a7e8a861e req-2121a6aa-614d-4798-b162-1ca03e7218e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4554eb0-6c9b-43a0-90e9-51695dc162f8", "tag": "98df740d-6a7a-4baa-9553-f3e319f76f39"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:01.406770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-64126c3c-0c0c-418b-a880-b05a7e8a861e req-2121a6aa-614d-4798-b162-1ca03e7218e7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.407819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-64126c3c-0c0c-418b-a880-b05a7e8a861e req-2121a6aa-614d-4798-b162-1ca03e7218e7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.408695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-64126c3c-0c0c-418b-a880-b05a7e8a861e req-2121a6aa-614d-4798-b162-1ca03e7218e7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.427337 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-64126c3c-0c0c-418b-a880-b05a7e8a861e req-2121a6aa-614d-4798-b162-1ca03e7218e7 service nova] Creating event network-changed:98df740d-6a7a-4baa-9553-f3e319f76f39 for instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 on nch1-master-1 Oct 29 20:53:01.434667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-64126c3c-0c0c-418b-a880-b05a7e8a861e req-2121a6aa-614d-4798-b162-1ca03e7218e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047473 Oct 29 20:53:01.435988 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 824/1584] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:01.446638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:01.448335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:01.458252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.459081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.460497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.461636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.462871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.463597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.612144 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-270fff21-2a77-45df-8d48-d325fc18aab0 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.451612 Oct 29 20:53:01.613301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 761/1585] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:01 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:01.619965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:01.620615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:01.626860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.627352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.627797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.628511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.628971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.629407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.847867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.857605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.858979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.860129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-50d40aef-cb74-4927-9b30-647658b3f37d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.422483 Oct 29 20:53:01.860690 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 825/1586] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:01 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:01.865124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a791c86-4a8a-4d64-996b-405cff0d9bf7 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa171348a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:01.885669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:01.899307 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d0dbc39-5946-482e-83fa-47485f5f2357 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.284133 Oct 29 20:53:01.913522 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 762/1587] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:01 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:01.920930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:01.921591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:01.927813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.929184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.929833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:01.930893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:01.931526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:01.932129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:02.041936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.051425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.053827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.058992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-18b321d2-9e9e-4192-8857-39ef1527f1ae tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.144527 Oct 29 20:53:02.059573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 763/1588] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:01 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:02.127482 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a791c86-4a8a-4d64-996b-405cff0d9bf7 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "DELETE /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.265719 Oct 29 20:53:02.135990 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 826/1589] 10.222.0.36 () {58 vars in 1296 bytes} [Sat Oct 29 20:53:01 2022] DELETE /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata/os_version => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:02.142870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-66622553-2017-4d34-9fdd-b2cf1b833959 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa171a39550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:02.188712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:02.189498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:02.194083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-66622553-2017-4d34-9fdd-b2cf1b833959 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 37 microversion: 2.1 time: 0.056225 Oct 29 20:53:02.202117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 764/1590] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:53:02 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 37 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:53:02.202381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:02.202877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:02.203504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:02.204399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:02.204854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:02.210161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:02.212341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e35013d3-ec43-4485-9d86-7e66cb877f13 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa171a07700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:02.269098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e35013d3-ec43-4485-9d86-7e66cb877f13 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:02.278457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e35013d3-ec43-4485-9d86-7e66cb877f13 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:02.437086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.450009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.453071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.455179 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7e6df757-2aab-476c-9ede-5b41cba999f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.270771 Oct 29 20:53:02.456074 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 827/1591] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:02 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:02.463757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-370095516", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:02.521311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] validate_networks() for [('755ff50a-afe6-4046-876c-0b19c0bb1d49', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:53:02.600157 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e35013d3-ec43-4485-9d86-7e66cb877f13 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.393047 Oct 29 20:53:02.600757 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 765/1592] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:02 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:02.606170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:02.606787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:02.612889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:02.614113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:02.614558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:02.615296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:02.615783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:02.616212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:02.882956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:02.892691 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-061316d0-ca2e-47a5-995e-29428734256b tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1468 microversion: 2.1 time: 0.290663 Oct 29 20:53:02.893273 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 766/1593] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:02 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:02.898991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1df1aa11-2ba5-441c-8533-65a5a765e7a6 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa172639430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:02.939341 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1df1aa11-2ba5-441c-8533-65a5a765e7a6 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.044717 Oct 29 20:53:02.940235 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 767/1594] 10.222.0.36 () {58 vars in 1290 bytes} [Sat Oct 29 20:53:02 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata/os_distro => generated 33 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:02.949396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:02.950479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:02.957118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:02.958111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:02.958576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:02.962824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:02.963365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:02.963814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.246005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:53:03.246652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:53:03.247245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:53:03.247774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:53:03.248266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:53:03.258870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.259451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.259962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.260779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.261326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.261898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.279894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:03.285854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:03.287524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for user 68212c49a188473ca9f523c46fd9cba2 and project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:03.303585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:53:03.306705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:53:03.356411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3faf4e9e-2f96-40c0-83a5-ca90b4ecc9e4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.898621 Oct 29 20:53:03.357416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 828/1595] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:53:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:53:03.366138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:03.367038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:03.376619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.377565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.378243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.379217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.379890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.380783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.407584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.421715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.425254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.429098 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85b3ab3d-6c2e-4ae7-a51f-b6930b2a3460 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.486911 Oct 29 20:53:03.433849 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 768/1596] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:02 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:03.450354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be7acef1-0692-4b5a-be0d-d1a9ab0ec466 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa171a4faf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:03.517669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-be7acef1-0692-4b5a-be0d-d1a9ab0ec466 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:03.524520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-be7acef1-0692-4b5a-be0d-d1a9ab0ec466 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:03.717540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.726854 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e009fcb0-c299-452b-b571-d53527d47aa7 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.368135 Oct 29 20:53:03.728087 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 829/1597] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:03 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:03.734987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be7acef1-0692-4b5a-be0d-d1a9ab0ec466 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.299520 Oct 29 20:53:03.736272 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 769/1598] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:03 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:03.741120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "8143b14b-a1cc-4d09-b1ee-95d78e193450"}, {"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "49ec4cbb-94ed-4be0-9d76-f85aebad0a87"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:03.743429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:03.746188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:03.759357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.762058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.762880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.764908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.765899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:03.766544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.767917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.768600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:03.772535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:03.802665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] Creating event network-vif-plugged:8143b14b-a1cc-4d09-b1ee-95d78e193450 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:03.807276 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] Creating event network-vif-plugged:49ec4cbb-94ed-4be0-9d76-f85aebad0a87 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:03.814487 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ca230bd1-4bd6-42c7-9260-4072073ccbaf req-cb35d43c-1007-49dd-ab75-2298aa2ec109 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076737 Oct 29 20:53:03.815466 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 770/1599] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:03.821976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7895b6d0-609d-4d2d-9c32-91bda8b2f40b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:03.823877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7895b6d0-609d-4d2d-9c32-91bda8b2f40b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:03.840140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:03.941686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.958711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.960717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:03.966979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6a06aab-dd13-4f17-9a61-cded3d0c563c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.237630 Oct 29 20:53:03.986646 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 830/1600] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:03 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:03.994708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1f7101a7-04c9-4715-af18-ba05b88f1d02 req-85c42085-183c-4b85-ba30-bfe32b2e041d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f786a-34b7-419d-be98-f44b35f17174", "name": "network-vif-deleted", "tag": "035ee969-a0e8-4370-8a01-bc9cc68cc5c8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:04.004580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1f7101a7-04c9-4715-af18-ba05b88f1d02 req-85c42085-183c-4b85-ba30-bfe32b2e041d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.005353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1f7101a7-04c9-4715-af18-ba05b88f1d02 req-85c42085-183c-4b85-ba30-bfe32b2e041d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.006067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1f7101a7-04c9-4715-af18-ba05b88f1d02 req-85c42085-183c-4b85-ba30-bfe32b2e041d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.024663 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1f7101a7-04c9-4715-af18-ba05b88f1d02 req-85c42085-183c-4b85-ba30-bfe32b2e041d service nova] Creating event network-vif-deleted:035ee969-a0e8-4370-8a01-bc9cc68cc5c8 for instance b39f786a-34b7-419d-be98-f44b35f17174 on nch1-master-1 Oct 29 20:53:04.028996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7895b6d0-609d-4d2d-9c32-91bda8b2f40b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.034549 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1f7101a7-04c9-4715-af18-ba05b88f1d02 req-85c42085-183c-4b85-ba30-bfe32b2e041d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046123 Oct 29 20:53:04.035158 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 831/1601] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:04.039442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7895b6d0-609d-4d2d-9c32-91bda8b2f40b tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1224 microversion: 2.1 time: 0.222223 Oct 29 20:53:04.040601 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 771/1602] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:03 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1224 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:04.046482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0fd6584e-53e3-439f-88f0-188db563be08 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa171e8f9d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:04.056013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:04.056739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:04.064168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.064674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.065142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.065885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.066344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.066775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.096006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0fd6584e-53e3-439f-88f0-188db563be08 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.054294 Oct 29 20:53:04.096871 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 772/1603] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:53:04 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:04.101399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:04.102039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:04.108943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.109559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.110009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.110802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.111274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.111706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.145856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.146378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.147552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.148871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lazy-loading 'fault' on Instance uuid b39f786a-34b7-419d-be98-f44b35f17174 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:04.203911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.213182 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e33922b-a0da-4a95-b3b4-dff1d9d5b1e9 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1302 microversion: 2.1 time: 0.115294 Oct 29 20:53:04.221944 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 773/1604] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:04 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:04.225386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78d88fcd-9ebd-4cf1-83e1-774011ec6381 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa171a07c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:04.239692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.248361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.250173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.251835 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fdac03b0-40ff-43db-837a-73327e89820b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.215389 Oct 29 20:53:04.252696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 832/1605] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:04 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:04.285727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-78d88fcd-9ebd-4cf1-83e1-774011ec6381 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:04.293395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-78d88fcd-9ebd-4cf1-83e1-774011ec6381 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:04.462453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:04.462987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:04.468185 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78d88fcd-9ebd-4cf1-83e1-774011ec6381 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.253295 Oct 29 20:53:04.468867 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 774/1606] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:04 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:04.469410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.469968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.470397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.471089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.471538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.471958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.477799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2249f21d-6edd-4e7d-98ba-42d3842b6da2 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa171a4f940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:04.526650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-2249f21d-6edd-4e7d-98ba-42d3842b6da2 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:04.533092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-2249f21d-6edd-4e7d-98ba-42d3842b6da2 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:04.660995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.671513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.673192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:04.674595 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b47fb2cc-29cd-4cc4-bf04-c9bad5f81725 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.216748 Oct 29 20:53:04.677523 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 833/1607] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:04 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:04.754992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:04.755673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:04.762562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.762935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.763649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.764591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:04.765070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:04.765679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:04.844166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2249f21d-6edd-4e7d-98ba-42d3842b6da2 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 64 microversion: 2.1 time: 0.369819 Oct 29 20:53:04.844869 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 775/1608] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:04 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 64 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:53:04.856086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa566e08-8bce-4234-a67c-9229306e8d23 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa171a1db80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:04.911454 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa566e08-8bce-4234-a67c-9229306e8d23 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 64 microversion: 2.1 time: 0.059943 Oct 29 20:53:04.912529 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 776/1609] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:53:04 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 64 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:04.922813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60eb5a2b-6512-4db9-b7da-abfe67d27e14 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa171a4ff70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:04.989113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60eb5a2b-6512-4db9-b7da-abfe67d27e14 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:04.996818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60eb5a2b-6512-4db9-b7da-abfe67d27e14 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:05.010623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.019311 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91984d7b-1ba7-4d52-a671-e53de1862901 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.269118 Oct 29 20:53:05.019984 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 834/1610] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:04 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:05.025323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:05.026033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:05.031893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.032442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.033126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.034141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.034505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.034939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.127249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.139800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.141568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.147680 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-418f4002-376a-425c-8e12-dba92fc2de4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.125916 Oct 29 20:53:05.148254 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 835/1611] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:05 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:05.152879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:05.153756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:05.159791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.160555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.161240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.162202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.162914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.163565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.262739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.274574 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45ca1e44-6e90-4b84-8b6c-35f9fc00a7d2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1282 microversion: 2.1 time: 0.125023 Oct 29 20:53:05.275829 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 836/1612] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:05 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:05.293404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:05.294308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:05.302914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.303935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.304367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.305433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.305588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.305955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.340353 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60eb5a2b-6512-4db9-b7da-abfe67d27e14 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.421783 Oct 29 20:53:05.345511 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 777/1613] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:04 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:53:05.345700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.345700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.345700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.345700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lazy-loading 'fault' on Instance uuid b39f786a-34b7-419d-be98-f44b35f17174 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:05.347782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:05.348414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:05.356313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.356864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.357443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.358174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.358633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.359062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.418437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a554d93b7864309990e6252c09f59cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da56123652f4fb19fe782b6c32ce520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.427501 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bfb415bc-80bc-46e8-a5a3-0ea332a3bdfb tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 200 len: 1302 microversion: 2.1 time: 0.150251 Oct 29 20:53:05.441478 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 837/1614] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:05 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 1302 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:05.441478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0db8fca5-85e3-455c-933e-cabdc9f9b313 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update', calling method: .version_select at 0x7fa171314430>, body: {"meta": {"os_version": "alt"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:05.498728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0db8fca5-85e3-455c-933e-cabdc9f9b313 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:05.507952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0db8fca5-85e3-455c-933e-cabdc9f9b313 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:05.624568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.633096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.634604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:05.635799 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51290aff-79f4-411e-a3a3-5beeea58cc57 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1566 microversion: 2.25 time: 0.293811 Oct 29 20:53:05.639390 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 778/1615] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:05 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1566 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:05.700923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:05.701886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:05.712086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.712877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.714529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.716373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.716931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.718359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.819171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0db8fca5-85e3-455c-933e-cabdc9f9b313 tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.388106 Oct 29 20:53:05.820618 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 838/1616] 10.222.0.36 () {60 vars in 1313 bytes} [Sat Oct 29 20:53:05 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata/os_version => generated 31 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:05.829728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94d2b9c6-c3c2-4137-b019-e36a5c7e57dc tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa171375670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:05.879809 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94d2b9c6-c3c2-4137-b019-e36a5c7e57dc tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 58 microversion: 2.1 time: 0.053949 Oct 29 20:53:05.880639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 839/1617] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:53:05 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 58 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:53:05.894395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "04b9470e-35a4-48e8-9216-737abadca683"}, {"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "80432d50-130e-4119-9603-19dd672ae1bd"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:05.906043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:05.906530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:05.906961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:05.921303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] Creating event network-vif-plugged:04b9470e-35a4-48e8-9216-737abadca683 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:05.921918 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] Creating event network-vif-plugged:80432d50-130e-4119-9603-19dd672ae1bd for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:05.927369 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-17d934a2-487b-4d2b-866c-2471be6269f6 req-28f325d7-0554-4cc3-ac0e-b66da67fb6d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036885 Oct 29 20:53:05.928321 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 840/1618] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:05.934637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-330237fe-50c4-4383-960a-c139c58fd99c tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'update_all', calling method: .version_select at 0x7fa1712f2280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:05.998085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-330237fe-50c4-4383-960a-c139c58fd99c tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:06.004946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-330237fe-50c4-4383-960a-c139c58fd99c tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:06.215140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.229886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.231449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.232722 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d9022fc2-962d-40b6-a9e6-5452a08e3abc tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.536289 Oct 29 20:53:06.233312 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 779/1619] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:05 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:06.258393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:06.259141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:06.266875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:06.273532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:06.274410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:06.275467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:06.276105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:06.276724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:06.413330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-330237fe-50c4-4383-960a-c139c58fd99c tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 61 microversion: 2.1 time: 0.482085 Oct 29 20:53:06.414107 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 841/1620] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:53:05 2022] PUT /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 61 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:06.419217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:06.422457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:06.430040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:06.430538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:06.431153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:06.431880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:06.432343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:06.433689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:06.713781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.716258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:06.723717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.725916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.731214 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff3fa82d-c437-4b6f-8e4f-e373e1e78952 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.316118 Oct 29 20:53:06.731785 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 842/1621] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:06 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:06.736496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:06.737096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:06.744362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:06.744852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:06.745484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:06.746464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:06.747083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:06.747676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:06.944435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:06.952471 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d980b4c6-3dbe-4db5-b6dc-9190a29e3a46 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.718128 Oct 29 20:53:06.953053 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 780/1622] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:06 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:06.965684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-052af247-b123-430c-8e87-6679e140f4ed tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Action: 'create', calling method: .version_select at 0x7fa171a07700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:07.009691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-052af247-b123-430c-8e87-6679e140f4ed tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:07.014869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-052af247-b123-430c-8e87-6679e140f4ed tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Getting quotas for user 2cdad375fc1c4650973a9367a83296ef and project cf49a2e6986e4bb5a2571b90776084b7. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:07.047110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.055458 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06359071-1dcf-405d-9579-a1d7a2203894 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.322492 Oct 29 20:53:07.056167 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 843/1623] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:06 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:07.061284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.062034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] [instance: b39f786a-34b7-419d-be98-f44b35f17174] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:07.069235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.069761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.070201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.071060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.071521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.072018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.088418 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] HTTP exception thrown: Instance b39f786a-34b7-419d-be98-f44b35f17174 could not be found. Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Request method failure captured: Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 HTTP/1.1 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZFThGEhtohnjLqroLp-J0j-DKPY8jfznTS3mEM6kDwZhJeLWXG_QO6U0cYc60yCHtj4pUg02-VzGdn1ugqvlJdOmtJzMs1UWG7yvEpRNyvyCfP23Y273aH4FnMiI_sDy7T7IXYwoOD6nAgaQX-boA2FOlB5qJL4ODuRzhKnKcrAKYA Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3da56123652f4fb19fe782b6c32ce520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MigrationsAdminTest-1765316182 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 3da56123652f4fb19fe782b6c32ce520 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MigrationsAdminTest-1765316182 Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0a554d93b7864309990e6252c09f59cc Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MigrationsAdminTest-1765316182-project Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b39f786a-34b7-419d-be98-f44b35f17174 could not be found. Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b39f786a-34b7-419d-be98-f44b35f17174'} Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39f786a-34b7-419d-be98-f44b35f17174 could not be found. Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39f786a-34b7-419d-be98-f44b35f17174 could not be found. Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:07.090034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39f786a-34b7-419d-be98-f44b35f17174 could not be found. Oct 29 20:53:07.095181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:07.097005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] Returning 404 to user: Instance b39f786a-34b7-419d-be98-f44b35f17174 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:53:07.098082 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-676c8be5-d101-48a8-8e99-b03234d0e365 tempest-MigrationsAdminTest-1765316182 tempest-MigrationsAdminTest-1765316182-project] 10.222.0.36 "GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174" status: 404 len: 111 microversion: 2.1 time: 0.040875 Oct 29 20:53:07.098808 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 844/1624] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/servers/b39f786a-34b7-419d-be98-f44b35f17174 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:53:07.107901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.108536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:07.115965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.116899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.117651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.118332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.118998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.119438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.368472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.370301 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-052af247-b123-430c-8e87-6679e140f4ed tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "POST /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 85 microversion: 2.1 time: 0.415977 Oct 29 20:53:07.371041 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 781/1625] 10.222.0.36 () {60 vars in 1281 bytes} [Sat Oct 29 20:53:06 2022] POST /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 85 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:07.377997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.379134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:07.380039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.382383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.383814 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-252f4210-f2d8-4173-942a-6961fde71ec3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1556 microversion: 2.25 time: 0.280177 Oct 29 20:53:07.384622 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 845/1626] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1556 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:07.389264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37faf045-14e2-485e-9f27-70565c7ad5fc tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] Calling method '.version_select at 0x7fa171348280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.401417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.408403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.408886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.409657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.410540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.411509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.456614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37faf045-14e2-485e-9f27-70565c7ad5fc tempest-ImagesMetadataTestJSON-1538073546 tempest-ImagesMetadataTestJSON-1538073546-project] 10.222.0.36 "GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata" status: 200 len: 85 microversion: 2.1 time: 0.070565 Oct 29 20:53:07.457194 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 846/1627] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/images/f2a35444-1ed1-487a-9346-24d858896d19/metadata => generated 85 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:53:07.475214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e941365c-b4c5-4f94-bd5c-a3a2904c9f2f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '.version_select at 0x7fa1713c24c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.479254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e941365c-b4c5-4f94-bd5c-a3a2904c9f2f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.479781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e941365c-b4c5-4f94-bd5c-a3a2904c9f2f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.480418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e941365c-b4c5-4f94-bd5c-a3a2904c9f2f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.492109 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e941365c-b4c5-4f94-bd5c-a3a2904c9f2f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.026484 Oct 29 20:53:07.501508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 847/1628] 10.222.0.36 () {60 vars in 1184 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:07.511118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.512108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:07.519088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.519587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.520024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.520735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.521194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.521702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.809773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 828d0c05-713e-47b5-a8d5-369061b2c2d7 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:07.835172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e67dfb2-90ac-44b8-a764-3c0f28f4945b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 2048 microversion: 2.25 time: 0.327835 Oct 29 20:53:07.836235 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 848/1629] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 2048 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:07.842376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:07.843300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:07.849407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.850819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.851479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.852474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.861962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.861962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:07.863285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.864720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:07.874905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.876574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:07.878633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e820bad4-d2b7-4e7f-87e6-39cec3a0ff3d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.505967 Oct 29 20:53:07.879589 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 782/1630] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:07.952036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "63d60491-c21a-48b5-a73d-567ca98d992e"}, {"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-plugged", "status": "completed", "tag": "350a15b5-cd02-426b-b837-13daafa16f6e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:07.973306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:07.977163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:07.977586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:08.022638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] Creating event network-vif-plugged:63d60491-c21a-48b5-a73d-567ca98d992e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:08.023599 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] Creating event network-vif-plugged:350a15b5-cd02-426b-b837-13daafa16f6e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:08.042962 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-17b26b0e-860a-4177-aa7d-65227261c79e req-19921a0f-920d-4f8b-82e1-df4cc91e12b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096590 Oct 29 20:53:08.043558 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 783/1631] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:53:08.053812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:08.054673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:08.062021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:08.062692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:08.063468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:08.064379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:08.064978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:08.065412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:08.108011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:08.125009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:08.127677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:08.139687 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3be9708e-6366-40ed-bcc6-8fb733f8a1fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.300786 Oct 29 20:53:08.141973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 849/1632] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:07 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:08.152515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-187446217", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:08.248582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] validate_networks() for [('dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:53:08.569155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:08.586352 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64c71047-48c7-47f8-a066-ad2a6c5d76df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.537473 Oct 29 20:53:08.586967 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 784/1633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:08 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:08.591661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:08.592275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:08.607347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:08.608116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:08.608750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:08.609515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:08.612928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:08.613477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:08.910649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:08.921620 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-291b6ecd-27eb-458d-83f1-acf416e62ec6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.333589 Oct 29 20:53:08.923068 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 785/1634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:08 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:08.937199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1f7d81d0-6769-4592-8a95-bc67d916bea0 req-54750b4f-06bb-481f-82af-dd68f4247987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feaedd45-ece1-4af1-b6fd-423ff496f7c6", "tag": "83a7af20-cc55-4582-a20c-12a247fc4d1c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:08.955857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1f7d81d0-6769-4592-8a95-bc67d916bea0 req-54750b4f-06bb-481f-82af-dd68f4247987 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:08.957026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1f7d81d0-6769-4592-8a95-bc67d916bea0 req-54750b4f-06bb-481f-82af-dd68f4247987 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:08.957907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1f7d81d0-6769-4592-8a95-bc67d916bea0 req-54750b4f-06bb-481f-82af-dd68f4247987 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.000812 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1f7d81d0-6769-4592-8a95-bc67d916bea0 req-54750b4f-06bb-481f-82af-dd68f4247987 service nova] Creating event network-changed:83a7af20-cc55-4582-a20c-12a247fc4d1c for instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 on nch2-master-1 Oct 29 20:53:09.007999 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1f7d81d0-6769-4592-8a95-bc67d916bea0 req-54750b4f-06bb-481f-82af-dd68f4247987 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081183 Oct 29 20:53:09.010529 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 786/1635] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:09.020955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:09.024529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:09.035340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.036278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.037025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.039578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.041403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.043704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.367871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:53:09.369057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:53:09.369565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:53:09.370148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:53:09.370730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:53:09.393436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.394402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.395075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.396027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.397260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.397896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.440079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:09.458792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for user d3e4d267d3b344928a2ca0a6e79eadb4 and project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:09.478915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:53:09.481259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:53:09.525618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.549036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.551673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.552915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5cba5051-7d5c-43ab-b8f8-3dcceada55b5 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.539252 Oct 29 20:53:09.553608 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 787/1636] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:09 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:09.563573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:09.566378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:09.583473 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cfef83a4-8081-4d82-9354-4872ac91a44f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.440198 Oct 29 20:53:09.584110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 850/1637] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:53:09.594673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.596096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.596588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aefa7acf-0ff4-4928-bbde-fa714cfd7a47 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:09.597245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aefa7acf-0ff4-4928-bbde-fa714cfd7a47 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:09.597676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.599307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.600042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.605060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.690868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aefa7acf-0ff4-4928-bbde-fa714cfd7a47 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.701397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aefa7acf-0ff4-4928-bbde-fa714cfd7a47 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.703573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aefa7acf-0ff4-4928-bbde-fa714cfd7a47 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.711762 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aefa7acf-0ff4-4928-bbde-fa714cfd7a47 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1261 microversion: 2.25 time: 0.119261 Oct 29 20:53:09.712690 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 851/1638] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:09 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:09.720251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:09.721066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:09.728191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.729037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.729756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.730701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.731355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.731975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.766677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.776357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.777852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.793011 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-132b74ec-e1ae-47f0-9824-52888b5c078a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.238387 Oct 29 20:53:09.794317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 788/1639] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:09 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:09.944459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:09.949133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:09.950006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:09.958519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.959382 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10532d10-16e6-4324-8c04-d7d6035e7649 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.244512 Oct 29 20:53:09.959654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.960464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.962006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:09.969650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:09.970377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:09.974971 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 852/1640] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:09 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:10.216312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:10.229760 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f8f7fe18-ffbf-40cf-a585-0a7f7ef86e5f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.286085 Oct 29 20:53:10.245494 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 789/1641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:09 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:10.585653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:10.587104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:10.596954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:10.598255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:10.599366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:10.600908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:10.601631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:10.602760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:10.744605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:10.745617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:10.754271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:10.755014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:10.755795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:10.757418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:10.758071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:10.758670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:10.883198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:10.895668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:10.898417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:10.901040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93c5a97c-60dd-4320-9cec-79b751e25036 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1257 microversion: 2.25 time: 0.166589 Oct 29 20:53:10.902299 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 790/1642] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:10 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:10.992546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.008325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.010201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.011702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a93df9b0-1929-4d12-8085-1e5e97a9962f tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1878 microversion: 2.32 time: 0.435247 Oct 29 20:53:11.013059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 853/1643] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:10 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1878 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:11.017921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:11.018810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:11.025216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.026014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.026723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.027678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.028372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.029046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.092810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-28179347", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:11.127299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.137132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.139749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.145312 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a1a1f43-e23f-47aa-956a-f4c98496d24e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.130942 Oct 29 20:53:11.146009 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 854/1644] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:11 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:11.151917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:11.152813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:11.153779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:53:11.159211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.159948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.160435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.161075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.161570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.162263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.543234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:53:11.543668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:53:11.544432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:53:11.544853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:53:11.545265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:53:11.558140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.563877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.564680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.565339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.566329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.567054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.568320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.571756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45ac870d-7fef-49c1-8afc-8b5af2437908 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.420359 Oct 29 20:53:11.572487 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 855/1645] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:11 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:11.590711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:11.592397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:11.610548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Getting quotas for project b36492b0e551465b80ec5d4f9b91d1d1. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:11.611564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.612852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.614716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.616841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.617756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.618569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Getting quotas for user 49faa862c6a441d0ab0e42deb06517e9 and project b36492b0e551465b80ec5d4f9b91d1d1. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:11.619091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.639147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:53:11.643523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:53:11.728940 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b0a36bb-dac6-4ee3-9a8d-e12b1c69f9ba tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812721 Oct 29 20:53:11.732957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 791/1646] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:53:11.752579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e2d0cf96-58a4-441e-b78b-eae7289af463 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:11.754499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e2d0cf96-58a4-441e-b78b-eae7289af463 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:11.894346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e2d0cf96-58a4-441e-b78b-eae7289af463 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.903873 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e2d0cf96-58a4-441e-b78b-eae7289af463 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1212 microversion: 2.1 time: 0.160566 Oct 29 20:53:11.904475 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 792/1647] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:11 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1212 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:11.938538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:11.944481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:11.945425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:11.949525 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ac93518-0a09-4dc1-a652-633efd6a49f5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.375625 Oct 29 20:53:11.950188 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 856/1648] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:11 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:11.973397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.993564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.994189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:11.997689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:11.998256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:11.998714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.041653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:12.042934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:12.045678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:12.055226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.060663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.065800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.068100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.069285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.069918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.115773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.148034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.151517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.153265 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a01cf07-c2fa-4734-bb72-b48c45cc2f2b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1319 microversion: 2.25 time: 0.224067 Oct 29 20:53:12.174712 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 793/1649] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:11 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:12.183159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:12.184908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:12.220462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.221214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.221862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.222783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.223402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.224199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.338160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.357243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.359022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.375048 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-123e6657-e130-4549-aab7-b6b9c1e8c13d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.197063 Oct 29 20:53:12.376306 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 794/1650] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:12 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:12.385413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.395287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.395574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-fb5e9636-6045-4aec-a362-49fdfffecfa1 req-02be1bea-4b8c-4143-a34d-ae1a0f6915f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4554eb0-6c9b-43a0-90e9-51695dc162f8", "name": "network-vif-plugged", "status": "completed", "tag": "98df740d-6a7a-4baa-9553-f3e319f76f39"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:12.398744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.400504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10dbec37-0512-471c-92ef-47b9fb76018d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2831 microversion: 2.32 time: 0.364070 Oct 29 20:53:12.401273 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 857/1651] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:12 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2831 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:12.414697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fb5e9636-6045-4aec-a362-49fdfffecfa1 req-02be1bea-4b8c-4143-a34d-ae1a0f6915f7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.415181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fb5e9636-6045-4aec-a362-49fdfffecfa1 req-02be1bea-4b8c-4143-a34d-ae1a0f6915f7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.419171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fb5e9636-6045-4aec-a362-49fdfffecfa1 req-02be1bea-4b8c-4143-a34d-ae1a0f6915f7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.430096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:12.430632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:12.439755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.441358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.441884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.442619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.444066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.444895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.446239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-fb5e9636-6045-4aec-a362-49fdfffecfa1 req-02be1bea-4b8c-4143-a34d-ae1a0f6915f7 service nova] Creating event network-vif-plugged:98df740d-6a7a-4baa-9553-f3e319f76f39 for instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 on nch1-master-1 Oct 29 20:53:12.462071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-fb5e9636-6045-4aec-a362-49fdfffecfa1 req-02be1bea-4b8c-4143-a34d-ae1a0f6915f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079180 Oct 29 20:53:12.463384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 795/1652] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:12.599369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:12.600142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:12.606650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.607342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.607865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.608969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.609739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.610169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.636751 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1cbec804-63ba-4a58-b219-11bab3300eeb tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.210703 Oct 29 20:53:12.638544 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 858/1653] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 20:53:12 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571/os-interface => generated 1832 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:12.864556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:12.878915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-edfdd26f-b61e-4e68-8c45-d539d992db36 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.283690 Oct 29 20:53:12.879706 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 796/1654] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:12 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:12.929888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:12.930801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:12.946400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.947189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.947643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.948373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.948861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.949296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.973957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:12.975170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:12.987943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.988329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.988932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:12.994183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:12.994951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:12.995561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:13.137081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.151592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f73af13-eadd-4802-9de8-a9880048aefc tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1264 microversion: 2.1 time: 0.227144 Oct 29 20:53:13.159930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 859/1655] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:12 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:13.185406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:13.187785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:13.199323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:13.206321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:13.206954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:13.207789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:13.208332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:13.208847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:13.247532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.258314 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48ec57e8-6d6e-4e0a-843d-feb4e0e54c5a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.287980 Oct 29 20:53:13.269762 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 797/1656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:12 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:13.311941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.321753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.323625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.324665 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1d4e5e9d-5aa8-4a36-a386-a4f950230723 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1319 microversion: 2.25 time: 0.145051 Oct 29 20:53:13.325231 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 860/1657] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:13 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:13.408284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:13.408919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:13.420521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:13.421018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:13.421495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:13.426656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:13.427144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:13.427586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:13.564768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.578309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.583760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:13.596042 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d594d291-ffcd-40f8-a32b-3badca9a9d9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.192773 Oct 29 20:53:13.600321 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 798/1658] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:13 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:13.905896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:13.906673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:13.912739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:13.920016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:13.920863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:13.921886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:13.922512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:13.923425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.177637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:14.178307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:14.191072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:14.196159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.203918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.204429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.205215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.205730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.206160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.217239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:14.225998 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cfe61bdb-3190-48b5-ad6f-f2d17b8050df tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1199 microversion: 2.1 time: 0.324543 Oct 29 20:53:14.229894 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 861/1659] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:13 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1199 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:14.282592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:14.284160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:14.291942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.292697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.293333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.294514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.295139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.295743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.684713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:14.695602 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffa0f38d-9318-42e2-8aba-f0c56706406c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1270 microversion: 2.1 time: 0.523187 Oct 29 20:53:14.697736 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 799/1660] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:14 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1270 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:14.705385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:14.707655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:14.723222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.724038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.725332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.726330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.727307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.727904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.924876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:14.933923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc07e22e-5764-404f-a5d5-1512f5ae0ec4 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.655557 Oct 29 20:53:14.935230 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 862/1661] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:14 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:14.940158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:14.941046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:14.948647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.949387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.950105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.951081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:14.951777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:14.952399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:14.992707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:15.005794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.015673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.023667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.025709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-158e78ae-0a18-47b9-a5f9-fb73b06cb4f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.326288 Oct 29 20:53:15.031725 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 800/1662] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:14 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:15.061787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.073393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.074959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.081360 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2805f2c-5655-4df1-8ed0-f774174ee20a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.144913 Oct 29 20:53:15.082310 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 863/1663] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:14 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:15.202954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7681feca-594d-4857-8182-276d15f0400d req-0b0f95c3-4975-459c-9649-66dce3d5ae59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaedd45-ece1-4af1-b6fd-423ff496f7c6", "name": "network-vif-plugged", "status": "completed", "tag": "83a7af20-cc55-4582-a20c-12a247fc4d1c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:15.224263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7681feca-594d-4857-8182-276d15f0400d req-0b0f95c3-4975-459c-9649-66dce3d5ae59 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.224882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7681feca-594d-4857-8182-276d15f0400d req-0b0f95c3-4975-459c-9649-66dce3d5ae59 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.225398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7681feca-594d-4857-8182-276d15f0400d req-0b0f95c3-4975-459c-9649-66dce3d5ae59 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.253423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:15.256783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:15.265108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.266193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.266991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.268073 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7681feca-594d-4857-8182-276d15f0400d req-0b0f95c3-4975-459c-9649-66dce3d5ae59 service nova] Creating event network-vif-plugged:83a7af20-cc55-4582-a20c-12a247fc4d1c for instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 on nch2-master-1 Oct 29 20:53:15.268508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.269154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.269845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.278560 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7681feca-594d-4857-8182-276d15f0400d req-0b0f95c3-4975-459c-9649-66dce3d5ae59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079487 Oct 29 20:53:15.284543 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 801/1664] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:15.577828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.586069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-138351a1-c187-4b8c-bbf6-5fae2211c3b1 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1382 microversion: 2.1 time: 0.337496 Oct 29 20:53:15.586707 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 864/1665] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:15 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1382 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:15.608889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:15.609639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:15.616586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.617417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.618248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.619226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.619676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.620296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.728400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:15.729324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:15.735360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.735842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.736450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.737334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.738000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.738423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.850831 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52c51d4c-8e6c-493d-950f-bf9a2695ef6a tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1533 microversion: 2.1 time: 0.245280 Oct 29 20:53:15.858059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 802/1666] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:15 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1533 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:15.875399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:15.876387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:15.883802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.884625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.885170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.886036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:15.886585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:15.887524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:15.980470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:15.995334 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06a6330d-9e0d-4b57-9162-3a5c234d3a51 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.271318 Oct 29 20:53:16.015896 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 865/1667] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:15 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:16.024744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:16.026031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:16.033149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.033887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.035008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.036249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.036884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.038255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.185779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:16.198314 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b68525df-01f2-455a-a7e5-32a180972d3d tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1533 microversion: 2.1 time: 0.326773 Oct 29 20:53:16.198953 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 803/1668] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:15 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1533 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:16.214940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:16.218734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:16.232652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.235398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.238227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.239238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.240031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.240694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.323376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.338374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e556542d-8bde-4db4-9fe7-8038fe0c0662 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1324 microversion: 2.1 time: 0.319880 Oct 29 20:53:16.339174 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 866/1669] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:16 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:16.344643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:16.347378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:16.365075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.365807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.366354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.367185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.367751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.368281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.509821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.520897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.526474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.533195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.539677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-46817086-cddc-4870-8fa5-3f90c7942bff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.199314 Oct 29 20:53:16.542490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.544722 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 867/1670] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:16 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:16.556118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f6b0e590-3e2b-4a14-ba61-42d8ff35f9fb req-cc6483e1-f56d-49d6-94eb-154367ca3047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "tag": "8143b14b-a1cc-4d09-b1ee-95d78e193450"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:16.571035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:16.572801 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bfae9a75-286b-4496-9c99-d896544d36c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.372704 Oct 29 20:53:16.573593 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 804/1671] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:16 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:16.581474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6b0e590-3e2b-4a14-ba61-42d8ff35f9fb req-cc6483e1-f56d-49d6-94eb-154367ca3047 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.581963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6b0e590-3e2b-4a14-ba61-42d8ff35f9fb req-cc6483e1-f56d-49d6-94eb-154367ca3047 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.582392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6b0e590-3e2b-4a14-ba61-42d8ff35f9fb req-cc6483e1-f56d-49d6-94eb-154367ca3047 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.585382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:16.596473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.599708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.600388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.602468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.604473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.605502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.610363 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f6b0e590-3e2b-4a14-ba61-42d8ff35f9fb req-cc6483e1-f56d-49d6-94eb-154367ca3047 service nova] Creating event network-changed:8143b14b-a1cc-4d09-b1ee-95d78e193450 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:53:16.628977 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f6b0e590-3e2b-4a14-ba61-42d8ff35f9fb req-cc6483e1-f56d-49d6-94eb-154367ca3047 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082613 Oct 29 20:53:16.637228 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 868/1672] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:16.658477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f95dd397-db36-4356-a109-642fca033a59 req-63ebbf63-3d74-4a8f-8ef1-b3841bb1bb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86395c89-f3f7-4e4b-880a-725d49b91d8f", "tag": "525b692f-a93a-41bb-ac6c-57f9327d2761"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:16.698283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f95dd397-db36-4356-a109-642fca033a59 req-63ebbf63-3d74-4a8f-8ef1-b3841bb1bb3e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.702000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9c165f66-5f14-417a-91ba-c8fa83d44f4c tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.123333 Oct 29 20:53:16.703250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f95dd397-db36-4356-a109-642fca033a59 req-63ebbf63-3d74-4a8f-8ef1-b3841bb1bb3e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.706883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f95dd397-db36-4356-a109-642fca033a59 req-63ebbf63-3d74-4a8f-8ef1-b3841bb1bb3e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.712353 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 805/1673] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 20:53:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:16.731576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:16.741673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:16.748565 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f95dd397-db36-4356-a109-642fca033a59 req-63ebbf63-3d74-4a8f-8ef1-b3841bb1bb3e service nova] Creating event network-changed:525b692f-a93a-41bb-ac6c-57f9327d2761 for instance 86395c89-f3f7-4e4b-880a-725d49b91d8f on nch2-master-1 Oct 29 20:53:16.771975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f95dd397-db36-4356-a109-642fca033a59 req-63ebbf63-3d74-4a8f-8ef1-b3841bb1bb3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132771 Oct 29 20:53:16.774322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.777079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.779819 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 869/1674] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:16.781351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.782327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:16.782969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:16.785288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:16.844463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lazy-loading 'flavor' on Instance uuid c4554eb0-6c9b-43a0-90e9-51695dc162f8 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:16.875220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Going to try to live migrate instance to nch2-master-1 {{(pid=138884) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:53:17.026042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:17.028307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:17.050052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:17.050848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:17.058213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:17.065161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:17.068039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:17.069110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:17.488327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:17.497080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3611f04f-f2d3-499b-a5bf-b10b11f673b8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.481043 Oct 29 20:53:17.497699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 870/1675] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:17 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:17.513673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:17.514296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:17.527187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:17.527869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:17.528528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:17.529425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:17.530070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:17.530696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:17.968188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:17.979439 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf209d8c-9c27-4f5c-a9d4-2720a27783b5 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1520 microversion: 2.1 time: 0.471441 Oct 29 20:53:17.980341 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 871/1676] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:17 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:18.000364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:18.001129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:18.022547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.023139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.023658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.024443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.024967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.025785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.129589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.142629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.145282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.154458 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f11dda1-1258-4a2c-9214-163470044eb0 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.172884 Oct 29 20:53:18.155647 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 872/1677] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:17 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:18.161377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:18.163335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:18.170919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.171634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.172310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.173254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.173907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.174517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.326542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.337220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.339355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.340745 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-adde9198-a313-421f-9fc7-067086be051e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.183693 Oct 29 20:53:18.344455 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 873/1678] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:18 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:18.355798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:18.358816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:18.368015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.368507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.369786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.370789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.371432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.372019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.535735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.544988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b72ca439-d7fa-46f8-b247-7a5024ed35d9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1520 microversion: 2.1 time: 0.199245 Oct 29 20:53:18.546233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 874/1679] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:18 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:18.554916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:18.555525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:18.569909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.570757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.571270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.572380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.572930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.573438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.763060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:18.770815 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-223ef1b6-84f5-4091-9c2c-dd14d2612d1f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.223287 Oct 29 20:53:18.771388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 875/1680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:18 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:18.776271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1877497403"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:18.778658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:18.788571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.789085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.789668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:18.790243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:18.790891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:18.791316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:19.041068 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7ca7191-def2-480f-9b0a-a8f5e0e3ae28 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6/action" status: 202 len: 0 microversion: 2.1 time: 0.268129 Oct 29 20:53:19.042182 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 876/1681] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:53:18 2022] POST /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:53:19.052392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e113c111-aa02-4ace-94ee-43ba2d0fb557 req-aef3e60f-54a1-42ad-997f-b1d4196735ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d324009-d931-499f-83ac-cdd3cc3def5c", "tag": "2af17672-719d-48fb-a0df-59093ab7beb4"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:19.063933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e113c111-aa02-4ace-94ee-43ba2d0fb557 req-aef3e60f-54a1-42ad-997f-b1d4196735ca service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:19.064472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e113c111-aa02-4ace-94ee-43ba2d0fb557 req-aef3e60f-54a1-42ad-997f-b1d4196735ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:19.065122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e113c111-aa02-4ace-94ee-43ba2d0fb557 req-aef3e60f-54a1-42ad-997f-b1d4196735ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:19.080709 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e113c111-aa02-4ace-94ee-43ba2d0fb557 req-aef3e60f-54a1-42ad-997f-b1d4196735ca service nova] Creating event network-changed:2af17672-719d-48fb-a0df-59093ab7beb4 for instance 1d324009-d931-499f-83ac-cdd3cc3def5c on nch2-master-1 Oct 29 20:53:19.086602 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e113c111-aa02-4ace-94ee-43ba2d0fb557 req-aef3e60f-54a1-42ad-997f-b1d4196735ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042463 Oct 29 20:53:19.088408 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 877/1682] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:19.094170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0889cac0-230b-4d9f-9063-0f8b261da0e3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '.version_select at 0x7fa1712f2820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:19.280751 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0889cac0-230b-4d9f-9063-0f8b261da0e3 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87" status: 204 len: 0 microversion: 2.1 time: 0.190741 Oct 29 20:53:19.281414 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 878/1683] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:19 2022] DELETE /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:19.289960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:19.290691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:19.297528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:19.298025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:19.298489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:19.299218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:19.299669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:19.300095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:19.371114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:19.378440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:19.379912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:19.385950 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64119d70-c56e-4db3-aa59-fdef35205b3f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.099990 Oct 29 20:53:19.386530 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 879/1684] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:19 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:19.391061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29905cb1-8cb8-4cc3-8d13-73edb6d93387 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '.version_select at 0x7fa171375310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:19.412309 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-29905cb1-8cb8-4cc3-8d13-73edb6d93387 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Image not found. Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29905cb1-8cb8-4cc3-8d13-73edb6d93387 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87 HTTP/1.1 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '66f8e43d-c560-4a29-b53b-64e0e4e73a87'} Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66f8e43d-c560-4a29-b53b-64e0e4e73a87 Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:53:19.414715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66f8e43d-c560-4a29-b53b-64e0e4e73a87 could not be found. Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29905cb1-8cb8-4cc3-8d13-73edb6d93387 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-29905cb1-8cb8-4cc3-8d13-73edb6d93387 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87" status: 404 len: 62 microversion: 2.1 time: 0.028720 Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 880/1685] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:19 2022] GET /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:19.423509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:19.426957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:19.433365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:19.433897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:19.434340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:19.435054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:19.435516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:19.435951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:19.574505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:19.583198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:19.584763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:19.585890 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-797bc7f8-ecc4-4e71-8a86-4b52bff438c0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.168156 Oct 29 20:53:19.586439 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 881/1686] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:19 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:19.641624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1251201246", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1cc8922f-83e5-42c2-bce3-6544d389a499"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:19.694772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] validate_networks() for [('1cc8922f-83e5-42c2-bce3-6544d389a499', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:53:19.698709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=28 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:20.222602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:53:20.223065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:53:20.223967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:53:20.224425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:53:20.224990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:53:20.239909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:20.240411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:20.240883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:20.241648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:20.242181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:20.242617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:20.264274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:20.273430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for user d1c5ef005ddf4a96828abd5376fffa37 and project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:20.290237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:53:20.293209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:53:20.358189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0049b811-d210-4e90-8e90-4be78b73aa72 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770706 Oct 29 20:53:20.365782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 882/1687] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:53:20.365782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:20.365782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:20.372906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:20.373507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:20.374131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:20.374859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:20.375473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:20.376054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:20.393886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:20.644842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:20.674555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-565fa363-8ae2-4936-8683-60111ae1d6c9 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1532 microversion: 2.1 time: 0.304625 Oct 29 20:53:20.675338 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 883/1688] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:20 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1532 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:20.701194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:20.702370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:20.713878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:20.718201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:20.719001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:20.720023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:20.720790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:20.721491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:20.925875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:20.935431 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-66585afa-1dcb-4615-8c3b-3dc32af92d95 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.258403 Oct 29 20:53:20.936349 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 884/1689] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:20 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:20.941225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd923ec0-92f2-4db8-9028-0356d0a50732 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:20.943608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd923ec0-92f2-4db8-9028-0356d0a50732 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:21.023651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd923ec0-92f2-4db8-9028-0356d0a50732 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.030924 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd923ec0-92f2-4db8-9028-0356d0a50732 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1208 microversion: 2.1 time: 0.093296 Oct 29 20:53:21.046838 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 885/1690] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:20 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1208 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:21.053794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:21.054563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:21.061953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.062445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.063324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.064149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.064982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.065235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.169309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.178741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.181851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.187766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4cddf262-519d-4503-b8af-f8e44e5aa8f9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.139347 Oct 29 20:53:21.191583 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 886/1691] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:21 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:21.196498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:21.197129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:21.207653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.208249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.208709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.210521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.211249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.211920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.400538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.411986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.413570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.414896 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-555df377-00c5-4d24-ab74-e3fb670fbb32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.222698 Oct 29 20:53:21.430999 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 887/1692] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:21 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:21.479487 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a313d59e-f904-45c7-984c-fdc8041ee0eb tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8/action" status: 202 len: 0 microversion: 2.1 time: 4.760800 Oct 29 20:53:21.481573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 806/1693] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:53:16 2022] POST /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8/action => generated 0 bytes in 4764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:53:21.501532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:21.503241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:21.520406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.523172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.525109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.526252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.528110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.528734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.700572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:21.701303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:21.713865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.714517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.715215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.716274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.717122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.717900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.732994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.762445 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5625968-d5f6-41e3-b9c4-485620614f44 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.276080 Oct 29 20:53:21.766289 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 888/1694] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:21 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:21.901401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=52 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:21.951709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:21.961243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c32a6bd1-26eb-4a4c-ac6e-eb2b399cb3b1 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1538 microversion: 2.1 time: 0.266059 Oct 29 20:53:21.962414 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 807/1695] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:21 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1538 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:21.963259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:21.964091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:21.972276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.974274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.975351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:21.981492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:21.981492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:21.981492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.062070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:22.063186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:22.072033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.072913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.073554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.074438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.075067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.075672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.184817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:22.204304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:22.214105 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a46065d6-5754-4655-a704-f504ede429f6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1260 microversion: 2.1 time: 0.149417 Oct 29 20:53:22.215403 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5be111ea-8bf4-4e10-b605-4df6d214c7ef tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.256563 Oct 29 20:53:22.226118 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 808/1696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:22 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:22.231796 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 889/1697] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:21 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:22.249954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:22.250490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:22.260125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.261734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.262213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.262916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.263374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.263806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.371830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:22.384652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:22.391473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:22.410341 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0886085-bba9-40bd-8a61-f3e4bf7bdb4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.181818 Oct 29 20:53:22.414643 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 809/1698] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:22 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:22.448233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:22.448931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:22.457498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.458023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.458467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.459231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.460230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.460718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.795449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:22.797150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:22.807279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.808306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.809019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:22.810974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:22.811680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:22.813340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.149156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.157934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.159604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.160783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b29f82a4-91d1-4ceb-aad7-8e64ca551577 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.719841 Oct 29 20:53:23.161701 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 890/1699] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:22 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:23.166741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:23.167349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:23.179311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.179800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.180430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.181327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.181976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.182767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.323848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.338263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c5dac27-e4d3-4e7c-84cb-53341fc60b3e tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.550537 Oct 29 20:53:23.354369 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 810/1700] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:22 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:23.361071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:23.362229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:23.370678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.371391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.372178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.373351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.374035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.375177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.533392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.544994 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b687e12-e0a4-46bd-a494-a725490b31a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1266 microversion: 2.1 time: 0.188963 Oct 29 20:53:23.549865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 811/1701] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:23 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:23.558135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:23.560261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:23.574655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.586296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.586823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.587583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.588053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.588765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.620229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.643985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a40b47d-84c4-4a00-9070-fd2a19e59254 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1533 microversion: 2.1 time: 0.481185 Oct 29 20:53:23.644894 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 891/1702] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:23 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1533 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:23.650021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:23.662079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:23.669763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.676245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.677185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.678158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.679621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.680292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.814100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.827449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.828900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:23.845244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c033a85a-cb6e-4bb0-be75-ed89f3c3ae60 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.198880 Oct 29 20:53:23.846092 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 892/1703] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:23 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:23.861659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b137b57c-c18c-4319-b478-57a439182455 req-c0ace663-a132-4cc1-9362-1fb5d29e4791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395c89-f3f7-4e4b-880a-725d49b91d8f", "name": "network-vif-plugged", "status": "completed", "tag": "525b692f-a93a-41bb-ac6c-57f9327d2761"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:23.877996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b137b57c-c18c-4319-b478-57a439182455 req-c0ace663-a132-4cc1-9362-1fb5d29e4791 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:23.878482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b137b57c-c18c-4319-b478-57a439182455 req-c0ace663-a132-4cc1-9362-1fb5d29e4791 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:23.883481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b137b57c-c18c-4319-b478-57a439182455 req-c0ace663-a132-4cc1-9362-1fb5d29e4791 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:23.912214 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b137b57c-c18c-4319-b478-57a439182455 req-c0ace663-a132-4cc1-9362-1fb5d29e4791 service nova] Creating event network-vif-plugged:525b692f-a93a-41bb-ac6c-57f9327d2761 for instance 86395c89-f3f7-4e4b-880a-725d49b91d8f on nch2-master-1 Oct 29 20:53:23.923871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b137b57c-c18c-4319-b478-57a439182455 req-c0ace663-a132-4cc1-9362-1fb5d29e4791 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076583 Oct 29 20:53:23.925151 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 893/1704] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:24.036802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:24.051507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2dc950c-4e3e-43e8-9769-4deb3339322b tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.500315 Oct 29 20:53:24.067489 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 812/1705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:23 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:24.192132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:24.193295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:24.204579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.205318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.206452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.206452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.209657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.209657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.365267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:24.366779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:24.373506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.374265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.374902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.375798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.376439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.377031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.547213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:24.557052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:24.558571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:24.559888 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-98922107-094f-430b-b58b-4d225dbe82c6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.372427 Oct 29 20:53:24.560461 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 894/1706] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:24 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:24.585133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:24.585133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:24.607490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:24.609023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.609806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.610268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.611187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.611665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.612105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.830897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:24.840066 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8ea46add-f82c-453b-8142-d3cb2392b571 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.478512 Oct 29 20:53:24.842362 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 813/1707] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:24 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:24.847883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:24.848628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:24.857263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.858217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.858889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.859610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:24.860065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:24.860684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:24.994953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.003592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9d519f3-a24f-4d91-bd9d-d2e7a4f50f19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.432502 Oct 29 20:53:25.004324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 895/1708] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:24 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:25.021702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:25.022885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:25.028792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.029545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.029986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.030697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.031152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.031913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.130822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.139987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.141628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.147255 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5e9eefe-499e-4e47-a293-6a2bfe734e8d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1560 microversion: 2.91 time: 0.135973 Oct 29 20:53:25.147771 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 896/1709] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:25 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1560 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:25.168864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.172503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:25.173334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:25.177691 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc60e430-fa5d-4cfb-88f2-0cf46810fb46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1520 microversion: 2.1 time: 0.333842 Oct 29 20:53:25.178913 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 814/1710] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:24 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:25.182805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.183464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.184041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.184914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.185491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.186025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.202059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:25.202848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:25.209803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.210560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.211184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.211900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.212351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.213094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.239463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:53:25.320015 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc47afba-2145-4b72-bdf1-297ee0d4a5d8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 204 len: 0 microversion: 2.1 time: 0.121450 Oct 29 20:53:25.324123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 815/1711] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:53:25 2022] DELETE /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 20:53:25.330391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:25.331225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:25.338676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.339168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.339609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.340318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.340780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.341222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.434151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.443469 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f627ac9-2edb-445d-93cf-cc897aa6167a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.280774 Oct 29 20:53:25.444691 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 897/1712] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:25 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:25.590576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.598410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a0bde9e1-1a7e-4eb7-be60-059b4d8ef1e6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1526 microversion: 2.1 time: 0.272848 Oct 29 20:53:25.598985 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 816/1713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:25 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1526 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:25.656275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:25.656886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:25.663742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.664219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.664650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.665335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.665808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.666225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.864636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:25.865358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:25.872733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.873199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.873673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.874395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.874844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.875283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.881507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.903561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.905443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:25.906919 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a86e6b8-16b1-47d5-9a87-7c103fff0e52 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.254596 Oct 29 20:53:25.908376 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 898/1714] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:25 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:25.922020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-16342cb1-dc17-4902-9c97-f97c5a213f0a req-5a08339e-6d97-468d-8fad-d65b369bd4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ff39d8-d9c4-48f9-92e9-9c2dac9633d0", "tag": "036bac86-fd93-4b18-8d46-08ab4f0665ed"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:25.933420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-16342cb1-dc17-4902-9c97-f97c5a213f0a req-5a08339e-6d97-468d-8fad-d65b369bd4be service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:25.934197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-16342cb1-dc17-4902-9c97-f97c5a213f0a req-5a08339e-6d97-468d-8fad-d65b369bd4be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:25.934879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-16342cb1-dc17-4902-9c97-f97c5a213f0a req-5a08339e-6d97-468d-8fad-d65b369bd4be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:25.939996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:25.948049 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-16342cb1-dc17-4902-9c97-f97c5a213f0a req-5a08339e-6d97-468d-8fad-d65b369bd4be service nova] Creating event network-changed:036bac86-fd93-4b18-8d46-08ab4f0665ed for instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 on nch1-master-1 Oct 29 20:53:25.953331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-16342cb1-dc17-4902-9c97-f97c5a213f0a req-5a08339e-6d97-468d-8fad-d65b369bd4be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043540 Oct 29 20:53:25.954104 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 899/1715] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:26.028405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:26.029242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:26.035244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.035727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.036161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.036850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.037297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.038429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.196955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.206935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-77829d19-8cba-4069-a73a-341c4f9f9b07 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.346150 Oct 29 20:53:26.207791 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 817/1716] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:25 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:26.228020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:26.228847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:26.235266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.235675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.236267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.237022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.237775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.237961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.324203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.328786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.332713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.334193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.337958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7697638e-f1de-46f8-8cfe-50f3328428e9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.313520 Oct 29 20:53:26.338868 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 900/1717] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:26 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:26.347466 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0c03cb3-ba24-4d1c-a978-4899e09c1a74 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1560 microversion: 2.91 time: 0.138446 Oct 29 20:53:26.348144 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 818/1718] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:26 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1560 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:26.466883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:26.467417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:26.473555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.474072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.474522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.475229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.475694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.476136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.623473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:26.624371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:26.633092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.633706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.634305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.634852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.635179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.635845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.636285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.639685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:26.656583 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3282db87-f5a2-49ac-a9f3-85c12e63734c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1312 microversion: 2.1 time: 0.193564 Oct 29 20:53:26.657213 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 901/1719] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:26 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:26.776093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:26.785567 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05de422b-1dca-4d36-a880-6ecf510cdc09 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1526 microversion: 2.1 time: 0.165937 Oct 29 20:53:26.786153 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 819/1720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:26 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:26.945047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:26.945944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:26.953936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.954365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.954790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.955753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:26.956410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:26.957034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:26.974328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:27.087992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1ed3167a-e6f4-4ad0-8af7-f17a4913891b req-fb56e78f-799c-4696-87ab-7420e19c4692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaedd45-ece1-4af1-b6fd-423ff496f7c6", "name": "network-vif-plugged", "status": "completed", "tag": "83a7af20-cc55-4582-a20c-12a247fc4d1c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:27.103294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1ed3167a-e6f4-4ad0-8af7-f17a4913891b req-fb56e78f-799c-4696-87ab-7420e19c4692 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.104104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1ed3167a-e6f4-4ad0-8af7-f17a4913891b req-fb56e78f-799c-4696-87ab-7420e19c4692 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.104722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1ed3167a-e6f4-4ad0-8af7-f17a4913891b req-fb56e78f-799c-4696-87ab-7420e19c4692 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.107837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.117950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.119052 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1ed3167a-e6f4-4ad0-8af7-f17a4913891b req-fb56e78f-799c-4696-87ab-7420e19c4692 service nova] Creating event network-vif-plugged:83a7af20-cc55-4582-a20c-12a247fc4d1c for instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 on nch2-master-1 Oct 29 20:53:27.119563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.120742 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f557d9ec-dd47-4f6d-ab67-a66d3fd75bfe tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.180085 Oct 29 20:53:27.121810 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 902/1721] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:26 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:27.125929 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1ed3167a-e6f4-4ad0-8af7-f17a4913891b req-fb56e78f-799c-4696-87ab-7420e19c4692 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045469 Oct 29 20:53:27.126799 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 820/1722] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:27.237261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.237864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:27.244019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.244843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.245294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.246029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.246481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.246906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.362949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.364737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:27.380348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.380870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.381912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.382652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.383112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.383535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.464701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.472731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac9ac7dd-6205-4db2-9b22-64614d58c926 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.239920 Oct 29 20:53:27.473354 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 903/1723] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:27.479171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.479823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:27.486322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.486808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.487754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.488717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.489177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.489645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.572238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.580617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.582246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.587170 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b119fa3d-8476-4267-b7c9-c0348be79753 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1560 microversion: 2.91 time: 0.111951 Oct 29 20:53:27.587752 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 904/1724] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1560 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:27.588968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.596987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b07ce84d-3218-4350-94d3-41d4191f4481 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.239451 Oct 29 20:53:27.597567 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 821/1725] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:27.679766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.680387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:27.686469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.686955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.687392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.688095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.688553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.688982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.809938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.810551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:27.816924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.817417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.817904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.818613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.819152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.819524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.821645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.829639 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d37120e-b518-4ca3-8265-c9c2083c3063 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1461 microversion: 2.1 time: 0.154085 Oct 29 20:53:27.830189 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 905/1726] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1461 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:27.899602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Calling method '.version_select at 0x7fa171276c10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.910980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.911470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.911904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.930957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.931465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.931907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.949189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b51c2069-a101-4c1b-81d2-75c10bc041b9 tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/b36492b0e551465b80ec5d4f9b91d1d1?start=2022-10-28T20%3A53%3A27.844797&end=2022-10-30T20%3A53%3A27.844797" status: 200 len: 693 microversion: 2.1 time: 0.100671 Oct 29 20:53:27.949811 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 906/1727] 10.222.0.36 () {58 vars in 1412 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/os-simple-tenant-usage/b36492b0e551465b80ec5d4f9b91d1d1?start=2022-10-28T20%3A53%3A27.844797&end=2022-10-30T20%3A53%3A27.844797 => generated 693 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:53:27.954126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:27.962809 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-142916eb-fe01-46ba-8d4b-323304c018b2 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1526 microversion: 2.1 time: 0.156681 Oct 29 20:53:27.963485 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 822/1728] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:27.965034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '.version_select at 0x7fa1712ab790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:27.974625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.975753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.976104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.985447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:27.986005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:27.986500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:27.998011 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea0c1a58-b1b4-4f11-84e3-901cba146bc8 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/b36492b0e551465b80ec5d4f9b91d1d1?start=2022-10-28T20%3A53%3A27.844797&end=2022-10-30T20%3A53%3A27.844797" status: 200 len: 693 microversion: 2.1 time: 0.036932 Oct 29 20:53:27.998578 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 907/1729] 10.222.0.36 () {58 vars in 1412 bytes} [Sat Oct 29 20:53:27 2022] GET /compute/v2.1/os-simple-tenant-usage/b36492b0e551465b80ec5d4f9b91d1d1?start=2022-10-28T20%3A53%3A27.844797&end=2022-10-30T20%3A53%3A27.844797 => generated 693 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:53:28.012951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Calling method '.version_select at 0x7fa171cfddc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.022536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.022946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.023394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.042802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.043291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.043736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.113706 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-58a3649b-58cb-4baa-89d4-eeb306f0c90b tempest-TenantUsagesTestJSON-846055550 tempest-TenantUsagesTestJSON-846055550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T20%3A53%3A27.844797&end=2022-10-30T20%3A53%3A27.844797&detailed=1" status: 200 len: 19790 microversion: 2.1 time: 0.104333 Oct 29 20:53:28.114295 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 823/1730] 10.222.0.36 () {58 vars in 1335 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T20%3A53%3A27.844797&end=2022-10-30T20%3A53%3A27.844797&detailed=1 => generated 19790 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:53:28.144726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.145267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.148027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.148027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.152487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.153025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.153483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.154200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.154670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.155087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.155514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.156742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.157381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.158331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.158935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.160913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.182273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:53:28.290287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1a19282-83dd-47eb-bd83-80574dc9609c tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "DELETE /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 204 len: 0 microversion: 2.1 time: 0.149057 Oct 29 20:53:28.293537 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 908/1731] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:53:28 2022] DELETE /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:28.300004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.300004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.306241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.306741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.307186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.307894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.308362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.308794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.317343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.327476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.328960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.330131 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4869ca3b-e8a2-4083-8db0-9c0f3f2885f9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.187671 Oct 29 20:53:28.330698 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 824/1732] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:28.470225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.480034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-beb84e0b-6d96-4fea-b09c-9f727d30ff38 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1467 microversion: 2.1 time: 0.184932 Oct 29 20:53:28.484487 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 909/1733] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1467 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:28.501201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.501948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.508983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.509492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.510124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.510863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.518004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.530699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.600151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6bdb8c46-cf0c-4f19-992d-f17c0e189246 req-b56c259d-04f6-4500-93f8-7f49583cde59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaedd45-ece1-4af1-b6fd-423ff496f7c6", "name": "network-vif-deleted", "tag": "83a7af20-cc55-4582-a20c-12a247fc4d1c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:28.613047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6bdb8c46-cf0c-4f19-992d-f17c0e189246 req-b56c259d-04f6-4500-93f8-7f49583cde59 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.614177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6bdb8c46-cf0c-4f19-992d-f17c0e189246 req-b56c259d-04f6-4500-93f8-7f49583cde59 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.614836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6bdb8c46-cf0c-4f19-992d-f17c0e189246 req-b56c259d-04f6-4500-93f8-7f49583cde59 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.627961 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6bdb8c46-cf0c-4f19-992d-f17c0e189246 req-b56c259d-04f6-4500-93f8-7f49583cde59 service nova] Creating event network-vif-deleted:83a7af20-cc55-4582-a20c-12a247fc4d1c for instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 on nch2-master-1 Oct 29 20:53:28.636218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6bdb8c46-cf0c-4f19-992d-f17c0e189246 req-b56c259d-04f6-4500-93f8-7f49583cde59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039629 Oct 29 20:53:28.636815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 910/1734] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:28.642332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.643052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.650254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.650752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.651203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.651913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.652371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.652802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.714507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.723016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d863706-6ba8-41fb-a7c6-56683e48ab04 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.225868 Oct 29 20:53:28.723595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 825/1735] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:28.728997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.729653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.730723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.736461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.737248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.737714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.738637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.739301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.739732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.744018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.745537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.750818 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-badb45f3-ea05-4431-9c36-8e12a7b5dcca tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.112809 Oct 29 20:53:28.751582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 911/1736] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:28.875785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:28.884043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31a827d5-5e0c-40c8-bb70-6516e1fbed34 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.159133 Oct 29 20:53:28.884612 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 826/1737] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:28.986562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:28.987175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:28.994362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.994842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.995278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:28.995968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:28.996423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:28.996850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.060104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:29.067756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6054fafb-a83d-43f3-8152-b65b2544b14f tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1484 microversion: 2.1 time: 0.085176 Oct 29 20:53:29.068326 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 912/1738] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:28 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1484 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:29.152000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-70b9d987-850a-44ff-b0d5-c51370f92dc7 req-e7427ad1-4cf8-4c7c-a362-9c20c727a644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d324009-d931-499f-83ac-cdd3cc3def5c", "name": "network-vif-plugged", "status": "completed", "tag": "2af17672-719d-48fb-a0df-59093ab7beb4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:29.162520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-70b9d987-850a-44ff-b0d5-c51370f92dc7 req-e7427ad1-4cf8-4c7c-a362-9c20c727a644 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.163001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-70b9d987-850a-44ff-b0d5-c51370f92dc7 req-e7427ad1-4cf8-4c7c-a362-9c20c727a644 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.163428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-70b9d987-850a-44ff-b0d5-c51370f92dc7 req-e7427ad1-4cf8-4c7c-a362-9c20c727a644 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.175118 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-70b9d987-850a-44ff-b0d5-c51370f92dc7 req-e7427ad1-4cf8-4c7c-a362-9c20c727a644 service nova] Creating event network-vif-plugged:2af17672-719d-48fb-a0df-59093ab7beb4 for instance 1d324009-d931-499f-83ac-cdd3cc3def5c on nch2-master-1 Oct 29 20:53:29.180589 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-70b9d987-850a-44ff-b0d5-c51370f92dc7 req-e7427ad1-4cf8-4c7c-a362-9c20c727a644 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032531 Oct 29 20:53:29.181195 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 827/1739] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:29.356945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:29.357615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:29.364746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.365238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.366248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.367067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.367637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.368061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.504167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:29.504991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:29.511349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.511835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.512278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.512974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.513436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.513888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.549871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:29.559128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:29.560841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:29.562064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7d7bd202-117d-4fa2-b2fb-7fec9f9fc119 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.209266 Oct 29 20:53:29.562887 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 913/1740] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:29 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:29.746856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:29.747468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:29.756312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.761824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.762328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.763196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.763666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.764994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.866628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:29.885697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5dc92b6a-a008-4dd6-944b-61262bb7740f tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1467 microversion: 2.1 time: 0.381991 Oct 29 20:53:29.887674 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 828/1741] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:29 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1467 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:29.905010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:29.908430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:29.933719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.934241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.937136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:29.937985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:29.938473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:29.938943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.155641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.165967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.168383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.169367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.174884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08f0cff3-1177-412c-afe5-9d20b2096ac4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.286080 Oct 29 20:53:30.175875 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 829/1742] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:29 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:30.182893 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b24c63ed-06bd-490e-ac0d-49e4ddf4558b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.439646 Oct 29 20:53:30.183840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:30.190387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:30.197495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.198237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.198823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.199680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.200434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.201009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.201623 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 914/1743] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:29 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:30.210948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:30.211703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:30.218526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.219034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.219760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.220701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.221421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.221873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.262852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.263444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.263942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.264484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lazy-loading 'fault' on Instance uuid feaedd45-ece1-4af1-b6fd-423ff496f7c6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:30.347291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.357017 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be859233-4431-4607-9f4d-e5d673ff1c2c tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1314 microversion: 2.1 time: 0.154097 Oct 29 20:53:30.359149 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 915/1744] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:30 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:30.373215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b6a354fb-8c8d-4d8e-a35d-3c206cbf0efa req-39071d48-6c60-45ee-9128-3b860c096040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4554eb0-6c9b-43a0-90e9-51695dc162f8", "name": "network-vif-unplugged", "status": "completed", "tag": "98df740d-6a7a-4baa-9553-f3e319f76f39"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:30.393043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6a354fb-8c8d-4d8e-a35d-3c206cbf0efa req-39071d48-6c60-45ee-9128-3b860c096040 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.393780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6a354fb-8c8d-4d8e-a35d-3c206cbf0efa req-39071d48-6c60-45ee-9128-3b860c096040 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.394294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6a354fb-8c8d-4d8e-a35d-3c206cbf0efa req-39071d48-6c60-45ee-9128-3b860c096040 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.410014 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b6a354fb-8c8d-4d8e-a35d-3c206cbf0efa req-39071d48-6c60-45ee-9128-3b860c096040 service nova] Creating event network-vif-unplugged:98df740d-6a7a-4baa-9553-f3e319f76f39 for instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 on nch1-master-1 Oct 29 20:53:30.416480 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b6a354fb-8c8d-4d8e-a35d-3c206cbf0efa req-39071d48-6c60-45ee-9128-3b860c096040 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056020 Oct 29 20:53:30.417322 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 916/1745] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:30.516627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.529716 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a7c31be-2ab4-47c0-9f83-4778f9b1783a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.351860 Oct 29 20:53:30.548156 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 830/1746] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:30 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:30.590041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:30.590749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:30.605198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.606636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.607912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.609042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.609723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.610350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.894997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.907403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.915046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:30.916111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:30.919305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:30.921414 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a880e5f4-9d4b-4663-b52c-a3089967d1ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1361 microversion: 2.25 time: 0.337646 Oct 29 20:53:30.939337 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 917/1747] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:30 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:30.942778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.945699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.950217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:30.951074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:30.951779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:30.952464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.044871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.054619 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af7cb78d-53d9-4f37-bd37-bbf48c230d4a tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1425 microversion: 2.1 time: 0.144536 Oct 29 20:53:31.066495 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 831/1748] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:30 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1425 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:31.111201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e72eb723-5a51-4fcd-8474-579f5b2a0d93 req-e9d473da-9c69-4330-bde0-deae5a4d1fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86395c89-f3f7-4e4b-880a-725d49b91d8f", "name": "network-vif-deleted", "tag": "525b692f-a93a-41bb-ac6c-57f9327d2761"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:31.144296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:31.146683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e72eb723-5a51-4fcd-8474-579f5b2a0d93 req-e9d473da-9c69-4330-bde0-deae5a4d1fe9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.149103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e72eb723-5a51-4fcd-8474-579f5b2a0d93 req-e9d473da-9c69-4330-bde0-deae5a4d1fe9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.149698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e72eb723-5a51-4fcd-8474-579f5b2a0d93 req-e9d473da-9c69-4330-bde0-deae5a4d1fe9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.190622 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e72eb723-5a51-4fcd-8474-579f5b2a0d93 req-e9d473da-9c69-4330-bde0-deae5a4d1fe9 service nova] Creating event network-vif-deleted:525b692f-a93a-41bb-ac6c-57f9327d2761 for instance 86395c89-f3f7-4e4b-880a-725d49b91d8f on nch2-master-1 Oct 29 20:53:31.204539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:31.205836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:31.216580 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e72eb723-5a51-4fcd-8474-579f5b2a0d93 req-e9d473da-9c69-4330-bde0-deae5a4d1fe9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110367 Oct 29 20:53:31.217638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 918/1749] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:31.225275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:31.227743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.228292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.228758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.229549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.230342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:31.238860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.239436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.245108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.246528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.248930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.250091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.250829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.251545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.495620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.508024 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0ac5675-671d-4b1f-9457-707967a1a0d0 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.286977 Oct 29 20:53:31.511033 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 919/1750] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:31 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:31.521690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:31.522587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:31.543014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.546346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.547051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.548019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.549361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.551008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.590083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.595391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:31.611755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.615274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.616681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.617410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.618069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lazy-loading 'fault' on Instance uuid feaedd45-ece1-4af1-b6fd-423ff496f7c6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:31.620650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.643279 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-21bd3adc-377a-45ca-8048-923afa7fb700 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.442888 Oct 29 20:53:31.653712 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 832/1751] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:31 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:31.665951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:31.667528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:31.683464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.684327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.684892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.688862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.689743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.690465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.700336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.714534 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-51672f7a-5cf4-49c6-a40c-96f248c6ca49 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 200 len: 1314 microversion: 2.1 time: 0.202093 Oct 29 20:53:31.715430 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 920/1752] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:31 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:31.898397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:31.907605 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2470e939-8693-4467-a2da-06d001351730 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.252298 Oct 29 20:53:31.908694 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 833/1753] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:31 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:31.948742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:31.950902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:31.959939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.960361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.960983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:31.961909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:31.962525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:31.963148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.085276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:32.086699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:32.095055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.095817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.096467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.097485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.098251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.099250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.150037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:32.152554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.153045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.153737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.156485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lazy-loading 'fault' on Instance uuid 86395c89-f3f7-4e4b-880a-725d49b91d8f {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:32.165584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:32.169745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:32.171470 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b643697a-d124-4ab2-88a6-b6ca58af424d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1557 microversion: 2.25 time: 0.227214 Oct 29 20:53:32.173428 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 921/1754] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:31 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:32.204188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:32.205978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:32.220001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.221836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.222389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.223404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.223991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.224661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.650252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49faa862c6a441d0ab0e42deb06517e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b36492b0e551465b80ec5d4f9b91d1d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:32.659484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d079bdd0-10b6-443d-bfda-7afbc19b30ea tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 200 len: 1302 microversion: 2.1 time: 0.580006 Oct 29 20:53:32.660361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 834/1755] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:32 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 1302 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:32.671301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:32.672054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:32.680473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.681019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.681491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.682229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.682693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.683122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.858042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:32.870552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:32.872102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31f77b82-82c1-40d8-94e1-fdf04b28be3d tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 2049 microversion: 2.25 time: 0.674514 Oct 29 20:53:32.875506 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 922/1756] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:32 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 2049 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:32.884718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-234347c7-f22d-42e4-a5f6-3b3816adb5a0 req-3612ce47-4551-4348-9a29-7cdbe4a7bdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4554eb0-6c9b-43a0-90e9-51695dc162f8", "tag": "98df740d-6a7a-4baa-9553-f3e319f76f39"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:32.896210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:32.903143 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5af142e5-996b-41d7-bc88-627bf5de91f4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.241569 Oct 29 20:53:32.904032 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 835/1757] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:32 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:32.909711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-234347c7-f22d-42e4-a5f6-3b3816adb5a0 req-3612ce47-4551-4348-9a29-7cdbe4a7bdd9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.910189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-234347c7-f22d-42e4-a5f6-3b3816adb5a0 req-3612ce47-4551-4348-9a29-7cdbe4a7bdd9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.910628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-234347c7-f22d-42e4-a5f6-3b3816adb5a0 req-3612ce47-4551-4348-9a29-7cdbe4a7bdd9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.913444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:32.916865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:32.927286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.930391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.931272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.932204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.933420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.934156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.946798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-234347c7-f22d-42e4-a5f6-3b3816adb5a0 req-3612ce47-4551-4348-9a29-7cdbe4a7bdd9 service nova] Creating event network-changed:98df740d-6a7a-4baa-9553-f3e319f76f39 for instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 on nch1-master-1 Oct 29 20:53:32.956950 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-234347c7-f22d-42e4-a5f6-3b3816adb5a0 req-3612ce47-4551-4348-9a29-7cdbe4a7bdd9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078107 Oct 29 20:53:32.962242 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 923/1758] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:32.968045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:32.968759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:32.975390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.975903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.976521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:32.977239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:32.977787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:32.978226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.007379 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 HTTP/1.1 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'feaedd45-ece1-4af1-b6fd-423ff496f7c6'} Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.009622 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:53:33.014920 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.016409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:53:33.018375 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c177c8c6-c1bf-40d6-a852-d392de01efc6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 404 len: 111 microversion: 2.1 time: 0.054961 Oct 29 20:53:33.019434 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 924/1759] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:32 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:53:33.024193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-89416008-c06f-4034-8294-97613f0dc07c req-a3393d65-5069-4bf9-a661-1c37b95dea4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ff39d8-d9c4-48f9-92e9-9c2dac9633d0", "name": "network-vif-plugged", "status": "completed", "tag": "036bac86-fd93-4b18-8d46-08ab4f0665ed"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:33.036264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-89416008-c06f-4034-8294-97613f0dc07c req-a3393d65-5069-4bf9-a661-1c37b95dea4a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.037091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-89416008-c06f-4034-8294-97613f0dc07c req-a3393d65-5069-4bf9-a661-1c37b95dea4a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.038091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:33.038778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-89416008-c06f-4034-8294-97613f0dc07c req-a3393d65-5069-4bf9-a661-1c37b95dea4a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.055439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:33.055782 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-89416008-c06f-4034-8294-97613f0dc07c req-a3393d65-5069-4bf9-a661-1c37b95dea4a service nova] Creating event network-vif-plugged:036bac86-fd93-4b18-8d46-08ab4f0665ed for instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 on nch1-master-1 Oct 29 20:53:33.057018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:33.061966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-89416008-c06f-4034-8294-97613f0dc07c req-a3393d65-5069-4bf9-a661-1c37b95dea4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041023 Oct 29 20:53:33.066759 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 925/1760] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:33.071442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-443b824a-cf36-454e-a7cf-f2b6907819b2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.166120 Oct 29 20:53:33.072987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:33.073954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:33.082359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.083113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.083763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.084866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.085687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.086290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.102087 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 836/1761] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:32 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:33.118261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:33.118896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:33.134841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.135344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.135958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.136767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.138360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.138817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.551254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:33.575630 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4425dd03-fa31-4d44-aa67-22c540b4398f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 2049 microversion: 2.25 time: 0.507354 Oct 29 20:53:33.579019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:33.587472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05750420-bfa6-48aa-bb7d-af7c327b0f28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.484098 Oct 29 20:53:33.588051 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 837/1762] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:33 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:33.590426 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 926/1763] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:33 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 2049 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:33.593775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2070754092", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:33.603478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:33.607476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:33.611807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.612423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.612971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.613899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.614523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.615051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.644081 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e080a69d-f3f3-45f1-9ef7-0bf5a7978f66 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045743 Oct 29 20:53:33.644694 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 927/1764] 10.222.0.36 () {60 vars in 1217 bytes} [Sat Oct 29 20:53:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:53:33.658876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:33.659533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:33.666716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.667349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.667895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.668402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] validate_networks() for [('755ff50a-afe6-4046-876c-0b19c0bb1d49', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:53:33.668956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.669963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.670503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.768834 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbdbdbc8-2960-41b0-a255-4753eed750db tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c/action" status: 202 len: 0 microversion: 2.25 time: 0.109201 Oct 29 20:53:33.769579 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 928/1765] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:53:33 2022] POST /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:33.779429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:33.786020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] [instance: 86395c89-f3f7-4e4b-880a-725d49b91d8f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:33.798047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.798551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.799001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.799938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.800415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.800915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.829856 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] HTTP exception thrown: Instance 86395c89-f3f7-4e4b-880a-725d49b91d8f could not be found. Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Request method failure captured: Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f HTTP/1.1 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK1c8s-syldvg2aE-nKOAPSNce4Hna-QqOE40yHjSGb4-BPXjW8HIvrJ8_mWetOJBO651G99lXszCKzkRo97ExCpwltYGlaVp0etUz9GIcnYGN9RBUXyi1KX1xcqPKz_fQ8-6S9CP9ZmgcrixgbW4yplLD95fjnXASK4kkc3m9nvWs Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b36492b0e551465b80ec5d4f9b91d1d1 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TenantUsagesTestJSON-1020100038 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b36492b0e551465b80ec5d4f9b91d1d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b36492b0e551465b80ec5d4f9b91d1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b36492b0e551465b80ec5d4f9b91d1d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b36492b0e551465b80ec5d4f9b91d1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TenantUsagesTestJSON-1020100038 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b36492b0e551465b80ec5d4f9b91d1d1 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1020100038 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TenantUsagesTestJSON-1020100038-project Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 49faa862c6a441d0ab0e42deb06517e9 Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TenantUsagesTestJSON-1020100038-project Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 86395c89-f3f7-4e4b-880a-725d49b91d8f could not be found. Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '86395c89-f3f7-4e4b-880a-725d49b91d8f'} Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86395c89-f3f7-4e4b-880a-725d49b91d8f could not be found. Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86395c89-f3f7-4e4b-880a-725d49b91d8f could not be found. Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:33.831514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86395c89-f3f7-4e4b-880a-725d49b91d8f could not be found. Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] Returning 404 to user: Instance 86395c89-f3f7-4e4b-880a-725d49b91d8f could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:53:33.836687 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64c0ba03-7392-44da-bef6-325dde0511c5 tempest-TenantUsagesTestJSON-1020100038 tempest-TenantUsagesTestJSON-1020100038-project] 10.222.0.36 "GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f" status: 404 len: 111 microversion: 2.1 time: 0.063296 Oct 29 20:53:33.840521 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 929/1766] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:33 2022] GET /compute/v2.1/servers/86395c89-f3f7-4e4b-880a-725d49b91d8f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:53:33.846550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:33.847621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:33.856530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.857081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.857816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:33.858779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:33.859360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:33.859911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.162996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:34.187381 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9976295f-0453-4af4-9986-d89386802979 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 2054 microversion: 2.25 time: 0.345724 Oct 29 20:53:34.219555 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 930/1767] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:33 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 2054 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:34.224413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:34.225134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:34.236463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.236977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.237421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.238161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.238619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.239050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.405551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:53:34.406199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:53:34.407436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:53:34.408013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:53:34.408916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:53:34.425780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.426633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.427325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.428866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.429590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.430305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.442851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:34.453567 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92a014b8-fd63-4060-af04-cc164b917140 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.233042 Oct 29 20:53:34.465483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 931/1768] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:34 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:34.466933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:53:34.473402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:34.473402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:34.479462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Getting quotas for user 68212c49a188473ca9f523c46fd9cba2 and project b6ccb1f9fdd949b3badcbd1ceb571548. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:53:34.481872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.482819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.483093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.484588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.484919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.485359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.508254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:53:34.511746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:53:34.568523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:34.578876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:34.586651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:34.599163 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-973aa55e-1025-4f3e-8265-127e77ba9418 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.142277 Oct 29 20:53:34.614263 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 932/1769] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:34 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:34.614490 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b55aa523-2444-40c3-902a-31e21273753a tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.015069 Oct 29 20:53:34.614490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 838/1770] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:53:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:53:34.614737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:34.614737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:34.618584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f65548ef-da22-4c84-896a-639b9fed5222 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:34.619682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f65548ef-da22-4c84-896a-639b9fed5222 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:34.624932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.627625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.627625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.627625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:34.627625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:34.629665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:34.694964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f65548ef-da22-4c84-896a-639b9fed5222 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:34.715162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f65548ef-da22-4c84-896a-639b9fed5222 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1225 microversion: 2.1 time: 0.102083 Oct 29 20:53:34.731275 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 839/1771] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:34 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:34.929234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:34.938311 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-74d0bfb7-3227-487f-8caf-81cf24eab916 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1308 microversion: 2.1 time: 0.329777 Oct 29 20:53:34.944487 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 933/1772] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:34 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:35.219625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:35.220495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:35.246804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:35.249304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:35.250539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:35.251799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:35.253702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:35.254381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:35.482324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:35.483500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:35.494834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:35.495625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:35.497260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:35.502385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:35.503145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:35.503768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:35.835049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:35.872693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-07ad8a19-f6e6-4e60-9e9e-5aa70b401af3 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 2034 microversion: 2.25 time: 0.659998 Oct 29 20:53:35.873618 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 840/1773] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:35 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 2034 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:35.878495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:35.879429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:35.895746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:35.896559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:35.897339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:35.898410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:35.899061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:35.899793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:35.947075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:35.960614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b27daaa-cd50-4f80-8ef9-ba656101d261 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.483332 Oct 29 20:53:35.973637 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 934/1774] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:35 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:35.991894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:35.993056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:36.013133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:36.020510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.021252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.021923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.023019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.023693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.027487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.208376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:36.219982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:36.227956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:36.242487 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd4e10a5-d96a-44fa-afe4-0298dc901205 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.367388 Oct 29 20:53:36.243422 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 841/1775] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:35 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:36.254325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:36.265210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:36.275062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.275909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.276627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.277679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.278416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.278946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.287328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:36.300174 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81fa9808-839a-4b8e-937d-da1263133f46 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1277 microversion: 2.1 time: 0.323696 Oct 29 20:53:36.302606 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 935/1776] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:35 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1277 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:36.317930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:36.319173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:36.325371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'flavor' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:36.326447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.327829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.328612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.329601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.330300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.331281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.347008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Going to try to live migrate instance to nch1-master-1 {{(pid=138884) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:53:36.769996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:36.796276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff1cc630-affc-46fb-9c43-99edd567090e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1489 microversion: 2.1 time: 0.490978 Oct 29 20:53:36.801683 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 936/1777] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:36 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1489 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:36.827526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:36.828176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:36.838886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.839648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.840262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.841189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:36.847765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:36.848499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:36.932583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:37.032837 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d8e6e0f-6df7-41ed-ae87-60864965ba20 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0/action" status: 202 len: 0 microversion: 2.1 time: 0.205491 Oct 29 20:53:37.039918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 937/1778] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:53:36 2022] POST /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:53:37.060989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:37.063493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:37.084276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:37.088019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:37.088797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:37.091803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:37.092595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:37.095321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:37.703916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:37.736260 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-900b62b2-eed8-4f3e-b7f8-d4bd5d1cfc0a tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.690016 Oct 29 20:53:37.738707 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 938/1779] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:37 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:37.749473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:37.750460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:37.769217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:37.770351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:37.771018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:37.780991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:37.782155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:37.783047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:38.422635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:38.446170 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c80503ae-2b2c-460c-9bbb-52ce4be32261 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 200 len: 1474 microversion: 2.1 time: 0.703692 Oct 29 20:53:38.461490 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 939/1780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:37 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 1474 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:38.484707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:38.486601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:38.518741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:38.521035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:38.521938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:38.524524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:38.529662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:38.530656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:38.719903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:38.743794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:38.750236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:38.768234 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5bac97be-85ce-451d-bcb1-d5c7231e095e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.300371 Oct 29 20:53:38.781482 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 940/1781] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:38 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:38.797898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:38.800439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:38.812564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:38.813753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:38.814763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:38.815858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:38.816611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:38.817548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:39.427212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:39.437006 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-13e0974f-e0f3-4867-a704-206d475525e0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 0.663727 Oct 29 20:53:39.442407 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 941/1782] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:38 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:39.455824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2034850684"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:39.458889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:39.482284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:39.483212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:39.483890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:39.484876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:39.485606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:39.486261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:39.553644 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be3f051a-d536-4f7b-90ba-3efea43ae6e1 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c/action" status: 202 len: 0 microversion: 2.25 time: 3.306566 Oct 29 20:53:39.554451 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 842/1783] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:53:36 2022] POST /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c/action => generated 0 bytes in 3308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:39.576740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:39.578252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:39.614639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:39.620825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:39.622035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:39.624466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:39.624985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:39.625447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:40.089957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1febc381-225c-45f9-9a36-402ae7ce34f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0/action" status: 202 len: 0 microversion: 2.1 time: 0.645874 Oct 29 20:53:40.095582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 942/1784] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:53:39 2022] POST /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:53:40.113971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:40.115081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:40.129939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:40.132848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:40.134599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:40.137024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:40.137837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:40.139403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:40.157374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:40.172222 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a9abe14-764c-4c3d-b661-22fbb5e5b94b tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1392 microversion: 2.1 time: 0.615431 Oct 29 20:53:40.192154 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 843/1785] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:39 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1392 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:40.199602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:40.201939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:40.230409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:40.231445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:40.235565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:40.237951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:40.240242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:40.242514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:40.456529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:40.467255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:40.475779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:40.492883 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52338e96-2a82-4cbc-a479-36589e079be5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.299141 Oct 29 20:53:40.493516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 844/1786] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:40 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:40.498292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0776c18-f1db-426c-a9ae-39fe60fb25f7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17638c550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:40.566987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0776c18-f1db-426c-a9ae-39fe60fb25f7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.072151 Oct 29 20:53:40.577156 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 845/1787] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:40 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:40.582931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:40.583778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:40.590774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:40.591525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:40.592144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:40.593165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:40.593841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:40.594439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:41.394080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:41.415889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:41.424967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:41.432003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ebefaa97-7a99-4ca7-bef6-ce6ab8fad88d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 1.334763 Oct 29 20:53:41.433303 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 943/1788] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:40 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:41.446395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5d85c189-fdd2-4d73-8faa-33b7606d28e0 req-a93ae515-021c-4023-88f2-9caff9046e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b309c7e-d98c-4c5d-964c-3ba410ac7ca6", "tag": "12498de0-fd54-4741-9fda-23fe2002f63a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:41.472280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5d85c189-fdd2-4d73-8faa-33b7606d28e0 req-a93ae515-021c-4023-88f2-9caff9046e12 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:41.473045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5d85c189-fdd2-4d73-8faa-33b7606d28e0 req-a93ae515-021c-4023-88f2-9caff9046e12 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:41.473761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5d85c189-fdd2-4d73-8faa-33b7606d28e0 req-a93ae515-021c-4023-88f2-9caff9046e12 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:41.510216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5d85c189-fdd2-4d73-8faa-33b7606d28e0 req-a93ae515-021c-4023-88f2-9caff9046e12 service nova] Creating event network-changed:12498de0-fd54-4741-9fda-23fe2002f63a for instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 on nch2-master-1 Oct 29 20:53:41.526509 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5d85c189-fdd2-4d73-8faa-33b7606d28e0 req-a93ae515-021c-4023-88f2-9caff9046e12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089015 Oct 29 20:53:41.527401 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 944/1789] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:41.541605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:41.542841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:41.562898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:41.564014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:41.566601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:41.567553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:41.569509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:41.572729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:41.685162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:41.696379 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84114303-63e4-48f8-b65a-6cc774f122ea tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 1.119149 Oct 29 20:53:41.699081 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 846/1790] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:40 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:41.705392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:41.707001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:41.727957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:41.730127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:41.730942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:41.732578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:41.733670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:41.734867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:42.031375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:42.048140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:42.056293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:42.067222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:42.072300 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30f81225-e050-4020-b157-7fcf8c005477 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.371712 Oct 29 20:53:42.073444 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 847/1791] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:41 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:42.087369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-73571970-3e09-4581-abd2-c4b05d763a24 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa176336c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:42.087843 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f843b526-5365-4bf7-ab29-5f3a053e3d61 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1382 microversion: 2.1 time: 0.557526 Oct 29 20:53:42.089595 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 945/1792] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:41 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1382 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:42.120511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-473540d5-5138-4cb6-8203-351186afeaf9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '.version_select at 0x7fa171523790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:42.126019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-473540d5-5138-4cb6-8203-351186afeaf9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:42.127366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-473540d5-5138-4cb6-8203-351186afeaf9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:42.128927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-473540d5-5138-4cb6-8203-351186afeaf9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:42.163580 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-473540d5-5138-4cb6-8203-351186afeaf9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.044878 Oct 29 20:53:42.165858 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 946/1793] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:53:42 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:42.186924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:42.187750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:42.205354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:42.206391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:42.207112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:42.208275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:42.209183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:42.211086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:42.221665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-73571970-3e09-4581-abd2-c4b05d763a24 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.146910 Oct 29 20:53:42.222283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 848/1794] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:42 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:42.466444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:42.467496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:42.494941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:42.496974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:42.498237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:42.499432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:42.500119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:42.500801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:43.033489 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a61403bd-0b15-4d2a-812d-eac0633be0e9 tempest-LiveMigrationTest-684237848 tempest-LiveMigrationTest-684237848-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1533 microversion: 2.1 time: 0.848970 Oct 29 20:53:43.036106 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 947/1795] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:42 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1533 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:43.049155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:43.051624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:43.077600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:43.080814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:43.083819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:43.086200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:43.087798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:43.091887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:43.483886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:43.559167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:43.568483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:43.574511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3272e8d5-1a6c-47c4-b5cd-ccede3ab1e28 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 1.116818 Oct 29 20:53:43.576523 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 849/1796] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:42 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:43.603253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:43.603916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:43.615193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:43.616333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:43.616996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:43.618166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:43.620118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:43.620742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:43.621018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:43.665230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:53:43.841018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 204 len: 0 microversion: 2.1 time: 0.261341 Oct 29 20:53:43.845900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 850/1797] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:53:43 2022] DELETE /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:43.859042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:43.861212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:43.882764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:43.884510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:43.888425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:43.889580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:43.890339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:43.892606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:44.199346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:44.212290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:44.228226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:44.246494 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd485377-337d-43b9-88cc-a05d4ab2050b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.395617 Oct 29 20:53:44.247393 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 851/1798] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:43 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:44.263169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0100aad-054e-4d70-b5e0-5fd0dc0b04a8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17191a8b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:44.339560 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0100aad-054e-4d70-b5e0-5fd0dc0b04a8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.090719 Oct 29 20:53:44.342765 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 852/1799] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:44 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:44.355216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:44.356133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:44.368095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:44.372322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:44.373055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:44.374021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:44.376235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:44.376872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:44.391050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:44.446450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:44.451290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:44.466600 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6e01aa1-58f7-408d-a429-86b7b4759f17 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 1.427657 Oct 29 20:53:44.468198 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 948/1800] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:43 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:44.482056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-202aa6a6-ae6f-4527-87e3-b9ce82803b02 req-2fba4753-09ee-4fc3-b87f-6fe358795a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d324009-d931-499f-83ac-cdd3cc3def5c", "name": "network-vif-unplugged", "status": "completed", "tag": "2af17672-719d-48fb-a0df-59093ab7beb4"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:44.512509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-202aa6a6-ae6f-4527-87e3-b9ce82803b02 req-2fba4753-09ee-4fc3-b87f-6fe358795a20 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:44.513379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-202aa6a6-ae6f-4527-87e3-b9ce82803b02 req-2fba4753-09ee-4fc3-b87f-6fe358795a20 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:44.514025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-202aa6a6-ae6f-4527-87e3-b9ce82803b02 req-2fba4753-09ee-4fc3-b87f-6fe358795a20 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:44.545171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-202aa6a6-ae6f-4527-87e3-b9ce82803b02 req-2fba4753-09ee-4fc3-b87f-6fe358795a20 service nova] Creating event network-vif-unplugged:2af17672-719d-48fb-a0df-59093ab7beb4 for instance 1d324009-d931-499f-83ac-cdd3cc3def5c on nch2-master-1 Oct 29 20:53:44.554744 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-202aa6a6-ae6f-4527-87e3-b9ce82803b02 req-2fba4753-09ee-4fc3-b87f-6fe358795a20 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081209 Oct 29 20:53:44.558454 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 949/1801] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:44.611953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:44.613101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:44.639836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:44.641144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:44.641849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:44.648311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:44.649020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:44.650514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:44.701604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:45.439098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.453214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.456770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.465090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e43fb9df-babc-4e50-bba0-c09dfe5f6939 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.856349 Oct 29 20:53:45.467378 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 950/1802] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:44 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:45.478341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:45.479224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:45.495753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:45.496674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:45.498698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:45.502931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:45.506743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:45.509255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:45.641686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.652528 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9c695a96-9a9b-4fbb-8d3d-909238ada850 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1388 microversion: 2.1 time: 1.307676 Oct 29 20:53:45.657338 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 853/1803] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:44 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1388 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:45.664596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3d501e78-4fde-4adf-87fc-006837eb979f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa173282a60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:45.730509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.753521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.765789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3d501e78-4fde-4adf-87fc-006837eb979f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.106855 Oct 29 20:53:45.766382 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 854/1804] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:45 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:45.769043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:45.781124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:45.787456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:45.789354 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b2c3b8c-a10e-4575-b7b6-deb051032c68 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.321561 Oct 29 20:53:45.790006 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 951/1805] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:45 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:45.801263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:45.801793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:45.802272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:45.805618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:45.812184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:45.813104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:46.368732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:46.390425 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de1dae22-ba6e-4837-b11d-bab6ed0e054d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 0.620949 Oct 29 20:53:46.394115 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 855/1806] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:45 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:46.495378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:46.496027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:46.509486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:46.510025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:46.510476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:46.511520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:46.511800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:46.518237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:46.600194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e737171f-4180-4713-a540-045d954be0ac req-f1079889-ee2f-4e54-b86a-93a7e35aa7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d324009-d931-499f-83ac-cdd3cc3def5c", "tag": "2af17672-719d-48fb-a0df-59093ab7beb4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:46.695594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e737171f-4180-4713-a540-045d954be0ac req-f1079889-ee2f-4e54-b86a-93a7e35aa7d9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:46.699621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e737171f-4180-4713-a540-045d954be0ac req-f1079889-ee2f-4e54-b86a-93a7e35aa7d9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:46.700091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e737171f-4180-4713-a540-045d954be0ac req-f1079889-ee2f-4e54-b86a-93a7e35aa7d9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:46.791795 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e737171f-4180-4713-a540-045d954be0ac req-f1079889-ee2f-4e54-b86a-93a7e35aa7d9 service nova] Creating event network-changed:2af17672-719d-48fb-a0df-59093ab7beb4 for instance 1d324009-d931-499f-83ac-cdd3cc3def5c on nch2-master-1 Oct 29 20:53:46.815954 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e737171f-4180-4713-a540-045d954be0ac req-f1079889-ee2f-4e54-b86a-93a7e35aa7d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223752 Oct 29 20:53:46.817317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 856/1807] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:46.827223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:46.830337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:46.845612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:46.854731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:46.855399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:46.856337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:46.856982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:46.857799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:47.065690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.075503 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3fb8fa79-3d9e-4fb8-bc54-e6c89a0053cb tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 200 len: 1346 microversion: 2.1 time: 0.256748 Oct 29 20:53:47.080384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 857/1808] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:46 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 1346 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:47.102774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d9123876-031a-41e2-8413-f57d35ac7749 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171e8f670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:47.167462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.179637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.186459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.187889 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d898105f-1352-4f71-9fa9-55911f0871c1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.697718 Oct 29 20:53:47.209704 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 952/1809] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:46 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:47.225379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:47.232428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:47.245827 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d9123876-031a-41e2-8413-f57d35ac7749 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.152294 Oct 29 20:53:47.247428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:47.248124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:47.248389 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 858/1810] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:47 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:47.258107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:47.259099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:47.259810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:47.260432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:47.266567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0530bc51-f8e7-444e-b489-6f9696ac01ff req-47f5c712-eab6-49db-aa6c-c61ffab3c146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4554eb0-6c9b-43a0-90e9-51695dc162f8", "name": "network-vif-deleted", "tag": "98df740d-6a7a-4baa-9553-f3e319f76f39"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:47.322217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0530bc51-f8e7-444e-b489-6f9696ac01ff req-47f5c712-eab6-49db-aa6c-c61ffab3c146 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:47.322699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0530bc51-f8e7-444e-b489-6f9696ac01ff req-47f5c712-eab6-49db-aa6c-c61ffab3c146 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:47.327093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0530bc51-f8e7-444e-b489-6f9696ac01ff req-47f5c712-eab6-49db-aa6c-c61ffab3c146 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:47.359848 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0530bc51-f8e7-444e-b489-6f9696ac01ff req-47f5c712-eab6-49db-aa6c-c61ffab3c146 service nova] Creating event network-vif-deleted:98df740d-6a7a-4baa-9553-f3e319f76f39 for instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 on nch2-master-1 Oct 29 20:53:47.376884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0530bc51-f8e7-444e-b489-6f9696ac01ff req-47f5c712-eab6-49db-aa6c-c61ffab3c146 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127118 Oct 29 20:53:47.382011 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 859/1811] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:47.413134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.423470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:47.424973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:47.439797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.442120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:47.443174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:47.449572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:47.451058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.451248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:47.451575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:47.452198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:47.494389 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec553d58-12f7-4ec4-b9cc-e97bb3de226f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.282801 Oct 29 20:53:47.500609 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 953/1812] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:47 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:47.871284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:47.880744 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0925416d-fc06-4f89-a520-0b1f25fbec1d tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 0.462972 Oct 29 20:53:47.883542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 860/1813] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:47 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:48.112917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:48.114675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: c4554eb0-6c9b-43a0-90e9-51695dc162f8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:48.126380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.128122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.128837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.130308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.131543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.133284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.166181 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] HTTP exception thrown: Instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 could not be found. Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Request method failure captured: Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 HTTP/1.1 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGzgVEgdgiwPHrSFL_unNDKXn9DoNXlkEWLbbhtOXyT3-DcLNx82NIsuQWntKmD0CJPRGG-EWgeKbap_sh-ehpF94RCFF1eA0ahDAOuSosnz4w9WcobAWplFPMm-zuyfsd0tWAcaqb2iJvL0NzWhS4k-hDaCPt4oU48orgS2cp0YrY Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d373d98fd667430fac145e2e63249419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d373d98fd667430fac145e2e63249419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveMigrationTest-2002133718 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveMigrationTest-2002133718-project Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 869b7117eab8443e9cbb52400b875ebc Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveMigrationTest-2002133718-project Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 could not be found. Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c4554eb0-6c9b-43a0-90e9-51695dc162f8'} Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 could not be found. Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 could not be found. Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:53:48.169949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 could not be found. Oct 29 20:53:48.178598 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:53:48.181400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Returning 404 to user: Instance c4554eb0-6c9b-43a0-90e9-51695dc162f8 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:53:48.184708 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e304bb4d-559f-4655-a39c-f9eda682aef4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8" status: 404 len: 111 microversion: 2.1 time: 0.077389 Oct 29 20:53:48.211505 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 954/1814] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:48 2022] GET /compute/v2.1/servers/c4554eb0-6c9b-43a0-90e9-51695dc162f8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:53:48.230860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:48.231947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:48.252156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.255080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.257160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.267059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-764d6c0b-18d5-47b0-9005-56fd5d9550cb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171314ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:48.281629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.284755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.289045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.610336 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-764d6c0b-18d5-47b0-9005-56fd5d9550cb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.348841 Oct 29 20:53:48.612127 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 955/1815] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:48 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:48.626863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:48.628378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:48.658446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.668120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.670126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.674169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.676015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.681083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.691644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:48.867626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:48.899977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:48.904469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:48.906649 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ded42d03-0ca9-4ed9-9448-0f43cb13812b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.685612 Oct 29 20:53:48.910834 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 861/1816] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:48 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:48.918723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f6bbfb19-9049-4e9a-bea0-c7c3ade29ca1 req-d1728387-467a-436b-abc2-6e9359924f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ff39d8-d9c4-48f9-92e9-9c2dac9633d0", "name": "network-vif-plugged", "status": "completed", "tag": "036bac86-fd93-4b18-8d46-08ab4f0665ed"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:48.944444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:48.958534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:48.967289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:48.972527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f6bbfb19-9049-4e9a-bea0-c7c3ade29ca1 req-d1728387-467a-436b-abc2-6e9359924f6d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:48.973193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f6bbfb19-9049-4e9a-bea0-c7c3ade29ca1 req-d1728387-467a-436b-abc2-6e9359924f6d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:48.976360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f6bbfb19-9049-4e9a-bea0-c7c3ade29ca1 req-d1728387-467a-436b-abc2-6e9359924f6d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:48.984169 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-093d681c-0dc7-49c7-a4af-0fce32f12d64 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.370564 Oct 29 20:53:48.987069 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 956/1817] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:48 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:49.000119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:49.002875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:49.010088 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f6bbfb19-9049-4e9a-bea0-c7c3ade29ca1 req-d1728387-467a-436b-abc2-6e9359924f6d service nova] Creating event network-vif-plugged:036bac86-fd93-4b18-8d46-08ab4f0665ed for instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 on nch1-master-1 Oct 29 20:53:49.021729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:49.022547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:49.023348 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f6bbfb19-9049-4e9a-bea0-c7c3ade29ca1 req-d1728387-467a-436b-abc2-6e9359924f6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109610 Oct 29 20:53:49.023968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:49.024915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:49.026550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:49.026775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 862/1818] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:49.027749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:49.475577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:49.509179 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-581ee4f6-05a0-4c2c-8ddf-4556368da168 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 0.516240 Oct 29 20:53:49.512805 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 957/1819] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:48 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:49.629616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9db91a27-2b15-433c-91c9-7953d7ae761e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1763a25e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:49.945959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:49.947771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:49.954624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:49.955568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:49.956302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:49.957329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:49.958097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:49.959521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.350382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:50.368912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:50.374583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:50.378963 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf90a2ea-37d6-41d5-b3c5-be6fb5797a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.440249 Oct 29 20:53:50.397663 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 958/1820] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:49 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:50.399109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:50.399569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:50.431151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:50.431710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:50.435094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.436270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:50.436920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:50.437667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.566557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:50.597827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:50.609101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:50.628078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68199c4b-a2fb-47c4-a04f-80d550ca3880 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.237107 Oct 29 20:53:50.630613 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 959/1821] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:50 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:50.635637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9db91a27-2b15-433c-91c9-7953d7ae761e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 1.010581 Oct 29 20:53:50.636547 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 863/1822] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:49 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:50.642893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:50.647688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:50.686354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:50.687845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:50.690181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.697489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:50.700164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:50.702007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.746869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:50.749362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:50.778754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:50.779765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:50.783110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.785867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:50.789004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:50.793057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:50.900606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:53:51.110971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6cc1fd91-4148-43de-a9b1-853b851affb8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 204 len: 0 microversion: 2.1 time: 0.367923 Oct 29 20:53:51.114045 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 864/1823] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:53:50 2022] DELETE /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 20:53:51.129962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3441de7c-4003-46b5-ab88-6a4bc5bdc22d req-bafa45ce-96ae-44a1-8def-f559d611cc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b309c7e-d98c-4c5d-964c-3ba410ac7ca6", "name": "network-vif-plugged", "status": "completed", "tag": "12498de0-fd54-4741-9fda-23fe2002f63a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:51.166814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3441de7c-4003-46b5-ab88-6a4bc5bdc22d req-bafa45ce-96ae-44a1-8def-f559d611cc03 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.167507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3441de7c-4003-46b5-ab88-6a4bc5bdc22d req-bafa45ce-96ae-44a1-8def-f559d611cc03 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.168053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3441de7c-4003-46b5-ab88-6a4bc5bdc22d req-bafa45ce-96ae-44a1-8def-f559d611cc03 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:51.198104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3441de7c-4003-46b5-ab88-6a4bc5bdc22d req-bafa45ce-96ae-44a1-8def-f559d611cc03 service nova] Creating event network-vif-plugged:12498de0-fd54-4741-9fda-23fe2002f63a for instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 on nch2-master-1 Oct 29 20:53:51.210981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:51.214044 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3441de7c-4003-46b5-ab88-6a4bc5bdc22d req-bafa45ce-96ae-44a1-8def-f559d611cc03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088879 Oct 29 20:53:51.216451 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 865/1824] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:51.232331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d4c9b22-477b-48ff-bc86-163821ba8ee6 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 0.599529 Oct 29 20:53:51.233656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:51.234901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:51.238879 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 960/1825] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:50 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:51.244716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.245601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.246355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:51.247734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.248491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.249146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:51.410487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:51.411245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:51.422068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.422739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.427274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:51.432021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.432597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.433057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:51.788919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:51.814224 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d48138b-3f6b-4a51-a07e-1ccef4854db2 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1670 microversion: 2.1 time: 0.586122 Oct 29 20:53:51.815412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 866/1826] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:51 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1670 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:51.831003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6777cc9b-3d2d-4f98-9086-8fcceac9cecc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17639fdc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:51.875317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:51.893501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:51.895654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:51.897852 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8a3339e-9a04-4ec9-8b35-c6cb3b5f05f2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.491751 Oct 29 20:53:51.899369 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 961/1827] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:51 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:53:51.905089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:51.906010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:51.916001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.916989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.917720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:51.919150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:51.929776 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6777cc9b-3d2d-4f98-9086-8fcceac9cecc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.112638 Oct 29 20:53:51.930636 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 867/1828] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:51 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:51.930909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:51.932356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:52.029609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:52.042236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:52.045260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:52.063674 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6222998d-764b-40eb-8a58-da35177cd103 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1537 microversion: 2.91 time: 0.162936 Oct 29 20:53:52.066847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 962/1829] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:51 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:52.267772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:52.269591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:52.309287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:52.313303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:52.315213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:52.320528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:52.329164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:52.333532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:52.847752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:52.855261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:52.883676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:52.884949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:52.885391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:52.894506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:52.895408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:52.895861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:53.325062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:53.348559 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5cbba2c-7ab3-4d29-b113-a12595ff943d tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1670 microversion: 2.1 time: 0.509763 Oct 29 20:53:53.350986 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 963/1830] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:52 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1670 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:53:53.368517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:53.370679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:53.388642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:53.389202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:53.389697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:53.390442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:53.391096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:53.391719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:53.415257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:53.425023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-118a7cb6-dc70-4d6f-aaa3-ac53655d6cb0 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1325 microversion: 2.1 time: 1.165746 Oct 29 20:53:53.430697 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 868/1831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:52 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1325 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:53.445922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-963b8b80-0d67-49ae-bb3c-99edb3ce84f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171e69670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:53.543600 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-963b8b80-0d67-49ae-bb3c-99edb3ce84f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.108890 Oct 29 20:53:53.544734 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 869/1832] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:53 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:53.556704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:53.557626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:53.572581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:53.578844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:53.579671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:53.580653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:53.581315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:53.581949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:53.881118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:53.900087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:53.901916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:53.916759 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9077993-3d73-4ef2-a37c-d7e57b30d8a6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1537 microversion: 2.91 time: 0.370200 Oct 29 20:53:53.933946 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 870/1833] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:53 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1537 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:54.180744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:54.195716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:54.199255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:54.210730 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ce66dae-199d-4eb2-88c3-3b960a1369de tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.855284 Oct 29 20:53:54.212286 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 964/1834] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:53 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:54.378593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:54.379219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:54.388423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:54.388920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:54.389384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:54.390131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:54.401472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:54.406102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:54.457840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:54.458623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:54.481790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:54.482323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:54.482756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:54.483467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:54.483932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:54.505266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.135729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:55.147587 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ddfb3c0d-0bae-4286-8a51-32a2f4a2cace tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1521 microversion: 2.1 time: 0.695476 Oct 29 20:53:55.169685 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 965/1835] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:54 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:55.176454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e08bfec6-0153-42e7-ac19-b9b366769bbb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1711f7dc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:55.276550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e08bfec6-0153-42e7-ac19-b9b366769bbb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.104731 Oct 29 20:53:55.295243 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 966/1836] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:55 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:55.302787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:55.303419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:55.319373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.319887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.320338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.321311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.321801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.322238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.484351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:55.506959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:55.516287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:55.526009 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca64999f-5218-4497-a5ea-8f7c7817ac6e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1480 microversion: 2.91 time: 0.228188 Oct 29 20:53:55.544119 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 967/1837] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:55 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1480 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:55.556599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:55.564064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:55.568840 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d1caef2-2762-4a86-8cbf-a47c918793d8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1670 microversion: 2.1 time: 1.193640 Oct 29 20:53:55.573400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:55.574474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Searching by: {'deleted': False, 'project_id': '05d859f9584140aca702ebc0cd656cab'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:53:55.581111 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 871/1838] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:54 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1670 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:55.583111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.586353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.587630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.588802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.589568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.590344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.605844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:55.606765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:55.622997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.623813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.624439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.625349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.626079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.626680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.694706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:53:55.772820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:53:55.911913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f7932ca-4ae3-4030-ad65-51287bcd3aa8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 204 len: 0 microversion: 2.1 time: 0.319011 Oct 29 20:53:55.912836 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 872/1839] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:53:55 2022] DELETE /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:55.935643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:55.936813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:55.945901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:55.949058 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7da607d7-16f5-40c0-bc0b-71025e7d80b0 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.403142 Oct 29 20:53:55.949662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.951541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.952669 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 968/1840] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:53:55 2022] GET /compute/v2.1/servers => generated 340 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:55.953037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.954252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.955630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.956347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.971047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:55.975637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:55.982131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.982702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.987951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:55.992962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:55.993811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:55.994351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:56.082540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=138885) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 20:53:56.237396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6516b66a-e136-4d5a-b3ca-c888eee40b65 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action" status: 202 len: 0 microversion: 2.91 time: 0.270298 Oct 29 20:53:56.238049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 969/1841] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:53:55 2022] POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:53:56.243562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:56.244491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:56.257171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:56.257914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:56.259463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:56.260447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:56.261086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:56.261712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:56.647545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:56.666482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:56.673218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:56.679236 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-18e3abd3-1768-4d3c-abfe-c5fa46ab422a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 0.749247 Oct 29 20:53:56.684859 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 873/1842] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:55 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:56.702049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:56.736275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:56.749447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Searching by: {'deleted': False, 'project_id': '05d859f9584140aca702ebc0cd656cab'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:53:56.754519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:56.755008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:56.755519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:56.762596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:56.763193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:56.763796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:56.931959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:56.999552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:53:57.131336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:57.153271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fceea9b4-443f-4725-805f-cee452770dae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1527 microversion: 2.1 time: 0.912857 Oct 29 20:53:57.154911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 970/1843] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:56 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1527 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:57.175088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:57.175865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:57.242842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:57.243368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:57.243809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:57.244523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:57.256973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:57.257602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:57.330469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:57.347605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:57.350103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:57.351486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:57.583649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:57.593364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:57.601162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:57.618418 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37d4efad-6526-45d1-b43f-082dfb955695 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1488 microversion: 2.91 time: 0.458736 Oct 29 20:53:57.621580 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 971/1844] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:57 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:57.631834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-af68792b-0403-4629-bd3f-86377436b964 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1711e8f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:57.734224 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-af68792b-0403-4629-bd3f-86377436b964 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.109744 Oct 29 20:53:57.748397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 972/1845] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:57 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:57.768870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:57.773305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:57.793423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:57.796722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:57.801649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:57.803257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:57.806142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:57.829435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:57.919992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:53:58.202219 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-44ff060c-f600-4b1b-b2c1-746cc855011e tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.514783 Oct 29 20:53:58.203803 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 874/1846] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:53:56 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:58.210958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:58.222247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:58.239331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:58.264287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:58.271176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:58.273401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:58.274618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:58.275449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:58.276228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:58.283664 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-03516c8d-d71b-4511-bfc1-9c7217f5b007 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1602 microversion: 2.1 time: 0.533064 Oct 29 20:53:58.290969 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 973/1847] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:57 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1602 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:58.319361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:58.324082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:58.347467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:58.348699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:58.352806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:58.354599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:58.355539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:58.356632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.232529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.250508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.255471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.268652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae0535a8-f86e-439d-9cdf-9844ad6f543a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1567 microversion: 2.25 time: 1.052265 Oct 29 20:53:59.274722 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 875/1848] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:58 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1567 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:53:59.301531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5d2bb0d-ddf5-4c5c-babd-eff89e090139 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:59.328410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5d2bb0d-ddf5-4c5c-babd-eff89e090139 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051834 Oct 29 20:53:59.343159 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 876/1849] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:53:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:59.348334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c61d2c01-117d-4299-addb-cc1f5d2f95e9 req-acf5797d-3753-4b50-bb63-5182835f0656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5fa038d-5a82-452d-bde6-eaa0b790d7cc", "name": "network-vif-deleted", "tag": "437d3157-cf84-48ff-88d0-d082479a661b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:53:59.412770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c61d2c01-117d-4299-addb-cc1f5d2f95e9 req-acf5797d-3753-4b50-bb63-5182835f0656 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:59.426022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c61d2c01-117d-4299-addb-cc1f5d2f95e9 req-acf5797d-3753-4b50-bb63-5182835f0656 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:59.428604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c61d2c01-117d-4299-addb-cc1f5d2f95e9 req-acf5797d-3753-4b50-bb63-5182835f0656 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.491491 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c61d2c01-117d-4299-addb-cc1f5d2f95e9 req-acf5797d-3753-4b50-bb63-5182835f0656 service nova] Creating event network-vif-deleted:437d3157-cf84-48ff-88d0-d082479a661b for instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc on nch1-master-1 Oct 29 20:53:59.505967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c61d2c01-117d-4299-addb-cc1f5d2f95e9 req-acf5797d-3753-4b50-bb63-5182835f0656 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158121 Oct 29 20:53:59.509838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68212c49a188473ca9f523c46fd9cba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ccb1f9fdd949b3badcbd1ceb571548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.512639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 877/1850] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:53:59.529157 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9813fbb-0071-42ac-a138-d1507cdbb676 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 200 len: 1527 microversion: 2.1 time: 1.225315 Oct 29 20:53:59.530955 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 974/1851] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:58 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 1527 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:59.540945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:59.542628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:59.561477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f7b3f7e-ceab-4696-9a66-a57859854f52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1711348b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:59.585131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:59.586385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:59.587968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.590413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:59.591109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:59.596146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.726105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f7b3f7e-ceab-4696-9a66-a57859854f52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1412 microversion: 2.1 time: 0.176173 Oct 29 20:53:59.726688 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 975/1852] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:53:59 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1412 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:53:59.746664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:53:59.762240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:53:59.799205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:59.800966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:59.801934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.807537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:59.809224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:59.815740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.935600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:53:59.936313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:53:59.937119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:53:59.938920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lazy-loading 'fault' on Instance uuid f5fa038d-5a82-452d-bde6-eaa0b790d7cc {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:53:59.950017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.963426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.976737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:53:59.993843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6da09a5-b014-4d5f-8ad6-4b911c5306d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.475208 Oct 29 20:54:00.000003 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 878/1853] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:53:59 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:00.017794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e9ca9642-f18b-462b-9b0b-3869cbaf0d0c req-48d339e6-40d3-4426-bb44-a8341bff24a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b309c7e-d98c-4c5d-964c-3ba410ac7ca6", "name": "network-vif-deleted", "tag": "12498de0-fd54-4741-9fda-23fe2002f63a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:00.034184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e9ca9642-f18b-462b-9b0b-3869cbaf0d0c req-48d339e6-40d3-4426-bb44-a8341bff24a8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.038327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e9ca9642-f18b-462b-9b0b-3869cbaf0d0c req-48d339e6-40d3-4426-bb44-a8341bff24a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.039134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e9ca9642-f18b-462b-9b0b-3869cbaf0d0c req-48d339e6-40d3-4426-bb44-a8341bff24a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:00.070100 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e9ca9642-f18b-462b-9b0b-3869cbaf0d0c req-48d339e6-40d3-4426-bb44-a8341bff24a8 service nova] Creating event network-vif-deleted:12498de0-fd54-4741-9fda-23fe2002f63a for instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 on nch2-master-1 Oct 29 20:54:00.081155 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e9ca9642-f18b-462b-9b0b-3869cbaf0d0c req-48d339e6-40d3-4426-bb44-a8341bff24a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078668 Oct 29 20:54:00.086783 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 879/1854] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:00.100449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:00.111604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:00.113804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-717603b1-e924-4104-999a-ab1bcae3a910 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 200 len: 1325 microversion: 2.1 time: 0.380934 Oct 29 20:54:00.114926 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 976/1855] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:53:59 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:00.116631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:00.133690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.136320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.136802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:00.137590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.138250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.139733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:00.209956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:54:00.300772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:00.303240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:00.317102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.319223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.319957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:00.321012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.327891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.328705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:00.394610 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7423d2bc-b72b-49a2-8de7-24da848198da tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 204 len: 0 microversion: 2.1 time: 0.306246 Oct 29 20:54:00.399864 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 880/1856] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:54:00 2022] DELETE /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:54:00.423689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:00.424445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:00.442181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.443706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.444181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:00.444917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:00.449557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:00.452686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.320636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76bb8b2a3e654f4ea4b4543df0b9cf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05d859f9584140aca702ebc0cd656cab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.340181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-204874c1-c851-4f81-a5eb-10a248b61489 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 200 len: 1715 microversion: 2.1 time: 0.935757 Oct 29 20:54:01.351548 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 881/1857] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:00 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 1715 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:01.352403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.358630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:01.359259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:01.364529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.373721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.375233 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cbbb8700-fadd-4d85-9a73-5d01ebae18e2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1542 microversion: 2.25 time: 1.078357 Oct 29 20:54:01.376391 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 977/1858] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:00 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1542 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:01.378904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:01.386119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59fa79ac-7507-4207-9f93-a93b27e20bc3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171134430>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:01.395811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:01.398843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.401582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:01.403070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:01.405144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.433948 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 could not be found. Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 HTTP/1.1 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 could not be found. Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7b309c7e-d98c-4c5d-964c-3ba410ac7ca6'} Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 could not be found. Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 could not be found. Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.436484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 could not be found. Oct 29 20:54:01.442293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.444549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance 7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:01.445820 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ba7ef159-4cbb-4578-8f75-b926f32a30ec tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6" status: 404 len: 111 microversion: 2.1 time: 0.093009 Oct 29 20:54:01.451185 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 882/1859] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:01 2022] GET /compute/v2.1/servers/7b309c7e-d98c-4c5d-964c-3ba410ac7ca6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:01.457555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:01.459490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:01.467543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:01.468293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:01.468976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.470090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:01.470926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:01.471530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.809324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.828967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.831969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:01.844880 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-50059a5e-5071-41e3-985a-13443d100270 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.392099 Oct 29 20:54:01.873804 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 883/1860] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:01 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:01.888159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:01.890202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: f5fa038d-5a82-452d-bde6-eaa0b790d7cc] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:01.911452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:01.912568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:01.915097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.916905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:01.922511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:01.923309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:01.978974 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] HTTP exception thrown: Instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc could not be found. Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Request method failure captured: Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc HTTP/1.1 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGzgVEgdgiwPHrSFL_unNDKXn9DoNXlkEWLbbhtOXyT3-DcLNx82NIsuQWntKmD0CJPRGG-EWgeKbap_sh-ehpF94RCFF1eA0ahDAOuSosnz4w9WcobAWplFPMm-zuyfsd0tWAcaqb2iJvL0NzWhS4k-hDaCPt4oU48orgS2cp0YrY Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d373d98fd667430fac145e2e63249419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d373d98fd667430fac145e2e63249419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-LiveMigrationTest-2002133718-project Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 869b7117eab8443e9cbb52400b875ebc Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-LiveMigrationTest-2002133718-project Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc could not be found. Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f5fa038d-5a82-452d-bde6-eaa0b790d7cc'} Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc could not be found. Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc could not be found. Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:01.991976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc could not be found. Oct 29 20:54:02.000889 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:02.013076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Returning 404 to user: Instance f5fa038d-5a82-452d-bde6-eaa0b790d7cc could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:02.016275 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cde4eca7-4f29-4aa4-adee-67f1af535298 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc" status: 404 len: 111 microversion: 2.1 time: 0.137863 Oct 29 20:54:02.017159 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 884/1861] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:01 2022] GET /compute/v2.1/servers/f5fa038d-5a82-452d-bde6-eaa0b790d7cc => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:02.026375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-110a351b-c45c-47d7-90d4-aa587e2d18ad tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '.version_select at 0x7fa17633bca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:02.031837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-110a351b-c45c-47d7-90d4-aa587e2d18ad tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:02.033342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-110a351b-c45c-47d7-90d4-aa587e2d18ad tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:02.034575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-110a351b-c45c-47d7-90d4-aa587e2d18ad tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:02.065376 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-110a351b-c45c-47d7-90d4-aa587e2d18ad tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1697 microversion: 2.25 time: 0.045505 Oct 29 20:54:02.068728 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 885/1862] 10.222.0.36 () {60 vars in 1184 bytes} [Sat Oct 29 20:54:02 2022] GET /compute/v2.1/os-migrations => generated 1697 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:02.092165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0f0afe3-49f7-40ae-b373-d4163572f85e tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '.version_select at 0x7fa1762e88b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:05.660630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:06.884435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:07.324604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:09.592375 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d0f0afe3-49f7-40ae-b373-d4163572f85e tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Image not found. Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0f0afe3-49f7-40ae-b373-d4163572f85e tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87 HTTP/1.1 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '66f8e43d-c560-4a29-b53b-64e0e4e73a87'} Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 66f8e43d-c560-4a29-b53b-64e0e4e73a87 to delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66f8e43d-c560-4a29-b53b-64e0e4e73a87 could not be found. Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:09.594991 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0f0afe3-49f7-40ae-b373-d4163572f85e tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:09.601551 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d0f0afe3-49f7-40ae-b373-d4163572f85e tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87" status: 404 len: 62 microversion: 2.1 time: 7.524750 Oct 29 20:54:09.605424 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 886/1863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:02 2022] DELETE /compute/v2.1/images/66f8e43d-c560-4a29-b53b-64e0e4e73a87 => generated 62 bytes in 7534 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:54:09.609698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-984be814-cdcd-4607-bd9a-60e1642153a3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '.version_select at 0x7fa1762e44c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:09.679351 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-984be814-cdcd-4607-bd9a-60e1642153a3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412802578" status: 202 len: 0 microversion: 2.1 time: 0.073598 Oct 29 20:54:09.680397 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 887/1864] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 20:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412802578 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:54:09.695571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:09.701422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:09.721903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:09.728425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:09.729168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:09.730228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:09.730906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:09.731551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:09.942080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59fa79ac-7507-4207-9f93-a93b27e20bc3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1421 microversion: 2.1 time: 8.564265 Oct 29 20:54:09.947003 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 978/1865] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:54:01 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1421 bytes in 8570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:09.962574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:09.964514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] [instance: a2b7ce09-5c63-4a63-80c2-e8251952d218] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:10.035939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:10.051443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.055002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.057322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.061048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.063337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.063978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.144352 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] HTTP exception thrown: Instance a2b7ce09-5c63-4a63-80c2-e8251952d218 could not be found. Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Request method failure captured: Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 HTTP/1.1 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJqK5FdvBiprVybt_AKOU1XrLGm923VkeJINmQL47zhX165HhzPNahi6HvdSiiLdAIIs3lv_659tNkSJ86O3di_BCsi5GgIglteglB0LAANLDu4DMDLWmWu2QsxZHlKGHL-nXC2jbOsWscM4x2785geBQGRTuSiNjYeaJuKGOUlCiw Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 05d859f9584140aca702ebc0cd656cab Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestManualDisk-800327494 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05d859f9584140aca702ebc0cd656cab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_05d859f9584140aca702ebc0cd656cab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/05d859f9584140aca702ebc0cd656cab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/05d859f9584140aca702ebc0cd656cab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestManualDisk-800327494 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 05d859f9584140aca702ebc0cd656cab Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestManualDisk-800327494 Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestManualDisk-800327494-project Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 76bb8b2a3e654f4ea4b4543df0b9cf6a Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestManualDisk-800327494-project Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a2b7ce09-5c63-4a63-80c2-e8251952d218 could not be found. Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a2b7ce09-5c63-4a63-80c2-e8251952d218'} Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b7ce09-5c63-4a63-80c2-e8251952d218 could not be found. Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b7ce09-5c63-4a63-80c2-e8251952d218 could not be found. Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:10.148521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b7ce09-5c63-4a63-80c2-e8251952d218 could not be found. Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.157054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Returning 404 to user: Instance a2b7ce09-5c63-4a63-80c2-e8251952d218 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:10.158959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97fd6d7e-8495-4741-86a5-689a6777a4b8 tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218" status: 404 len: 111 microversion: 2.1 time: 0.208378 Oct 29 20:54:10.162323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 979/1866] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:09 2022] GET /compute/v2.1/servers/a2b7ce09-5c63-4a63-80c2-e8251952d218 => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:10.192392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:10.195138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:10.199536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:54:10.211323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.214413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.215147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.216220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.237487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.238974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.263690 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c161473-113c-4821-b160-61a60355b918 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 2034 microversion: 2.25 time: 0.580438 Oct 29 20:54:10.264615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 888/1867] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:09 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 2034 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:10.276547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-291699ad-313c-473d-aeae-1d82366cd910 req-38e717e2-3983-443a-943b-bdc4c9025bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b7ce09-5c63-4a63-80c2-e8251952d218", "name": "network-vif-deleted", "tag": "beda8d49-3f5d-434f-b721-bcad16331053"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:10.336031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-291699ad-313c-473d-aeae-1d82366cd910 req-38e717e2-3983-443a-943b-bdc4c9025bfc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.337255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-291699ad-313c-473d-aeae-1d82366cd910 req-38e717e2-3983-443a-943b-bdc4c9025bfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.338350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-291699ad-313c-473d-aeae-1d82366cd910 req-38e717e2-3983-443a-943b-bdc4c9025bfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.367859 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-291699ad-313c-473d-aeae-1d82366cd910 req-38e717e2-3983-443a-943b-bdc4c9025bfc service nova] Creating event network-vif-deleted:beda8d49-3f5d-434f-b721-bcad16331053 for instance a2b7ce09-5c63-4a63-80c2-e8251952d218 on nch1-master-1 Oct 29 20:54:10.375924 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-291699ad-313c-473d-aeae-1d82366cd910 req-38e717e2-3983-443a-943b-bdc4c9025bfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109754 Oct 29 20:54:10.376821 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 889/1868] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:10.383093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:10.384001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:10.405133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.406686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.410090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.411600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.413763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.414412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.424681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:10.436710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:10.443078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:10.449513 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5559a6d-e63b-4874-a167-b6e10e8b9039 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.283638 Oct 29 20:54:10.452121 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 980/1869] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:10 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:10.461512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ba02e0b-bf1a-4276-8649-bdd11a658378 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171250dc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:10.482384 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 HTTP/1.1 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'feaedd45-ece1-4af1-b6fd-423ff496f7c6'} Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:10.486365 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.491182 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.495189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:10.496355 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-987bf17d-6287-4e62-9363-5d7a0002a9ae tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 404 len: 111 microversion: 2.1 time: 0.118166 Oct 29 20:54:10.501442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 890/1870] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:54:10 2022] DELETE /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:10.519144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b0ae2a0-0d7e-4ddb-aba4-92c8cf0cf8bb tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] Calling method '.version_select at 0x7fa1762e41f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:10.668332 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b0ae2a0-0d7e-4ddb-aba4-92c8cf0cf8bb tempest-ServersTestManualDisk-800327494 tempest-ServersTestManualDisk-800327494-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143922817" status: 202 len: 0 microversion: 2.1 time: 0.160383 Oct 29 20:54:10.673645 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 891/1871] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 20:54:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143922817 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:54:10.704505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b6c8519-1bd6-4785-9fd1-33ae53b02460 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Action: 'create', calling method: .version_select at 0x7fa1762dd8b0>, body: {"keypair": {"name": "tempest-keypair-1659885416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMq4Ymnp9iXPzbR0DxekdskVP4bbu9xu8HSJOvklA7B3GE3MF6GnPmh9yvx174Wf4axyr6Vg2osMmH5c2yyURQYbJ/93w091VCmlVYrTaVoC1ayk52KzIC2gZOgFQs1h0w=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:10.823730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-5b6c8519-1bd6-4785-9fd1-33ae53b02460 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for project a637980654ed411a96672f36bab6214a. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:54:10.830407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-5b6c8519-1bd6-4785-9fd1-33ae53b02460 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for user d3e4d267d3b344928a2ca0a6e79eadb4 and project a637980654ed411a96672f36bab6214a. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:54:10.893201 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b6c8519-1bd6-4785-9fd1-33ae53b02460 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.217546 Oct 29 20:54:10.895418 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 892/1872] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 20:54:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 221 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 20:54:10.916715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:10.921676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: feaedd45-ece1-4af1-b6fd-423ff496f7c6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:10.939818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.941956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.942704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.946053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:10.947607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:10.950066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:10.984914 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 HTTP/1.1 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'feaedd45-ece1-4af1-b6fd-423ff496f7c6'} Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.988373 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:10.996602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance feaedd45-ece1-4af1-b6fd-423ff496f7c6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:10.998520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ebdfe73-3f80-4800-8163-ed537a4ecdc8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6" status: 404 len: 111 microversion: 2.1 time: 0.101812 Oct 29 20:54:11.006502 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 893/1873] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:10 2022] GET /compute/v2.1/servers/feaedd45-ece1-4af1-b6fd-423ff496f7c6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:11.016161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-827811d9-8245-472c-8bb1-9102d1c58104 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '.version_select at 0x7fa171a394c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:11.063836 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-827811d9-8245-472c-8bb1-9102d1c58104 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333864863" status: 202 len: 0 microversion: 2.1 time: 0.055909 Oct 29 20:54:11.064908 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 894/1874] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 20:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333864863 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:54:11.498497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:11.499559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:11.511854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:11.514102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:11.516367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:11.520085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:11.521084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:11.521832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:11.889350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:11.928289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:11.936501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:12.004169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6d6a743-5ce3-4895-8173-174146b2dfb9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.511163 Oct 29 20:54:12.019615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 895/1875] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:11 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:12.046270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:12.046922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:12.106734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:12.110459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:12.114389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:12.119178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:12.125915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:12.129064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:12.338016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:54:12.689133 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be87e4d0-c406-452f-83c7-7c616304b993 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 204 len: 0 microversion: 2.1 time: 0.660163 Oct 29 20:54:12.696162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 896/1876] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:54:12 2022] DELETE /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:54:12.712948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:12.714783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:12.729490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:12.730158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:12.730922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:12.731953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:12.733592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:12.734498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:13.451844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:13.485112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:13.499369 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9adee4c-ae80-4871-b165-4e09eb9da1a6 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1485 microversion: 2.1 time: 0.798151 Oct 29 20:54:13.515389 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 897/1877] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:12 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1485 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:13.548830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:13.555040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:13.614127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:13.621702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:13.626981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:13.628045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:13.628686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:13.633277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:14.155591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:14.169787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:14.181587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:14.193877 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a8f2f1b2-f70e-4687-8d0a-a357fda48f5f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.673797 Oct 29 20:54:14.225231 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 898/1878] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:13 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:15.244170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:15.245654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:15.256229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:15.257439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:15.258357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:15.259273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:15.261095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:15.261734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:15.436413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:15.494969 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f64e64dc-5d28-4ebc-907f-072ea862a10c tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 200 len: 1443 microversion: 2.1 time: 0.954736 Oct 29 20:54:15.495602 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 899/1879] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:14 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 1443 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:15.536413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:15.540259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:15.592307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:15.600192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:15.611631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:15.612818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:15.626687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:15.628856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:15.822360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:15.835154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:15.837482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:15.845176 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc972873-438a-4ab7-b7c0-128d57739832 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.324757 Oct 29 20:54:15.846493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 900/1880] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:15 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:15.863440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-637a38a4-f673-4078-b484-64986c58c375 req-3d6c59b3-6daa-461b-aa6f-6dd4e1a92041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934a8859-1a93-494f-8403-638eb4b0ab5c", "name": "network-vif-deleted", "tag": "febb0e89-3b18-47fb-847c-0b59f0802d9b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:15.879084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-637a38a4-f673-4078-b484-64986c58c375 req-3d6c59b3-6daa-461b-aa6f-6dd4e1a92041 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:15.880211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-637a38a4-f673-4078-b484-64986c58c375 req-3d6c59b3-6daa-461b-aa6f-6dd4e1a92041 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:15.882539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-637a38a4-f673-4078-b484-64986c58c375 req-3d6c59b3-6daa-461b-aa6f-6dd4e1a92041 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:15.897981 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-637a38a4-f673-4078-b484-64986c58c375 req-3d6c59b3-6daa-461b-aa6f-6dd4e1a92041 service nova] Creating event network-vif-deleted:febb0e89-3b18-47fb-847c-0b59f0802d9b for instance 934a8859-1a93-494f-8403-638eb4b0ab5c on nch1-master-1 Oct 29 20:54:15.902466 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ba02e0b-bf1a-4276-8649-bdd11a658378 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 200 len: 1421 microversion: 2.1 time: 5.448877 Oct 29 20:54:15.903935 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 981/1881] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:54:10 2022] GET /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 1421 bytes in 5451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:15.907389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-637a38a4-f673-4078-b484-64986c58c375 req-3d6c59b3-6daa-461b-aa6f-6dd4e1a92041 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059155 Oct 29 20:54:15.912982 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 901/1882] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:15.926899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e630d335-ac0a-43c3-b2eb-c53104d52e92 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17628e040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:15.932370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d68246ad-c9db-4716-94b2-1377bd22bee8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '.version_select at 0x7fa17124a820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.107452 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e630d335-ac0a-43c3-b2eb-c53104d52e92 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 204 len: 0 microversion: 2.1 time: 1.190900 Oct 29 20:54:17.113008 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 902/1883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:15 2022] DELETE /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:54:17.123863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.125242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 934a8859-1a93-494f-8403-638eb4b0ab5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:17.145412 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d68246ad-c9db-4716-94b2-1377bd22bee8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Image not found. Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d68246ad-c9db-4716-94b2-1377bd22bee8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/e13df63b-8991-45a1-a35f-10175e565ddc HTTP/1.1 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'e13df63b-8991-45a1-a35f-10175e565ddc'} Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e13df63b-8991-45a1-a35f-10175e565ddc to delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e13df63b-8991-45a1-a35f-10175e565ddc could not be found. Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.147769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d68246ad-c9db-4716-94b2-1377bd22bee8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:17.152703 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d68246ad-c9db-4716-94b2-1377bd22bee8 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/images/e13df63b-8991-45a1-a35f-10175e565ddc" status: 404 len: 62 microversion: 2.1 time: 1.243710 Oct 29 20:54:17.158382 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 982/1884] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:15 2022] DELETE /compute/v2.1/images/e13df63b-8991-45a1-a35f-10175e565ddc => generated 62 bytes in 1253 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:54:17.170219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.172505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:17.203663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.250035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.087s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.251671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.253108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.254806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.260651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.261885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.263490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.267937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.268605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.270718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.273666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.334156 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] HTTP exception thrown: Instance 934a8859-1a93-494f-8403-638eb4b0ab5c could not be found. Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Request method failure captured: Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c HTTP/1.1 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZGzgVEgdgiwPHrSFL_unNDKXn9DoNXlkEWLbbhtOXyT3-DcLNx82NIsuQWntKmD0CJPRGG-EWgeKbap_sh-ehpF94RCFF1eA0ahDAOuSosnz4w9WcobAWplFPMm-zuyfsd0tWAcaqb2iJvL0NzWhS4k-hDaCPt4oU48orgS2cp0YrY Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d373d98fd667430fac145e2e63249419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d373d98fd667430fac145e2e63249419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-LiveMigrationTest-2002133718-project Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 869b7117eab8443e9cbb52400b875ebc Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-LiveMigrationTest-2002133718-project Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 934a8859-1a93-494f-8403-638eb4b0ab5c could not be found. Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '934a8859-1a93-494f-8403-638eb4b0ab5c'} Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934a8859-1a93-494f-8403-638eb4b0ab5c could not be found. Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934a8859-1a93-494f-8403-638eb4b0ab5c could not be found. Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.338415 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934a8859-1a93-494f-8403-638eb4b0ab5c could not be found. Oct 29 20:54:17.344631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.350729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Returning 404 to user: Instance 934a8859-1a93-494f-8403-638eb4b0ab5c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:17.355106 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8f470f5-91cc-4179-b08b-f1f5e9d79eaa tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c" status: 404 len: 111 microversion: 2.1 time: 0.240199 Oct 29 20:54:17.362087 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 903/1885] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:17 2022] GET /compute/v2.1/servers/934a8859-1a93-494f-8403-638eb4b0ab5c => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:17.372424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.373900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:17.390528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.391647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.395860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.397377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.398165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.398924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.463182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:54:17.499304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:17.522396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:17.523987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:17.546184 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0977e33-5cf4-4caa-939a-4d94f46f6ec5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.386393 Oct 29 20:54:17.557751 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 983/1886] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:17 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:17.566433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.570297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:17.591124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.600253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.601208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.603875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.606597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.607350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.641097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 HTTP/1.1 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117'} Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:17.669129 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.677305 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.680422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:17.682353 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e45b8357-6606-46cc-bc21-5f98c3618273 tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "DELETE /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 404 len: 111 microversion: 2.1 time: 0.118981 Oct 29 20:54:17.683228 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 984/1887] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:54:17 2022] DELETE /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:17.691806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.692730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:17.702793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:17.707151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.708221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.710520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.712405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.713780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.715523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.745052 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d7f4fcbb-7a06-49f0-a4cf-2b4b1ad079e2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 204 len: 0 microversion: 2.1 time: 0.379934 Oct 29 20:54:17.746965 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 904/1888] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:54:17 2022] DELETE /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:54:17.760173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:17.761371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] [instance: 31b8f36e-7013-4af8-a273-85bbe0cdb117] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:17.779867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.782874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.783702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.787868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:17.788679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:17.789439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:17.806389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:54:17.829916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] HTTP exception thrown: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Request method failure captured: Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 HTTP/1.1 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZKCx7FUwJvxbIXn2k1ZELBSaQuXNoRFyIeKPp25F9T3Ipx2P4zmLcltQC7TJq80IuoOGHWUV4AsEX21no9RDp2WYKr0HFzSZT3_dz-YPFL6csB6TFx5_dss0H7voD-vEwCNRlY9MyKlsaCBz2qf-4-Mti_W8Nm6EQkVCAliWQ6OPIo Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b6ccb1f9fdd949b3badcbd1ceb571548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b6ccb1f9fdd949b3badcbd1ceb571548 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 68212c49a188473ca9f523c46fd9cba2 Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1094391737-project Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '31b8f36e-7013-4af8-a273-85bbe0cdb117'} Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.836523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. Oct 29 20:54:17.843895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:54:17.846525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] Returning 404 to user: Instance 31b8f36e-7013-4af8-a273-85bbe0cdb117 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:17.847567 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-413e581d-d468-464a-a1a7-5861ec8946aa tempest-ImagesOneServerNegativeTestJSON-1094391737 tempest-ImagesOneServerNegativeTestJSON-1094391737-project] 10.222.0.36 "GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117" status: 404 len: 111 microversion: 2.1 time: 0.097617 Oct 29 20:54:17.852397 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 905/1889] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:17 2022] GET /compute/v2.1/servers/31b8f36e-7013-4af8-a273-85bbe0cdb117 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:17.980021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30272b6b-cdb2-4a40-923c-6d078ab662b3 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "DELETE /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 204 len: 0 microversion: 2.1 time: 0.291769 Oct 29 20:54:17.987465 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 985/1890] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:54:17 2022] DELETE /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:54:18.007123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:18.010239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:18.025387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:18.038590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:18.039362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:18.042299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:18.042990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:18.043623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:18.150802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-554659799", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1cc8922f-83e5-42c2-bce3-6544d389a499"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:18.330288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] validate_networks() for [('1cc8922f-83e5-42c2-bce3-6544d389a499', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:54:19.307549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:19.338829 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78453d41-584b-425d-a7c2-3e618493baa4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1499 microversion: 2.1 time: 1.349644 Oct 29 20:54:19.341361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 906/1891] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:17 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1499 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:19.366700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:19.371194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:19.409567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:19.423411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:19.426868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:19.431632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:19.433306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:19.438607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:19.712812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:19.728866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:19.735361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:19.749318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0d1ccdbb-3f61-4fce-b40f-c48779a6cd4c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.402362 Oct 29 20:54:19.752332 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 907/1892] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:19 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:20.329320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-468953433", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26"}], "security_groups": [{"name": "tempest-securitygroup--11272676"}], "key_name": "tempest-keypair-1659885416", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:20.790460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:54:20.791561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:54:20.792381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:54:20.793058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:54:20.794197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:54:20.821201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:20.828296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:20.829133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:20.830241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:20.830946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:20.832889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:20.857092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:20.912829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:54:20.937508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for user d1c5ef005ddf4a96828abd5376fffa37 and project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:54:21.013694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:54:21.046247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:54:21.260111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da83d6cc-d3d7-4e0e-905c-71968ca0a8c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.115195 Oct 29 20:54:21.266547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 986/1893] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:54:21.291629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] validate_networks() for [('dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:54:21.293004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:21.295880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:21.338924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:21.353196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:21.353196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:21.353196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:21.353196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:21.353196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:21.767979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '869b7117eab8443e9cbb52400b875ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd373d98fd667430fac145e2e63249419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:21.807999 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da94e166-6c61-4eaf-889c-3e9eb32463a8 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 200 len: 1457 microversion: 2.1 time: 0.536881 Oct 29 20:54:21.814640 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 987/1894] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:21 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 1457 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:21.840901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-db99d96d-8900-4b98-a3e2-c4b498dc53da req-ceb88781-0215-428a-b8c6-12effd5c1d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ff39d8-d9c4-48f9-92e9-9c2dac9633d0", "name": "network-vif-unplugged", "status": "completed", "tag": "036bac86-fd93-4b18-8d46-08ab4f0665ed"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:21.890499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-db99d96d-8900-4b98-a3e2-c4b498dc53da req-ceb88781-0215-428a-b8c6-12effd5c1d17 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:21.893826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-db99d96d-8900-4b98-a3e2-c4b498dc53da req-ceb88781-0215-428a-b8c6-12effd5c1d17 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:21.896406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-db99d96d-8900-4b98-a3e2-c4b498dc53da req-ceb88781-0215-428a-b8c6-12effd5c1d17 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:21.964184 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-db99d96d-8900-4b98-a3e2-c4b498dc53da req-ceb88781-0215-428a-b8c6-12effd5c1d17 service nova] Creating event network-vif-unplugged:036bac86-fd93-4b18-8d46-08ab4f0665ed for instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 on nch1-master-1 Oct 29 20:54:21.994281 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-db99d96d-8900-4b98-a3e2-c4b498dc53da req-ceb88781-0215-428a-b8c6-12effd5c1d17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170614 Oct 29 20:54:22.000387 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 988/1895] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:22.020438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:22.024322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:22.046587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:22.050311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:22.052687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:22.054382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:22.055896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:22.056758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:22.713668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:22.726259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:22.733546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:22.747110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39519723-5f69-414a-b2e2-0936bf560377 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.740985 Oct 29 20:54:22.748252 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 989/1896] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:22 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:22.756725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:22.759351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:22.784011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:22.784622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:22.788604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:22.789681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:22.790663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:22.791306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:23.417414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:23.429906 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-463aa87c-43e0-4533-91dd-a794567addb0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1211 microversion: 2.1 time: 0.680300 Oct 29 20:54:23.452273 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 990/1897] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:22 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1211 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:23.468816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-72e7b3ea-6551-45c6-b86e-9accd58527c6 req-018b9dea-af57-4cc1-ae3c-439cf5ed2abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a5f0f2-b498-4e74-9889-c6ea2fb68d22", "name": "network-vif-deleted", "tag": "1cd47c01-9bb9-4c88-97a5-4c4844fdf5af"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:23.520680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-72e7b3ea-6551-45c6-b86e-9accd58527c6 req-018b9dea-af57-4cc1-ae3c-439cf5ed2abe service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:23.523365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-72e7b3ea-6551-45c6-b86e-9accd58527c6 req-018b9dea-af57-4cc1-ae3c-439cf5ed2abe service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:23.526068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-72e7b3ea-6551-45c6-b86e-9accd58527c6 req-018b9dea-af57-4cc1-ae3c-439cf5ed2abe service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:23.562133 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-72e7b3ea-6551-45c6-b86e-9accd58527c6 req-018b9dea-af57-4cc1-ae3c-439cf5ed2abe service nova] Creating event network-vif-deleted:1cd47c01-9bb9-4c88-97a5-4c4844fdf5af for instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 on nch2-master-1 Oct 29 20:54:23.573593 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-72e7b3ea-6551-45c6-b86e-9accd58527c6 req-018b9dea-af57-4cc1-ae3c-439cf5ed2abe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119519 Oct 29 20:54:23.574540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 991/1898] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:23.590296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:23.591289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] [instance: 36a5f0f2-b498-4e74-9889-c6ea2fb68d22] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:23.643089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:23.643978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:23.644586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:23.650491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:23.651386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:23.653980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:23.750001 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] HTTP exception thrown: Instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 could not be found. Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Request method failure captured: Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 HTTP/1.1 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZGzgVEgdgiwPHrSFL_unNDKXn9DoNXlkEWLbbhtOXyT3-DcLNx82NIsuQWntKmD0CJPRGG-EWgeKbap_sh-ehpF94RCFF1eA0ahDAOuSosnz4w9WcobAWplFPMm-zuyfsd0tWAcaqb2iJvL0NzWhS4k-hDaCPt4oU48orgS2cp0YrY Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d373d98fd667430fac145e2e63249419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d373d98fd667430fac145e2e63249419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d373d98fd667430fac145e2e63249419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d373d98fd667430fac145e2e63249419 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveMigrationTest-2002133718 Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveMigrationTest-2002133718-project Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 869b7117eab8443e9cbb52400b875ebc Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveMigrationTest-2002133718-project Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 could not be found. Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '36a5f0f2-b498-4e74-9889-c6ea2fb68d22'} Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 could not be found. Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 could not be found. Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:54:23.752637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 could not be found. Oct 29 20:54:23.761056 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:54:23.764517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] Returning 404 to user: Instance 36a5f0f2-b498-4e74-9889-c6ea2fb68d22 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:54:23.765042 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8dd64d9-84c4-4f76-84e0-dc1ccea451c4 tempest-LiveMigrationTest-2002133718 tempest-LiveMigrationTest-2002133718-project] 10.222.0.36 "GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22" status: 404 len: 111 microversion: 2.1 time: 0.188440 Oct 29 20:54:23.765889 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 992/1899] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:23 2022] GET /compute/v2.1/servers/36a5f0f2-b498-4e74-9889-c6ea2fb68d22 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:54:23.771074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b6c6ff35-934f-48c7-9eba-93d30648f5b0 req-18ad3a79-eced-4e2e-a470-4ffa566dd948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ff39d8-d9c4-48f9-92e9-9c2dac9633d0", "name": "network-vif-deleted", "tag": "036bac86-fd93-4b18-8d46-08ab4f0665ed"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:23.784489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6c6ff35-934f-48c7-9eba-93d30648f5b0 req-18ad3a79-eced-4e2e-a470-4ffa566dd948 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:23.785985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6c6ff35-934f-48c7-9eba-93d30648f5b0 req-18ad3a79-eced-4e2e-a470-4ffa566dd948 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:23.786665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6c6ff35-934f-48c7-9eba-93d30648f5b0 req-18ad3a79-eced-4e2e-a470-4ffa566dd948 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:23.846199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b6c6ff35-934f-48c7-9eba-93d30648f5b0 req-18ad3a79-eced-4e2e-a470-4ffa566dd948 service nova] Creating event network-vif-deleted:036bac86-fd93-4b18-8d46-08ab4f0665ed for instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 on nch1-master-1 Oct 29 20:54:23.860772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b6c6ff35-934f-48c7-9eba-93d30648f5b0 req-18ad3a79-eced-4e2e-a470-4ffa566dd948 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093381 Oct 29 20:54:23.865810 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 993/1900] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:23.885070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:23.888392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:23.928569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:23.940220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:23.941091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:23.947225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:23.949071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:23.950661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:24.244319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:54:24.244800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:54:24.245233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:54:24.245681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:54:24.246104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:54:24.256924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:24.257432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:24.258092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:24.258852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:24.259318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:24.259756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:24.294065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:54:24.303343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for user d3e4d267d3b344928a2ca0a6e79eadb4 and project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:54:24.320847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.324494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:54:24.328769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:54:24.335284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.337615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.352877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9694c4b8-f8e1-4611-a859-ce942409e0fb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.485393 Oct 29 20:54:24.356384 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 994/1901] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:23 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:24.461368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:24.462094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:24.498239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7352e5f0-ef45-4872-aa40-13fbde3a50ab tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 4.174379 Oct 29 20:54:24.503733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:24.504327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:24.504788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:24.506642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:24.507332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:24.507928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:24.513281 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 908/1902] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:54:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 4189 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:54:24.537439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bfeea4b4-6434-4904-a2e3-57506ff19f32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:24.538099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfeea4b4-6434-4904-a2e3-57506ff19f32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:24.688411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.709681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83f66460-5416-4dc0-96a8-4075aaaea6c3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1259 microversion: 2.1 time: 0.253781 Oct 29 20:54:24.710263 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 995/1903] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:24 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:54:24.854383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfeea4b4-6434-4904-a2e3-57506ff19f32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.873738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfeea4b4-6434-4904-a2e3-57506ff19f32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.876949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfeea4b4-6434-4904-a2e3-57506ff19f32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:24.885652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bfeea4b4-6434-4904-a2e3-57506ff19f32 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1285 microversion: 2.25 time: 0.351875 Oct 29 20:54:24.898197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 909/1904] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:24 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:25.404671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:25.407732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:25.430386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.431049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.431551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.432332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.432865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.433362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.464475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:25.567165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:25.576099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:25.587436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:25.595867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-384d1a49-465a-4675-bd8d-e831fff4277b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1533 microversion: 2.91 time: 0.203130 Oct 29 20:54:25.610384 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 996/1905] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:25 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1533 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:25.644549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:25.651243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:25.671184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.672483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.675249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.678481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.679636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.682527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.746195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:25.746934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:25.755689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.759125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.761660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.764413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.766831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.767405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.878372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lazy-loading 'services' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:54:25.885246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:25.894228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6ffefe4-3c88-4a95-9215-496abbfc426a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1265 microversion: 2.1 time: 0.152061 Oct 29 20:54:25.899233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 997/1906] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:25 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:25.930219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:25.930897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:25.940626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.941274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.941844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.942685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.945011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:25.945744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:25.954235 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cf1408d2-2255-4d4a-b49c-1039c2f0b53e tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1938 microversion: 2.91 time: 0.319649 Oct 29 20:54:25.974675 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 910/1907] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:25 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1938 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:25.983994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:25.984940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:25.998189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:25.998966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:26.001667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:26.003436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:26.004930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:26.006299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:26.077739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lazy-loading 'flavor' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:54:26.158868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:26.171914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:26.181250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:26.182420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8edbeab5-8158-47ad-81b0-5d552fce3659 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1337 microversion: 2.25 time: 0.256371 Oct 29 20:54:26.202522 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 998/1908] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:25 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1337 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:26.462061 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-80719cd6-4a50-4855-8371-7cd97609e31c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action" status: 202 len: 0 microversion: 2.91 time: 0.482397 Oct 29 20:54:26.472039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 911/1909] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:54:25 2022] POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:54:26.478204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:26.480069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:26.503180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:26.507107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:26.511167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:26.516079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:26.517302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:26.520911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:26.722084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:26.731821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:26.733286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:26.761974 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97b2d578-c758-4351-93ee-9bb84ce187d1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.288679 Oct 29 20:54:26.762565 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 999/1910] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:26 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:26.924868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:26.925616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:26.940082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:26.940888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:26.949819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:26.950748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:26.951247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:26.951698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:27.218498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:27.219305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:27.230640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:27.237207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:27.239405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:27.241801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:27.245134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:27.248158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:27.491481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:27.511642 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81732986-80d0-49d3-9938-1eb8ef36c319 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1265 microversion: 2.1 time: 0.589684 Oct 29 20:54:27.513711 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 912/1911] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:26 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1265 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:27.549519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:27.560823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:27.570439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:27.582466 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c878dc1b-45a3-4b70-9398-3f6d29a7202b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1343 microversion: 2.25 time: 0.365539 Oct 29 20:54:27.599992 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1000/1912] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:27 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1343 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:27.796257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:27.796787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:27.809731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:27.811792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:27.814774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:27.816354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:27.817100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:27.818159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:28.074905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:28.088367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:28.091323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:28.106812 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ca8239f-772f-48e7-bbba-86688f70824f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.316546 Oct 29 20:54:28.107998 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 913/1913] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:27 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:28.538750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:28.539687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:28.554182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:28.555768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:28.559252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:28.560731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:28.565098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:28.570678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:28.611232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:28.611854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:28.622774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:28.653701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:28.654176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:28.659548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:28.660048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:28.671053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:29.042839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.059202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.063690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.066133 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3984aca1-6382-47d3-bc4a-c980fdb3a9f6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1343 microversion: 2.25 time: 0.458858 Oct 29 20:54:29.081565 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 914/1914] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:28 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1343 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:29.144290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:29.144919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:29.156884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:29.157438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:29.159576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:29.160375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:29.161897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:29.163565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:29.173098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:29.535625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.570012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.573716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.578742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:29.598217 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd31f11c-0a38-4c56-a193-3b5be2918db2 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.454576 Oct 29 20:54:29.599509 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bed8beef-3861-4519-8414-81179024dbf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 1.064287 Oct 29 20:54:29.600636 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1001/1915] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:28 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:29.624344 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 915/1916] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:29 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:30.098589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:30.099520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:30.122982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:30.131380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:30.132102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:30.136709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:30.137945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:30.138629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:30.628339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:30.629891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:30.654014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:30.655326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:30.656041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:30.657148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:30.659921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:30.663166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:30.871478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:30.976093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:31.390279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:31.404852 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d061c106-6286-4aef-993f-ce456f12d2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.781464 Oct 29 20:54:31.405588 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 916/1917] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:30 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:31.415310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:31.433346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:31.446582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:31.456312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:31.460539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:31.464250 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e98ea4c-fd8f-4e47-bebc-cd5a26c441bf tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 1.370241 Oct 29 20:54:31.482394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1002/1918] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:30 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:31.492988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:31.496542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:31.499725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:31.500805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:31.503785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:31.504787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:32.097610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e74d9207-6bf4-4831-9733-ab95e44d526e req-c95cb3de-1c6c-41cd-af84-cbebecb943d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d15e3a-29e9-413b-a5fb-507ff4f83211", "tag": "ba341985-c208-4b28-8634-0bf3568548a2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:32.121683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e74d9207-6bf4-4831-9733-ab95e44d526e req-c95cb3de-1c6c-41cd-af84-cbebecb943d0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:32.122736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e74d9207-6bf4-4831-9733-ab95e44d526e req-c95cb3de-1c6c-41cd-af84-cbebecb943d0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:32.123383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e74d9207-6bf4-4831-9733-ab95e44d526e req-c95cb3de-1c6c-41cd-af84-cbebecb943d0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:32.143902 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e74d9207-6bf4-4831-9733-ab95e44d526e req-c95cb3de-1c6c-41cd-af84-cbebecb943d0 service nova] Creating event network-changed:ba341985-c208-4b28-8634-0bf3568548a2 for instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 on nch2-master-1 Oct 29 20:54:32.153016 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e74d9207-6bf4-4831-9733-ab95e44d526e req-c95cb3de-1c6c-41cd-af84-cbebecb943d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068432 Oct 29 20:54:32.154841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1003/1919] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:32.247555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:32.267257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:32.272505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:32.287646 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e1fe78df-3b37-4f53-bf22-5487a3ffb14c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.857813 Oct 29 20:54:32.289592 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 917/1920] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:31 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:32.433260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:32.433988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:32.448500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:32.459275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:32.459857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:32.471759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:32.472637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:32.474043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:32.497811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:32.499608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:32.525903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:32.530900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:32.533943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:32.539716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:32.542793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:32.546166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:33.033299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:33.043533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:33.051764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:33.056843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4f354e8-76fe-42b3-8454-db47a139d9bd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 0.564334 Oct 29 20:54:33.058131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 918/1921] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:32 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:33.069917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-055fe9d6-daf4-41dc-8229-930aab5dd973 req-3591831b-672a-467d-bf03-cceb63d52bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623", "tag": "8719a5b1-e60d-48bc-8e71-ff14e6657083"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:33.097705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-055fe9d6-daf4-41dc-8229-930aab5dd973 req-3591831b-672a-467d-bf03-cceb63d52bbf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:33.098298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-055fe9d6-daf4-41dc-8229-930aab5dd973 req-3591831b-672a-467d-bf03-cceb63d52bbf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:33.098848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-055fe9d6-daf4-41dc-8229-930aab5dd973 req-3591831b-672a-467d-bf03-cceb63d52bbf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:33.126226 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-055fe9d6-daf4-41dc-8229-930aab5dd973 req-3591831b-672a-467d-bf03-cceb63d52bbf service nova] Creating event network-changed:8719a5b1-e60d-48bc-8e71-ff14e6657083 for instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 on nch1-master-1 Oct 29 20:54:33.139448 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-055fe9d6-daf4-41dc-8229-930aab5dd973 req-3591831b-672a-467d-bf03-cceb63d52bbf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073530 Oct 29 20:54:33.140176 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 919/1922] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:33.146513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:33.154695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:33.170077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:33.170732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:33.176315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:33.177524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:33.178349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:33.179159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:33.230569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:33.247977 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f871711-381a-4ecd-b14c-56abd7e91d50 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.819288 Oct 29 20:54:33.267667 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1004/1923] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:32 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:33.335363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:33.338503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:33.363226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:33.364087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:33.367423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:33.371882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:33.373267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:33.376076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.000138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:34.023123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:34.025114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:34.026906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-301faa33-6afd-4b02-8a19-b9475cdb4458 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2950 microversion: 2.32 time: 0.885137 Oct 29 20:54:34.038365 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 920/1924] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:33 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2950 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:34.067249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:34.068788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:34.084117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:34.085162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:34.085987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.087260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:34.088023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:34.088697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.276104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:34.432235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:34.480985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:34.486534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:34.508365 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43971c3e-a146-4af3-90d5-366be00025f1 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 1.186034 Oct 29 20:54:34.512147 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1005/1925] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:33 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:34.520234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:34.522048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:34.536660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:34.537997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:34.538653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.540160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:34.542068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:34.542881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.595403 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9869c135-9832-4f38-9637-4ff9f97ace7e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.532469 Oct 29 20:54:34.596499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 921/1926] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 20:54:34 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571/os-interface => generated 1832 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:34.611754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:34.612789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:34.623403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:34.623937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:34.624406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.625130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:34.625629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:34.626056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:34.868292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:34.988512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.015001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.016115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0fd1ffaa-b526-4864-9244-1c30f6f21d7e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.418113 Oct 29 20:54:35.024331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 922/1927] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:34 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:35.046828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.058739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.063702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67539ef4-1a91-4a33-a1dd-1eff976a873a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 0.549958 Oct 29 20:54:35.066277 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1006/1928] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:34 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:35.543790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:35.545349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:35.557992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:35.558502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:35.558950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:35.559679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:35.560142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:35.560571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:35.666617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.691370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.699591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:35.714281 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5905dfb8-0fea-44a1-a940-f24ef9923055 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.174304 Oct 29 20:54:35.716785 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 923/1929] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:35 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:36.050649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:36.052532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:36.071235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:36.081777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:36.085166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:36.090440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:36.100891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:36.103398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:36.111886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:36.116169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:36.139004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:36.144906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:36.146716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:36.150137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:36.156528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:36.159000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:36.678054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:36.688735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:36.714690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:36.717215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bb4779e1-97d9-4e06-8334-6f8fe3d99012 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 0.624899 Oct 29 20:54:36.718432 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 924/1930] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:36 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:36.743927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:36.744784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:36.774584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:36.783444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:36.784240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:36.789315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:36.798341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:36.801961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:36.825709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:36.865027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e689104-e80b-447b-b867-631cb459f629 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.816538 Oct 29 20:54:36.879880 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1007/1931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:36 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:37.036128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:37.051917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:37.053640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:37.079457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a67fa117-0672-4f7f-8546-9bbfc0e1b7f4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.330099 Oct 29 20:54:37.083832 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 925/1932] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:36 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:37.753499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:37.755276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:37.769242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:37.771087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:37.772240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:37.773858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:37.774571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:37.775406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:37.893713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:37.895357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:37.914708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:37.917654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:37.919226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:37.926226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:37.928074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:37.928916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:38.599070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:38.610591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:38.612080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:38.616625 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4d3477f-86c0-43c5-9cd0-f5ced32300b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 0.872644 Oct 29 20:54:38.617222 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1008/1933] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:37 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:38.653802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:38.653802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:38.662061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:38.662566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:38.663001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:38.664058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:38.665107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:38.665833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:38.792122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:38.811372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4259c45-7b21-4fca-b209-a5bb473f9bb9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.922850 Oct 29 20:54:38.826462 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 926/1934] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:37 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:39.058669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:39.085030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:39.100445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:39.119164 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1963984a-35a0-424a-8ba1-2e20b4fb693b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.480359 Oct 29 20:54:39.120616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1009/1935] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:38 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:39.651423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:39.655793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:39.677476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:39.679354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:39.682657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:39.685978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:39.686846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:39.694571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:39.836865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:39.838454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:39.862023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:39.866367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:39.869810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:39.876497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:39.876712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:39.887105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:40.278036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.303489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.309101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.310741 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9cb04b0-80df-4899-a192-e3998d1cbcdd tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 0.664965 Oct 29 20:54:40.315332 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 927/1936] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:39 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:40.326466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:40.334660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:40.365186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:40.365993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:40.366725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:40.367711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:40.371690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:40.372407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:40.429133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.456537 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10e98d65-88af-4c87-8c07-8fb96f789004 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.624379 Oct 29 20:54:40.470136 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1010/1937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:39 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:40.569842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.583011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.585027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:40.600000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-03bc7630-2e0c-419f-8ec8-d36bfc157de4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.281159 Oct 29 20:54:40.614526 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 928/1938] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:40 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:41.346015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:41.347106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:41.358843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:41.367404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:41.367913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:41.368361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:41.369099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:41.369587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:41.370020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:41.496832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:41.496832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:41.503147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:41.503444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:41.503886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:41.510341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:41.510843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:41.511676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:41.621443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.632899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.637947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.641095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9c351279-5624-4e67-bd90-3c65836167a3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 0.299042 Oct 29 20:54:41.642756 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1011/1939] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:41 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:41.671298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:41.678385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:41.689744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:41.690496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:41.691107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:41.697057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:41.697753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:41.699161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:41.836522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.855364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.858979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.876254 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4de1d48d-9831-4854-9645-5fc4619f82ff tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.217198 Oct 29 20:54:41.877141 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1012/1940] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:41 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:41.917614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:41.930588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-232a92dd-301a-4d95-8751-6c50aa3c0605 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.440085 Oct 29 20:54:41.934171 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 929/1941] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:41 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:42.465399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3dbd396f-05bf-4ee3-a834-e98ff24d0997 req-6a01316c-2c0d-4ac8-b537-7cd1f44a9b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623", "name": "network-vif-plugged", "status": "completed", "tag": "8719a5b1-e60d-48bc-8e71-ff14e6657083"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:42.485329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3dbd396f-05bf-4ee3-a834-e98ff24d0997 req-6a01316c-2c0d-4ac8-b537-7cd1f44a9b16 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:42.487681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3dbd396f-05bf-4ee3-a834-e98ff24d0997 req-6a01316c-2c0d-4ac8-b537-7cd1f44a9b16 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:42.488511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3dbd396f-05bf-4ee3-a834-e98ff24d0997 req-6a01316c-2c0d-4ac8-b537-7cd1f44a9b16 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:42.512444 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3dbd396f-05bf-4ee3-a834-e98ff24d0997 req-6a01316c-2c0d-4ac8-b537-7cd1f44a9b16 service nova] Creating event network-vif-plugged:8719a5b1-e60d-48bc-8e71-ff14e6657083 for instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 on nch1-master-1 Oct 29 20:54:42.530766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3dbd396f-05bf-4ee3-a834-e98ff24d0997 req-6a01316c-2c0d-4ac8-b537-7cd1f44a9b16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069245 Oct 29 20:54:42.533235 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1013/1942] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:42.671306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:42.673710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:42.690386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:42.694260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:42.702191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:42.703245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:42.709991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:42.710889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:42.905828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:42.907266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:42.929332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:42.931257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:42.942677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:42.944667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:42.946018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:42.955933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:43.015943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:43.674132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:43.684847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:43.691807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:43.704349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:43.714140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:43.715592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:43.718725 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7d800f4-cd51-4c12-8b4d-49b26e4c0b0f tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.817089 Oct 29 20:54:43.719323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1014/1943] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:42 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:43.735060 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-498060ef-f170-48e1-9f60-31e04798e6fb tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1409 microversion: 2.25 time: 1.067722 Oct 29 20:54:43.735679 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 930/1944] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:42 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1409 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:43.767426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:43.768046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:43.783280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:43.783785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:43.784219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:43.789746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:43.790250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:43.793694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:44.244025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:44.253527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-488b50ee-fe9c-4d88-8a0f-cd3096747e3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.510898 Oct 29 20:54:44.254119 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1015/1945] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:43 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:44.577318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2cadf74d-35b6-4b6e-bc5d-973c1aa385b6 req-53c92aec-a867-4c0c-a9d1-1a63dd654310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d15e3a-29e9-413b-a5fb-507ff4f83211", "name": "network-vif-plugged", "status": "completed", "tag": "ba341985-c208-4b28-8634-0bf3568548a2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:44.594376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cadf74d-35b6-4b6e-bc5d-973c1aa385b6 req-53c92aec-a867-4c0c-a9d1-1a63dd654310 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:44.595201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cadf74d-35b6-4b6e-bc5d-973c1aa385b6 req-53c92aec-a867-4c0c-a9d1-1a63dd654310 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:44.599597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cadf74d-35b6-4b6e-bc5d-973c1aa385b6 req-53c92aec-a867-4c0c-a9d1-1a63dd654310 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:44.627148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2cadf74d-35b6-4b6e-bc5d-973c1aa385b6 req-53c92aec-a867-4c0c-a9d1-1a63dd654310 service nova] Creating event network-vif-plugged:ba341985-c208-4b28-8634-0bf3568548a2 for instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 on nch2-master-1 Oct 29 20:54:44.639726 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2cadf74d-35b6-4b6e-bc5d-973c1aa385b6 req-53c92aec-a867-4c0c-a9d1-1a63dd654310 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070719 Oct 29 20:54:44.646053 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 931/1946] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:54:44.774992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:44.775611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:44.778951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:44.779951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:44.796913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:44.797415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:44.804598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:44.805133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:44.805616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:44.806359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:44.806824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:44.807246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:44.814557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:44.815780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:44.816279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:44.816730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:45.110827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.125555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.144443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.159346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bb3ec74e-190d-4af8-b9c2-3c559f55a38d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.390450 Oct 29 20:54:45.166284 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 932/1947] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:44 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:45.278894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:45.279411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:45.292388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:45.293228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:45.296948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:45.300336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:45.301007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:45.309431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:45.346616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:45.542125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.552250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.566522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.568618 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81a071f4-5518-4b43-8169-c27a5ce7e8e0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1604 microversion: 2.25 time: 0.805154 Oct 29 20:54:45.585960 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1016/1948] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:44 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1604 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:45.601890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:45.602590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:45.617221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:45.617964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:45.618584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:45.619479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:45.620102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:45.620696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:45.940549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:45.948603 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64de7e22-1896-457c-8642-e45ad38d4714 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1307 microversion: 2.1 time: 0.674641 Oct 29 20:54:45.965812 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48dccb15-346b-4f2e-9049-5e1e494ffd35 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.369429 Oct 29 20:54:45.966412 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1017/1949] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 20:54:45 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-interface => generated 284 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 20:54:45.977913 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 933/1950] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:45 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1307 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:46.202477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:46.205557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:46.218222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:46.218716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:46.219155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:46.219867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:46.226323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:46.227839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:46.382821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:46.392522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:46.401282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:46.419585 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d73773a9-4f40-4bcd-b56c-fb097e9f0782 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.220834 Oct 29 20:54:46.421827 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1018/1951] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:46 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:46.972865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:46.973544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:47.006855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:47.011477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:47.012342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:47.013645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:47.014287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:47.015137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:47.452366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:47.452996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:47.467718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:47.470064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:47.471805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:47.477654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:47.479519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:47.490847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:47.862569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:47.875987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a554890-8863-4b6e-8d23-3ea8a26f3e63 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1488 microversion: 2.1 time: 0.908494 Oct 29 20:54:47.899852 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 934/1952] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:46 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1488 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:47.906697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96510dde-5526-4a23-beac-ad05ca4a52eb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:47.943121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:54:47.946733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96510dde-5526-4a23-beac-ad05ca4a52eb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:47.951398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96510dde-5526-4a23-beac-ad05ca4a52eb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:47.952750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96510dde-5526-4a23-beac-ad05ca4a52eb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:48.014814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:48.028182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:48.034467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:48.060152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-060d480d-c66d-4339-9ecd-5ca8d8ec52eb tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.612190 Oct 29 20:54:48.061630 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1019/1953] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:47 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:48.189731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96510dde-5526-4a23-beac-ad05ca4a52eb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Going to try to stop instance {{(pid=138884) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 20:54:48.314787 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96510dde-5526-4a23-beac-ad05ca4a52eb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211/action" status: 202 len: 0 microversion: 2.1 time: 0.411840 Oct 29 20:54:48.316789 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 935/1954] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:54:47 2022] POST /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:54:48.325898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:48.327660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:48.338131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:48.342580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:48.343520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:48.344688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:48.345470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:48.346118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:49.095511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:49.096758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:49.112608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:49.118329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:49.119864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:49.121421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:49.122725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:49.129050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:49.228420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:49.239873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4660ad55-0b0a-4199-9e64-e1e1067b2c47 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.919058 Oct 29 20:54:49.258230 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1020/1955] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:48 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:49.414570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:49.436679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:49.439057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:49.453109 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-abe9d336-5000-439a-8f77-df0c7f0f4d46 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.361942 Oct 29 20:54:49.454173 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 936/1956] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:49 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:50.273645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:50.274554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:50.284425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:50.292416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:50.293255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:50.294306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:50.295588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:50.296300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:50.565651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-58a778bb-f248-41f9-9bba-8a93d9dda8af tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Action: 'create', calling method: .version_select at 0x7fa1710ec700>, body: {"keypair": {"name": "tempest-keypair-1034285978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiFfGz5j4UI/mB5wMIuQkfCi4PIhw4hfWK19weKtpLXa5eX73GnxraksRO4gFyGuOeH2qrsSzqVBtHQcUgFNGieCVcMiO3TUdLplvX9iqwD6ndIgEcdsadP6wDoULsixw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:50.602677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-58a778bb-f248-41f9-9bba-8a93d9dda8af tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Getting quotas for project db2137acee38429eaf0246a35c495060. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:54:50.612650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-58a778bb-f248-41f9-9bba-8a93d9dda8af tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Getting quotas for user 95819256e6c74cf182933860544dae77 and project db2137acee38429eaf0246a35c495060. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:54:50.660547 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-58a778bb-f248-41f9-9bba-8a93d9dda8af tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.489703 Oct 29 20:54:50.673572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:50.685198 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1021/1957] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:54:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:50.693874 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be7c2cdc-26b5-4180-afe2-162065e5ebf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.419153 Oct 29 20:54:50.696148 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 937/1958] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:50 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:50.700654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:50.702005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:50.718871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:50.720383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:50.721098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:50.722188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:50.723020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:50.723834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:51.091785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:51.104001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:51.115386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:51.132871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81e6724e-0c32-4d32-b50c-71e913bab9aa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.442858 Oct 29 20:54:51.144676 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1022/1959] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:50 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:51.191553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-433887c9-391f-41cd-ad36-c8c72fbac0ef req-82988a61-90d7-4f6e-8558-2c39cde31ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623", "tag": "8719a5b1-e60d-48bc-8e71-ff14e6657083"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:51.213600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-433887c9-391f-41cd-ad36-c8c72fbac0ef req-82988a61-90d7-4f6e-8558-2c39cde31ac7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:51.215681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-433887c9-391f-41cd-ad36-c8c72fbac0ef req-82988a61-90d7-4f6e-8558-2c39cde31ac7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:51.220402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-433887c9-391f-41cd-ad36-c8c72fbac0ef req-82988a61-90d7-4f6e-8558-2c39cde31ac7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:51.253243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-433887c9-391f-41cd-ad36-c8c72fbac0ef req-82988a61-90d7-4f6e-8558-2c39cde31ac7 service nova] Creating event network-changed:8719a5b1-e60d-48bc-8e71-ff14e6657083 for instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 on nch1-master-1 Oct 29 20:54:51.266072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-433887c9-391f-41cd-ad36-c8c72fbac0ef req-82988a61-90d7-4f6e-8558-2c39cde31ac7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076754 Oct 29 20:54:51.269880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 938/1960] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:51.720375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:51.721017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:51.732780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:51.734624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:51.737752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:51.738793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:51.741192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:51.742217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:52.465837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:52.483839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6898a603-5039-4bb0-9b5d-5e449351b184 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.767250 Oct 29 20:54:52.486160 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1023/1961] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:51 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:52.510903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:52.513674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:52.529753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:52.531599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:52.534428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:52.539049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:52.542052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:52.545853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:52.556583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93f6aef2-35a9-4590-9678-0c143e87bb21 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Action: 'create', calling method: .version_select at 0x7fa171a39700>, body: {"keypair": {"name": "tempest-keypair-1175714233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHw2zC/BAsSgHB+zgH+P5GXKOsm/WRC7CnnJheFjL8HHQOKaBiMTMTXdGVSVZxD8qijd3BLLOxAXrAonnporZqMBpNCdimAmAas8UeReKQdT5/2igznA6fZ2ePiKI88Dw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:52.595517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-93f6aef2-35a9-4590-9678-0c143e87bb21 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Getting quotas for project 25be1fabab794bdd8cafcbf0a5e057ee. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:54:52.613267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-93f6aef2-35a9-4590-9678-0c143e87bb21 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Getting quotas for user 28f84fe9b29a440c997864e7b81e78a8 and project 25be1fabab794bdd8cafcbf0a5e057ee. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:54:52.656531 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93f6aef2-35a9-4590-9678-0c143e87bb21 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.635770 Oct 29 20:54:52.657950 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 939/1962] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 20:54:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:52.702423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:52.723254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:52.730699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:52.763212 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06927fb1-6299-40f6-878b-08c792fdc6bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1560 microversion: 2.91 time: 0.264864 Oct 29 20:54:52.764410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1024/1963] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:52 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1560 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:53.517239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:53.518074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:53.534005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:53.539266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:53.539877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:53.540726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:53.541207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:53.542664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:53.791625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:53.792873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:53.806100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:53.806906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:53.807522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:53.813761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:53.815055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:53.815501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:54.058114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:54.075867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:54.077585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:54.104420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-074c08ea-17f3-47a8-9835-5f4e7c164d9e tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.317337 Oct 29 20:54:54.111990 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1025/1964] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:53 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:54:54.384274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:54.397592 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7fc820d7-7737-4362-a3c8-b2d741829dca tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.885132 Oct 29 20:54:54.414942 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 940/1965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:53 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:55.137743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:55.139227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:55.151126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:55.160311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:55.162099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:55.164688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:55.168178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:55.169855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:55.363578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:55.383618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:55.389035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:55.419695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf6b1137-3084-4bd4-91dc-f2634a8fa940 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.286065 Oct 29 20:54:55.420620 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1026/1966] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:55 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:55.432699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:55.434358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:55.453064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:55.453881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:55.459719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:55.460935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:55.461620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:55.462218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:56.185999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-259622389", "imageRef": "f9c9b0ba-0799-4090-b0bb-eda10bd75f91", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "65cdd04c-32d3-4166-ba64-4895a945cfd5"}], "security_groups": [{"name": "tempest-securitygroup--6215650"}], "key_name": "tempest-keypair-1034285978", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:56.677571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:56.697055 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2eebed67-6256-453e-81dc-2355d5254ebe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 1.272830 Oct 29 20:54:56.703416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 941/1967] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:55 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:56.714528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:56.720948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:56.733719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:56.741657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:56.742563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:56.744575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:56.745592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:56.746283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:56.752199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] validate_networks() for [('65cdd04c-32d3-4166-ba64-4895a945cfd5', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:54:57.680143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:57.698032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:57.707516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:57.732263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-34f2c879-a6ec-49c3-957a-35f28d7551d9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 1.019426 Oct 29 20:54:57.733211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 942/1968] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:56 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:57.742825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:57.758182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:57.786909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:57.790398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:57.791099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:57.799805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:57.800339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:57.800758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:58.922714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:58.933346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-17001a65-c4bf-4d6f-b8c2-ee7de9a0a226 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 1.196869 Oct 29 20:54:58.960353 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 943/1969] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:57 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:54:59.289544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fefbf14c-831e-4658-806d-53c7de15e6b2 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '.version_select at 0x7fa17191ab80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:59.402813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fefbf14c-831e-4658-806d-53c7de15e6b2 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90" status: 200 len: 371 microversion: 2.1 time: 0.439025 Oct 29 20:54:59.406724 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 944/1970] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:54:58 2022] GET /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90 => generated 371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:54:59.421770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:59.422937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:59.430296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:59.430917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:59.431785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:59.433064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:59.433609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:59.434174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:59.620381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:59.630642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:59.632548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:54:59.639006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-77d1d2b2-a0fc-4a92-bc42-45a0bd920d4b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.230751 Oct 29 20:54:59.639874 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 945/1971] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:54:59 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:54:59.659164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Action: 'update', calling method: .version_select at 0x7fa17191ab80>, body: {"quota_set": {"ram": "5120"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:54:59.675322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:54:59.677224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:54:59.679752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:54:59.680399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:54:59.681737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:54:59.708864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:59.709686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:59.710120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:59.711830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:59.712446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:59.713669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:59.747730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Getting quotas for project db2137acee38429eaf0246a35c495060. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:54:59.756810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Getting quotas for user 95819256e6c74cf182933860544dae77 and project db2137acee38429eaf0246a35c495060. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:54:59.777358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:54:59.780654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9c9b0ba-0799-4090-b0bb-eda10bd75f91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:54:59.814421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:59.815850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:59.820235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:59.822603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:54:59.823722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:54:59.824580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:54:59.880297 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9411aa87-1de9-4f00-8d0c-81cf4c76ca69 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 3.698439 Oct 29 20:54:59.885019 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1027/1972] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:54:56 2022] POST /compute/v2.1/servers => generated 403 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 20:54:59.903896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1527e011-beeb-4a32-8b8b-edb7a82cb80f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:54:59.908190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1527e011-beeb-4a32-8b8b-edb7a82cb80f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:54:59.980558 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f63e3f0-2a57-4203-866e-d47ef143f2e5 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90" status: 200 len: 328 microversion: 2.1 time: 0.337204 Oct 29 20:54:59.984266 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 946/1973] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:54:59 2022] PUT /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90 => generated 328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:00.014164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:00.015162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:00.023543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:00.024486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:00.026157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:00.028447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:00.029470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:00.030372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:00.196018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1527e011-beeb-4a32-8b8b-edb7a82cb80f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:00.205439 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1527e011-beeb-4a32-8b8b-edb7a82cb80f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1245 microversion: 2.1 time: 0.316860 Oct 29 20:55:00.210282 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1028/1974] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:59 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1245 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:00.237332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-402738775", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8a295a62-ed57-4413-b331-91b7b2ee2d46"}], "security_groups": [{"name": "tempest-securitygroup--887387789"}], "key_name": "tempest-keypair-1175714233", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:00.499447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] validate_networks() for [('8a295a62-ed57-4413-b331-91b7b2ee2d46', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:55:00.723306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:00.737229 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74e8ebfe-7acf-42fc-a2ad-7c96dbc86bc7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.751574 Oct 29 20:55:00.737864 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 947/1975] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:54:59 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:00.751440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a7c0739-cfdb-4e10-afd1-56fb3a738aa7 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:00.797739 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a7c0739-cfdb-4e10-afd1-56fb3a738aa7 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90" status: 202 len: 0 microversion: 2.1 time: 0.058731 Oct 29 20:55:00.798568 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 948/1976] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 20:55:00 2022] DELETE /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:55:00.808274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:00.808909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:00.825367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:00.829224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:00.830055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:00.831006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:00.834080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:00.834727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:01.061618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:01.075202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:01.079626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:01.092841 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb33c089-1a0f-41e8-8d27-32f952928b8b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.292954 Oct 29 20:55:01.093404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 949/1977] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:00 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:01.111181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5a15751d-39c0-4fea-be05-156a471732bd tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '.version_select at 0x7fa176228670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:01.265814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Getting quotas for project 25be1fabab794bdd8cafcbf0a5e057ee. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:01.280475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Getting quotas for user 28f84fe9b29a440c997864e7b81e78a8 and project 25be1fabab794bdd8cafcbf0a5e057ee. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:01.304278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:55:01.305705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:55:01.306436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:55:01.307470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:55:01.308174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:55:01.321703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:01.323288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:01.324186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:01.325298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:01.326049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:01.326343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5a15751d-39c0-4fea-be05-156a471732bd tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90" status: 200 len: 371 microversion: 2.1 time: 0.208490 Oct 29 20:55:01.327009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:01.327455 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 950/1978] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 20:55:01 2022] GET /compute/v2.1/os-quota-sets/687d474878ce47adbd0dca3a6e68fe90 => generated 371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:01.342100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:01.349432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:01.352167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Getting quotas for project 25be1fabab794bdd8cafcbf0a5e057ee. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:01.361401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:01.361936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:01.363391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:01.365880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Getting quotas for user 28f84fe9b29a440c997864e7b81e78a8 and project 25be1fabab794bdd8cafcbf0a5e057ee. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:01.367040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:01.368032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:01.368494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:01.382542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:01.401943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:55:01.406306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:55:01.523011 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48877a88-1ad1-4524-9304-b5bf2eaaed1e tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.311242 Oct 29 20:55:01.523847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1029/1979] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:55:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:55:01.549291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6956751c-c397-4b09-816d-cd7ef2b74332 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:01.550772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6956751c-c397-4b09-816d-cd7ef2b74332 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:01.553333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:01.579884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d176e6ee-f7a0-4c51-8764-4499c11bf4a9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1241 microversion: 2.1 time: 0.251216 Oct 29 20:55:01.584691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 951/1980] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:01 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1241 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:01.667480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6956751c-c397-4b09-816d-cd7ef2b74332 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:01.679172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6956751c-c397-4b09-816d-cd7ef2b74332 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1269 microversion: 2.1 time: 0.147333 Oct 29 20:55:01.680324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1030/1981] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:01 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1269 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:01.692471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-327c92b9-d2ad-49af-aecd-391abd5ccdc4 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '.version_select at 0x7fa1762a7e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:01.772313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:01.773338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:01.789011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:01.790397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:01.791146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:01.792208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:01.794323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:01.797722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:02.147405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:02.160289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e44a20d4-39dc-4dd7-b6a2-ebbce3c6e820 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.393341 Oct 29 20:55:02.161719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1031/1982] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:01 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:02.175145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:02.179416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:02.185591 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-327c92b9-d2ad-49af-aecd-391abd5ccdc4 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.508312 Oct 29 20:55:02.186357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 952/1983] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:55:01 2022] GET /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3/defaults => generated 371 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:02.200093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:02.200939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:02.201849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:02.202766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:02.204071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:02.204528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:02.612850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:02.613736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:02.662497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:02.672809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:02.676922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:02.685408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:02.702442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:02.706911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:02.938604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:02.953640 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f58f9a6e-1c07-49d4-82ed-d461d4274583 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1297 microversion: 2.1 time: 0.344171 Oct 29 20:55:02.956948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 953/1984] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:02 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1297 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:02.980569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:02.984302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:03.017623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.025325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.028063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.028893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.037208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.038942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.220114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:03.244085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9e4da62d-7f21-48f2-bea1-6dec9924f967 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1273 microversion: 2.1 time: 0.280111 Oct 29 20:55:03.245822 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 954/1985] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:02 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:03.257802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Action: 'update', calling method: .version_select at 0x7fa171144ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:03.340877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:03.350449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:03.361907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:03.376599 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a0fd77ef-bc78-44b4-b251-5bc644e6cbd7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 1.212945 Oct 29 20:55:03.378341 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1032/1986] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:02 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:03.386734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:03.397675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:03.417978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.418568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.419026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.419761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.420480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.420906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.627567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.628049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.634173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.638588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.639508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.640679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.793513 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4a719b94-60fc-4c82-8fd6-e0d2f64c937e tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366" status: 200 len: 328 microversion: 2.1 time: 0.538236 Oct 29 20:55:03.795271 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 955/1987] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:55:03 2022] PUT /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366 => generated 328 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:03.808794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '.version_select at 0x7fa17633b310>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:03.944597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.945095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.945682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.946433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:03.946896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:03.947366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:03.971127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:04.018147 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0bfa53a-ade5-4c95-8181-c73b3fc1ff87 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366/detail" status: 200 len: 916 microversion: 2.1 time: 0.213715 Oct 29 20:55:04.020986 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 956/1988] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:55:03 2022] GET /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366/detail => generated 916 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:55:04.033443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:04.037272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:04.075837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:04.076600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:04.080078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:04.081049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:04.083188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:04.084138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:04.248240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:04.255721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:04.265777 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-65fa30fe-8508-4086-a7a5-fc9b4460f5ad tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1303 microversion: 2.1 time: 0.243409 Oct 29 20:55:04.269746 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 957/1989] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:04 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:04.281238 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dd4a88c2-8414-4d57-bd2d-fe226d78d091 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.901430 Oct 29 20:55:04.283639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1033/1990] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:03 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:04.298628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:04.303249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:04.340208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:04.341000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:04.341657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:04.343782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:04.346939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:04.350683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:04.405491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:04.405954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:04.418552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:04.419064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:04.419520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:04.420501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:04.428937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:04.429406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:04.969706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:04.983206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:04.984665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:04.995721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:04.997936 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2062662a-a136-4095-89d0-b38510576f93 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.597349 Oct 29 20:55:05.007707 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1034/1991] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:04 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:55:05.020452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Action: 'update', calling method: .version_select at 0x7fa17111d820>, body: {"quota_set": {"ram": "2048"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:05.040399 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3ecb0d6-4558-4646-9f37-101c11c2ca77 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1329 microversion: 2.1 time: 0.768460 Oct 29 20:55:05.041067 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 958/1992] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:04 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1329 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:05.205882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.209368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.213308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.220563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.221294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.222767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.297175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:05.298630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:05.332319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:05.341723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.344910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.345633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.346580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.347705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.349984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.387406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.387824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.405124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.409334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.414283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.415674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.486695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:05.667047 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-066ba9a7-aee1-4909-baf5-27b4e3a5dfdb tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366?user_id=56d58dae0db14fc1801c7033f5d5d39a" status: 200 len: 328 microversion: 2.1 time: 0.648959 Oct 29 20:55:05.667714 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1035/1993] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 29 20:55:05 2022] PUT /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366?user_id=56d58dae0db14fc1801c7033f5d5d39a => generated 328 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:05.705847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:05.706904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:05.733867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:05.750895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4afc41c5-127d-4863-acda-7f7ab663fdf7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1303 microversion: 2.1 time: 0.457646 Oct 29 20:55:05.757543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.758496 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 959/1994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:05 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1303 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:05.763761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.766010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:05.769209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:05.773369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5767a62a-8d58-46a9-99e1-ccf5743dcb0c tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '.version_select at 0x7fa17625bf70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:05.780976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:05.782305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:06.135243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5767a62a-8d58-46a9-99e1-ccf5743dcb0c tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366?user_id=56d58dae0db14fc1801c7033f5d5d39a" status: 200 len: 370 microversion: 2.1 time: 0.374735 Oct 29 20:55:06.159438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 960/1995] 10.222.0.36 () {58 vars in 1323 bytes} [Sat Oct 29 20:55:05 2022] GET /compute/v2.1/os-quota-sets/b5c2d4d1306446dba7f16d45e4186366?user_id=56d58dae0db14fc1801c7033f5d5d39a => generated 370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:06.180280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:06.181043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:06.221372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:06.221910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:06.222352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:06.246040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:06.246633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:06.247087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:06.780639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:06.806329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:06.812437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:06.844382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b6b1c7c8-7966-4127-bda6-94f32ce8dd0c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.683713 Oct 29 20:55:06.845013 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 961/1996] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:06 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:06.868786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:06.869547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:06.877988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:06.912725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:06.913258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:06.913757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:06.917615 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdc64813-2b98-4274-8d7a-a0f6aeb263ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 1.231374 Oct 29 20:55:06.928483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1036/1997] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:05 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:06.933769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:06.934433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:06.937822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:06.957681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:06.958523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:06.991374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:06.992103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:06.992329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:06.993064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:07.010716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:07.011356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:07.424071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:07.442221 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fdd59491-4103-40c4-806b-29dfcc64b935 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1394 microversion: 2.1 time: 0.589000 Oct 29 20:55:07.445907 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 962/1998] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:06 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1394 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:07.477909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-093a501f-587a-460f-97b3-26fe528a82e8 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Calling method '.version_select at 0x7fa171151c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:07.672482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:07.687756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e478338-2c90-4c10-be85-3060eedfad93 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.758025 Oct 29 20:55:07.690978 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1037/1999] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:06 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:07.883668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:07.884355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:07.901951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:07.904769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:07.910239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:07.912080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:07.914617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:07.915991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:08.086578 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-093a501f-587a-460f-97b3-26fe528a82e8 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.639494 Oct 29 20:55:08.087325 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 963/2000] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:55:07 2022] GET /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3/defaults => generated 371 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:08.102537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:08.103307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:08.120904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:08.126759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:08.127253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:08.128029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:08.128511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:08.129590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:08.790177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:08.805213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:08.818930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:08.853712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9442606-7529-4129-9343-f2983e9d791a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.961459 Oct 29 20:55:08.854808 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1038/2001] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:07 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:08.892079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Action: 'update', calling method: .version_select at 0x7fa17125e430>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:09.074032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.077350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.079137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.080345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.087946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.089796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.105344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:09.114526 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c6b83f9e-0954-487d-bd5c-a449df52b6b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 1.017811 Oct 29 20:55:09.137590 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 964/2002] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:08 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:09.143370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:09.144005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:09.164840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.169637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.171316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.172675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.173335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.175899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.642870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c8e02a11-3191-40cb-964e-8784a5335677 tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3" status: 200 len: 329 microversion: 2.1 time: 0.786753 Oct 29 20:55:09.643518 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1039/2003] 10.222.0.36 () {60 vars in 1263 bytes} [Sat Oct 29 20:55:08 2022] PUT /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3 => generated 329 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:09.667088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:09.670805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:09.678437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:09.692782 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7530c85e-85e1-4754-9bc5-c8360c260839 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1394 microversion: 2.1 time: 0.553182 Oct 29 20:55:09.696184 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 965/2004] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:09 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1394 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:09.717893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.718409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.718862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.719666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.719943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-676886bc-a56c-4622-9cf6-1ec164341d9a req-867bd8aa-aa48-4cf9-8571-4fe3d0cbbe42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062626ca-4f09-4b7e-95d4-ee0863ed0c5c", "tag": "00ea2301-2ab7-4ade-8d5e-2642c240c912"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:09.720082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.720477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.744946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-676886bc-a56c-4622-9cf6-1ec164341d9a req-867bd8aa-aa48-4cf9-8571-4fe3d0cbbe42 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:09.755214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-676886bc-a56c-4622-9cf6-1ec164341d9a req-867bd8aa-aa48-4cf9-8571-4fe3d0cbbe42 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:09.756400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-676886bc-a56c-4622-9cf6-1ec164341d9a req-867bd8aa-aa48-4cf9-8571-4fe3d0cbbe42 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:09.794382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-676886bc-a56c-4622-9cf6-1ec164341d9a req-867bd8aa-aa48-4cf9-8571-4fe3d0cbbe42 service nova] Creating event network-changed:00ea2301-2ab7-4ade-8d5e-2642c240c912 for instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c on nch2-master-1 Oct 29 20:55:09.822016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-676886bc-a56c-4622-9cf6-1ec164341d9a req-867bd8aa-aa48-4cf9-8571-4fe3d0cbbe42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121324 Oct 29 20:55:09.828224 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 966/2005] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:09.848729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Action: 'update', calling method: .version_select at 0x7fa17629ab80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:10.069093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.070590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.072753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.075281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.079264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.080940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.336863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:10.356044 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0025921e-e6a3-4f0b-8c60-368a670e7cec tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.705620 Oct 29 20:55:10.356662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1040/2006] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:09 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:10.376132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:10.376912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:10.398516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.400707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.401282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.403568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.405204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.407938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.677199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:10.688615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:10.690275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:10.725550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fc88f0b1-1b98-458c-8ca2-6ad9d9c30bba tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.365110 Oct 29 20:55:10.726131 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1041/2007] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:10 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:10.737260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:10.745941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:10.768095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=18 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:10.786753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.789402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.790390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.792361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.796628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.799151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.826509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30ffb9f0-ac10-4edd-9700-836f63341c3a tempest-QuotasAdminTestJSON-1344783964 tempest-QuotasAdminTestJSON-1344783964-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3" status: 200 len: 329 microversion: 2.1 time: 0.995532 Oct 29 20:55:10.840669 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 967/2008] 10.222.0.36 () {60 vars in 1263 bytes} [Sat Oct 29 20:55:09 2022] PUT /compute/v2.1/os-quota-sets/b646d2de3b654119b281513604cb2bf3 => generated 329 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:10.862360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:10.864369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:10.889965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.890999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.891703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:10.902444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:10.903244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:10.903938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:11.234047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:11.249104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e38448d-02be-4ca1-84ba-1b2d7bdac995 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1394 microversion: 2.1 time: 0.404190 Oct 29 20:55:11.269191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 968/2009] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:10 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1394 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:11.281526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-200e2737-cce5-4f62-b1ba-941f7bf3fb47 req-35fc90f9-80d4-4b84-86d7-6a238f4b2573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07", "tag": "be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:11.304989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-200e2737-cce5-4f62-b1ba-941f7bf3fb47 req-35fc90f9-80d4-4b84-86d7-6a238f4b2573 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:11.306167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-200e2737-cce5-4f62-b1ba-941f7bf3fb47 req-35fc90f9-80d4-4b84-86d7-6a238f4b2573 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:11.308794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-200e2737-cce5-4f62-b1ba-941f7bf3fb47 req-35fc90f9-80d4-4b84-86d7-6a238f4b2573 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:11.338256 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-200e2737-cce5-4f62-b1ba-941f7bf3fb47 req-35fc90f9-80d4-4b84-86d7-6a238f4b2573 service nova] Creating event network-changed:be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045 for instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 on nch1-master-1 Oct 29 20:55:11.353654 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-200e2737-cce5-4f62-b1ba-941f7bf3fb47 req-35fc90f9-80d4-4b84-86d7-6a238f4b2573 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082667 Oct 29 20:55:11.358078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:11.360239 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 969/2010] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:11.372963 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81305917-029a-495b-9862-2825455ed4df tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.639644 Oct 29 20:55:11.373941 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1042/2011] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:10 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:11.382351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:11.384765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:11.400332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:11.400839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:11.401282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:11.402034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:11.402498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:11.402925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:11.725552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:11.760396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:11.761034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:11.767243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1639ea98-9379-407e-90fe-e9e7de950310 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.389468 Oct 29 20:55:11.781504 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 970/2012] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:11 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:11.781780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:11.781780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:11.781780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:11.788328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:11.789346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:11.795320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:12.036340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:12.049248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:12.051705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:12.067365 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0589fb4c-25fa-4f1c-8581-e4265f7bac44 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.308920 Oct 29 20:55:12.082821 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1043/2013] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:11 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:12.285890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:12.292968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:12.324746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:12.325972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:12.326440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:12.331471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:12.334735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:12.335661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:12.397434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:12.398078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:12.427482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:12.430139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:12.434085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:12.435138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:12.436386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:12.438952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:13.362182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:13.380453 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9280717d-eb8a-4f08-8a1d-eeaa91c520e6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1394 microversion: 2.1 time: 1.106580 Oct 29 20:55:13.401543 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 971/2014] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:12 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1394 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:13.415683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:13.420927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:13.439262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:13.443160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:13.446048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:13.453177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:13.453952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:13.454766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:13.499401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:13.525722 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cfe97d98-27d1-486b-a332-3b1b293cd48a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 1.131550 Oct 29 20:55:13.531388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1044/2015] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:12 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:13.562525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:13.563607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:13.597161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:13.605122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:13.606202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:13.620935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:13.625764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:13.628144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:14.116699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:14.130700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:14.131881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:14.143847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:14.144527 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48c4011d-3c62-41df-ba76-4aa5ae3d35f7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.741551 Oct 29 20:55:14.152269 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 972/2016] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:13 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:14.165632 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e9a2554-4466-45ba-a197-46f132f122d5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.628006 Oct 29 20:55:14.168356 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1045/2017] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:13 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:14.403846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:14.404510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:14.407937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:14.430688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:14.431205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:14.431860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:14.432849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:14.436492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:14.440801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:14.557106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:14.557971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:14.574688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:14.579819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:14.580443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:14.581694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:14.582940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:14.583560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:15.321759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:15.334161 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-446e594e-5b38-4928-8b44-7cc2e100f649 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.781511 Oct 29 20:55:15.337807 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1046/2018] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:14 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:15.354324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:15.355747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:15.398592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:15.399424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:15.403067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:15.404092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:15.406002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:15.407527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:15.479025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:15.490630 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6131fcf9-638b-40c8-9096-202f7ba289b9 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1394 microversion: 2.1 time: 1.091578 Oct 29 20:55:15.493409 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 973/2019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:14 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1394 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:15.502976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:15.503821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:15.519268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:15.520014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:15.520662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:15.521662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:15.524101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:15.524773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:15.680861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:15.697004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:15.698551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:15.719672 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3d4f3d6e-3d41-47f8-8aac-dfc8250321dd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.224936 Oct 29 20:55:15.720689 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 974/2020] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:15 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:15.855719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:15.871101 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40b829c7-1428-4178-9b6f-bdf9d22a7c25 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.531804 Oct 29 20:55:15.874854 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1047/2021] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:15 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:16.053198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-71c7bf5d-9c10-4762-9f57-059189aa278f req-7b8780e2-2811-49dd-aef5-22a395121252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062626ca-4f09-4b7e-95d4-ee0863ed0c5c", "name": "network-vif-plugged", "status": "completed", "tag": "00ea2301-2ab7-4ade-8d5e-2642c240c912"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:16.076918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-71c7bf5d-9c10-4762-9f57-059189aa278f req-7b8780e2-2811-49dd-aef5-22a395121252 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.077417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-71c7bf5d-9c10-4762-9f57-059189aa278f req-7b8780e2-2811-49dd-aef5-22a395121252 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.078027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-71c7bf5d-9c10-4762-9f57-059189aa278f req-7b8780e2-2811-49dd-aef5-22a395121252 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.104050 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-71c7bf5d-9c10-4762-9f57-059189aa278f req-7b8780e2-2811-49dd-aef5-22a395121252 service nova] Creating event network-vif-plugged:00ea2301-2ab7-4ade-8d5e-2642c240c912 for instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c on nch2-master-1 Oct 29 20:55:16.120963 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-71c7bf5d-9c10-4762-9f57-059189aa278f req-7b8780e2-2811-49dd-aef5-22a395121252 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072175 Oct 29 20:55:16.121992 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 975/2022] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:16.366935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:16.368097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:16.384318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.384901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.387231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.388282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.389092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.391257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.531670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:16.534756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:16.583941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.588813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.591389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.595135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.599603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.600364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.804568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:16.814289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-75ba3b43-bf20-4db9-a9a0-fffb3ad6780a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.458579 Oct 29 20:55:16.823214 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1048/2023] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:16 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:16.833307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:16.833961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:16.853232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.853763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.854209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.854982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.855379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.855808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.864864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:16.873967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcda41a8-1b41-4b45-a7cf-49919014cb38 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1394 microversion: 2.1 time: 0.361109 Oct 29 20:55:16.881867 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 976/2024] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:16 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1394 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:16.902505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:16.903502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:16.911969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.914717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.915633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:16.918466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:16.919128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:16.919874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:17.031988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:17.045532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:17.047081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:17.067509 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c663eaeb-fa68-41c0-9376-85525a90df13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.242498 Oct 29 20:55:17.093909 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1049/2025] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:16 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:17.238376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:17.262768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d009fe2c-7a1d-4442-9bfe-ac072920ef0e tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.363537 Oct 29 20:55:17.293227 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 977/2026] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:16 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:17.864720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:17.868381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:17.887438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:17.887973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:17.888456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:17.889255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:17.889811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:17.890314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:17.906623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:17.909239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:17.947986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:17.951075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:17.953228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:17.958925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:17.962604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:17.964074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:17.995092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:18.407447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:18.422533 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-89e3b9d9-5b54-4db3-9ec2-8f1d37b3b212 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1498 microversion: 2.1 time: 0.568445 Oct 29 20:55:18.423147 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1050/2027] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:17 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1498 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:18.469908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:18.470566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:18.500989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:18.501495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:18.508597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:18.509734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:18.510220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:18.510663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:18.558522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:18.568483 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f204458-2d97-4494-a8e2-28fd82858e92 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1575 microversion: 2.1 time: 0.674164 Oct 29 20:55:18.571845 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 978/2028] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:17 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1575 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:18.589264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:18.590172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:18.610893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:18.613330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:18.614592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:18.616484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:18.616965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:18.617406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:18.760238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:18.776377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:18.790735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:18.824838 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c52c163-0325-4e78-8121-786bd77d3dc7 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1555 microversion: 2.91 time: 0.392842 Oct 29 20:55:18.826632 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1051/2029] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:18 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1555 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:18.850957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:18.850957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:18.857159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:18.860169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:18.862450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:18.864288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:18.865018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:18.866900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:18.960027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:18.984456 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f685c47a-fa53-4019-8ef7-7264088166de tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.407954 Oct 29 20:55:19.000317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 979/2030] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:18 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:19.112038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=11 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:19.123932 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d69a4b9-cffd-4b2b-9efc-5fcee7b0690b tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.290000 Oct 29 20:55:19.132525 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1052/2031] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:55:18 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:19.298819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Action: 'update', calling method: .version_select at 0x7fa176228280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:19.306375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.306984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.307725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.328979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.331957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.332681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.380749 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] HTTP exception thrown: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Request method failure captured: Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117 HTTP/1.1 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 56 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZM2ELGVhOdgGlyiL_zdmOudqB9FLnQGS9aUZlrJGtSee_ePjBLL1iIkYILOy3WRc35kexaB4vU0rllkaxO-QXZGaAK84hK45YAaCVWig8Q2VEzMGegL9WA6fGDAQLW3cLBmBaLollOTBmasSofJ6iQSUat4Wb6FE87cDs271_PhU5E Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a70373669be6444a90ee8daf565329d0 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a70373669be6444a90ee8daf565329d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a70373669be6444a90ee8daf565329d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a70373669be6444a90ee8daf565329d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a70373669be6444a90ee8daf565329d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a70373669be6444a90ee8daf565329d0 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f9a72c3a9e7a4cd8b00bf9f51733ac3d Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: exception: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '03ddf5e8-f4d3-495a-a80b-b7266b00a117', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:55:19.398208 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Returning 404 to user: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa76603b-ce44-4b5f-9526-d6846873cef9 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117" status: 404 len: 110 microversion: 2.53 time: 0.377116 Oct 29 20:55:19.403592 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 980/2032] 10.222.0.36 () {62 vars in 1309 bytes} [Sat Oct 29 20:55:19 2022] PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117 => generated 110 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 20:55:19.412761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Action: 'update', calling method: .version_select at 0x7fa1710c9160>, body: {"status": "disabled"} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:19.420905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.422243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.423005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.443242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.444057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.444951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.452869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:19.453943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:19.461780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.462286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.465092 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] HTTP exception thrown: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.465763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.467852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Request method failure captured: Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117 HTTP/1.1 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 22 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZM2ELGVhOdgGlyiL_zdmOudqB9FLnQGS9aUZlrJGtSee_ePjBLL1iIkYILOy3WRc35kexaB4vU0rllkaxO-QXZGaAK84hK45YAaCVWig8Q2VEzMGegL9WA6fGDAQLW3cLBmBaLollOTBmasSofJ6iQSUat4Wb6FE87cDs271_PhU5E Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a70373669be6444a90ee8daf565329d0 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a70373669be6444a90ee8daf565329d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a70373669be6444a90ee8daf565329d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a70373669be6444a90ee8daf565329d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a70373669be6444a90ee8daf565329d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a70373669be6444a90ee8daf565329d0 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f9a72c3a9e7a4cd8b00bf9f51733ac3d Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: {"status": "disabled"} Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: exception: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '03ddf5e8-f4d3-495a-a80b-b7266b00a117', 'body': {'status': 'disabled'}} Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:55:19.469130 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.477069 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.478583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.478583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.482633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Returning 404 to user: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:55:19.484284 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1c0951c-7667-4b0c-bdfb-f1dda77e71ed tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117" status: 404 len: 110 microversion: 2.53 time: 0.077382 Oct 29 20:55:19.486037 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1053/2033] 10.222.0.36 () {62 vars in 1309 bytes} [Sat Oct 29 20:55:19 2022] PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117 => generated 110 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:55:19.512438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Action: 'update', calling method: .version_select at 0x7fa171d644c0>, body: {"status": "enabled"} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:19.516529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.517018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.517490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.526893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.527501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.527948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.531409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:19.538733 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] HTTP exception thrown: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Request method failure captured: Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117 HTTP/1.1 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 21 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZM2ELGVhOdgGlyiL_zdmOudqB9FLnQGS9aUZlrJGtSee_ePjBLL1iIkYILOy3WRc35kexaB4vU0rllkaxO-QXZGaAK84hK45YAaCVWig8Q2VEzMGegL9WA6fGDAQLW3cLBmBaLollOTBmasSofJ6iQSUat4Wb6FE87cDs271_PhU5E Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a70373669be6444a90ee8daf565329d0 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a70373669be6444a90ee8daf565329d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a70373669be6444a90ee8daf565329d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a70373669be6444a90ee8daf565329d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a70373669be6444a90ee8daf565329d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a70373669be6444a90ee8daf565329d0 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121 Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f9a72c3a9e7a4cd8b00bf9f51733ac3d Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: {"status": "enabled"} Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: exception: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '03ddf5e8-f4d3-495a-a80b-b7266b00a117', 'body': {'status': 'enabled'}} Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:55:19.540896 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. Oct 29 20:55:19.548605 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:19.554551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Returning 404 to user: Service 03ddf5e8-f4d3-495a-a80b-b7266b00a117 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:55:19.554551 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8df6c855-4055-4a79-b56d-46d0499d9b51 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117" status: 404 len: 110 microversion: 2.53 time: 0.060173 Oct 29 20:55:19.554551 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1054/2034] 10.222.0.36 () {62 vars in 1309 bytes} [Sat Oct 29 20:55:19 2022] PUT /compute/v2.1/os-services/03ddf5e8-f4d3-495a-a80b-b7266b00a117 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:55:19.563930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:19.570972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.571675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.576076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.577566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.578458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.579355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.609226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=70 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:19.620627 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2f932cc-9a44-4a1a-a9aa-f96b19a87bf8 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.060831 Oct 29 20:55:19.622195 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1055/2035] 10.222.0.36 () {60 vars in 1178 bytes} [Sat Oct 29 20:55:19 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:19.640856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:19.648355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.649296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.650090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.651148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.653159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.654720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.704432 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbbabc59-1649-456a-bb3a-7fa56cf58249 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.071181 Oct 29 20:55:19.706088 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1056/2036] 10.222.0.36 () {60 vars in 1211 bytes} [Sat Oct 29 20:55:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:19.733790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:19.742444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.743758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.744515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.746061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.747582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.748776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.799102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0431f87b-d16f-41df-8b22-9330fe576f29 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.072825 Oct 29 20:55:19.800558 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1057/2037] 10.222.0.36 () {60 vars in 1178 bytes} [Sat Oct 29 20:55:19 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:19.822227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:19.840882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.844094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.844845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.873295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.875427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.877230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.903779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:19.916289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85538e8e-9340-4d01-806d-8255d07367ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 200 len: 1475 microversion: 2.1 time: 0.467686 Oct 29 20:55:19.916906 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 981/2038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:19 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:19.930146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:19.940302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:19.950692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.951573 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2607c3d9-ff4e-4f6c-aba4-44f4d17e0272 tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.138702 Oct 29 20:55:19.952419 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1058/2039] 10.222.0.36 () {60 vars in 1237 bytes} [Sat Oct 29 20:55:19 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:19.962628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-514384714"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:19.966219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.967451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.968555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.969422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.970085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.972759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:19.987634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.989105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.990023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:19.991064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:19.991903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:19.992590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.136773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:20.146023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:20.147757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:20.153688 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29a34fb0-fc21-4949-9a8c-148d6bd2099c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1537 microversion: 2.91 time: 0.235704 Oct 29 20:55:20.170035 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 982/2040] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:19 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:20.182966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:20.187067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:20.187831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:20.188541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.189610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:20.190436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:20.191163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.226192 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3d91c89-35a3-4268-b52a-9c2b819e54da tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.054326 Oct 29 20:55:20.235632 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 983/2041] 10.222.0.36 () {60 vars in 1178 bytes} [Sat Oct 29 20:55:20 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:20.244327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:20.245881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:20.254053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:20.255424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:20.257395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.258486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:20.259252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:20.260018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.394231 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c23e6936-2a0d-488d-8957-6071f5d9a1f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211/action" status: 202 len: 0 microversion: 2.1 time: 0.438551 Oct 29 20:55:20.402537 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1059/2042] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:55:19 2022] POST /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:55:20.432275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:20.445026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:20.445786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:20.446689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.447902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:20.448474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:20.450562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:20.490222 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a207575a-837f-44f6-a29b-7bd52630c80c tempest-ServicesAdminNegativeV253TestJSON-1059620121 tempest-ServicesAdminNegativeV253TestJSON-1059620121-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.085829 Oct 29 20:55:20.491451 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1060/2043] 10.222.0.36 () {60 vars in 1239 bytes} [Sat Oct 29 20:55:20 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:20.507235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecbd2dda-e24b-441d-9011-185f0507c2b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1710a63a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:20.587313 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ecbd2dda-e24b-441d-9011-185f0507c2b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.094376 Oct 29 20:55:20.588595 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1061/2044] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:20 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:20.591243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:20.603478 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b50cc13f-8d9f-4303-a1d9-106d9c8ddf45 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.366320 Oct 29 20:55:20.604088 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 984/2045] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:20 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:20.823091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a4f4a7f-f2b7-491c-b8ee-8cba293506e1 tempest-ServicesAdminNegativeV253TestJSON-1116220362 tempest-ServicesAdminNegativeV253TestJSON-1116220362-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:20.827191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8a4f4a7f-f2b7-491c-b8ee-8cba293506e1 tempest-ServicesAdminNegativeV253TestJSON-1116220362 tempest-ServicesAdminNegativeV253TestJSON-1116220362-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b3f3e4e92db545dba7676924f11128ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468065282174408199485e854f96f3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a4f4a7f-f2b7-491c-b8ee-8cba293506e1 tempest-ServicesAdminNegativeV253TestJSON-1116220362 tempest-ServicesAdminNegativeV253TestJSON-1116220362-project] Request method failure captured: Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZM111yRWEG6e6vP8uL9rXrW5krt-eKbAm95uEuky774eZSAPkAf4QtSUqJZnHzIJfwY6m3Vcdau9odGE04Zu6nzcdkolelrvLuou6YlkeNK59EAdpvhTBcZGIS_ZmJ0xmNyAK-CQEmhkKAJfvFE_AO8ADaQQL4cxprLNydjnPtTbSw Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 468065282174408199485e854f96f3d7 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1116220362 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/468065282174408199485e854f96f3d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_468065282174408199485e854f96f3d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/468065282174408199485e854f96f3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/468065282174408199485e854f96f3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1116220362 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 468065282174408199485e854f96f3d7 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1116220362 Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1116220362-project Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b3f3e4e92db545dba7676924f11128ef Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1116220362-project Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: action_args: {} Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 20:55:20.857576 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a4f4a7f-f2b7-491c-b8ee-8cba293506e1 tempest-ServicesAdminNegativeV253TestJSON-1116220362 tempest-ServicesAdminNegativeV253TestJSON-1116220362-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8a4f4a7f-f2b7-491c-b8ee-8cba293506e1 tempest-ServicesAdminNegativeV253TestJSON-1116220362 tempest-ServicesAdminNegativeV253TestJSON-1116220362-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.269429 Oct 29 20:55:20.868481 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1062/2046] 10.222.0.36 () {60 vars in 1178 bytes} [Sat Oct 29 20:55:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:55:21.187597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:21.188749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:21.191891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=64 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:21.199831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.200335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.200777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.201560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.202479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.203129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.356422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:21.384351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:21.388829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:21.398926 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-617ccf50-8276-4ccf-acde-bb91eabc5929 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1540 microversion: 2.91 time: 0.215384 Oct 29 20:55:21.399620 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 985/2047] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:21 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1540 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:21.425740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:21.430412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:21.445236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.445818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.446330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.447178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.447894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.448820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.512884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:21.513696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:21.522258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.524717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.526770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=138885) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 20:55:21.527176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.528999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.529838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.531378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.619140 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f792853-4108-40eb-b7c9-3da2acc82716 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action" status: 202 len: 0 microversion: 2.91 time: 0.197036 Oct 29 20:55:21.619724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1063/2048] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:55:21 2022] POST /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:55:21.624893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6c188270-12cb-44b0-b990-9c4bb7ce47e0 req-8e1a0a78-24c7-4b65-b018-cfec4433379a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062626ca-4f09-4b7e-95d4-ee0863ed0c5c", "tag": "00ea2301-2ab7-4ade-8d5e-2642c240c912"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:21.646580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6c188270-12cb-44b0-b990-9c4bb7ce47e0 req-8e1a0a78-24c7-4b65-b018-cfec4433379a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.647711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6c188270-12cb-44b0-b990-9c4bb7ce47e0 req-8e1a0a78-24c7-4b65-b018-cfec4433379a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.648376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6c188270-12cb-44b0-b990-9c4bb7ce47e0 req-8e1a0a78-24c7-4b65-b018-cfec4433379a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.667256 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6c188270-12cb-44b0-b990-9c4bb7ce47e0 req-8e1a0a78-24c7-4b65-b018-cfec4433379a service nova] Creating event network-changed:00ea2301-2ab7-4ade-8d5e-2642c240c912 for instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c on nch2-master-1 Oct 29 20:55:21.675093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6c188270-12cb-44b0-b990-9c4bb7ce47e0 req-8e1a0a78-24c7-4b65-b018-cfec4433379a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053730 Oct 29 20:55:21.677079 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1064/2049] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:21.685224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e27fb85-56cc-480a-83b2-d53213f6b5fe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa172533040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:21.779825 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e27fb85-56cc-480a-83b2-d53213f6b5fe tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.099497 Oct 29 20:55:21.781008 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1065/2050] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:21 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:21.789330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:21.790375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:21.817238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:21.833076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.833076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.833489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.835357 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7734a2d4-fa2d-4fa2-a842-787e67db93c6 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1575 microversion: 2.1 time: 0.319379 Oct 29 20:55:21.836445 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 986/2051] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:21 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1575 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:21.848371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.848371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.848371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.876062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:21.894312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:21.918445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.918945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.919399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:21.938115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:21.939902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:21.942690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:22.008841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:22.022740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:22.039753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:22.058098 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-17940218-99b3-4228-8f2c-eb5a2e954b33 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1488 microversion: 2.91 time: 0.275599 Oct 29 20:55:22.058810 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1066/2052] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:21 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:22.352346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:22.366161 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-351484e5-6f4e-463b-90ca-61f02c457749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.493983 Oct 29 20:55:22.383600 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 987/2053] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:21 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:22.796237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d782d540-826a-4ef0-a450-a6bb8147a393 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1712de940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:22.844226 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d782d540-826a-4ef0-a450-a6bb8147a393 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.051970 Oct 29 20:55:22.844969 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1067/2054] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:22 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:23.092860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:23.093576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:23.111303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:23.111925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:23.112451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:23.114082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:23.114659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:23.115730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:23.197493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:23.211171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:23.213363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:23.222961 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b1d69c4c-1769-4370-9740-8c8160102cd9 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1488 microversion: 2.91 time: 0.134990 Oct 29 20:55:23.237479 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 988/2055] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:23 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1488 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:23.392478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:23.393096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:23.399429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:23.399930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:23.400370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:23.401070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:23.401563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:23.401991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:23.645931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:23.655569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-147ef0aa-1d88-49f9-b5a4-67ea7ceb3bcb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.266798 Oct 29 20:55:23.656391 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1068/2056] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:23 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:23.866111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34d7aeaf-a579-465c-b2f6-96e9419f364f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1713148b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:23.939567 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34d7aeaf-a579-465c-b2f6-96e9419f364f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.082727 Oct 29 20:55:23.940422 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1069/2057] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:23 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:23.961648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1699245196", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:24.058405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:55:24.253954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:24.255389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:24.265556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:24.266409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:24.267070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:24.268012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:24.268666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:24.269293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:24.286302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:55:24.286989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:55:24.287677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:55:24.288309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:55:24.289038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:55:24.304957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:24.305444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:24.305906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:24.306886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:24.307567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:24.307997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:24.331355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Getting quotas for project ca557cc6cfbc46f4a1b236d51e841818. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:24.337494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Getting quotas for user c7d8a34d7d9d4f2cb5fe7c37f596c09f and project ca557cc6cfbc46f4a1b236d51e841818. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:24.352064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:55:24.354777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:55:24.372925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:24.395462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:24.396921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:24.407177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8fcd73e7-dc11-4779-a646-09eab5f570cf tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625453 Oct 29 20:55:24.411045 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4621753f-db06-4109-922c-0eb666e62a6a tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.160712 Oct 29 20:55:24.414287 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 989/2058] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:55:24.414686 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1070/2059] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:24 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:24.427679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce9445d7-6f4b-4f9c-a564-8c070a94d1a1 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:24.428504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ce9445d7-6f4b-4f9c-a564-8c070a94d1a1 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:24.509792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce9445d7-6f4b-4f9c-a564-8c070a94d1a1 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:24.518331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce9445d7-6f4b-4f9c-a564-8c070a94d1a1 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1217 microversion: 2.1 time: 0.102857 Oct 29 20:55:24.523925 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1071/2060] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:24 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:24.700567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:24.702338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:24.716589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:24.718318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:24.719498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:24.721993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:24.722664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:24.723999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:24.955822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61445db3-1277-45e5-8f4f-09282c706d9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17125e430>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:24.984797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:25.025019 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-18a065f5-83dd-4ac3-b8af-be5c63f9564f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.327495 Oct 29 20:55:25.025681 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 990/2061] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:24 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:25.064016 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61445db3-1277-45e5-8f4f-09282c706d9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.112219 Oct 29 20:55:25.064586 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1072/2062] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:24 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:25.449332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:25.450399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:25.467117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:25.469011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:25.473959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:25.475468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:25.476175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:25.476839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:25.541628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:25.542356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:25.555091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:25.561145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:25.561813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:25.562871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:25.564296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:25.564918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:25.603431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:25.615154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:25.620694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:25.634547 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-950f75db-bb0d-478a-b1da-45abdcb09918 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.190250 Oct 29 20:55:25.635728 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 991/2063] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:25 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:25.676414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:25.686689 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6c1f1282-965c-4121-acc4-3ef57f45cd7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1269 microversion: 2.1 time: 0.150106 Oct 29 20:55:25.687589 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1073/2064] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:25 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:25.911202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0f3c67a2-5677-4fa3-959a-5f43e2954856 req-67900ca4-ea8c-40f3-85f0-c4436d10a55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d15e3a-29e9-413b-a5fb-507ff4f83211", "name": "network-vif-plugged", "status": "completed", "tag": "ba341985-c208-4b28-8634-0bf3568548a2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:25.932574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0f3c67a2-5677-4fa3-959a-5f43e2954856 req-67900ca4-ea8c-40f3-85f0-c4436d10a55d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:25.935786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0f3c67a2-5677-4fa3-959a-5f43e2954856 req-67900ca4-ea8c-40f3-85f0-c4436d10a55d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:25.936927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0f3c67a2-5677-4fa3-959a-5f43e2954856 req-67900ca4-ea8c-40f3-85f0-c4436d10a55d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:25.964684 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0f3c67a2-5677-4fa3-959a-5f43e2954856 req-67900ca4-ea8c-40f3-85f0-c4436d10a55d service nova] Creating event network-vif-plugged:ba341985-c208-4b28-8634-0bf3568548a2 for instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 on nch2-master-1 Oct 29 20:55:25.974041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0f3c67a2-5677-4fa3-959a-5f43e2954856 req-67900ca4-ea8c-40f3-85f0-c4436d10a55d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066253 Oct 29 20:55:25.974877 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 992/2065] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:26.050067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:26.050676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:26.063802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:26.064785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:26.065114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:26.067562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:26.067918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:26.068365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:26.080407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04c3e35c-4c67-48f7-bfd2-8beeb337ad4f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762dd5e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:26.191552 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04c3e35c-4c67-48f7-bfd2-8beeb337ad4f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.115779 Oct 29 20:55:26.195396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 993/2066] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:26 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:26.615975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:26.641815 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f42c54da-5015-474e-ae9d-41738277f749 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.578533 Oct 29 20:55:26.643314 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1074/2067] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:26 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:26.669222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:26.670570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:26.696644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:26.698007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:26.700272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:26.702430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:26.704226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:26.705008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:26.713448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:26.713938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:26.732680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:26.736087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:26.740731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:26.744387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:26.748396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:26.748862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:26.935128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:26.947329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:26.953310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:26.965884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c429b37e-b532-4f2d-8049-53c812f4ea28 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.303717 Oct 29 20:55:26.967045 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 994/2068] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:26 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:26.999134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:27.014394 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdbc14ac-9b98-49fc-8964-62765f1efe15 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1275 microversion: 2.1 time: 0.305903 Oct 29 20:55:27.015274 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1075/2069] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:26 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:27.215070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7625daf1-d7c3-4f78-97a5-821575566ac8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171114700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:27.366183 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7625daf1-d7c3-4f78-97a5-821575566ac8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1411 microversion: 2.1 time: 0.161843 Oct 29 20:55:27.375012 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 995/2070] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:27 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:27.667155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:27.668622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:27.695495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:27.698891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:27.698891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:27.698891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:27.698891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:27.698891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:28.000110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:28.001499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:28.016804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:28.023772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:28.026514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:28.027501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:28.030973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:28.035348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:28.653357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:28.663821 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c37a4a5-d03d-4128-9198-3500fda0837f tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 1.003158 Oct 29 20:55:28.673803 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1076/2071] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:27 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:28.691331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:28.693731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:28.716417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:28.724915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:28.726513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:28.729852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:28.733243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:28.743762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:28.765507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:28.787343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:28.794291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:28.810056 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a13f819-f377-453d-9091-5d168fc3359d tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.814801 Oct 29 20:55:28.811397 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 996/2072] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:27 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:28.821836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b989bee-fcdd-49b1-8c61-166e892f0850 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171114b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:29.423931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:29.447396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-66a0af07-7c8d-4a31-b33b-2fb7b6838b9e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.771669 Oct 29 20:55:29.453341 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1077/2073] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:28 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:29.700465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:29.701694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:29.723595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:29.728919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:29.730883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:29.733433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:29.735242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:29.735784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:30.375463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:30.393090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0bd11454-06f3-47f7-a1af-3c66358561eb tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.694586 Oct 29 20:55:30.406430 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1078/2074] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:29 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:30.411872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:30.433833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:30.462515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=14 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:30.464082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:30.478943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:30.481952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:30.483235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:30.485912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:30.487991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:30.751511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:30.762917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:30.772989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:30.780545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:30.793683 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d3738af-1e35-452e-a48c-c18b86908b40 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.385352 Oct 29 20:55:30.807877 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1079/2075] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:30 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:30.844769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-258d81ab-6c56-4245-9426-e40e362cd56f req-0422daf1-fdbd-4bb0-8a41-cf185e34b9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:30.881233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-258d81ab-6c56-4245-9426-e40e362cd56f req-0422daf1-fdbd-4bb0-8a41-cf185e34b9ba service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:30.884739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-258d81ab-6c56-4245-9426-e40e362cd56f req-0422daf1-fdbd-4bb0-8a41-cf185e34b9ba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:30.886796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-258d81ab-6c56-4245-9426-e40e362cd56f req-0422daf1-fdbd-4bb0-8a41-cf185e34b9ba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:30.919816 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-258d81ab-6c56-4245-9426-e40e362cd56f req-0422daf1-fdbd-4bb0-8a41-cf185e34b9ba service nova] Creating event network-changed:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:55:30.934716 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-258d81ab-6c56-4245-9426-e40e362cd56f req-0422daf1-fdbd-4bb0-8a41-cf185e34b9ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115446 Oct 29 20:55:30.935755 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1080/2076] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:30.948321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:30.951123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:30.976300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:30.977069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:30.977949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:30.980842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:30.981750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:30.986505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:31.389594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:31.405711 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-949df3a7-da4d-439e-b3a2-44b38a1798b4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.463114 Oct 29 20:55:31.407697 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1081/2077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:30 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:31.427313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3ac62a1-1cf8-4b05-b608-27a3e6e36fac tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Action: 'create', calling method: .version_select at 0x7fa1712f2f70>, body: {"keypair": {"name": "tempest-keypair-1075960236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfA5IDC6YUF2dSQj4AAmEFn4CA/8igkVrduze9aqlEpt8egY5MYOK12pGGOGHXkrTtUas0HdleEp8t/42sgPwuApe5zuQbH2YXsyzpF3Rm09gkj5pOQ88K9/oeU2DtaNw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:31.451248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d3ac62a1-1cf8-4b05-b608-27a3e6e36fac tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Getting quotas for project c22ac3c92da747c58302269fc6a028f4. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:31.473878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d3ac62a1-1cf8-4b05-b608-27a3e6e36fac tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Getting quotas for user 014a25f21b294a42986928e0a8df6cfa and project c22ac3c92da747c58302269fc6a028f4. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:31.478850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:31.510629 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3ac62a1-1cf8-4b05-b608-27a3e6e36fac tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.100631 Oct 29 20:55:31.513684 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1082/2078] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 20:55:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 20:55:31.557948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:31.562871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:31.586949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:31.594357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:31.596352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:31.599700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:31.601356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:31.602732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:31.947468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:31.972028 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d90ac10-093d-4b90-a401-5603731d4e4d tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.454768 Oct 29 20:55:31.973960 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1083/2079] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:31 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:31.980243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:32.000215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:32.030130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:32.037726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:32.041267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:32.044541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:32.046641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:32.048622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:32.302070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:32.330078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:32.338531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:32.356863 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a051c24f-e353-42f1-b820-1e48cfc651bf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.380747 Oct 29 20:55:32.358012 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1084/2080] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:31 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:32.435756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:32.436394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:32.454375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:32.454895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:32.455348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:32.456160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:32.456542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:32.472515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:32.920805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:32.934677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25586d42-de71-4b58-8298-1607f331f9a9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.504586 Oct 29 20:55:32.939905 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1085/2081] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:32 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:32.957819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-977cecd6-a95b-4c69-8df9-e091ce3ede3c req-84bf4a22-753b-49a9-89d3-ca4ad2578692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07", "name": "network-vif-plugged", "status": "completed", "tag": "be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:32.985551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-977cecd6-a95b-4c69-8df9-e091ce3ede3c req-84bf4a22-753b-49a9-89d3-ca4ad2578692 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:32.987061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-977cecd6-a95b-4c69-8df9-e091ce3ede3c req-84bf4a22-753b-49a9-89d3-ca4ad2578692 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:32.989291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-977cecd6-a95b-4c69-8df9-e091ce3ede3c req-84bf4a22-753b-49a9-89d3-ca4ad2578692 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:33.018990 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-977cecd6-a95b-4c69-8df9-e091ce3ede3c req-84bf4a22-753b-49a9-89d3-ca4ad2578692 service nova] Creating event network-vif-plugged:be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045 for instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 on nch1-master-1 Oct 29 20:55:33.030988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-977cecd6-a95b-4c69-8df9-e091ce3ede3c req-84bf4a22-753b-49a9-89d3-ca4ad2578692 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087523 Oct 29 20:55:33.033933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1086/2082] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:33.048577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:33.053072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:33.068330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:33.069186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:33.070081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:33.071591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:33.074853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:33.075589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:33.517492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:33.526933 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f825be7-0893-46e0-b86a-04480eda170a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.491557 Oct 29 20:55:33.530999 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1087/2083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:33 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:33.537485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:33.538338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:33.559901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:33.560758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:33.563947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:33.565181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:33.565926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:33.566589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:33.699486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:33.710479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:33.715616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:33.725606 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3fac2672-a707-446e-9213-b79c06f77a77 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.192482 Oct 29 20:55:33.726621 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1088/2084] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:33 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:33.966066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:33.967364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:33.981474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:33.982434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:33.983097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:33.984170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:33.985224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:33.986004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:34.284197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:34.293373 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2545efed-0590-4e9a-bcfc-a99e4f1f6017 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.333910 Oct 29 20:55:34.294295 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1089/2085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:33 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:34.318681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=14 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:34.353643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:34.558744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:34.559379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:34.566843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:34.567336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:34.567772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:34.570231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:34.570809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:34.571264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:34.825138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:34.838846 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20957f67-eae5-4cdd-ab8a-302139e1cc7a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1368 microversion: 2.1 time: 0.283393 Oct 29 20:55:34.849488 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1090/2086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:34 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:34.860081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:34.860081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:34.871048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:34.871559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:34.872008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:34.872751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:34.873199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:34.876250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:35.056662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:35.076282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:35.077894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:35.098576 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90cd6ebf-d141-44b0-bd91-1497bf3dc2e5 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.255059 Oct 29 20:55:35.100509 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1091/2087] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:34 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:35.319770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:35.320327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:35.337977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:35.339137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:35.339597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:35.340338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:35.340806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:35.341242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:35.590740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:35.601164 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9a245a9-1ada-4209-a337-ac39bd7f2b9d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.286249 Oct 29 20:55:35.611646 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1092/2088] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:35 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:35.617408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1419008941", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c31a6714-3e25-440a-be25-39417e620a09"}, {"port": "05d7ea0c-d052-4d7e-a462-6503fe5f5642", "tag": "port-1"}, {"port": "694c1168-38a2-4247-b315-9261c3f49f31", "tag": "port-2"}, {"uuid": "d24e5907-2504-4135-bc39-85deb99068b1", "tag": "net-1"}, {"uuid": "d24e5907-2504-4135-bc39-85deb99068b1"}, {"uuid": "b6696f67-66d5-4e4d-9ec7-772b38199ed7", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b6696f67-66d5-4e4d-9ec7-772b38199ed7", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f63b060b-36c0-43ae-9fa9-42a926d80cd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ec673dab-2cf6-4dc2-b93f-219ee36ef531", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3debad03-736d-4863-b27d-c2bed6ae1053", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2019775418"}], "key_name": "tempest-keypair-1075960236", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:38.770923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=85 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:38.801441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:39.184682 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b989bee-fcdd-49b1-8c61-166e892f0850 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1420 microversion: 2.1 time: 10.371562 Oct 29 20:55:39.187063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 997/2089] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:28 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1420 bytes in 10375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:39.201707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:39.202867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:39.230775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:39.231908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:39.232400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:39.235047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:39.236721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:39.238126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:39.279778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] validate_networks() for [('c31a6714-3e25-440a-be25-39417e620a09', None, None, None, None, None), (None, None, '05d7ea0c-d052-4d7e-a462-6503fe5f5642', None, None, None), (None, None, '694c1168-38a2-4247-b315-9261c3f49f31', None, None, None), ('d24e5907-2504-4135-bc39-85deb99068b1', None, None, None, None, None), ('d24e5907-2504-4135-bc39-85deb99068b1', None, None, None, None, None), ('b6696f67-66d5-4e4d-9ec7-772b38199ed7', '10.2.2.100', None, None, None, None), ('b6696f67-66d5-4e4d-9ec7-772b38199ed7', '10.2.2.200', None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:55:39.586001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:39.586001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ebc851a-53f7-4ab0-8ed7-87311eb18794 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1553 microversion: 2.1 time: 0.386847 Oct 29 20:55:39.604515 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 998/2090] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:39 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1553 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:39.612151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:39.612773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:39.633054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:39.634185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:39.635134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:39.636777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:39.639407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:39.640055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:39.807076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:39.818047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:39.820287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:39.829211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-517591a8-8d27-4ded-af17-dd47b750a2a4 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.223089 Oct 29 20:55:39.842337 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 999/2091] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:39 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:39.859438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:40.227950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:40.240142 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-18891ba6-3b25-4dc0-8a2e-dfd91add511b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.396086 Oct 29 20:55:40.240738 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1000/2092] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:39 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:40.245885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8982f83f-19c7-4822-b598-594e15f0bd6f req-2760c14d-d606-4aa7-bbb2-577cf76afb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "name": "network-vif-plugged", "status": "completed", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:40.256921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8982f83f-19c7-4822-b598-594e15f0bd6f req-2760c14d-d606-4aa7-bbb2-577cf76afb2f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:40.258003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8982f83f-19c7-4822-b598-594e15f0bd6f req-2760c14d-d606-4aa7-bbb2-577cf76afb2f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:40.258604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8982f83f-19c7-4822-b598-594e15f0bd6f req-2760c14d-d606-4aa7-bbb2-577cf76afb2f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:40.271668 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8982f83f-19c7-4822-b598-594e15f0bd6f req-2760c14d-d606-4aa7-bbb2-577cf76afb2f service nova] Creating event network-vif-plugged:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:55:40.277890 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8982f83f-19c7-4822-b598-594e15f0bd6f req-2760c14d-d606-4aa7-bbb2-577cf76afb2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035737 Oct 29 20:55:40.278953 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1001/2093] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:40.285993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52d0e193-ca5a-44e0-8d16-cf6ac8957ab5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762a11f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:40.395036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52d0e193-ca5a-44e0-8d16-cf6ac8957ab5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 200 len: 1420 microversion: 2.1 time: 0.114382 Oct 29 20:55:40.398516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1002/2094] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:40 2022] GET /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:40.404553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:40.406423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:40.423874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:40.429472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:40.430146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:40.431277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:40.431893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:40.434479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:40.936310 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ece595f-c304-44c0-86d8-4eda0959480a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.536458 Oct 29 20:55:40.936896 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1003/2095] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 20:55:40 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-interface => generated 284 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:40.941842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5bf6995-ba2f-43d5-9e6a-96f33294ba71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171121700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:41.454797 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d5bf6995-ba2f-43d5-9e6a-96f33294ba71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 204 len: 0 microversion: 2.1 time: 0.516726 Oct 29 20:55:41.455323 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1004/2096] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:40 2022] DELETE /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:55:41.460871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:41.461519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:41.468086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:41.468858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:41.470050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:41.470950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:41.471422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:41.471848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:41.484372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:41.594220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:41.603980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:41.605542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:41.611479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c2d90dc-d002-480f-a553-3ee448e328fa tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.155097 Oct 29 20:55:41.612361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1005/2097] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:41 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:41.638419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:41.639377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:41.647801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:41.648525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:41.649110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:41.649993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:41.650772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:41.651446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:41.857032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:41.866852 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-853b9f06-a2c5-4f79-abb2-ab0066a3b579 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1317 microversion: 2.1 time: 0.243264 Oct 29 20:55:41.867516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1006/2098] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:41 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:41.874158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:41.875036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:41.883494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:41.885181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:41.885181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:41.885953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:41.886735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:41.887198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:41.932844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:55:42.054655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c115410-70ba-4276-98bd-461925ac5189 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 204 len: 0 microversion: 2.1 time: 0.185446 Oct 29 20:55:42.056564 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1007/2099] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:55:41 2022] DELETE /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:55:42.185521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1326038287", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1cc8922f-83e5-42c2-bce3-6544d389a499"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:42.262936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] validate_networks() for [('1cc8922f-83e5-42c2-bce3-6544d389a499', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:55:42.855209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:55:42.855805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:55:42.856343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:55:42.856768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:55:42.857248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:55:42.868512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:42.869655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:42.870366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:42.871384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:42.872202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:42.872833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:42.895841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Getting quotas for project c22ac3c92da747c58302269fc6a028f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:42.903093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Getting quotas for user 014a25f21b294a42986928e0a8df6cfa and project c22ac3c92da747c58302269fc6a028f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:42.911170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:55:42.911823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:55:42.912581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:55:42.913479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:55:42.914325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:55:42.929054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:42.929853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:42.930450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:42.931950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:42.932879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:42.933472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:42.956044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:42.962731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for user d1c5ef005ddf4a96828abd5376fffa37 and project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:42.977534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:55:42.980020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:55:43.041386 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a86ea5fb-c4db-495d-be66-d3cb14cef8d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861165 Oct 29 20:55:43.049315 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1008/2100] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:55:43.057779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7533c8dd-d012-4a94-ba93-254caf16b2fa req-745c5778-b770-45cc-b5f3-ee58f877d34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07", "tag": "be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:43.075384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7533c8dd-d012-4a94-ba93-254caf16b2fa req-745c5778-b770-45cc-b5f3-ee58f877d34b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.075928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7533c8dd-d012-4a94-ba93-254caf16b2fa req-745c5778-b770-45cc-b5f3-ee58f877d34b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.077317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7533c8dd-d012-4a94-ba93-254caf16b2fa req-745c5778-b770-45cc-b5f3-ee58f877d34b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.094448 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7533c8dd-d012-4a94-ba93-254caf16b2fa req-745c5778-b770-45cc-b5f3-ee58f877d34b service nova] Creating event network-changed:be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045 for instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 on nch1-master-1 Oct 29 20:55:43.100338 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7533c8dd-d012-4a94-ba93-254caf16b2fa req-745c5778-b770-45cc-b5f3-ee58f877d34b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056202 Oct 29 20:55:43.101845 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1009/2101] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:43.109159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:43.110084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:43.112948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:55:43.116675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f63b060b-36c0-43ae-9fa9-42a926d80cd7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ec673dab-2cf6-4dc2-b93f-219ee36ef531',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3debad03-736d-4863-b27d-c2bed6ae1053',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:55:43.120299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.120868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.122234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.122761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.123228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.123672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.213254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.225154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.226577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.235534 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-34934d3f-7605-4cee-82d9-b4f346e03a13 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.132478 Oct 29 20:55:43.236413 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1010/2102] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:43 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:43.257842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:43.259459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:43.268280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.269070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.269736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.270362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.270829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.271302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.444169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.453688 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d57394ca-930b-4931-9cf0-3f018df35ba3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1465 microversion: 2.1 time: 0.206343 Oct 29 20:55:43.454536 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1011/2103] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:43 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1465 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:43.459468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10c324b3-8e42-4ad7-9cd3-35f93dcc46f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:43.461235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10c324b3-8e42-4ad7-9cd3-35f93dcc46f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:43.544687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10c324b3-8e42-4ad7-9cd3-35f93dcc46f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.557002 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10c324b3-8e42-4ad7-9cd3-35f93dcc46f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1208 microversion: 2.1 time: 0.101276 Oct 29 20:55:43.578066 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1012/2104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:43 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:43.596517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-530767263", "metadata": {"image_type": "test"}}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:43.607000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:43.627121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.627756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.628216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.631075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.631619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.632137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.713905 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4d5a2a7-a349-4139-b6d6-272c5d429916 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.099293 Oct 29 20:55:43.717495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1093/2105] 10.222.0.36 () {62 vars in 1189 bytes} [Sat Oct 29 20:55:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 8105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:55:43.723164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Getting quotas for project ca557cc6cfbc46f4a1b236d51e841818. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:55:43.730126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a26463a9-e10f-4551-bfe5-236b57797446 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:43.730979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a26463a9-e10f-4551-bfe5-236b57797446 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:43.747257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Getting quotas for user c7d8a34d7d9d4f2cb5fe7c37f596c09f and project ca557cc6cfbc46f4a1b236d51e841818. Resources: dict_keys(['metadata_items']) {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:55:43.843724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a26463a9-e10f-4551-bfe5-236b57797446 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.857399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a26463a9-e10f-4551-bfe5-236b57797446 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.864563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a26463a9-e10f-4551-bfe5-236b57797446 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:43.868298 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a26463a9-e10f-4551-bfe5-236b57797446 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1286 microversion: 2.42 time: 0.143345 Oct 29 20:55:43.877317 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1094/2106] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:43 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:55:43.905063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d7d3b4d2-a67a-4106-8dcd-36dbc0f9b497 req-bfd1d415-e680-4404-bf24-bde5933503f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d15e3a-29e9-413b-a5fb-507ff4f83211", "name": "network-vif-unplugged", "status": "completed", "tag": "ba341985-c208-4b28-8634-0bf3568548a2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:43.927856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d7d3b4d2-a67a-4106-8dcd-36dbc0f9b497 req-bfd1d415-e680-4404-bf24-bde5933503f1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:43.929325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d7d3b4d2-a67a-4106-8dcd-36dbc0f9b497 req-bfd1d415-e680-4404-bf24-bde5933503f1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:43.930089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d7d3b4d2-a67a-4106-8dcd-36dbc0f9b497 req-bfd1d415-e680-4404-bf24-bde5933503f1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:43.951808 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d7d3b4d2-a67a-4106-8dcd-36dbc0f9b497 req-bfd1d415-e680-4404-bf24-bde5933503f1 service nova] Creating event network-vif-unplugged:ba341985-c208-4b28-8634-0bf3568548a2 for instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 on nch2-master-1 Oct 29 20:55:43.972444 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d7d3b4d2-a67a-4106-8dcd-36dbc0f9b497 req-bfd1d415-e680-4404-bf24-bde5933503f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079123 Oct 29 20:55:43.973947 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1095/2107] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:44.131822 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-65a533db-cf18-4f7e-b37c-a67231338e65 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "POST /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462/action" status: 202 len: 0 microversion: 2.1 time: 0.543016 Oct 29 20:55:44.133790 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1013/2108] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:55:43 2022] POST /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:55:44.146063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01077ade-6a68-43c0-9a5a-dfe6d1bb81e8 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1712f2160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:44.247599 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01077ade-6a68-43c0-9a5a-dfe6d1bb81e8 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.106547 Oct 29 20:55:44.249515 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1096/2109] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:44 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:44.274180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:44.274975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:44.283292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:44.283821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:44.284396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:44.285354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:44.286093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:44.287183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:44.539845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.567777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.580972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.587780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:44.589552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:44.596983 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4b3e522-e2dc-4681-a601-1da1cd10006b tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.331420 Oct 29 20:55:44.604834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:44.608779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:44.615343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:44.615613 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1014/2110] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:44 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:44.616530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:44.617217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:44.617830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:44.726824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.736615 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a0f57d4-1977-4a1e-a459-44dc1b88484e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1260 microversion: 2.1 time: 0.154525 Oct 29 20:55:44.737412 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1097/2111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:44 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:44.898631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdf74ced-1fe1-4ddd-880d-79dbf02dbce9 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:44.899210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cdf74ced-1fe1-4ddd-880d-79dbf02dbce9 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:44.966874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cdf74ced-1fe1-4ddd-880d-79dbf02dbce9 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.975463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cdf74ced-1fe1-4ddd-880d-79dbf02dbce9 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.977169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cdf74ced-1fe1-4ddd-880d-79dbf02dbce9 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:44.978365 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cdf74ced-1fe1-4ddd-880d-79dbf02dbce9 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1286 microversion: 2.42 time: 0.083843 Oct 29 20:55:44.978941 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1015/2112] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:44 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:45.115977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0a050d6d-87ba-449f-870a-b569855eec6d req-fb6328dc-9f7d-4242-aa4f-9003bec5bb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d15e3a-29e9-413b-a5fb-507ff4f83211", "name": "network-vif-deleted", "tag": "ba341985-c208-4b28-8634-0bf3568548a2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:45.126464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0a050d6d-87ba-449f-870a-b569855eec6d req-fb6328dc-9f7d-4242-aa4f-9003bec5bb18 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:45.126983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0a050d6d-87ba-449f-870a-b569855eec6d req-fb6328dc-9f7d-4242-aa4f-9003bec5bb18 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:45.127421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0a050d6d-87ba-449f-870a-b569855eec6d req-fb6328dc-9f7d-4242-aa4f-9003bec5bb18 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:45.147044 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0a050d6d-87ba-449f-870a-b569855eec6d req-fb6328dc-9f7d-4242-aa4f-9003bec5bb18 service nova] Creating event network-vif-deleted:ba341985-c208-4b28-8634-0bf3568548a2 for instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 on nch2-master-1 Oct 29 20:55:45.153395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0a050d6d-87ba-449f-870a-b569855eec6d req-fb6328dc-9f7d-4242-aa4f-9003bec5bb18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041107 Oct 29 20:55:45.155719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1098/2113] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:45.267879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8301ef73-cd7c-478d-9234-d90fc5997105 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171070040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:45.333978 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8301ef73-cd7c-478d-9234-d90fc5997105 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.072321 Oct 29 20:55:45.334880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1016/2114] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:45 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:45.633204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:45.633851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:45.640648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:45.641138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:45.641663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:45.642424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:45.642894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:45.643320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:45.711746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:45.719988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:45.721429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:45.726532 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-79b98654-3911-4d3c-b06c-9b59f13bc496 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.098312 Oct 29 20:55:45.727107 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1099/2115] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:45 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:45.760802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:45.761424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:45.767449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:45.767934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:45.768376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:45.769075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:45.769862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:45.770525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:45.851203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:45.861728 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-597313b3-dff5-4ed5-be1c-32fc7014ca71 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1266 microversion: 2.1 time: 0.104098 Oct 29 20:55:45.863624 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1017/2116] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:45 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:46.006523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:46.007428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:46.015281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:46.015881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:46.016377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:46.017200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:46.018258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:46.018787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:46.111003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:46.121629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:46.123848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:46.125304 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61feaaa9-6326-46fa-a046-5a78efbc0026 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1576 microversion: 2.42 time: 0.125014 Oct 29 20:55:46.138144 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1100/2117] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:45 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1576 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:46.349964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e39fa26-75f3-4a6d-8fbe-1449e4426ce2 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1710d3ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:46.393385 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e39fa26-75f3-4a6d-8fbe-1449e4426ce2 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.047715 Oct 29 20:55:46.394682 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1018/2118] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:46 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:46.757855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:46.759119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:46.775106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:46.775698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:46.776191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:46.778534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:46.779267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:46.779718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:46.886994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:46.887668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:46.897049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:46.897582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:46.898041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:46.898769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:46.899240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:46.899677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:46.915789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:46.938720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:46.951332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:46.956363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:46.964712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2958a981-acb7-4bd9-9ad7-1b481f7658c6 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.214185 Oct 29 20:55:46.965629 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1101/2119] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:46 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:47.139115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:47.150141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7abf19e-7745-4d50-9902-67330aed5a18 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.267560 Oct 29 20:55:47.150729 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1019/2120] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:46 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:47.153487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:47.154114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:47.169266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:47.169867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:47.170863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:47.171810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:47.172526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:47.173168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:47.174968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7438912e-1002-4f64-91bd-7f0cc2455a99 req-7bd87e83-0130-4aed-ba0d-35687727e1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9060230-1b76-4c8b-8dea-7936bfa7cacf", "tag": "de3b480a-5d12-4dcd-8fb4-722321458c00"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:47.188714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7438912e-1002-4f64-91bd-7f0cc2455a99 req-7bd87e83-0130-4aed-ba0d-35687727e1dc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:47.189639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7438912e-1002-4f64-91bd-7f0cc2455a99 req-7bd87e83-0130-4aed-ba0d-35687727e1dc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:47.190253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7438912e-1002-4f64-91bd-7f0cc2455a99 req-7bd87e83-0130-4aed-ba0d-35687727e1dc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:47.228554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7438912e-1002-4f64-91bd-7f0cc2455a99 req-7bd87e83-0130-4aed-ba0d-35687727e1dc service nova] Creating event network-changed:de3b480a-5d12-4dcd-8fb4-722321458c00 for instance e9060230-1b76-4c8b-8dea-7936bfa7cacf on nch2-master-1 Oct 29 20:55:47.235094 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7438912e-1002-4f64-91bd-7f0cc2455a99 req-7bd87e83-0130-4aed-ba0d-35687727e1dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067762 Oct 29 20:55:47.236075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1020/2121] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:55:47.251893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:47.257087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:47.265153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:47.266930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:47.268305 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b4a6d38-903d-4eb3-8ed6-9eacaee3c39d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1594 microversion: 2.42 time: 0.118770 Oct 29 20:55:47.285627 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1102/2122] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:47 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1594 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:47.412276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ebe7e0ca-2414-4c2d-9838-02a296842582 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1762dd160>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:47.507246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ebe7e0ca-2414-4c2d-9838-02a296842582 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.100871 Oct 29 20:55:47.515407 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1021/2123] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:47 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:47.995488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:47.996195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:48.028858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:48.029825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:48.030539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:48.031535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:48.032230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:48.032834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:48.174366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:48.175106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:48.206458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:48.207233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:48.209599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:48.210530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:48.213084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:48.213852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:48.305496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.322660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.328574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.364709 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-435d1c92-be72-4fb2-a469-9c8ec7f94457 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.358715 Oct 29 20:55:48.391171 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1103/2124] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:47 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:48.397510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:48.398857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:48.406366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:48.407284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:48.407946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:48.409652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:48.411155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:48.412691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:48.652716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.664263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b9403130-21cd-427c-a98f-7dc9a424716f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.494147 Oct 29 20:55:48.668694 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1022/2125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:48 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:48.679638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-17618a2d-e32f-4080-a237-ac5ac7c8cbbe tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171114160>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:48.770382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.782695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.784548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:48.786110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72e17fd2-6f3e-4b0f-ab2a-ec87c7ecc204 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1662 microversion: 2.42 time: 0.393447 Oct 29 20:55:48.799768 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1104/2126] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:48 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1662 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:49.396240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:49.398003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:49.412814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:49.413661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:49.414407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:49.421345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:49.422310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:49.423030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:49.572047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:49.588804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:49.590299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:49.605707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-354bf602-7b40-4d74-b99a-6d7c06c54e98 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1546 microversion: 2.91 time: 0.213543 Oct 29 20:55:49.606848 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1105/2127] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:49 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:49.694694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:49.696166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:49.713033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:49.713866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:49.714458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:49.715330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:49.715932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:49.716501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:49.869382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-17618a2d-e32f-4080-a237-ac5ac7c8cbbe tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 1.196565 Oct 29 20:55:49.874025 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1023/2128] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:48 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:49.930870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:49.934220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:49.962877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:49.967313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:49.968238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:49.973501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:49.978763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:49.980684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:50.145944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.166844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b934850-5a57-4c2f-8da8-8a512bf9e5fc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.475911 Oct 29 20:55:50.169820 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1106/2129] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:49 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:50.183626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-aad4761d-1ab4-4045-936d-2adff57e2b8f req-e84bdf68-d050-4569-a37b-f24026c9914a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "name": "network-vif-plugged", "status": "completed", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:50.230882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aad4761d-1ab4-4045-936d-2adff57e2b8f req-e84bdf68-d050-4569-a37b-f24026c9914a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:50.231375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aad4761d-1ab4-4045-936d-2adff57e2b8f req-e84bdf68-d050-4569-a37b-f24026c9914a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:50.235052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aad4761d-1ab4-4045-936d-2adff57e2b8f req-e84bdf68-d050-4569-a37b-f24026c9914a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:50.274468 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-aad4761d-1ab4-4045-936d-2adff57e2b8f req-e84bdf68-d050-4569-a37b-f24026c9914a service nova] Creating event network-vif-plugged:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:55:50.292937 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-aad4761d-1ab4-4045-936d-2adff57e2b8f req-e84bdf68-d050-4569-a37b-f24026c9914a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121411 Oct 29 20:55:50.297720 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1107/2130] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:50.356221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.376586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.383385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.384700 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-868cb9f3-c693-43bd-bd09-d0ab5659351b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1662 microversion: 2.42 time: 0.482112 Oct 29 20:55:50.386368 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1024/2131] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:49 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1662 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:50.637498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:50.638362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:50.656642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:50.663189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:50.665811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:50.666905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:50.667595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:50.669613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:50.793103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.806976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.808978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:50.822905 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-124de47c-b0da-4001-b991-ec1b766a5c9c tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1533 microversion: 2.91 time: 0.190596 Oct 29 20:55:50.825015 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1108/2132] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:50 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1533 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:50.854222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:50.855528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:50.863793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:50.865327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:50.866229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:50.875182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:50.877134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:50.878222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:50.884777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31ac26d5-d99f-4e66-b55a-a86257d9a77b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1710c9550>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:50.964874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31ac26d5-d99f-4e66-b55a-a86257d9a77b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.083006 Oct 29 20:55:50.965501 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1109/2133] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:50 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:51.027123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] Lazy-loading 'services' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:55:51.053406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2aac691-f911-4688-868d-41de72341e67 tempest-UnshelveToHostMultiNodesTest-1148096178 tempest-UnshelveToHostMultiNodesTest-1148096178-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1938 microversion: 2.91 time: 0.202915 Oct 29 20:55:51.054940 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1025/2134] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:50 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1938 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:55:51.109806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:51.110444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:51.120713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.120713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.120713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.121309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.122220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.122927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.163723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:55:51.192568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:51.193577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:51.203942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.204432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.204882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.205637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.206105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.206540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.351828 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3157ff66-08c0-449c-90ab-9baf4dc5fedf tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 204 len: 0 microversion: 2.91 time: 0.247072 Oct 29 20:55:51.352800 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1110/2135] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:55:51 2022] DELETE /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:55:51.369777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:51.370619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:51.383115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.383602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.384086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.384746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.385198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.385656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.521937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.537322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.542425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.557295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:51.559670 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-741dda65-00e1-48d1-9016-7a277f4d4927 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.202194 Oct 29 20:55:51.563739 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1111/2136] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:51 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:51.564624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.573132 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b587cded-1e6e-4930-9b3b-9bdb50a4452c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.385802 Oct 29 20:55:51.578691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1026/2137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:51 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:51.585880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:51.593344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:51.608146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.608570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.609007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.609737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:51.610204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:51.611383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:51.937637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.952339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.954495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:51.955931 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1e72b60-acdf-44f6-a57c-c4889ea7c2f8 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1756 microversion: 2.42 time: 0.390297 Oct 29 20:55:51.957911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1112/2138] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:51 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1756 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:51.982872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-72b4ed5b-4bdf-4858-a617-5378687f3673 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1711210d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:52.062320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-72b4ed5b-4bdf-4858-a617-5378687f3673 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.083262 Oct 29 20:55:52.062903 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1027/2139] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:51 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:52.592391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:52.594103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:52.600827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:52.601852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:52.615808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:52.618397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:52.619261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:52.620061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:52.621011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:52.621999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:52.622655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:52.623315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:52.625289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:52.625820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:52.627762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:52.628480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:52.844557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:52.860585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:52.866525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:52.877515 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-47185609-fc5b-4f83-9078-afb58191a629 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1539 microversion: 2.91 time: 0.288974 Oct 29 20:55:52.884155 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1113/2140] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:52 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:52.944947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:52.985976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:52.986604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:52.988834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:53.001791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:53.002552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:53.004241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:53.007296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:53.009656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:53.010355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:53.030384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:53.046547 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c17e841d-f7ca-42e2-afcf-b3ad988c56ea tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.445715 Oct 29 20:55:53.047845 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1028/2141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:52 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:53.078760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36827aa8-70ef-4d68-a292-3a90d5ba920a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171070310>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:53.168662 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36827aa8-70ef-4d68-a292-3a90d5ba920a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.093716 Oct 29 20:55:53.171358 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1029/2142] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:53 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:53.254649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:53.267059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:53.268628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:53.270677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b76ad17-5e2e-4c50-8378-fed733604c80 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1803 microversion: 2.42 time: 0.289210 Oct 29 20:55:53.271726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1114/2143] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:52 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1803 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:55:53.915314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:53.916190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:53.935825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:53.936570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:53.937058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:53.937839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:53.938312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:53.940844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:53.963895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-484c1d02-84d6-403e-897b-4110cdb267b3 req-5bfea150-2958-4454-9517-864ee8dbb32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9060230-1b76-4c8b-8dea-7936bfa7cacf", "name": "network-vif-plugged", "status": "completed", "tag": "de3b480a-5d12-4dcd-8fb4-722321458c00"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:53.973103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:53.982807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-484c1d02-84d6-403e-897b-4110cdb267b3 req-5bfea150-2958-4454-9517-864ee8dbb32a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:53.983585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-484c1d02-84d6-403e-897b-4110cdb267b3 req-5bfea150-2958-4454-9517-864ee8dbb32a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:53.984593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-484c1d02-84d6-403e-897b-4110cdb267b3 req-5bfea150-2958-4454-9517-864ee8dbb32a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:54.002957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-484c1d02-84d6-403e-897b-4110cdb267b3 req-5bfea150-2958-4454-9517-864ee8dbb32a service nova] Creating event network-vif-plugged:de3b480a-5d12-4dcd-8fb4-722321458c00 for instance e9060230-1b76-4c8b-8dea-7936bfa7cacf on nch2-master-1 Oct 29 20:55:54.010053 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-484c1d02-84d6-403e-897b-4110cdb267b3 req-5bfea150-2958-4454-9517-864ee8dbb32a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050281 Oct 29 20:55:54.011993 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1115/2144] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:54.074177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:54.074893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:54.085914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:54.086418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:54.089003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:54.093074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:54.093759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:54.094349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:54.394967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.406807 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f931c528-b05e-48e4-8fea-2dbcee5cda83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.337136 Oct 29 20:55:54.411995 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1116/2145] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:54 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:54.426112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4a441cd-c199-4635-97bc-24b8b9102d24 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171375700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:54.430604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:54.431510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:54.432087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:54.433300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lazy-loading 'fault' on Instance uuid 4ad51716-7b03-4254-8557-3ca69423621c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:55:54.489623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.510955 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4a441cd-c199-4635-97bc-24b8b9102d24 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.096383 Oct 29 20:55:54.512053 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1117/2146] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:54 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:54.520151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.525485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6550a74432294bf986cb02f6f73ed556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9971a4c060c460ab18788a4d41cec48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.527427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:54.533165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:54.547492 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84a90775-9dfb-414b-ba2e-09ea3919bacd tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 200 len: 1544 microversion: 2.91 time: 0.637647 Oct 29 20:55:54.549147 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1030/2147] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:53 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 1544 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:54.549676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:54.550869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:54.552767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:54.555239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:54.555881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:54.556325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:54.782954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.798152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.799934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:54.801771 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-29e6c94f-084c-4d2c-a409-0d46e1519454 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1838 microversion: 2.42 time: 0.288615 Oct 29 20:55:54.802524 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1118/2148] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:54 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1838 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:55.399798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3797bbd7-fd18-4b06-9d43-9f508db1732f req-69ba5bab-2659-4ab0-ba71-50ed5fa43002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "99491349-fec3-4967-9bed-d1945e2bccad"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:55.412206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=10 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:55.430569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3797bbd7-fd18-4b06-9d43-9f508db1732f req-69ba5bab-2659-4ab0-ba71-50ed5fa43002 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.430569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3797bbd7-fd18-4b06-9d43-9f508db1732f req-69ba5bab-2659-4ab0-ba71-50ed5fa43002 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.431299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3797bbd7-fd18-4b06-9d43-9f508db1732f req-69ba5bab-2659-4ab0-ba71-50ed5fa43002 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:55.440987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:55.441627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:55.444424 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3797bbd7-fd18-4b06-9d43-9f508db1732f req-69ba5bab-2659-4ab0-ba71-50ed5fa43002 service nova] Creating event network-changed:99491349-fec3-4967-9bed-d1945e2bccad for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:55:55.451362 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3797bbd7-fd18-4b06-9d43-9f508db1732f req-69ba5bab-2659-4ab0-ba71-50ed5fa43002 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059339 Oct 29 20:55:55.452075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1031/2149] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:55.453763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.458064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.458869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:55.460597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.462620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.464443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:55.527997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-41466672-819a-4190-92b8-d93feecaabdd tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171070e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:55.595057 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-41466672-819a-4190-92b8-d93feecaabdd tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.071873 Oct 29 20:55:55.597225 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1032/2150] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:55 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:55.610923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:55.612302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] [instance: 4ad51716-7b03-4254-8557-3ca69423621c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:55.616025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:55.629270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.630106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.630692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:55.631705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.632605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.633184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:55.676984 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] HTTP exception thrown: Instance 4ad51716-7b03-4254-8557-3ca69423621c could not be found. Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Request method failure captured: Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c HTTP/1.1 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZKdXe1exPScCpfTeft3PlVJYmoXLzpSritsfL1ALTFJ_7v-wkYWc5yYGNIzHXZH_rsuqRKnaa6F1bCX2KkVqZu9u8W91XW4lhU_3huf4_1GSfwzNFDqkLxgo9XE61Feh8nzwo4J2uEGYIMW9t-nAC9L-so_BTFIDTxYKuenrNzwHis Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.91 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b9971a4c060c460ab18788a4d41cec48 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-856584608 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b9971a4c060c460ab18788a4d41cec48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b9971a4c060c460ab18788a4d41cec48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b9971a4c060c460ab18788a4d41cec48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b9971a4c060c460ab18788a4d41cec48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-856584608 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b9971a4c060c460ab18788a4d41cec48 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-856584608 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-UnshelveToHostMultiNodesTest-856584608-project Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6550a74432294bf986cb02f6f73ed556 Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-856584608-project Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4ad51716-7b03-4254-8557-3ca69423621c could not be found. Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4ad51716-7b03-4254-8557-3ca69423621c'} Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad51716-7b03-4254-8557-3ca69423621c could not be found. Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad51716-7b03-4254-8557-3ca69423621c could not be found. Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:55.679113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad51716-7b03-4254-8557-3ca69423621c could not be found. Oct 29 20:55:55.682847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:55:55.683639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] Returning 404 to user: Instance 4ad51716-7b03-4254-8557-3ca69423621c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:55:55.684519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2a0d7dc-ee05-4e6b-a5c2-7347b5116307 tempest-UnshelveToHostMultiNodesTest-856584608 tempest-UnshelveToHostMultiNodesTest-856584608-project] 10.222.0.36 "GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c" status: 404 len: 111 microversion: 2.91 time: 0.084652 Oct 29 20:55:55.685100 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1033/2151] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:55 2022] GET /compute/v2.1/servers/4ad51716-7b03-4254-8557-3ca69423621c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:55:55.815230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:55.832705 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90513e04-ce4a-437a-88b7-284f8d88b93c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1308 microversion: 2.1 time: 0.396078 Oct 29 20:55:55.834388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1119/2152] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:55 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:55.838036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:55.838961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:55.854014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.870301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.870796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:55.871974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:55.872517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:55.872951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:56.292228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:56.304207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:56.305592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:56.306763 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b5296418-73d6-49c9-86a2-65cb5ad0828e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1838 microversion: 2.42 time: 0.476953 Oct 29 20:55:56.307584 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1034/2153] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:55 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1838 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:56.620646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93ff897a-880b-473e-8010-9df1a7f50321 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1712ab3a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:56.724188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93ff897a-880b-473e-8010-9df1a7f50321 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.115885 Oct 29 20:55:56.725371 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1120/2154] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:56 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:56.860987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:56.862412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:56.871354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:56.872301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:56.872989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:56.873965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:56.874676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:56.875512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.065093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:57.073847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4e53c1ea-4dba-41ee-8c0f-cd62e0a6f0ff tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1488 microversion: 2.1 time: 0.217358 Oct 29 20:55:57.092723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1035/2155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:56 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1488 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:55:57.106659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:57.107238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:57.120581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.121088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.122945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.123705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.124177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.124618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.186521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lazy-loading 'flavor' on Instance uuid e9060230-1b76-4c8b-8dea-7936bfa7cacf {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:55:57.263980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:55:57.336412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:57.338860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:57.348861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9db9fd41-ac13-4058-aab0-43f0841398d9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf/action" status: 202 len: 0 microversion: 2.1 time: 0.254092 Oct 29 20:55:57.353585 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1121/2156] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:55:57 2022] POST /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:55:57.377244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:57.380239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.380767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.381087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:57.381272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.385441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.387773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.390050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.403892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.408191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.408725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.409497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.410781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.411237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.837413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:57.858804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:57.860547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:57.865515 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f7e4e5d3-61ee-4810-b4da-9e712407ef8e tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1859 microversion: 2.42 time: 0.533689 Oct 29 20:55:57.883878 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1036/2157] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:57 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1859 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:57.883878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-08033f9a-5148-43d3-ad81-081cd38a07a2 req-4ea432aa-6a30-4005-91fe-8ffee99edabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "05d7ea0c-d052-4d7e-a462-6503fe5f5642"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:57.895066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08033f9a-5148-43d3-ad81-081cd38a07a2 req-4ea432aa-6a30-4005-91fe-8ffee99edabb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:57.895576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08033f9a-5148-43d3-ad81-081cd38a07a2 req-4ea432aa-6a30-4005-91fe-8ffee99edabb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:57.896027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08033f9a-5148-43d3-ad81-081cd38a07a2 req-4ea432aa-6a30-4005-91fe-8ffee99edabb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:57.934681 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-08033f9a-5148-43d3-ad81-081cd38a07a2 req-4ea432aa-6a30-4005-91fe-8ffee99edabb service nova] Creating event network-changed:05d7ea0c-d052-4d7e-a462-6503fe5f5642 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:55:57.941791 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-08033f9a-5148-43d3-ad81-081cd38a07a2 req-4ea432aa-6a30-4005-91fe-8ffee99edabb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072733 Oct 29 20:55:57.943570 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1037/2158] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:55:57.951089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35d97cff-479b-49cf-9fbb-bbbf9ac2b209 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176205c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:58.005812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:58.022803 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35d97cff-479b-49cf-9fbb-bbbf9ac2b209 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.077653 Oct 29 20:55:58.036868 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1038/2159] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:57 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:58.043373 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d988e51-9e0b-4285-b154-10abc58b0604 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1496 microversion: 2.1 time: 0.678743 Oct 29 20:55:58.044724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1122/2160] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:57 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1496 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:58.892802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:58.893746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:58.915930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:58.916438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:58.916888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:58.923120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:58.923980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:58.927021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.040853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1551c1b7-69f0-487c-a28e-ea2c1d027b53 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1712f2700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:59.134037 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1551c1b7-69f0-487c-a28e-ea2c1d027b53 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.097569 Oct 29 20:55:59.151606 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1123/2161] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:55:59 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:59.159232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:59.159908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:59.188247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.188752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.189200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.189971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.190433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.192984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.413723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.424747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.437151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.438539 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af6deb0e-f67f-4fed-8a74-87e1f9dc900b tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.550783 Oct 29 20:55:59.439111 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1039/2162] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:55:58 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:55:59.519573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:59.528050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.529104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Searching by: {'deleted': False, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:55:59.542633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.544494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.545143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.547937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.549793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.551075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.600143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:55:59.602812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.612772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c2eb234-1ade-4065-88d2-6fe666a1edf8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 200 len: 1479 microversion: 2.1 time: 0.461795 Oct 29 20:55:59.619063 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1124/2163] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:55:59 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 1479 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:55:59.646178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1336851982"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:55:59.649009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:55:59.651683 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-68b664e3-670e-4e14-b235-f012b872bc53 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.136502 Oct 29 20:55:59.652498 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1040/2164] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:55:59 2022] GET /compute/v2.1/servers => generated 333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:55:59.657558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.658472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.659137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.661922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.662737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.663987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.669681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:55:59.682870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.685254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Searching by: {'deleted': False, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:55:59.712223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.713078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.713727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.715125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.716121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.716770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:55:59.774273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:55:59.845704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:55:59.857513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:55:59.858002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:55:59.858446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:00.130440 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38837dac-3ddc-4523-a650-64df898fa7f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf/action" status: 202 len: 0 microversion: 2.1 time: 0.489359 Oct 29 20:56:00.131792 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1125/2165] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:55:59 2022] POST /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 29 20:56:00.137305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-54122af5-06a5-4933-8573-b1f6b946610b req-2a8654dc-cbc7-4617-a838-02215c40bdbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "694c1168-38a2-4247-b315-9261c3f49f31"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:00.149874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-54122af5-06a5-4933-8573-b1f6b946610b req-2a8654dc-cbc7-4617-a838-02215c40bdbb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:00.150571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-54122af5-06a5-4933-8573-b1f6b946610b req-2a8654dc-cbc7-4617-a838-02215c40bdbb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:00.151205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-54122af5-06a5-4933-8573-b1f6b946610b req-2a8654dc-cbc7-4617-a838-02215c40bdbb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:00.166093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-54122af5-06a5-4933-8573-b1f6b946610b req-2a8654dc-cbc7-4617-a838-02215c40bdbb service nova] Creating event network-changed:694c1168-38a2-4247-b315-9261c3f49f31 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:00.175824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-54122af5-06a5-4933-8573-b1f6b946610b req-2a8654dc-cbc7-4617-a838-02215c40bdbb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042372 Oct 29 20:56:00.176964 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1126/2166] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:00.186708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c8ba0171-c961-4916-b967-2860f5581104 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1712f2280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.275915 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c8ba0171-c961-4916-b967-2860f5581104 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.096919 Oct 29 20:56:00.276892 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1127/2167] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:00.299676 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2126af8-c790-4ea2-b013-b948a5d89ddb tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.637412 Oct 29 20:56:00.301941 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1041/2168] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:55:59 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:00.318331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3d1d639d-ad8e-4e22-8aaf-805cd78268a5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1762059d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.384967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3d1d639d-ad8e-4e22-8aaf-805cd78268a5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.081742 Oct 29 20:56:00.388700 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1042/2169] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:00.393374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3376b47-6ec2-4cc0-9e2f-f9c5a4d076cf tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.417966 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3376b47-6ec2-4cc0-9e2f-f9c5a4d076cf tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027914 Oct 29 20:56:00.428238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1043/2170] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:00.470194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.471018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:00.483261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:00.483768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:00.484220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:00.484947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:00.485411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:00.485998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:00.538883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4c8dc0d-d982-42aa-85e7-eb20660d2279 tempest-ListImagesTestJSON-568722837 tempest-ListImagesTestJSON-568722837-project] Calling method '.version_select at 0x7fa171375820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.594824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4c8dc0d-d982-42aa-85e7-eb20660d2279 tempest-ListImagesTestJSON-568722837 tempest-ListImagesTestJSON-568722837-project] 10.222.0.36 "GET /compute/v2.1/images/1a2bec42-cf5e-436b-826e-51ea67e041f7" status: 200 len: 784 microversion: 2.1 time: 0.316017 Oct 29 20:56:00.595777 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1128/2171] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/images/1a2bec42-cf5e-436b-826e-51ea67e041f7 => generated 784 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:00.619373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa0e958e-3fa1-4957-8f65-84b38dca70e6 tempest-ListImagesTestJSON-568722837 tempest-ListImagesTestJSON-568722837-project] Calling method '.version_select at 0x7fa1712f2700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.724634 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa0e958e-3fa1-4957-8f65-84b38dca70e6 tempest-ListImagesTestJSON-568722837 tempest-ListImagesTestJSON-568722837-project] 10.222.0.36 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.116478 Oct 29 20:56:00.725672 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1129/2172] 10.222.0.36 () {58 vars in 1122 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/images => generated 871 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:56:00.743102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55866137-2d7f-4c78-becf-c8130b725d23 tempest-ListImagesTestJSON-568722837 tempest-ListImagesTestJSON-568722837-project] Calling method '.version_select at 0x7fa171375d30>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.835188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55866137-2d7f-4c78-becf-c8130b725d23 tempest-ListImagesTestJSON-568722837 tempest-ListImagesTestJSON-568722837-project] 10.222.0.36 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.098559 Oct 29 20:56:00.840135 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1130/2173] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:00.926192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:00.927570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:00.941504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:00.943453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:00.944074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:00.945118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:00.946644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:00.947940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:01.017981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:56:01.062285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:01.065982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:01.079135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:01.080708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:01.086697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31740187-33a1-44d1-ad97-a8bd6ce676bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.622784 Oct 29 20:56:01.097982 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1044/2174] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:00 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:56:01.190761 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc8a3be8-4718-4176-969b-d48750efacae tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "DELETE /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 204 len: 0 microversion: 2.1 time: 0.269371 Oct 29 20:56:01.192375 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1131/2175] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:56:00 2022] DELETE /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:01.201890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:01.201890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:01.210685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:01.211526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:01.211933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:01.212652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:01.213114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:01.213573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:01.294708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-018fc118-c36f-45df-bc2e-accd61514cd8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa172533040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:01.382325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-018fc118-c36f-45df-bc2e-accd61514cd8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.093083 Oct 29 20:56:01.383415 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1132/2176] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:01 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:01.401620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5321155-3b8f-4d65-b492-612757c96eb9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171411040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:01.488150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:01.498349 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5321155-3b8f-4d65-b492-612757c96eb9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.100742 Oct 29 20:56:01.500849 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96208494-dc58-42a3-8141-17a8014a944c tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1699 microversion: 2.1 time: 0.304655 Oct 29 20:56:01.502211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1045/2177] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:01 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1699 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:01.508272 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1133/2178] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:01 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:02.115865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:02.117006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:02.135920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:02.136657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:02.137249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:02.138254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:02.139146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:02.140888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:02.223477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "498fed4d-2d39-41a9-aa73-628dd56d08c4"}, {"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "0edb5772-4240-4851-ad33-8160a8554967"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:02.233615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:02.234030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:02.234470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:02.247503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] Creating event network-changed:498fed4d-2d39-41a9-aa73-628dd56d08c4 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:02.248029 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] Creating event network-changed:0edb5772-4240-4851-ad33-8160a8554967 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:02.255021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ebe5ff03-992e-4775-b9bf-f3ca20377986 req-841088bd-2f7b-4ddf-9ca9-4fc002706fce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041837 Oct 29 20:56:02.255973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1134/2179] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:02.400629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d72c149e-50e8-40d6-ba17-3c772c1e0ce9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1712f2ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:02.447165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:02.459899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:02.461762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:02.463495 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25fd0937-87b2-4d8b-8224-30e9d66f9c50 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.353019 Oct 29 20:56:02.465061 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1046/2180] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:02 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:02.495499 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d72c149e-50e8-40d6-ba17-3c772c1e0ce9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.099640 Oct 29 20:56:02.498750 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1135/2181] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:02 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:02.521597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a58526a6-1ea8-403b-a178-af473112c332 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176257af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:02.529132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:02.530201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:02.539037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:02.539973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:02.540635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:02.551620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:02.553604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:02.557653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:02.602976 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a58526a6-1ea8-403b-a178-af473112c332 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1421 microversion: 2.1 time: 0.091244 Oct 29 20:56:02.628528 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1047/2182] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:02 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:02.791401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:02.805482 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ffa4bcd-2607-4325-8054-d9274c29e725 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1699 microversion: 2.1 time: 0.281441 Oct 29 20:56:02.815506 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1136/2183] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:02 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1699 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:03.493929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:03.494934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:03.512884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be7b823b-499a-4863-a587-a11364e8070e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17111d670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:03.524021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:03.525205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:03.526106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:03.526884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:03.527462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:03.527993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:03.746026 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be7b823b-499a-4863-a587-a11364e8070e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.237475 Oct 29 20:56:03.748707 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1137/2184] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:03 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:03.761299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:03.762841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:03.789995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:03.791492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:03.792695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:03.794187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:03.796289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:03.798127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.303210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:04.330108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:04.336366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:04.346115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af6166f8-acc7-45f2-9bc5-f348b1e35219 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.858297 Oct 29 20:56:04.349532 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1048/2185] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:03 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:04.366846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5623b915-d845-4451-8869-55bbcda31ab4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1762578b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:04.421970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:04.450749 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92954cfb-cce7-4df6-a86d-3c416345ed96 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 2341 microversion: 2.25 time: 0.699982 Oct 29 20:56:04.453061 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1138/2186] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:03 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 2341 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:04.488403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:04.494801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:04.508929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.511527 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5623b915-d845-4451-8869-55bbcda31ab4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1430 microversion: 2.1 time: 0.159740 Oct 29 20:56:04.512611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1049/2187] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:04 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1430 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:04.516814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.518024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.519522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.522309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.522920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.529310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:04.538303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.539085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.539768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.540901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.541865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.542552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.583683 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-836a5c60-ea52-4f41-9a16-89776d4432b4 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067235 Oct 29 20:56:04.587469 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1050/2188] 10.222.0.36 () {60 vars in 1217 bytes} [Sat Oct 29 20:56:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:56:04.605278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d959c1dc-074d-4d95-8475-be954235f747 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176257b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:04.691280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:04.702030 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be1c52f4-3cb9-4407-b907-b885d796f2e8 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1632 microversion: 2.1 time: 0.231248 Oct 29 20:56:04.712105 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d959c1dc-074d-4d95-8475-be954235f747 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 200 len: 1430 microversion: 2.1 time: 0.123381 Oct 29 20:56:04.721542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1051/2189] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:04 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 1430 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:04.721723 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1139/2190] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:04 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1632 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:04.727620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:04.728258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:04.731999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bae199c5-5e1e-40ae-82b2-46ff2c6b43da req-3664daaf-c9c8-46a3-97e8-464320a756cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "abaf2156-3eee-4776-87af-f4ae60c180d6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:04.741233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.743800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.744598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.746030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.749079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.750523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.759560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bae199c5-5e1e-40ae-82b2-46ff2c6b43da req-3664daaf-c9c8-46a3-97e8-464320a756cc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:04.760756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bae199c5-5e1e-40ae-82b2-46ff2c6b43da req-3664daaf-c9c8-46a3-97e8-464320a756cc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:04.762708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bae199c5-5e1e-40ae-82b2-46ff2c6b43da req-3664daaf-c9c8-46a3-97e8-464320a756cc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:04.801036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bae199c5-5e1e-40ae-82b2-46ff2c6b43da req-3664daaf-c9c8-46a3-97e8-464320a756cc service nova] Creating event network-changed:abaf2156-3eee-4776-87af-f4ae60c180d6 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:04.821519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bae199c5-5e1e-40ae-82b2-46ff2c6b43da req-3664daaf-c9c8-46a3-97e8-464320a756cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106943 Oct 29 20:56:04.822501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1052/2191] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:04.834540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aaf14e1e-7001-4aed-8b22-23d4048c5edf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa176257790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:04.948320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aaf14e1e-7001-4aed-8b22-23d4048c5edf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.124237 Oct 29 20:56:04.949111 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1053/2192] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:04 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:05.148881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:05.160395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34a4ab90-bf8b-4455-9d7e-b33dbb0e60a3 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1478 microversion: 2.1 time: 0.434909 Oct 29 20:56:05.162513 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1140/2193] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:04 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1478 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:05.355049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2d3233dd-a50b-4f74-b235-cd013c713795 req-23d5e2d7-0a1f-41b9-ac21-428a76275f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062626ca-4f09-4b7e-95d4-ee0863ed0c5c", "name": "network-vif-deleted", "tag": "00ea2301-2ab7-4ade-8d5e-2642c240c912"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:05.379279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:05.380463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:05.394893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:05.411077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:05.412404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:05.413324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:05.414366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:05.415125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:05.426198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2d3233dd-a50b-4f74-b235-cd013c713795 req-23d5e2d7-0a1f-41b9-ac21-428a76275f43 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:05.427970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2d3233dd-a50b-4f74-b235-cd013c713795 req-23d5e2d7-0a1f-41b9-ac21-428a76275f43 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:05.436376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2d3233dd-a50b-4f74-b235-cd013c713795 req-23d5e2d7-0a1f-41b9-ac21-428a76275f43 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:05.463692 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2d3233dd-a50b-4f74-b235-cd013c713795 req-23d5e2d7-0a1f-41b9-ac21-428a76275f43 service nova] Creating event network-vif-deleted:00ea2301-2ab7-4ade-8d5e-2642c240c912 for instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c on nch2-master-1 Oct 29 20:56:05.480639 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2d3233dd-a50b-4f74-b235-cd013c713795 req-23d5e2d7-0a1f-41b9-ac21-428a76275f43 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131557 Oct 29 20:56:05.484893 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1054/2194] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:05.736805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:05.740927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:05.771872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:05.777576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:05.781343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:05.786451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:05.791248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:05.793055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:05.836612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:05.851875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:05.863857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:05.867257 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f506a4dd-8f62-43e2-8ce0-dbd5c6e4c050 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.493425 Oct 29 20:56:05.870058 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1141/2195] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:05 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:05.965541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f64038f-5c11-414f-b71c-813b3f77fecc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1710a69d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:05.979887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:05.982789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:05.984718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:05.987626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lazy-loading 'fault' on Instance uuid 062626ca-4f09-4b7e-95d4-ee0863ed0c5c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:06.083444 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f64038f-5c11-414f-b71c-813b3f77fecc tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.122865 Oct 29 20:56:06.084638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1142/2196] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:05 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:06.142931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f84fe9b29a440c997864e7b81e78a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25be1fabab794bdd8cafcbf0a5e057ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:06.170884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f425d661-e181-4fa7-845a-14b58e7c0900 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 200 len: 1359 microversion: 2.1 time: 0.444194 Oct 29 20:56:06.173622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1055/2197] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:05 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 1359 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:06.187749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:06.188625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:06.203313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:06.203845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:06.204307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:06.205065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:06.207716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:06.208180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:06.589024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f151151-e569-44ac-bce7-7e64e381bfb2", "device": "/dev/xvdb"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:06.595683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:06.603827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:06.604577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:06.605229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:06.606194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:06.606897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:06.607515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.091974 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b25f3b8-47e2-4952-8881-166a90b354aa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "POST /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.505659 Oct 29 20:56:07.092735 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1056/2198] 10.222.0.36 () {62 vars in 1364 bytes} [Sat Oct 29 20:56:06 2022] POST /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:56:07.135052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d0e7b59f-7317-4021-b564-c42500e98496 req-e29f54fd-e4b5-4589-be2b-81db7fca5880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9060230-1b76-4c8b-8dea-7936bfa7cacf", "name": "network-vif-plugged", "status": "completed", "tag": "de3b480a-5d12-4dcd-8fb4-722321458c00"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:07.171664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d0e7b59f-7317-4021-b564-c42500e98496 req-e29f54fd-e4b5-4589-be2b-81db7fca5880 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:07.172175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d0e7b59f-7317-4021-b564-c42500e98496 req-e29f54fd-e4b5-4589-be2b-81db7fca5880 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:07.172616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d0e7b59f-7317-4021-b564-c42500e98496 req-e29f54fd-e4b5-4589-be2b-81db7fca5880 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.184471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:07.200941 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9221383-67e0-4161-965e-f989aad66312 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1465 microversion: 2.1 time: 1.017974 Oct 29 20:56:07.201567 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1143/2199] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:06 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1465 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:07.230773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:07.230773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:07.230947 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d0e7b59f-7317-4021-b564-c42500e98496 req-e29f54fd-e4b5-4589-be2b-81db7fca5880 service nova] Creating event network-vif-plugged:de3b480a-5d12-4dcd-8fb4-722321458c00 for instance e9060230-1b76-4c8b-8dea-7936bfa7cacf on nch2-master-1 Oct 29 20:56:07.252897 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d0e7b59f-7317-4021-b564-c42500e98496 req-e29f54fd-e4b5-4589-be2b-81db7fca5880 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155926 Oct 29 20:56:07.254190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:07.262775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1057/2200] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:07.264771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:07.266117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.269330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:07.270470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:07.271030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.273406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c5e20faf-27f2-4ea9-be01-28151b0bc211 req-225d33bc-80af-40e4-874c-5eff6d8a4905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "4f8b913f-10da-41e4-a3f2-8e6662803dda"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:07.301489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c5e20faf-27f2-4ea9-be01-28151b0bc211 req-225d33bc-80af-40e4-874c-5eff6d8a4905 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:07.302246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c5e20faf-27f2-4ea9-be01-28151b0bc211 req-225d33bc-80af-40e4-874c-5eff6d8a4905 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:07.309534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c5e20faf-27f2-4ea9-be01-28151b0bc211 req-225d33bc-80af-40e4-874c-5eff6d8a4905 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.342280 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c5e20faf-27f2-4ea9-be01-28151b0bc211 req-225d33bc-80af-40e4-874c-5eff6d8a4905 service nova] Creating event network-changed:4f8b913f-10da-41e4-a3f2-8e6662803dda for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:07.365146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c5e20faf-27f2-4ea9-be01-28151b0bc211 req-225d33bc-80af-40e4-874c-5eff6d8a4905 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100005 Oct 29 20:56:07.367738 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1058/2201] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:07.378009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e689e421-2aee-4679-8948-7f98d1a09a40 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa176280550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:07.495474 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e689e421-2aee-4679-8948-7f98d1a09a40 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.126249 Oct 29 20:56:07.503707 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1059/2202] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:07 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:07.508759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:07.515134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] [instance: 062626ca-4f09-4b7e-95d4-ee0863ed0c5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:07.545856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:07.551771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:07.554976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.558159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:07.560693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:07.561313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:07.619463 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] HTTP exception thrown: Instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c could not be found. Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Request method failure captured: Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c HTTP/1.1 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZMbFA4RHtrzwgQOlnjpbCegvd77_1NO2BpsusUi8Z7XE_hRSkFLk3vSgr0_eVIikZjtnASdgxNE674PSLR00pEPJzx2TZz-wr4jMR1ioW2O0UOPzY7BGQqsdjVfWTyznqkrJcT1zxVcWvZWJsag_6qQWHfGYhoDwZi4Bzn5uEUoDdk Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 25be1fabab794bdd8cafcbf0a5e057ee Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-1829403402 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25be1fabab794bdd8cafcbf0a5e057ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25be1fabab794bdd8cafcbf0a5e057ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25be1fabab794bdd8cafcbf0a5e057ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25be1fabab794bdd8cafcbf0a5e057ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-1829403402 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 25be1fabab794bdd8cafcbf0a5e057ee Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-1829403402 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-1829403402-project Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 28f84fe9b29a440c997864e7b81e78a8 Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-1829403402-project Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c could not be found. Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '062626ca-4f09-4b7e-95d4-ee0863ed0c5c'} Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c could not be found. Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c could not be found. Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:07.627647 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c could not be found. Oct 29 20:56:07.633651 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:07.635948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Returning 404 to user: Instance 062626ca-4f09-4b7e-95d4-ee0863ed0c5c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:07.638405 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2a9730d5-34d9-468c-91cb-1a0478ad41f1 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c" status: 404 len: 111 microversion: 2.1 time: 0.133462 Oct 29 20:56:07.642879 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1060/2203] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:07 2022] GET /compute/v2.1/servers/062626ca-4f09-4b7e-95d4-ee0863ed0c5c => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:56:07.664620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d85620ae-1c00-448d-b291-73c0fadab8e6 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1762e8670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:07.763590 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d85620ae-1c00-448d-b291-73c0fadab8e6 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/1a2bec42-cf5e-436b-826e-51ea67e041f7" status: 200 len: 784 microversion: 2.1 time: 0.116874 Oct 29 20:56:07.774045 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1061/2204] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:07 2022] GET /compute/v2.1/images/1a2bec42-cf5e-436b-826e-51ea67e041f7 => generated 784 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:07.784194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5ae65285-7c8c-491b-9a6a-3cbd285ea764 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] Calling method '.version_select at 0x7fa171114ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:07.825718 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5ae65285-7c8c-491b-9a6a-3cbd285ea764 tempest-ServersTestJSON-1829403402 tempest-ServersTestJSON-1829403402-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175714233" status: 202 len: 0 microversion: 2.1 time: 0.050086 Oct 29 20:56:07.829307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1062/2205] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 20:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175714233 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:07.835941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4bf2ad49-7b31-4738-a312-609d5d52045f tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:07.858358 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4bf2ad49-7b31-4738-a312-609d5d52045f tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027188 Oct 29 20:56:07.859007 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1063/2206] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 20:56:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:07.885402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21b85d57-301c-45e8-b0c1-bbe66fabf14f tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1711141f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:08.810789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:08.825700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:08.827162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:08.828339 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1bf372cb-82d9-4978-951c-5965fbe51c02 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 1.619709 Oct 29 20:56:08.828911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1144/2207] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:07 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:08.855993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-deea45df-62d5-437d-8365-13c75c39612d tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1713aee50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:08.860115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-21b85d57-301c-45e8-b0c1-bbe66fabf14f tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "DELETE /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 204 len: 0 microversion: 2.1 time: 0.989367 Oct 29 20:56:08.864805 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1064/2208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:07 2022] DELETE /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 0 bytes in 991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:08.869758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c86975c-10b8-4b19-99fc-6d783d513cf9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176257820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:08.960505 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-8c86975c-10b8-4b19-99fc-6d783d513cf9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] HTTP exception thrown: Image not found. Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c86975c-10b8-4b19-99fc-6d783d513cf9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Request method failure captured: Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d HTTP/1.1 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZM7tfNAnLyf60iKh9BmxwE_TT7ynCIkM4p6F8U_poDHpU8IVr_RoFJyaTYYVehHlLKusPGPO3joAXXs-QNUr3xdorwSnqkM8pPWG-Qqp0DkWEq3mYqv_t7PQvKpA7AiPq4V1cJgxlK0v6XiWedH68pvGQWPITkJUUEZsQSimUejSlc Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ca557cc6cfbc46f4a1b236d51e841818 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ca557cc6cfbc46f4a1b236d51e841818 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerTestJSON-815154293-project Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7d8a34d7d9d4f2cb5fe7c37f596c09f Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerTestJSON-815154293-project Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '02d6b623-9871-45d1-b6fd-09c12443857d'} Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02d6b623-9871-45d1-b6fd-09c12443857d Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:56:08.962557 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02d6b623-9871-45d1-b6fd-09c12443857d could not be found. Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c86975c-10b8-4b19-99fc-6d783d513cf9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:08.965837 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c86975c-10b8-4b19-99fc-6d783d513cf9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 404 len: 62 microversion: 2.1 time: 0.097956 Oct 29 20:56:08.970033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1065/2209] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:08 2022] GET /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:56:08.981732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-deea45df-62d5-437d-8365-13c75c39612d tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.151716 Oct 29 20:56:08.982320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1145/2210] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:08 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:08.994404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-228521204"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:09.007616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:09.017984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:09.018496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:09.018983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:09.019714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:09.020176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:09.020615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:09.403047 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd69d298-cce3-4b02-9fde-97a8be068d0b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "POST /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462/action" status: 202 len: 0 microversion: 2.1 time: 0.425780 Oct 29 20:56:09.415544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-95f0afc5-f61c-40d4-8f20-54f6bed4ccc9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171411820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:09.423388 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1066/2211] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:56:08 2022] POST /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 29 20:56:09.501654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-95f0afc5-f61c-40d4-8f20-54f6bed4ccc9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.090124 Oct 29 20:56:09.502918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1146/2212] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:09 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:09.852769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:09.857231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:09.858284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:09.877542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:09.879754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:09.882250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:09.885489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:09.886233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:09.889912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:09.959269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b02d3903-2a48-4708-b39b-97af838d6315 req-59e05406-5784-4e20-bb0a-24701a99a5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "name": "network-vif-unplugged", "status": "completed", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:09.983404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b02d3903-2a48-4708-b39b-97af838d6315 req-59e05406-5784-4e20-bb0a-24701a99a5c2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:09.984254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b02d3903-2a48-4708-b39b-97af838d6315 req-59e05406-5784-4e20-bb0a-24701a99a5c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:09.988740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b02d3903-2a48-4708-b39b-97af838d6315 req-59e05406-5784-4e20-bb0a-24701a99a5c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:10.014990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:10.030737 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b02d3903-2a48-4708-b39b-97af838d6315 req-59e05406-5784-4e20-bb0a-24701a99a5c2 service nova] Creating event network-vif-unplugged:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:56:10.055128 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b02d3903-2a48-4708-b39b-97af838d6315 req-59e05406-5784-4e20-bb0a-24701a99a5c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100990 Oct 29 20:56:10.056586 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1147/2213] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:10.067976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83b050cc-3c14-4f3f-a819-b5b318e21dc3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17125e790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:10.177213 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83b050cc-3c14-4f3f-a819-b5b318e21dc3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.119224 Oct 29 20:56:10.179160 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1148/2214] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:10 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:10.379781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:10.397769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:10.401964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:10.403558 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79becf57-01ed-4ce0-9308-407dff860f98 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.551826 Oct 29 20:56:10.404146 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1067/2215] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:09 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:10.518042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86790c29-19e9-49f6-87d1-055775073ef7 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1713ae820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:10.624627 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86790c29-19e9-49f6-87d1-055775073ef7 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.110600 Oct 29 20:56:10.625854 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1149/2216] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:10 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:11.192964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9610e0f4-18a2-4e2b-aded-9e416b15baf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762e8430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:11.272152 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9610e0f4-18a2-4e2b-aded-9e416b15baf1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.083261 Oct 29 20:56:11.273049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1068/2217] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:11 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:11.432295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:11.433663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:11.442115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:11.442831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:11.443422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:11.444362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:11.444981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:11.445591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:11.640600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d828d060-ce24-4aa5-8c7c-8068417a5d96 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176246f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:11.741632 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d828d060-ce24-4aa5-8c7c-8068417a5d96 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.104885 Oct 29 20:56:11.743617 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1069/2218] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:11 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:11.854822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:11.865024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:11.875289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:11.882894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb299b24-fe20-4508-a908-258d3450e530 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.455810 Oct 29 20:56:11.883912 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1150/2219] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:11 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:11.960571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:11.961231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:11.982118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:11.982847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:11.983486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:11.984376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:11.984987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:11.985603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:12.307508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac01428a-0127-49cb-bc43-14fc410a5b28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1713ae940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:12.412591 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac01428a-0127-49cb-bc43-14fc410a5b28 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.120304 Oct 29 20:56:12.421213 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1151/2220] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:12 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:12.464842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:12.509804 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-59b3b24f-003f-4fd7-b6a9-918d2586ebbe tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 2419 microversion: 2.25 time: 0.554593 Oct 29 20:56:12.511167 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1070/2221] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:11 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 2419 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:12.544524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:12.547549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:12.558183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:12.559414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:12.560082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:12.561029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:12.561767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:12.562531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:12.590245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'flavor' on Instance uuid f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:12.607541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Going to try to live migrate instance to nch2-master-1 {{(pid=138885) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:56:12.760682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5ca8333b-2b91-407f-817b-0172d9dc5a90 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1762e83a0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:12.923013 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5ca8333b-2b91-407f-817b-0172d9dc5a90 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.167487 Oct 29 20:56:12.932570 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1071/2222] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:12 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:12.937868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:12.938831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:12.946597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:12.947461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:12.948118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:12.949068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:12.949770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:12.950414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:13.745586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:13.766055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:13.767664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:13.772651 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48b0b59d-bdc0-4742-99f7-78b13dfcef3c tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.837134 Oct 29 20:56:13.773270 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1072/2223] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:12 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:13.786750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b26b0fb3-5df5-4d58-ab9c-157290242c79 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa176228790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:14.275412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b26b0fb3-5df5-4d58-ab9c-157290242c79 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1438 microversion: 2.1 time: 0.495295 Oct 29 20:56:14.280319 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1073/2224] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:13 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1438 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:14.298055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f8f7408e-efac-4e4b-8d88-a323d020de7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176257700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:14.555386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:15.954507 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/action" status: 202 len: 0 microversion: 2.25 time: 3.414483 Oct 29 20:56:15.956173 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1152/2225] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:56:12 2022] POST /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/action => generated 0 bytes in 3417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:15.968185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:15.976847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:16.020844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:16.025012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:16.026538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:16.029286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:16.029984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:16.031566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:16.635586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:16.653990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:16.664074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:16.668727 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-966d2ea5-ccc5-4330-8deb-9dd193fe3272 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.711003 Oct 29 20:56:16.671544 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1153/2226] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:15 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:16.687753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae5ae249-3675-48ad-b3a2-b2c9e858eef6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17144aaf0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:22.946071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:23.755787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:25.777584 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f8f7408e-efac-4e4b-8d88-a323d020de7a tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 11.463620 Oct 29 20:56:25.777584 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1074/2227] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:14 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 11465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:25.779141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae5ae249-3675-48ad-b3a2-b2c9e858eef6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1447 microversion: 2.1 time: 9.083148 Oct 29 20:56:25.779141 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1154/2228] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:16 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1447 bytes in 9097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:25.793936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:25.794592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:25.810116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:25.817494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:25.818104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:25.818546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:25.819854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:25.820330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:25.820766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:26.180363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8602063e-ffad-4e54-92f3-83c6bf9959a3 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa176205c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1971568089", "description": "tempest-description-1338305805"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:26.676085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:26.691741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:26.702402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:26.704011 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6fbca6e3-10f1-4df7-8c43-8390c7674d18 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1811 microversion: 2.25 time: 0.933480 Oct 29 20:56:26.704815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1155/2229] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:25 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1811 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:26.717356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-686bb62b-290c-4019-be04-f1fcc041b77c req-49136a4c-f4f3-4201-b58e-b4868eb89c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "name": "network-vif-plugged", "status": "completed", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:26.742961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-686bb62b-290c-4019-be04-f1fcc041b77c req-49136a4c-f4f3-4201-b58e-b4868eb89c6b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:26.743591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-686bb62b-290c-4019-be04-f1fcc041b77c req-49136a4c-f4f3-4201-b58e-b4868eb89c6b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:26.744107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-686bb62b-290c-4019-be04-f1fcc041b77c req-49136a4c-f4f3-4201-b58e-b4868eb89c6b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:26.760148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-686bb62b-290c-4019-be04-f1fcc041b77c req-49136a4c-f4f3-4201-b58e-b4868eb89c6b service nova] Creating event network-vif-plugged:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:56:26.779367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-686bb62b-290c-4019-be04-f1fcc041b77c req-49136a4c-f4f3-4201-b58e-b4868eb89c6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073089 Oct 29 20:56:26.780370 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1156/2230] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:26.785805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:26.786513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:26.805350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:26.806148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:26.806752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:26.807695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:26.808300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:26.808877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:27.160592 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8602063e-ffad-4e54-92f3-83c6bf9959a3 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.409733 Oct 29 20:56:27.172364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:27.174489 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1075/2231] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:56:25 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:27.183192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:27.184663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-970e6593-2a56-4f25-84e2-d11b682fc43d req-e7cb7e3d-a724-4ac2-b841-9bc1d78b9ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623", "name": "network-vif-unplugged", "status": "completed", "tag": "8719a5b1-e60d-48bc-8e71-ff14e6657083"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:27.189414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:27.190744 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e3a69ca1-5852-4d99-bdc4-95ed793050bc tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.409228 Oct 29 20:56:27.192320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1157/2232] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:26 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:27.198549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d3c84af-eb90-4cb8-94d2-433c58a322a9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171314ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:27.228202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-970e6593-2a56-4f25-84e2-d11b682fc43d req-e7cb7e3d-a724-4ac2-b841-9bc1d78b9ded service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:27.230413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-970e6593-2a56-4f25-84e2-d11b682fc43d req-e7cb7e3d-a724-4ac2-b841-9bc1d78b9ded service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:27.231113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-970e6593-2a56-4f25-84e2-d11b682fc43d req-e7cb7e3d-a724-4ac2-b841-9bc1d78b9ded service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:27.248962 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-970e6593-2a56-4f25-84e2-d11b682fc43d req-e7cb7e3d-a724-4ac2-b841-9bc1d78b9ded service nova] Creating event network-vif-unplugged:8719a5b1-e60d-48bc-8e71-ff14e6657083 for instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 on nch1-master-1 Oct 29 20:56:27.262561 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-970e6593-2a56-4f25-84e2-d11b682fc43d req-e7cb7e3d-a724-4ac2-b841-9bc1d78b9ded service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078481 Oct 29 20:56:27.270150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1076/2233] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:27.288360 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d3c84af-eb90-4cb8-94d2-433c58a322a9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 200 len: 1447 microversion: 2.1 time: 0.094627 Oct 29 20:56:27.299270 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1158/2234] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:27 2022] GET /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:27.299468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5599a343-44db-4865-ae94-bfd39c9bfb21 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa176205550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:27.304483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d14e4fd-96b1-440d-9183-408ca5814ba4 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa17144a9d0>, body: {"security_group_rule": {"parent_group_id": "7bee58fd-1fba-4847-b083-c0e80f9d6ed6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:27.363113 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5599a343-44db-4865-ae94-bfd39c9bfb21 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.088331 Oct 29 20:56:27.366384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1077/2235] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:27 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:27.372663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d565b7b-aa2d-442b-84c5-339596ee92a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762579d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:27.933262 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7d14e4fd-96b1-440d-9183-408ca5814ba4 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.640467 Oct 29 20:56:27.934720 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1159/2236] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:27.946791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:27.947886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:27.973423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:27.974781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:27.978322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:27.981606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:27.982282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:27.982941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:28.475530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:28.489563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:28.498402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:28.502364 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d24059af-8b44-43b5-b6af-e147899b9745 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1811 microversion: 2.25 time: 0.564466 Oct 29 20:56:28.509550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1160/2237] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:27 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1811 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:28.526174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c42db395-1262-4cb5-a24f-ae0171b2875a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa171411430>, body: {"security_group_rule": {"parent_group_id": "7bee58fd-1fba-4847-b083-c0e80f9d6ed6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:28.667740 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d565b7b-aa2d-442b-84c5-339596ee92a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 204 len: 0 microversion: 2.1 time: 1.300067 Oct 29 20:56:28.670145 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1078/2238] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:27 2022] DELETE /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 0 bytes in 1303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:28.678068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:28.679113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:28.686576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:28.687549 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c42db395-1262-4cb5-a24f-ae0171b2875a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: This rule already exists in group 7bee58fd-1fba-4847-b083-c0e80f9d6ed6 Oct 29 20:56:28.688251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:28.689723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:28.694636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:28.695322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:28.696514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c42db395-1262-4cb5-a24f-ae0171b2875a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 138 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: {"security_group_rule": {"parent_group_id": "7bee58fd-1fba-4847-b083-c0e80f9d6ed6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: exception: This rule already exists in group 7bee58fd-1fba-4847-b083-c0e80f9d6ed6 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7bee58fd-1fba-4847-b083-c0e80f9d6ed6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7bee58fd-1fba-4847-b083-c0e80f9d6ed6 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7bee58fd-1fba-4847-b083-c0e80f9d6ed6 Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:28.719756 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:28.723886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:28.723886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:28.723886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7bee58fd-1fba-4847-b083-c0e80f9d6ed6 Oct 29 20:56:28.723886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:28.729756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c42db395-1262-4cb5-a24f-ae0171b2875a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 400 to user: This rule already exists in group 7bee58fd-1fba-4847-b083-c0e80f9d6ed6 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:28.730988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c42db395-1262-4cb5-a24f-ae0171b2875a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.220295 Oct 29 20:56:28.734930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1161/2239] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:28 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:56:28.738588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9de38303-032b-4709-bd4b-7ce79f2ae5e8 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa17144a8b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:28.796430 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9de38303-032b-4709-bd4b-7ce79f2ae5e8 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.061229 Oct 29 20:56:28.797381 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1162/2240] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:28 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:28.802666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:28.803509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:28.811751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:28.812606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:28.813262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:28.814225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:28.814936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:28.816108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:28.849988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:56:28.996387 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e4165c8e-46c5-4b2f-8007-2600fadd4590 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 204 len: 0 microversion: 2.1 time: 0.197175 Oct 29 20:56:28.999685 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1163/2241] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:56:28 2022] DELETE /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:29.019476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36c79cc9-30d2-4cf6-b3e6-48e3087a579d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa17144a4c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:29.242165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:29.254845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:29.264898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:29.266322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c125fee-340e-4cb3-8be4-586c7d248e39 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.594592 Oct 29 20:56:29.275606 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1079/2242] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:28 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:29.295172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-294260949", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1cc8922f-83e5-42c2-bce3-6544d389a499"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:29.384927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] validate_networks() for [('1cc8922f-83e5-42c2-bce3-6544d389a499', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:56:29.528979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36c79cc9-30d2-4cf6-b3e6-48e3087a579d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/f5f2cec5-c9a8-432c-9bca-9c61416e8e7b" status: 202 len: 0 microversion: 2.1 time: 0.526491 Oct 29 20:56:29.530345 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1164/2243] 10.222.0.36 () {58 vars in 1287 bytes} [Sat Oct 29 20:56:28 2022] DELETE /compute/v2.1/os-security-group-rules/f5f2cec5-c9a8-432c-9bca-9c61416e8e7b => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:29.535835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-65616ead-f6d3-475d-b117-75d8a8039b74 req-fcc08d27-216f-48de-aac5-89e15312432c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623", "tag": "8719a5b1-e60d-48bc-8e71-ff14e6657083"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:29.567535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-65616ead-f6d3-475d-b117-75d8a8039b74 req-fcc08d27-216f-48de-aac5-89e15312432c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:29.568264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-65616ead-f6d3-475d-b117-75d8a8039b74 req-fcc08d27-216f-48de-aac5-89e15312432c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:29.570343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-65616ead-f6d3-475d-b117-75d8a8039b74 req-fcc08d27-216f-48de-aac5-89e15312432c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:29.597129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-65616ead-f6d3-475d-b117-75d8a8039b74 req-fcc08d27-216f-48de-aac5-89e15312432c service nova] Creating event network-changed:8719a5b1-e60d-48bc-8e71-ff14e6657083 for instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 on nch1-master-1 Oct 29 20:56:29.610893 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-65616ead-f6d3-475d-b117-75d8a8039b74 req-fcc08d27-216f-48de-aac5-89e15312432c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076326 Oct 29 20:56:29.611966 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1165/2244] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:29.627496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:29.631509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:29.644133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:29.644630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:29.645075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:29.650746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:29.652867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:29.653504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:30.185788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:30.225158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:30.226723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:30.227960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9cf1015f-f92d-499b-b682-c404aef941b7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1811 microversion: 2.25 time: 0.614137 Oct 29 20:56:30.228885 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1166/2245] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:29 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1811 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:30.237997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ac00168-ec61-458d-b8f7-659777d95153 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa171411ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-846794383", "description": "tempest-description-1321889865"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:30.423842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:56:30.424490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:56:30.425279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:56:30.426236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:56:30.426830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:56:30.463185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:30.464811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:30.468355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:30.476526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:30.477355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:30.478004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:30.547208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:30.563035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for user d1c5ef005ddf4a96828abd5376fffa37 and project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:30.617309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:56:30.624990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:56:30.686538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ac00168-ec61-458d-b8f7-659777d95153 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.456359 Oct 29 20:56:30.687531 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1167/2246] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:56:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:30.693217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e807763d-38f3-4d93-9ec5-bbdc872388aa tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171411820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:30.770119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e807763d-38f3-4d93-9ec5-bbdc872388aa tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.081350 Oct 29 20:56:30.779124 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1168/2247] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:30 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:30.783006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:30.785023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:30.786207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2e2aa52-4078-41bc-ad67-49733ff76908 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505468 Oct 29 20:56:30.798144 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1080/2248] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:56:30.803768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:30.804257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:30.804700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:30.805416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:30.810654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:30.811133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:30.825603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc1c20cc-2b88-473c-9d67-7420987dc920 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa176299e50>, body: {"security_group_rule": {"parent_group_id": "1e739cad-cdb2-4fd7-96d7-666a6796677f", "ip_protocol": "tcp", "from_port": 1734553822, "to_port": 22}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:31.099174 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-bc1c20cc-2b88-473c-9d67-7420987dc920 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Invalid port range 1734553822:22. Former value cannot be greater than the later Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc1c20cc-2b88-473c-9d67-7420987dc920 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 146 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: {"security_group_rule": {"parent_group_id": "1e739cad-cdb2-4fd7-96d7-666a6796677f", "ip_protocol": "tcp", "from_port": 1734553822, "to_port": 22}} Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid port range 1734553822:22. Former value cannot be greater than the later Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1e739cad-cdb2-4fd7-96d7-666a6796677f', 'ip_protocol': 'tcp', 'from_port': 1734553822, 'to_port': 22}}} Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1734553822:22. Former value cannot be greater than the later Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1734553822:22. Former value cannot be greater than the later Oct 29 20:56:31.102999 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1734553822:22. Former value cannot be greater than the later Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc1c20cc-2b88-473c-9d67-7420987dc920 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 400 to user: Invalid port range 1734553822:22. Former value cannot be greater than the later {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc1c20cc-2b88-473c-9d67-7420987dc920 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.305259 Oct 29 20:56:31.106863 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1081/2249] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:30 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:56:31.110874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4dc3acd-17d1-4c96-b363-020e5a49eadd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:31.111505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4dc3acd-17d1-4c96-b363-020e5a49eadd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:31.275138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4dc3acd-17d1-4c96-b363-020e5a49eadd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.295021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4dc3acd-17d1-4c96-b363-020e5a49eadd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1207 microversion: 2.1 time: 0.187515 Oct 29 20:56:31.296100 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1082/2250] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:31 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1207 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:31.305262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9caf631-2d42-43f4-8b7c-feca726a598a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa1710d95e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1958513786", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:31.311684 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a9caf631-2d42-43f4-8b7c-feca726a598a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Security group id should be uuid Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9caf631-2d42-43f4-8b7c-feca726a598a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 131 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1958513786", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group id should be uuid Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1958513786', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:31.320934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:31.324424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 29 20:56:31.324424 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:31.324424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9caf631-2d42-43f4-8b7c-feca726a598a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 400 to user: Security group id should be uuid {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:31.324424 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9caf631-2d42-43f4-8b7c-feca726a598a tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.025162 Oct 29 20:56:31.324424 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1083/2251] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:56:31.335471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:31.336588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:31.347798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:31.348660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:31.349331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:31.350848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:31.351536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:31.353509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:31.355378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.367722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.369667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.371597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdefc33d-5735-4b02-97f4-ec0bde475ef6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.597410 Oct 29 20:56:31.372422 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1169/2252] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:30 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:31.377407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-743e0706-3219-4e80-a442-f7fb54ae176e tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa171411280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1539458367", "description": "tempest-description-1357072887"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:31.820627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.858597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.865135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:31.883671 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b9690cf2-f62e-4d64-a461-07c89ae40ff1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1811 microversion: 2.25 time: 0.545446 Oct 29 20:56:31.888113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1084/2253] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:31 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1811 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:31.908811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-580bd49e-0c1b-46ed-9490-a50e799dbca4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1763a2820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:31.964935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-743e0706-3219-4e80-a442-f7fb54ae176e tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.591153 Oct 29 20:56:31.966524 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1170/2254] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:56:31 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:31.980110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd193192-0012-447d-9157-ad3dd884ec42 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa1713ae5e0>, body: {"security_group_rule": {"parent_group_id": "a6c9f9d3-aff9-4633-ae84-5771316ac5b0", "ip_protocol": "tempest-999-349448921", "from_port": 22, "to_port": 22}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:32.021484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-580bd49e-0c1b-46ed-9490-a50e799dbca4 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1426 microversion: 2.1 time: 0.129969 Oct 29 20:56:32.025276 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1085/2255] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:31 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1426 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:32.089858 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cd193192-0012-447d-9157-ad3dd884ec42 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Invalid IP protocol tempest-999-349448921. Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd193192-0012-447d-9157-ad3dd884ec42 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 156 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: {"security_group_rule": {"parent_group_id": "a6c9f9d3-aff9-4633-ae84-5771316ac5b0", "ip_protocol": "tempest-999-349448921", "from_port": 22, "to_port": 22}} Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid IP protocol tempest-999-349448921. Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a6c9f9d3-aff9-4633-ae84-5771316ac5b0', 'ip_protocol': 'tempest-999-349448921', 'from_port': 22, 'to_port': 22}}} Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-349448921. Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-349448921. Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.092492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-349448921. Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd193192-0012-447d-9157-ad3dd884ec42 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 400 to user: Invalid IP protocol tempest-999-349448921. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd193192-0012-447d-9157-ad3dd884ec42 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.118669 Oct 29 20:56:32.100897 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1171/2256] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:56:32.106753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-074837c2-99ec-4c20-9865-736f3574f72f tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa176354280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-414685029", "description": "tempest-description-298752656"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:32.326695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:32.327437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:32.356031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:32.357397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:32.358164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:32.359184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:32.360281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:32.360975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:32.401246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-074837c2-99ec-4c20-9865-736f3574f72f tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.298334 Oct 29 20:56:32.402616 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1086/2257] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:56:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:32.407652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:32.408548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:32.437619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:32.439902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:32.442892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:32.444080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:32.447584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:32.449532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:32.585635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:32.599445 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-217ef78c-1fe6-4c6a-b475-d902bc5197d8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1259 microversion: 2.1 time: 0.278065 Oct 29 20:56:32.601643 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1172/2258] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:32 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:32.613014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3939fd9-bc21-471b-9178-d135348f56ed tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa171523a60>, body: {"security_group_rule": {"parent_group_id": "e552e0bb-89af-4671-9da5-fc2ab9e02a26", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:32.737114 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d3939fd9-bc21-471b-9178-d135348f56ed tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3939fd9-bc21-471b-9178-d135348f56ed tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 138 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: {"security_group_rule": {"parent_group_id": "e552e0bb-89af-4671-9da5-fc2ab9e02a26", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e552e0bb-89af-4671-9da5-fc2ab9e02a26', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 20:56:32.739502 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 20:56:32.743445 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:32.744558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3939fd9-bc21-471b-9178-d135348f56ed tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:32.745372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3939fd9-bc21-471b-9178-d135348f56ed tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.137106 Oct 29 20:56:32.746163 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1173/2259] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:32 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:56:32.757000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-206bcdaa-f7d2-4274-bd5a-1eeba41fd588 req-9abbfaf2-a0e0-4d96-b36e-e575f4d7e100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9060230-1b76-4c8b-8dea-7936bfa7cacf", "name": "network-vif-unplugged", "status": "completed", "tag": "de3b480a-5d12-4dcd-8fb4-722321458c00"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:32.780151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-206bcdaa-f7d2-4274-bd5a-1eeba41fd588 req-9abbfaf2-a0e0-4d96-b36e-e575f4d7e100 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:32.780814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-206bcdaa-f7d2-4274-bd5a-1eeba41fd588 req-9abbfaf2-a0e0-4d96-b36e-e575f4d7e100 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:32.781357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-206bcdaa-f7d2-4274-bd5a-1eeba41fd588 req-9abbfaf2-a0e0-4d96-b36e-e575f4d7e100 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:32.818537 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-206bcdaa-f7d2-4274-bd5a-1eeba41fd588 req-9abbfaf2-a0e0-4d96-b36e-e575f4d7e100 service nova] Creating event network-vif-unplugged:de3b480a-5d12-4dcd-8fb4-722321458c00 for instance e9060230-1b76-4c8b-8dea-7936bfa7cacf on nch2-master-1 Oct 29 20:56:32.832754 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-206bcdaa-f7d2-4274-bd5a-1eeba41fd588 req-9abbfaf2-a0e0-4d96-b36e-e575f4d7e100 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085275 Oct 29 20:56:32.836387 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1174/2260] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:32.852975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b63677a-e1a2-4a50-af3b-5866dd05e701 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa171276670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1951890415", "description": "tempest-description-1154592107"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:33.150493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:33.176691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:33.180071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:33.182392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91f957b0-6da2-4893-9cfd-dffa23267ca5 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.777880 Oct 29 20:56:33.185495 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1087/2261] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:32 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:33.222143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:33.223061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:33.231526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:33.232462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:33.233261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:33.234446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:33.235301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:33.236004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:33.932520 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b63677a-e1a2-4a50-af3b-5866dd05e701 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.093844 Oct 29 20:56:33.933243 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1175/2262] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:56:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:33.942478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9043fb89-20cd-492b-be43-81b64f9f572c tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1714c29d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:34.034681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9043fb89-20cd-492b-be43-81b64f9f572c tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1435 microversion: 2.1 time: 0.099437 Oct 29 20:56:34.035541 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1176/2263] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:33 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1435 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:34.042431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:34.043370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:34.059062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.061542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.064343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.065176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.065690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.066293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.072116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:34.094776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:34.096307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:34.100536 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bc85d69-07c7-47cd-9621-57f6d8cf19fa tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1811 microversion: 2.25 time: 0.912556 Oct 29 20:56:34.118221 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1088/2264] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:33 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1811 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:34.130807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f8abc783-ba61-4359-8000-81363bbfaccb req-d428326e-2367-4aaf-9be6-3ba5acc66a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9060230-1b76-4c8b-8dea-7936bfa7cacf", "name": "network-vif-deleted", "tag": "de3b480a-5d12-4dcd-8fb4-722321458c00"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:34.153569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f8abc783-ba61-4359-8000-81363bbfaccb req-d428326e-2367-4aaf-9be6-3ba5acc66a4e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.156205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f8abc783-ba61-4359-8000-81363bbfaccb req-d428326e-2367-4aaf-9be6-3ba5acc66a4e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.156984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f8abc783-ba61-4359-8000-81363bbfaccb req-d428326e-2367-4aaf-9be6-3ba5acc66a4e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.176178 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f8abc783-ba61-4359-8000-81363bbfaccb req-d428326e-2367-4aaf-9be6-3ba5acc66a4e service nova] Creating event network-vif-deleted:de3b480a-5d12-4dcd-8fb4-722321458c00 for instance e9060230-1b76-4c8b-8dea-7936bfa7cacf on nch2-master-1 Oct 29 20:56:34.178358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:34.184781 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f8abc783-ba61-4359-8000-81363bbfaccb req-d428326e-2367-4aaf-9be6-3ba5acc66a4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065026 Oct 29 20:56:34.186321 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1089/2265] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:34.196820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e9ace5f-2b71-4cd0-8652-62c0c4c8d57d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa1762ddf70>, body: {"security_group_rule": {"parent_group_id": "587e0280-29cc-43a3-ae9a-c3a2d081994a", "ip_protocol": "tcp", "from_port": 22, "to_port": 1385483212}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:34.217775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e258b5a9-ce7a-4807-be3a-4e52f0374d52 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1265 microversion: 2.1 time: 0.178934 Oct 29 20:56:34.219157 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1177/2266] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:34 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:34.238879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-029b27ff-63b0-4c13-aeb9-fa37f3e28b0d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1715231f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:34.306565 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-029b27ff-63b0-4c13-aeb9-fa37f3e28b0d tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 200 len: 1435 microversion: 2.1 time: 0.085999 Oct 29 20:56:34.307369 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1178/2267] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:34 2022] GET /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 1435 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:34.317911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:34.323089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:34.334790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.335303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.335748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.336589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.337057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.337534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.390534 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3e9ace5f-2b71-4cd0-8652-62c0c4c8d57d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Invalid port range 22:1385483212. Valid TCP ports should be between 1-65535 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e9ace5f-2b71-4cd0-8652-62c0c4c8d57d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 146 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: {"security_group_rule": {"parent_group_id": "587e0280-29cc-43a3-ae9a-c3a2d081994a", "ip_protocol": "tcp", "from_port": 22, "to_port": 1385483212}} Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid port range 22:1385483212. Valid TCP ports should be between 1-65535 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'security_group_rule': {'parent_group_id': '587e0280-29cc-43a3-ae9a-c3a2d081994a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1385483212}}} Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1385483212. Valid TCP ports should be between 1-65535 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1385483212. Valid TCP ports should be between 1-65535 Oct 29 20:56:34.396506 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1385483212. Valid TCP ports should be between 1-65535 Oct 29 20:56:34.401674 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:34.404484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e9ace5f-2b71-4cd0-8652-62c0c4c8d57d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 400 to user: Invalid port range 22:1385483212. Valid TCP ports should be between 1-65535 {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:34.405637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e9ace5f-2b71-4cd0-8652-62c0c4c8d57d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.218119 Oct 29 20:56:34.406399 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1090/2268] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:34 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:56:34.417280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:34.418509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:34.431908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.433922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.434729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.436270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:34.436931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:34.438874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:34.902529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:34.913552 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfb8fa29-b732-4fb2-878b-636434d4b9c9 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1465 microversion: 2.1 time: 0.505551 Oct 29 20:56:34.931486 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1091/2269] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:34 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1465 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:34.957300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Action: 'create', calling method: .version_select at 0x7fa1762dd8b0>, body: {"security_group_rule": {"parent_group_id": "f5ada45c-43c9-4175-8e0d-1c7c143563c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:35.027585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:35.036082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:35.040518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:35.044398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:35.046237 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8696452e-3cf9-48de-8249-79821d4bcea0 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.737414 Oct 29 20:56:35.050765 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1179/2270] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:34 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:35.061963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c962457b-6567-4209-afbb-9814785b70e9 req-a555fb27-697c-45df-81e0-42c9c34d29ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "694c1168-38a2-4247-b315-9261c3f49f31"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:35.091343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c962457b-6567-4209-afbb-9814785b70e9 req-a555fb27-697c-45df-81e0-42c9c34d29ba service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:35.092139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c962457b-6567-4209-afbb-9814785b70e9 req-a555fb27-697c-45df-81e0-42c9c34d29ba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:35.101016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c962457b-6567-4209-afbb-9814785b70e9 req-a555fb27-697c-45df-81e0-42c9c34d29ba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:35.126892 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c962457b-6567-4209-afbb-9814785b70e9 req-a555fb27-697c-45df-81e0-42c9c34d29ba service nova] Creating event network-vif-plugged:694c1168-38a2-4247-b315-9261c3f49f31 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:35.139359 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c962457b-6567-4209-afbb-9814785b70e9 req-a555fb27-697c-45df-81e0-42c9c34d29ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086818 Oct 29 20:56:35.140223 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1180/2271] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:35.148363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bd26fedc-c873-48ba-9497-ef332f34a3ae tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa171411c10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:35.446876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:56:35.447540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.security_group_api [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Neutron security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 not found {{(pid=138884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:56:35.448279 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.448279 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 138 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: {"security_group_rule": {"parent_group_id": "f5ada45c-43c9-4175-8e0d-1c7c143563c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f5ada45c-43c9-4175-8e0d-1c7c143563c5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:56:35.458187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 404 to user: Security group f5ada45c-43c9-4175-8e0d-1c7c143563c5 does not exist Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-f44935dd-848e-402c-8062-32cc56599987'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-463a2e43-108b-4615-a85a-ab914ff5889b tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.527599 Oct 29 20:56:35.462906 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1092/2272] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 20:56:34 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:56:35.476247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:35.478899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:35.522926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:35.523460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:35.523981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:35.524844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:35.525443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:35.541265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:36.027654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bd26fedc-c873-48ba-9497-ef332f34a3ae tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "DELETE /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8" status: 204 len: 0 microversion: 2.1 time: 0.885865 Oct 29 20:56:36.028240 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1181/2273] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:35 2022] DELETE /compute/v2.1/images/c2bfe132-b50b-437a-a65b-ac8104873fc8 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:36.034765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:36.035535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:36.058829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:36.059332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:36.059770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:36.064916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:36.070463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:36.071437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:36.073386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:36.080184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:36.087604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:36.089442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9c4a5731-fd83-4d64-92ef-cdc9cfdf16a8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1811 microversion: 2.25 time: 0.626961 Oct 29 20:56:36.090283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1093/2274] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:35 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1811 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:36.095814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa171151280>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:36.175250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:56:36.175868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.security_group_api [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Neutron security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 not found {{(pid=138884) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 29 20:56:36.176803 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] HTTP exception thrown: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.176803 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Request method failure captured: Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-security-group-rules/096cae9e-fad7-40b1-9b28-88d688163e39 HTTP/1.1 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZNv080lah10GAw5ggFa2pNos4_N7cU4MLEN0w2QJpCvsPSWgNGIwjcvUSS0net9zGNY0HbQXMtFzEF8XlJoxekWJuGh_FndraBY-0ycDQEG31l3ZK5sMVFDX_AFjKjAmtSSLEMaDbYPNbH-vW0hdVcLwqY1YP6NYBk9YeRGfIas8SY Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d7557bede5bb4be68d91a9233a4ddb74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d7557bede5bb4be68d91a9233a4ddb74 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 33dcaae0ba544ff5b18a95038804f6b0 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-498190705-project Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '096cae9e-fad7-40b1-9b28-88d688163e39'} Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:56:36.178721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Returning 404 to user: Security group rule 096cae9e-fad7-40b1-9b28-88d688163e39 does not exist Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-8976a036-62d7-40f7-b191-4cdbf1ed8b42'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27c8d13f-2b9d-47c0-82af-545bc0f95b96 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/096cae9e-fad7-40b1-9b28-88d688163e39" status: 404 len: 199 microversion: 2.1 time: 0.088811 Oct 29 20:56:36.181985 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1094/2275] 10.222.0.36 () {58 vars in 1287 bytes} [Sat Oct 29 20:56:36 2022] DELETE /compute/v2.1/os-security-group-rules/096cae9e-fad7-40b1-9b28-88d688163e39 => generated 199 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:56:36.193745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81623a4a-8e4e-44c7-95e0-ddf6a0339880 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '.version_select at 0x7fa1762e81f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:36.270143 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-81623a4a-8e4e-44c7-95e0-ddf6a0339880 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] HTTP exception thrown: Image not found. Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81623a4a-8e4e-44c7-95e0-ddf6a0339880 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Request method failure captured: Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d HTTP/1.1 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZM7tfNAnLyf60iKh9BmxwE_TT7ynCIkM4p6F8U_poDHpU8IVr_RoFJyaTYYVehHlLKusPGPO3joAXXs-QNUr3xdorwSnqkM8pPWG-Qqp0DkWEq3mYqv_t7PQvKpA7AiPq4V1cJgxlK0v6XiWedH68pvGQWPITkJUUEZsQSimUejSlc Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ca557cc6cfbc46f4a1b236d51e841818 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ca557cc6cfbc46f4a1b236d51e841818 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesOneServerTestJSON-815154293-project Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7d8a34d7d9d4f2cb5fe7c37f596c09f Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesOneServerTestJSON-815154293-project Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '02d6b623-9871-45d1-b6fd-09c12443857d'} Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 02d6b623-9871-45d1-b6fd-09c12443857d to delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02d6b623-9871-45d1-b6fd-09c12443857d could not be found. Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.272683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:56:36.276091 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:56:36.280345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81623a4a-8e4e-44c7-95e0-ddf6a0339880 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:36.281811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81623a4a-8e4e-44c7-95e0-ddf6a0339880 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "DELETE /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d" status: 404 len: 62 microversion: 2.1 time: 0.099601 Oct 29 20:56:36.282400 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1095/2276] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:36 2022] DELETE /compute/v2.1/images/02d6b623-9871-45d1-b6fd-09c12443857d => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:56:36.300486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:36.301328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:36.331613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:36.332458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:36.332921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:36.333881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:36.334505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:36.334939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:36.826174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:36.857095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9ccd13e-9ce6-4b32-a918-de2f9c2d4920 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.826237 Oct 29 20:56:36.865589 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1182/2277] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:36 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:36.889868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1709212682", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "5bedc97f-6078-4777-ba44-ea276076ecf0"}, {"uuid": "c709b3f0-33f8-41eb-b244-38b59ae415f2"}, {"uuid": "5bedc97f-6078-4777-ba44-ea276076ecf0"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:36.969139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:36.990426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:36.999067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:37.000626 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90f90248-8d87-4ab3-b52c-c5ee54dc0bfb tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.717242 Oct 29 20:56:37.005540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1096/2278] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:36 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:37.023021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8da9aad2-9ee1-458f-a7eb-873d8addc814 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa171154c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:37.040526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] validate_networks() for [('5bedc97f-6078-4777-ba44-ea276076ecf0', None, None, None, None, None), ('c709b3f0-33f8-41eb-b244-38b59ae415f2', None, None, None, None, None), ('5bedc97f-6078-4777-ba44-ea276076ecf0', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:56:37.780293 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8da9aad2-9ee1-458f-a7eb-873d8addc814 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/587e0280-29cc-43a3-ae9a-c3a2d081994a" status: 202 len: 0 microversion: 2.1 time: 0.773326 Oct 29 20:56:37.781012 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1097/2279] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:56:37 2022] DELETE /compute/v2.1/os-security-groups/587e0280-29cc-43a3-ae9a-c3a2d081994a => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:37.786543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:37.787061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:37.797399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:37.797947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:37.798397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:37.799119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:37.800151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:37.800588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:37.831616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:56:37.929121 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4bd65e40-ec01-4ea6-9953-f4a74ab0187e tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 204 len: 0 microversion: 2.1 time: 0.146656 Oct 29 20:56:37.930595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1098/2280] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:56:37 2022] DELETE /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:37.940097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:37.941295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:37.949339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:37.951090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:37.951739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:37.952707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:37.953373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:37.954094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:38.249301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:38.276825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:38.315200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:38.322854 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3bea51a2-6052-4756-a35d-fe0c36efb32a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1801 microversion: 2.25 time: 0.390505 Oct 29 20:56:38.327211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1099/2281] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:37 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1801 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:38.336930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "498fed4d-2d39-41a9-aa73-628dd56d08c4"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "99491349-fec3-4967-9bed-d1945e2bccad"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:38.369526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:38.370223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:38.370812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:38.407597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] Creating event network-vif-plugged:498fed4d-2d39-41a9-aa73-628dd56d08c4 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:38.411379 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] Creating event network-vif-plugged:99491349-fec3-4967-9bed-d1945e2bccad for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:38.421327 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ede5a235-79ab-4315-85d9-d1ea62faf728 req-cdbaf745-6002-4577-ab16-0f31a0c35a9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090217 Oct 29 20:56:38.427121 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1100/2282] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:38.432479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f8e0866-5df7-4d1d-9e95-88ea065a0e8d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa1711540d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:38.977962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:56:38.980012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:56:38.980768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:56:38.983371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:56:38.984201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:56:39.006309 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f8e0866-5df7-4d1d-9e95-88ea065a0e8d tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e552e0bb-89af-4671-9da5-fc2ab9e02a26" status: 202 len: 0 microversion: 2.1 time: 0.577808 Oct 29 20:56:39.007341 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1101/2283] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:56:38 2022] DELETE /compute/v2.1/os-security-groups/e552e0bb-89af-4671-9da5-fc2ab9e02a26 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:39.016271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:39.016933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:39.017392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:39.018866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:39.019323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:39.021955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:39.024973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:39.026921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:39.048402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:39.049306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:39.051595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:39.053245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:39.054976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:39.056571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:39.093978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Getting quotas for project 86e380500f114891bf674438936e8e97. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:39.119100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Getting quotas for user 00a550d419d943628a9f73797cb7f36b and project 86e380500f114891bf674438936e8e97. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:39.161116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:56:39.165936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:56:39.303185 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f64db20a-6cbf-4cd0-a2de-7d017617908b tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432941 Oct 29 20:56:39.307057 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1183/2284] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:56:39.323289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:39.326028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:39.340383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:39.343467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:39.344082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:39.347460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:39.348142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:39.349581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:40.300072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:40.321526 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d3ab9231-1fa4-4273-a040-f37b822369ef tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 1.302784 Oct 29 20:56:40.322483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1102/2285] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:39 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:40.339105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2b78d3a7-63a9-439e-bfb7-7f98a6c2cc3f req-4b31a80f-f2b7-4990-a735-b9df09ec53a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beff40db-1248-41ac-bfc3-33299f73eb0e", "tag": "a71ba1a5-d419-4940-bdd1-bb22b699fa7a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:40.363203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:40.372742 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee23cc53-34ec-4e50-9ea8-c84aebba718b tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1471 microversion: 2.1 time: 1.062978 Oct 29 20:56:40.373368 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1184/2286] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:39 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1471 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:40.385733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2b78d3a7-63a9-439e-bfb7-7f98a6c2cc3f req-4b31a80f-f2b7-4990-a735-b9df09ec53a6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:40.387040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2b78d3a7-63a9-439e-bfb7-7f98a6c2cc3f req-4b31a80f-f2b7-4990-a735-b9df09ec53a6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:40.387487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2b78d3a7-63a9-439e-bfb7-7f98a6c2cc3f req-4b31a80f-f2b7-4990-a735-b9df09ec53a6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:40.400193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:40.400859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:40.404895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2b78d3a7-63a9-439e-bfb7-7f98a6c2cc3f req-4b31a80f-f2b7-4990-a735-b9df09ec53a6 service nova] Creating event network-changed:a71ba1a5-d419-4940-bdd1-bb22b699fa7a for instance beff40db-1248-41ac-bfc3-33299f73eb0e on nch1-master-1 Oct 29 20:56:40.411402 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2b78d3a7-63a9-439e-bfb7-7f98a6c2cc3f req-4b31a80f-f2b7-4990-a735-b9df09ec53a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087567 Oct 29 20:56:40.412491 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1103/2287] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:40.419257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22e292d7-65b7-4b32-ad1c-c23be8e3ed1b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '.version_select at 0x7fa176246940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:40.428637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e292d7-65b7-4b32-ad1c-c23be8e3ed1b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:40.429419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e292d7-65b7-4b32-ad1c-c23be8e3ed1b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:40.430052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22e292d7-65b7-4b32-ad1c-c23be8e3ed1b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:40.438554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:40.438987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22e292d7-65b7-4b32-ad1c-c23be8e3ed1b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1278 microversion: 2.25 time: 0.024874 Oct 29 20:56:40.439107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:40.440310 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1104/2288] 10.222.0.36 () {60 vars in 1184 bytes} [Sat Oct 29 20:56:40 2022] GET /compute/v2.1/os-migrations => generated 1278 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:40.442782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:40.443568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:40.446494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3766b4a6-c83d-4e37-b13d-d840b32cfec0 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa171154af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:40.450761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:40.451224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:40.522190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:40.895319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:40.912660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:40.915579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:40.919058 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ed1af9f-39c1-4364-8a3b-9d6d0cf4ff06 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.544652 Oct 29 20:56:40.935515 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1185/2289] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:40 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:40.944217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:40.944778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:40.986636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:40.987254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:40.987722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:40.988490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:40.988962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:40.989402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.055967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3766b4a6-c83d-4e37-b13d-d840b32cfec0 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/a6c9f9d3-aff9-4633-ae84-5771316ac5b0" status: 202 len: 0 microversion: 2.1 time: 0.614386 Oct 29 20:56:41.056800 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1105/2290] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:56:40 2022] DELETE /compute/v2.1/os-security-groups/a6c9f9d3-aff9-4633-ae84-5771316ac5b0 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:41.064015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:41.064802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:41.098332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.099809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.100271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.101010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.101518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.101973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.209656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:41.222688 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf5b0341-c467-4b9f-8306-7d2445f59f0e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1217 microversion: 2.1 time: 0.285625 Oct 29 20:56:41.242634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1186/2291] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:40 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:41.247949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "05d7ea0c-d052-4d7e-a462-6503fe5f5642"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "abaf2156-3eee-4776-87af-f4ae60c180d6"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "4f8b913f-10da-41e4-a3f2-8e6662803dda"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-plugged", "status": "completed", "tag": "0edb5772-4240-4851-ad33-8160a8554967"}, {"server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "name": "network-vif-unplugged", "status": "completed", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:41.270357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.273860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.274534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.294806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:41.324819 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Creating event network-vif-plugged:05d7ea0c-d052-4d7e-a462-6503fe5f5642 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:41.325419 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Creating event network-vif-plugged:abaf2156-3eee-4776-87af-f4ae60c180d6 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:41.325963 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Creating event network-vif-plugged:4f8b913f-10da-41e4-a3f2-8e6662803dda for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:41.330419 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Creating event network-vif-plugged:0edb5772-4240-4851-ad33-8160a8554967 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:41.331777 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] Creating event network-vif-unplugged:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:56:41.355620 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a67d1aac-4f89-4663-ac11-f7edc4dd0dc3 req-778fa75a-865c-4661-9ad0-702916eb95fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.109787 Oct 29 20:56:41.358199 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1187/2292] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:41.401175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:41.427257 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aafd6ae7-d267-41fc-8a6a-bd457cc22c75 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 2419 microversion: 2.25 time: 0.369002 Oct 29 20:56:41.427892 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1106/2293] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:41 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 2419 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:41.432824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3854b82b-44ac-4643-bb23-003f50b77780 req-a8320224-b315-4011-b825-aafcbe885cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fee4706-a16a-4ce7-8cdf-9b0a6f659462", "name": "network-vif-deleted", "tag": "933ea12d-07a7-4ec2-ba55-c24667afd382"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:41.443749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3854b82b-44ac-4643-bb23-003f50b77780 req-a8320224-b315-4011-b825-aafcbe885cd6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.444423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3854b82b-44ac-4643-bb23-003f50b77780 req-a8320224-b315-4011-b825-aafcbe885cd6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.445054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3854b82b-44ac-4643-bb23-003f50b77780 req-a8320224-b315-4011-b825-aafcbe885cd6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.466292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3854b82b-44ac-4643-bb23-003f50b77780 req-a8320224-b315-4011-b825-aafcbe885cd6 service nova] Creating event network-vif-deleted:933ea12d-07a7-4ec2-ba55-c24667afd382 for instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 on nch2-master-1 Oct 29 20:56:41.473576 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3854b82b-44ac-4643-bb23-003f50b77780 req-a8320224-b315-4011-b825-aafcbe885cd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044116 Oct 29 20:56:41.474793 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1107/2294] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:41.481408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f8bc78de-056c-4d16-b433-016ea02dda4f tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa176205c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:41.633666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:41.634575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:41.653655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.654333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.655042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.657160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.659321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.661143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.719817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:56:41.769834 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f8bc78de-056c-4d16-b433-016ea02dda4f tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1e739cad-cdb2-4fd7-96d7-666a6796677f" status: 202 len: 0 microversion: 2.1 time: 0.293857 Oct 29 20:56:41.773321 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1108/2295] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:56:41 2022] DELETE /compute/v2.1/os-security-groups/1e739cad-cdb2-4fd7-96d7-666a6796677f => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:41.779720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:41.780487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:41.795783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.796710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.797163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.798992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.798992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.800401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.857168 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d740a334-2018-4579-a756-38c06ad5467a tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "DELETE /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 204 len: 0 microversion: 2.32 time: 0.494889 Oct 29 20:56:41.858004 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1188/2296] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:56:41 2022] DELETE /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:56:41.872644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:41.873891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:41.883900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.884708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.885383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.886412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.887117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.887696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.936961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:41.937758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:41.938357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:41.938814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lazy-loading 'fault' on Instance uuid 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:41.997682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.006858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b22e218e-61f7-4fb4-82b1-c7f4df4d375a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.234845 Oct 29 20:56:42.024999 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1109/2297] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:41 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:42.031644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:42.032713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:42.036013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d8a34d7d9d4f2cb5fe7c37f596c09f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca557cc6cfbc46f4a1b236d51e841818', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.040867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.041618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.042287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.043242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.043924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.044567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.044866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d40bca1e-b201-4f4f-a43f-eccf2eb75403 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 200 len: 1307 microversion: 2.1 time: 0.180917 Oct 29 20:56:42.045473 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1189/2298] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:41 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 1307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:42.071755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:42.079897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bbada8b-8426-45c0-b4b1-5d5a9c0af494 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] Calling method '.version_select at 0x7fa1710a6820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:42.283008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:42.305877 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc0664ac-e92d-4f20-a950-8d0ba6aaae05 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 2419 microversion: 2.25 time: 0.278904 Oct 29 20:56:42.307094 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1110/2299] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:42 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 2419 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:42.323165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:42.323958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:42.333791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.334712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.335418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.337404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.338537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.340526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.460173 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bbada8b-8426-45c0-b4b1-5d5a9c0af494 tempest-SecurityGroupRulesNegativeTestJSON-498190705 tempest-SecurityGroupRulesNegativeTestJSON-498190705-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/7bee58fd-1fba-4847-b083-c0e80f9d6ed6" status: 202 len: 0 microversion: 2.1 time: 0.401782 Oct 29 20:56:42.460971 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1190/2300] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:56:42 2022] DELETE /compute/v2.1/os-security-groups/7bee58fd-1fba-4847-b083-c0e80f9d6ed6 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:42.467970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:42.468594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:42.485837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.486379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.486866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.487582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.492716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.493255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.757817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.771019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.772465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.773753 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0ebd81c-cee4-4c87-a973-53dd925b8eb6 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2956 microversion: 2.32 time: 0.464966 Oct 29 20:56:42.774314 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1111/2301] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:42 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2956 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:42.778861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:42.779472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:42.786725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.787439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.788032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.788888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.789515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.790079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.813415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.828994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.830605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.832244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1e19bb61-1e2e-49bc-a017-96acf1b122df tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1880 microversion: 2.42 time: 0.369457 Oct 29 20:56:42.832815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1191/2302] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:42 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1880 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:42.854935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:42.856379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:42.864507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.865711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.866169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.866971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:42.867480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:42.867929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:42.917207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:42.925981 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f7996963-59c8-4793-a31b-fc8c3d45da86 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1217 microversion: 2.1 time: 0.150425 Oct 29 20:56:42.926784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1112/2303] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:42 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:42.990246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lazy-loading 'services' on Instance uuid f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:43.034354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:43.035281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:43.044654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.045402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.046564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.047498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.048218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.048805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.088891 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f850470-2957-4d73-97d5-becb312e00a1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments/9f151151-e569-44ac-bce7-7e64e381bfb2" status: 202 len: 0 microversion: 2.25 time: 0.241128 Oct 29 20:56:43.090994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1192/2304] 10.222.0.36 () {60 vars in 1457 bytes} [Sat Oct 29 20:56:42 2022] DELETE /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments/9f151151-e569-44ac-bce7-7e64e381bfb2 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:43.102601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:43.104563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] [instance: 6fee4706-a16a-4ce7-8cdf-9b0a6f659462] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:43.113760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.114430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.114874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.115627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.116119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.116550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.133802 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] HTTP exception thrown: Instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 could not be found. Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Request method failure captured: Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 HTTP/1.1 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZM7tfNAnLyf60iKh9BmxwE_TT7ynCIkM4p6F8U_poDHpU8IVr_RoFJyaTYYVehHlLKusPGPO3joAXXs-QNUr3xdorwSnqkM8pPWG-Qqp0DkWEq3mYqv_t7PQvKpA7AiPq4V1cJgxlK0v6XiWedH68pvGQWPITkJUUEZsQSimUejSlc Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: ca557cc6cfbc46f4a1b236d51e841818 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ca557cc6cfbc46f4a1b236d51e841818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: ca557cc6cfbc46f4a1b236d51e841818 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-815154293 Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesOneServerTestJSON-815154293-project Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7d8a34d7d9d4f2cb5fe7c37f596c09f Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesOneServerTestJSON-815154293-project Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 could not be found. Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6fee4706-a16a-4ce7-8cdf-9b0a6f659462'} Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 could not be found. Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 could not be found. Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:43.136159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 could not be found. Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] Returning 404 to user: Instance 6fee4706-a16a-4ce7-8cdf-9b0a6f659462 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e607e1c7-6685-4b32-9793-4634ff3d94e5 tempest-ImagesOneServerTestJSON-815154293 tempest-ImagesOneServerTestJSON-815154293-project] 10.222.0.36 "GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462" status: 404 len: 111 microversion: 2.1 time: 0.043026 Oct 29 20:56:43.144138 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1193/2305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:43 2022] GET /compute/v2.1/servers/6fee4706-a16a-4ce7-8cdf-9b0a6f659462 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:56:43.145722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:43.147730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:43.155408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.155592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.155960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.156688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.157148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.157630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.237677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-51dfc43a-b36a-4ef8-b2fc-2b22f28ef8a6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093191 Oct 29 20:56:43.238918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1194/2306] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 29 20:56:43 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:56:43.304327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:43.316823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5408b30d-31cb-4077-8f2b-6ba8bb0a81f9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.288259 Oct 29 20:56:43.323416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1113/2307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:43 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:43.804147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:43.805754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:43.817427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.818103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.818508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.819382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.820026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.820600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.867383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:43.868521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:43.876931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.878377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.879025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:43.881125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:43.881816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:43.882404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.323698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.334796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.339222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.341485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.344484 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-419d2b56-d746-4441-b71c-b4f5f1409fde tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2956 microversion: 2.32 time: 0.543009 Oct 29 20:56:44.347313 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1195/2308] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:43 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2956 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:44.347396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.348748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.350147 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bfe2d6b9-1e8e-42a8-bd89-d2c7c995fcfa tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2839 microversion: 2.42 time: 0.494038 Oct 29 20:56:44.350980 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1114/2309] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:43 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2839 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:44.365950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:44.368432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:44.370815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:44.374389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:44.383557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.384386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.385035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.385992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.386663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.387497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.388168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.389618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.391690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.394426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.397068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.399220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.469793 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ac46d1b-8ea2-4a60-86b9-678c1c9cb6d0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.117660 Oct 29 20:56:44.470400 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1115/2310] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 29 20:56:44 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:44.492673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:44.495049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:44.496345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:44.502108 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-248a0803-ffdc-4e4d-b968-095e91fe9977 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1217 microversion: 2.1 time: 0.154079 Oct 29 20:56:44.504726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1196/2311] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:44 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:44.508969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.509434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.510087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.510971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.514374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.515683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.519846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:44.524594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:44.531091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.531581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.532017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.532780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:44.533238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:44.533738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:44.821571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5085808-c52c-4305-99c7-81f1d921d541 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.308871 Oct 29 20:56:44.831668 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1197/2312] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 20:56:44 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044/os-interface => generated 1831 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:45.003695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:45.013326 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-92edad60-54a3-4818-9797-27bfcbd37b5a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.534595 Oct 29 20:56:45.030920 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1116/2313] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:44 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:45.380722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:45.382277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:45.395838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:45.399229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:45.399909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:45.402378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:45.414456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:45.417447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:45.459198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28c7d179-9f42-486b-83f7-b3616ea5b956 tempest-ListImageFiltersNegativeTestJSON-1459358004 tempest-ListImageFiltersNegativeTestJSON-1459358004-project] Calling method '.version_select at 0x7fa1713ae820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:45.509199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-28c7d179-9f42-486b-83f7-b3616ea5b956 tempest-ListImageFiltersNegativeTestJSON-1459358004 tempest-ListImageFiltersNegativeTestJSON-1459358004-project] HTTP exception thrown: Image not found. Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28c7d179-9f42-486b-83f7-b3616ea5b956 tempest-ListImageFiltersNegativeTestJSON-1459358004 tempest-ListImageFiltersNegativeTestJSON-1459358004-project] Request method failure captured: Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/images/9451787b-374c-44cb-bf36-b7d053f9ae40 HTTP/1.1 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZONVoov9TKOgc04s-tmGur6CUmiGbgfLH0WJAt3bC3nESkws_9JbvGWKI49k6rQNEB6inrkj0lknd5UIPV65eRjkeTtYq546Kj8C_yBiHao1aJYxVQEGcwkfOknVJA5CB4WdFM91Olnb5y4yWlVRp4VtGyTc4xzdf4OPD_j8jl06EY Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4fb43bb05c3d44ef8c10fc9906b8bac1 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1459358004 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fb43bb05c3d44ef8c10fc9906b8bac1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4fb43bb05c3d44ef8c10fc9906b8bac1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4fb43bb05c3d44ef8c10fc9906b8bac1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4fb43bb05c3d44ef8c10fc9906b8bac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1459358004 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4fb43bb05c3d44ef8c10fc9906b8bac1 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1459358004 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ListImageFiltersNegativeTestJSON-1459358004-project Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 18a728251cbd4fd4b70845b59d87b570 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1459358004-project Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9451787b-374c-44cb-bf36-b7d053f9ae40'} Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9451787b-374c-44cb-bf36-b7d053f9ae40 Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:56:45.515349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9451787b-374c-44cb-bf36-b7d053f9ae40 could not be found. Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:56:45.520799 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:56:45.525097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28c7d179-9f42-486b-83f7-b3616ea5b956 tempest-ListImageFiltersNegativeTestJSON-1459358004 tempest-ListImageFiltersNegativeTestJSON-1459358004-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:56:45.526929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-28c7d179-9f42-486b-83f7-b3616ea5b956 tempest-ListImageFiltersNegativeTestJSON-1459358004 tempest-ListImageFiltersNegativeTestJSON-1459358004-project] 10.222.0.36 "GET /compute/v2.1/images/9451787b-374c-44cb-bf36-b7d053f9ae40" status: 404 len: 62 microversion: 2.1 time: 0.376520 Oct 29 20:56:45.540241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1198/2314] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:45 2022] GET /compute/v2.1/images/9451787b-374c-44cb-bf36-b7d053f9ae40 => generated 62 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:56:45.553919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:45.554559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:45.589010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:45.591691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:45.592242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:45.593278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:45.595806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:45.598250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:45.825176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:45.831799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:45.854992 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1401b061-9735-46c4-a2f0-f349d7503a6f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1265 microversion: 2.1 time: 0.311945 Oct 29 20:56:45.861338 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1199/2315] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:45 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:46.043797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:46.044695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:46.071548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:46.076829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:46.081721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:46.083208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:46.084547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:46.085155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:46.152012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:46.177437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:46.179371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:46.181919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4a25595-cff3-4bb8-94ba-a18cbee858b4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2956 microversion: 2.32 time: 0.811084 Oct 29 20:56:46.210574 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1117/2316] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:45 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2956 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:56:46.823495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:46.838396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-068a5086-5c0b-4c92-9e58-92a280149050 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.802501 Oct 29 20:56:46.841765 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1200/2317] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:46 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:46.889245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:46.890003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:46.903806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:46.904391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:46.905474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:46.905820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:46.906486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:46.908127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:47.160406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:47.171599 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf5e7ed2-2df7-47b6-a87c-ffc6191dc5c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1271 microversion: 2.1 time: 0.286822 Oct 29 20:56:47.191401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1118/2318] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:46 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:47.219465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:47.220083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:47.227939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:47.228869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:47.229477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:47.230414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:47.232043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:47.232978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:47.523476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:47.535377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:47.537185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:47.538706 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d27bc3e0-da5c-49ff-a91e-14a6b27c2b10 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2956 microversion: 2.32 time: 0.324492 Oct 29 20:56:47.553916 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1201/2319] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:47 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2956 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:47.741060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-90428755", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26"}], "block_device_mapping_v2": [{"uuid": "fd3221f7-f74c-42c3-adb5-0153e2927c11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:47.816834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] validate_networks() for [('dfd8b820-bcb1-4a18-9bf9-2fcec4faaf26', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:56:47.863474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:47.864729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:47.871397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:47.871893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:47.872435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:47.873144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:47.873817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:47.874397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:48.219208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:48.231770 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-281810dc-cea7-44b6-ac4d-1f35b980836c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.372671 Oct 29 20:56:48.239587 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1202/2320] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:47 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:48.246284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2ab9a351-b717-4247-babb-7878b14c722b req-9fbc86e0-f8ac-4140-94f9-079ee81e9e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beff40db-1248-41ac-bfc3-33299f73eb0e", "name": "network-vif-plugged", "status": "completed", "tag": "a71ba1a5-d419-4940-bdd1-bb22b699fa7a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:48.282332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ab9a351-b717-4247-babb-7878b14c722b req-9fbc86e0-f8ac-4140-94f9-079ee81e9e22 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:48.284136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ab9a351-b717-4247-babb-7878b14c722b req-9fbc86e0-f8ac-4140-94f9-079ee81e9e22 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:48.284767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ab9a351-b717-4247-babb-7878b14c722b req-9fbc86e0-f8ac-4140-94f9-079ee81e9e22 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:48.300243 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2ab9a351-b717-4247-babb-7878b14c722b req-9fbc86e0-f8ac-4140-94f9-079ee81e9e22 service nova] Creating event network-vif-plugged:a71ba1a5-d419-4940-bdd1-bb22b699fa7a for instance beff40db-1248-41ac-bfc3-33299f73eb0e on nch1-master-1 Oct 29 20:56:48.306130 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2ab9a351-b717-4247-babb-7878b14c722b req-9fbc86e0-f8ac-4140-94f9-079ee81e9e22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064901 Oct 29 20:56:48.307488 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1203/2321] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:48.313786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:48.314668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:48.321104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:48.321820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:48.322459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:48.323312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:48.323914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:48.324488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:48.587330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:48.610512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cfb24279-4507-41f4-8783-021f917915bb tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1271 microversion: 2.1 time: 0.300871 Oct 29 20:56:48.614131 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1204/2322] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:48 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:48.631849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62815267-2fed-492c-86da-0f37a8b4198f"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:48.640105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:48.667947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:48.668458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:48.668903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:48.669652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:48.674062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:48.681150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:48.980530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:56:48.982952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:56:48.983685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:56:48.984399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:56:48.986193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:56:49.019290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.020229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.022349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.023460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.024809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.026514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.056212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:49.080627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:49.100385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Getting quotas for user d3e4d267d3b344928a2ca0a6e79eadb4 and project a637980654ed411a96672f36bab6214a. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:49.150180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:49.288362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:56:49.292946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd3221f7-f74c-42c3-adb5-0153e2927c11',volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:56:49.327425 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "POST /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707757 Oct 29 20:56:49.334933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1205/2323] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 20:56:48 2022] POST /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:49.354276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-fb31085a-901e-47c9-b1d9-d005cc276812 req-c6d29147-34af-4001-bf14-dfbadba7c8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "tag": "99491349-fec3-4967-9bed-d1945e2bccad"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:49.396306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fb31085a-901e-47c9-b1d9-d005cc276812 req-c6d29147-34af-4001-bf14-dfbadba7c8d8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.403770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fb31085a-901e-47c9-b1d9-d005cc276812 req-c6d29147-34af-4001-bf14-dfbadba7c8d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.404462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fb31085a-901e-47c9-b1d9-d005cc276812 req-c6d29147-34af-4001-bf14-dfbadba7c8d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.443305 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-fb31085a-901e-47c9-b1d9-d005cc276812 req-c6d29147-34af-4001-bf14-dfbadba7c8d8 service nova] Creating event network-changed:99491349-fec3-4967-9bed-d1945e2bccad for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 20:56:49.460657 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-fb31085a-901e-47c9-b1d9-d005cc276812 req-c6d29147-34af-4001-bf14-dfbadba7c8d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130914 Oct 29 20:56:49.461636 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1206/2324] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:49.481491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:49.485026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:49.488256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:49.502458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.506640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.507361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.508336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.509383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.510273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.633007 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9010555a-1c06-452f-94bc-7191e4036a8c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.896343 Oct 29 20:56:49.635921 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1119/2325] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:56:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:56:49.641690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:49.642583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:49.651256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.654132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.654892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.655859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:49.657237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:49.661656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:49.911713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:49.962796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:49.964280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:49.978548 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce2cb6a0-b9d6-4d95-af01-10f7a2d1453b tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2914 microversion: 2.32 time: 0.515384 Oct 29 20:56:49.983579 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1207/2326] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:49 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2914 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:50.001820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:50.002622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:50.029356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:50.029891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:50.030339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:50.031051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:50.031511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:50.031943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:50.379547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:50.388283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afd9e42b-f97f-434a-aee1-485ec02616e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1307 microversion: 2.1 time: 0.750869 Oct 29 20:56:50.398868 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1120/2327] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:49 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1307 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:50.404039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e71b7f1c-33e7-422e-83c0-dbc65797d313 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:50.404667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e71b7f1c-33e7-422e-83c0-dbc65797d313 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:50.429601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:50.579600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e71b7f1c-33e7-422e-83c0-dbc65797d313 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:50.597067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e71b7f1c-33e7-422e-83c0-dbc65797d313 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:50.599541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e71b7f1c-33e7-422e-83c0-dbc65797d313 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:50.601695 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e71b7f1c-33e7-422e-83c0-dbc65797d313 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1102 microversion: 2.25 time: 0.201381 Oct 29 20:56:50.602667 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1121/2328] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:50 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1102 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:50.707499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:50.716413 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ae579ab-8297-42de-80e7-970469d7181d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1313 microversion: 2.1 time: 0.731545 Oct 29 20:56:50.723006 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1208/2329] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:49 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:50.728001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-unplugged", "status": "completed", "tag": "8143b14b-a1cc-4d09-b1ee-95d78e193450"}, {"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-unplugged", "status": "completed", "tag": "350a15b5-cd02-426b-b837-13daafa16f6e"}, {"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-unplugged", "status": "completed", "tag": "04b9470e-35a4-48e8-9216-737abadca683"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:50.754254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:50.755282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:50.757220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:50.785251 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Creating event network-vif-unplugged:8143b14b-a1cc-4d09-b1ee-95d78e193450 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:50.790160 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Creating event network-vif-unplugged:350a15b5-cd02-426b-b837-13daafa16f6e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:50.791813 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] Creating event network-vif-unplugged:04b9470e-35a4-48e8-9216-737abadca683 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:50.806343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-58280352-879c-48fe-8bc4-fd4bec18ad1b req-b8888afa-2edb-4207-bca3-5ea0cac1fd3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.081598 Oct 29 20:56:50.808678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1209/2330] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:50.845167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9798e70d-7a0a-49cf-bc47-140b7cf00870 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa17633b790>, body: {"keypair": {"name": "tempest-keypair-10358273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNDrs3JMdTvzEGGQeQV1IpxiJj428SMKjdRNxQgQi7NBXcqvC1KrRXZUJCPIcMbr6hvZcg352s0O9XAi8O86MbHjLU1SyNkncgnOZuEwGSt2flNdP/vPCPwXBi+/wGKIQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:50.885515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9798e70d-7a0a-49cf-bc47-140b7cf00870 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:50.900655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9798e70d-7a0a-49cf-bc47-140b7cf00870 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:50.968867 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9798e70d-7a0a-49cf-bc47-140b7cf00870 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.363447 Oct 29 20:56:50.970709 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1122/2331] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 20:56:50.985865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-300495d9-49a6-475f-9fee-b04151e8e60e tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa1712ab940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:50.998107 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-300495d9-49a6-475f-9fee-b04151e8e60e tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-10358273" status: 200 len: 511 microversion: 2.2 time: 0.020599 Oct 29 20:56:50.999345 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1210/2332] 10.222.0.36 () {60 vars in 1252 bytes} [Sat Oct 29 20:56:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-10358273 => generated 511 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:51.009757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:51.010972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:51.027577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.028172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f088dda8-ce73-4a75-9810-cf6989f0a112 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171375e50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:51.030237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.031147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:51.034972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.037598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.038438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:51.083847 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f088dda8-ce73-4a75-9810-cf6989f0a112 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10358273" status: 204 len: 0 microversion: 2.2 time: 0.067789 Oct 29 20:56:51.084734 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1211/2333] 10.222.0.36 () {60 vars in 1255 bytes} [Sat Oct 29 20:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10358273 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:51.098107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ee258a9-b845-4a14-81b3-9175652b7166 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa17189b8b0>, body: {"keypair": {"name": "tempest-keypair-82390695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmH75jc9i+VPj6VJtGMfSsP4LWe46HHZkLZiegXrpoe/uhEqFe8wrnOqT1Xuh/Q9vg1ndLs62qS86EJyhPhaxJW0fkdBNhPI+swzcP7inHZ9YAXH48F64gm4RmoAC9ORQ=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:51.129779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0ee258a9-b845-4a14-81b3-9175652b7166 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:51.151171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0ee258a9-b845-4a14-81b3-9175652b7166 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:51.217173 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ee258a9-b845-4a14-81b3-9175652b7166 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.119367 Oct 29 20:56:51.222192 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1212/2334] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:51 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 29 20:56:51.235108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2860b29-2544-434b-aa6a-1de3cc001935 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171c4a040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:51.275303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b2860b29-2544-434b-aa6a-1de3cc001935 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82390695" status: 204 len: 0 microversion: 2.2 time: 0.048313 Oct 29 20:56:51.276561 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1213/2335] 10.222.0.36 () {60 vars in 1255 bytes} [Sat Oct 29 20:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82390695 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:51.289695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bbf2f102-831b-4254-9999-ef84297baafb tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa17144a790>, body: {"keypair": {"name": "tempest-keypair-2071451892", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:51.333266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-bbf2f102-831b-4254-9999-ef84297baafb tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:51.343966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-bbf2f102-831b-4254-9999-ef84297baafb tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:51.412986 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bbf2f102-831b-4254-9999-ef84297baafb tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.131101 Oct 29 20:56:51.414479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1214/2336] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:51 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 29 20:56:51.426871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:51.428874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:51.449195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.450321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.455921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:51.456831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.457318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.457804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:51.510937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:51.532515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:51.539019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:51.544336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00f2aade-0ef4-41e8-ae30-c28168ffed54 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2867 microversion: 2.32 time: 0.537546 Oct 29 20:56:51.565337 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1123/2337] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:51 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2867 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:51.579245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9739352e-2587-4c1d-bc3f-a16e6464034b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa176246ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:51.611008 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9739352e-2587-4c1d-bc3f-a16e6464034b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071451892" status: 204 len: 0 microversion: 2.2 time: 0.043559 Oct 29 20:56:51.613156 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1124/2338] 10.222.0.36 () {60 vars in 1261 bytes} [Sat Oct 29 20:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071451892 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:51.622889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b4cf87c2-ca06-4c18-8e8b-93cbba031874 req-db52a3c8-cfb1-4e48-8f26-bff01d9239c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-deleted", "tag": "80432d50-130e-4119-9603-19dd672ae1bd"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:51.667181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b4cf87c2-ca06-4c18-8e8b-93cbba031874 req-db52a3c8-cfb1-4e48-8f26-bff01d9239c8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.669973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b4cf87c2-ca06-4c18-8e8b-93cbba031874 req-db52a3c8-cfb1-4e48-8f26-bff01d9239c8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.670643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b4cf87c2-ca06-4c18-8e8b-93cbba031874 req-db52a3c8-cfb1-4e48-8f26-bff01d9239c8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:51.706064 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b4cf87c2-ca06-4c18-8e8b-93cbba031874 req-db52a3c8-cfb1-4e48-8f26-bff01d9239c8 service nova] Creating event network-vif-deleted:80432d50-130e-4119-9603-19dd672ae1bd for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:51.730235 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b4cf87c2-ca06-4c18-8e8b-93cbba031874 req-db52a3c8-cfb1-4e48-8f26-bff01d9239c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106638 Oct 29 20:56:51.731286 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1125/2339] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:51.746392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f29a4ea0-78ec-4648-a998-c7228d88ebf3 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa17204d8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-481425377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SMaEvwxVrBg9bDNuZTncLtjfdT4YKMprYXyQJJEMQeNMRBGr2l/F2tCF7ZphxUuMW8pZF1BiVc8aCftWu3HwIX/o1pbzU+bNot5U5e9QMXrUFzw8E/fFCDMut2/Dz1g=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:51.805983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-f29a4ea0-78ec-4648-a998-c7228d88ebf3 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:51.822928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-f29a4ea0-78ec-4648-a998-c7228d88ebf3 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:51.884204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f29a4ea0-78ec-4648-a998-c7228d88ebf3 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.147614 Oct 29 20:56:51.900485 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1126/2340] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 20:56:51.907547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:51.908415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:51.919594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.920253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.920783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:51.921900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:51.922506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:51.923140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.104811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:52.112837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:52.118475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:52.121357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:52.124271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8b6d04ed-79be-44a4-9d7e-aed96a29e568 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 200 len: 1488 microversion: 2.1 time: 0.704810 Oct 29 20:56:52.124871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1215/2341] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:51 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 1488 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:52.125619 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6dc2c8da-66d1-4fa2-baee-29ea4f918110 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1249 microversion: 2.25 time: 0.223854 Oct 29 20:56:52.131701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:52.135100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:52.148929 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1127/2342] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:51 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1249 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:52.153057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.155641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.156304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.159392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.160096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.160703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.168565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d531a63e-b085-4344-a7b7-d40386695633 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa176205c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-140792154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLI3k1tfLKm6ddgJlTk4jmBIAiL9DtO0lx+qzW2pBewFz15ufG4yAoWbjkDmbQKmBpxmkhKEH5P6YHR8DBBwMWINlC/l5mfTu3MDlBFj2XlM2N4xFTBMGhdiAl6x6SNnqw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:52.188525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d531a63e-b085-4344-a7b7-d40386695633 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:52.194413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d531a63e-b085-4344-a7b7-d40386695633 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:52.249339 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d531a63e-b085-4344-a7b7-d40386695633 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.098526 Oct 29 20:56:52.258238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1128/2343] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:52 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 20:56:52.267256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-332698752"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:52.271087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:52.278213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.278969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.279558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.280433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.281086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.281724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.554256 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93b22b9c-bde3-4c15-84d6-09e453a119b5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e/action" status: 202 len: 0 microversion: 2.1 time: 0.294444 Oct 29 20:56:52.556634 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1129/2344] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:56:52 2022] POST /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:56:52.566237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96347e4a-4a2f-4bda-83b7-38d98c4d131b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa17639f280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1387261902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUTk4AllnElp9JGtTc/0vS1ekfrz9GyhbIhP364UXiYbWTCSm51wyeHmoZieR2nU/o3OBSgWAX568+tlnWL4xNOPBo3CL3siwY2I14EqaRGQxfFKas6hiNhPWOO39z7ZQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:52.631213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96347e4a-4a2f-4bda-83b7-38d98c4d131b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:52.638108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96347e4a-4a2f-4bda-83b7-38d98c4d131b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:52.680766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96347e4a-4a2f-4bda-83b7-38d98c4d131b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.120213 Oct 29 20:56:52.689049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1130/2345] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:52 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 20:56:52.696718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-562a8ada-7ed5-4019-ba2c-c9b5c944f3d3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171154af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:52.785665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-562a8ada-7ed5-4019-ba2c-c9b5c944f3d3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.093988 Oct 29 20:56:52.787216 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1131/2346] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:52 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:52.791836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:52.792563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:52.810626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.813900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.814352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.815647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.816094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.816536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.876830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:52.894850 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a68d5dc4-6272-4655-923d-df475f05c5b4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1313 microversion: 2.1 time: 0.766654 Oct 29 20:56:52.897986 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1216/2347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:52 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1313 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:52.909770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a8d773a-edcb-4d2f-8ac8-e4d7760df56e tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171276ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:52.920617 ncdv-master-1 devstack@n-api.service[138885]: WARNING oslo_db.sqlalchemy.utils [None req-8a8d773a-edcb-4d2f-8ac8-e4d7760df56e tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 20:56:52.933223 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8a8d773a-edcb-4d2f-8ac8-e4d7760df56e tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.033123 Oct 29 20:56:52.943852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1217/2348] 10.222.0.36 () {60 vars in 1177 bytes} [Sat Oct 29 20:56:52 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:52.954784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d398225e-e8e5-47a5-b0db-5f33f5d03e22 req-e5509452-ab4d-4b7b-84ca-dc20bf8c79f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-unplugged", "status": "completed", "tag": "63d60491-c21a-48b5-a73d-567ca98d992e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:52.971083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d398225e-e8e5-47a5-b0db-5f33f5d03e22 req-e5509452-ab4d-4b7b-84ca-dc20bf8c79f0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:52.971507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d398225e-e8e5-47a5-b0db-5f33f5d03e22 req-e5509452-ab4d-4b7b-84ca-dc20bf8c79f0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:52.971957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d398225e-e8e5-47a5-b0db-5f33f5d03e22 req-e5509452-ab4d-4b7b-84ca-dc20bf8c79f0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:52.998406 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d398225e-e8e5-47a5-b0db-5f33f5d03e22 req-e5509452-ab4d-4b7b-84ca-dc20bf8c79f0 service nova] Creating event network-vif-unplugged:63d60491-c21a-48b5-a73d-567ca98d992e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:53.029712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d398225e-e8e5-47a5-b0db-5f33f5d03e22 req-e5509452-ab4d-4b7b-84ca-dc20bf8c79f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083826 Oct 29 20:56:53.030324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1218/2349] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:53.043724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41b38175-e3ca-4234-bccc-4971881ed1aa tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa17111d820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.100343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41b38175-e3ca-4234-bccc-4971881ed1aa tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1387261902" status: 204 len: 0 microversion: 2.2 time: 0.064838 Oct 29 20:56:53.105995 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1219/2350] 10.222.0.36 () {60 vars in 1321 bytes} [Sat Oct 29 20:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1387261902 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:53.118807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef78a612-8099-4de1-ac16-52d280e3548a tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa1710c9430>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.168334 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef78a612-8099-4de1-ac16-52d280e3548a tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-140792154" status: 204 len: 0 microversion: 2.2 time: 0.061000 Oct 29 20:56:53.169512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1220/2351] 10.222.0.36 () {60 vars in 1318 bytes} [Sat Oct 29 20:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-140792154 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:53.177315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.179354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:53.200897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:53.201658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:53.202265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:53.202715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:53.204441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:53.205125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:53.205988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:53.221869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:53.223698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:53.227111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0d575da9-1c4b-4763-b34e-dfc9387de4f4 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2753 microversion: 2.32 time: 0.438891 Oct 29 20:56:53.240662 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1132/2352] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:52 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2753 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:53.260195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8261c98a-24a2-454c-9280-287503ebbd6f tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171ef7670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.296981 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8261c98a-24a2-454c-9280-287503ebbd6f tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-481425377" status: 204 len: 0 microversion: 2.2 time: 0.054949 Oct 29 20:56:53.298228 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1133/2353] 10.222.0.36 () {60 vars in 1318 bytes} [Sat Oct 29 20:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-481425377 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:53.314201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b4a1bb77-d53f-4adc-bc1d-16740b661071 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa1762dd790>, body: {"keypair": {"name": "tempest-keypair-2025054842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxdalSav8JuVvpbYzX4eI2LBP8unk4Q2licZu4KNrBZwNVhkbWNK1/tNSW03aVllszNmUZhzFgubZvG4Xjl0oF62w6ENjgBNnrWhmJ1EpIpi4vgq04qfbE7R/kTGjTHSQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:53.320704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:53.329880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:53.333955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:53.336724 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5768d3a-d9e9-4411-9d03-d4e795336564 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1249 microversion: 2.25 time: 0.164423 Oct 29 20:56:53.338481 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1221/2354] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:53 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1249 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:53.356960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b4a1bb77-d53f-4adc-bc1d-16740b661071 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:53.368704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b4a1bb77-d53f-4adc-bc1d-16740b661071 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:53.414360 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b4a1bb77-d53f-4adc-bc1d-16740b661071 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.107683 Oct 29 20:56:53.415732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1134/2355] 10.222.0.36 () {62 vars in 1199 bytes} [Sat Oct 29 20:56:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 29 20:56:53.427959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0bf3f1b1-3468-4d9a-be97-3180a01f8fe4 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171617310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.437828 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0bf3f1b1-3468-4d9a-be97-3180a01f8fe4 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-2025054842" status: 200 len: 513 microversion: 2.2 time: 0.014297 Oct 29 20:56:53.439086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1222/2356] 10.222.0.36 () {60 vars in 1258 bytes} [Sat Oct 29 20:56:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2025054842 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:53.455790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51820f5b-b94a-49a5-b0e4-4dd69a9a9600 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa1763a2dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.459999 ncdv-master-1 devstack@n-api.service[138884]: WARNING oslo_db.sqlalchemy.utils [None req-51820f5b-b94a-49a5-b0e4-4dd69a9a9600 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 20:56:53.473636 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51820f5b-b94a-49a5-b0e4-4dd69a9a9600 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.022417 Oct 29 20:56:53.477113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1135/2357] 10.222.0.36 () {60 vars in 1177 bytes} [Sat Oct 29 20:56:53 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:53.485442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-770e6ff4-6e8d-4922-9e27-6e3324e3fde9 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa17144aa60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.529224 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-770e6ff4-6e8d-4922-9e27-6e3324e3fde9 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025054842" status: 204 len: 0 microversion: 2.2 time: 0.044737 Oct 29 20:56:53.529913 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1223/2358] 10.222.0.36 () {60 vars in 1261 bytes} [Sat Oct 29 20:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025054842 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:53.543662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Action: 'create', calling method: .version_select at 0x7fa171d57550>, body: {"keypair": {"name": "tempest-keypair-503541083", "type": "x509"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:53.573930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:53.583420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:53.638736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.processutils [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmu9luow1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmu9luow1/temp.key -subj /CN=a56eacd15aee45c78e3f8250661bec2f -extensions v3_req_client {{(pid=138884) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 20:56:53.802800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63d47171-ba8f-491d-8118-cf923e225be2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171411c10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.881052 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63d47171-ba8f-491d-8118-cf923e225be2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.083218 Oct 29 20:56:53.881911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1224/2359] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:53 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:53.898019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-153619b8-120a-4288-b410-6f302aabb17a req-e3768209-8906-4a41-aaf0-900233f2305d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-deleted", "tag": "350a15b5-cd02-426b-b837-13daafa16f6e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:53.931793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-153619b8-120a-4288-b410-6f302aabb17a req-e3768209-8906-4a41-aaf0-900233f2305d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:53.936213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-153619b8-120a-4288-b410-6f302aabb17a req-e3768209-8906-4a41-aaf0-900233f2305d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:53.936859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-153619b8-120a-4288-b410-6f302aabb17a req-e3768209-8906-4a41-aaf0-900233f2305d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:53.950161 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-153619b8-120a-4288-b410-6f302aabb17a req-e3768209-8906-4a41-aaf0-900233f2305d service nova] Creating event network-vif-deleted:350a15b5-cd02-426b-b837-13daafa16f6e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:53.956778 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-153619b8-120a-4288-b410-6f302aabb17a req-e3768209-8906-4a41-aaf0-900233f2305d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072234 Oct 29 20:56:53.958049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1225/2360] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:53.963281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:53.964204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:53.971667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:53.972377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:53.972977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:53.973950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:53.974707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:53.975299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.186910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.processutils [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmu9luow1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmu9luow1/temp.key -subj /CN=a56eacd15aee45c78e3f8250661bec2f -extensions v3_req_client" returned: 0 in 0.547s {{(pid=138884) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 20:56:54.195127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.processutils [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmu9luow1/temp.key -password pass: {{(pid=138884) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 20:56:54.223610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.processutils [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmu9luow1/temp.key -password pass:" returned: 0 in 0.028s {{(pid=138884) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 20:56:54.236647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.246921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc9d4f9b-efa1-42e6-ac0c-4b96778e9fd6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1334 microversion: 2.1 time: 0.287439 Oct 29 20:56:54.247628 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1226/2361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:53 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1334 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:54.269400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.278275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:54.290132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:56:54.293958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.295462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.297192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Getting quotas for user a56eacd15aee45c78e3f8250661bec2f and project 2bb9e12be0e3413c964a2a88fff7f020. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:56:54.297685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.298440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.298913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.299386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.301361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:54.325605 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81d758c6-6890-4e74-8fcd-836e565ac553 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.787121 Oct 29 20:56:54.328185 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1136/2362] 10.222.0.36 () {62 vars in 1198 bytes} [Sat Oct 29 20:56:53 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 790 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:54.340391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.341481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:54.350395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.351167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.351775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.352941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.353720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.354306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.371033 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24b82b94-07e5-40e3-8b7c-cbc724762a18 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121926 Oct 29 20:56:54.374211 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1227/2363] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:56:54 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:54.385838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1890a656-f453-4233-b50a-5cf51db27a92 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171617160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.391470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:54.401142 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1890a656-f453-4233-b50a-5cf51db27a92 tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-503541083" status: 200 len: 1533 microversion: 2.2 time: 0.025619 Oct 29 20:56:54.402586 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1228/2364] 10.222.0.36 () {60 vars in 1255 bytes} [Sat Oct 29 20:56:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-503541083 => generated 1533 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:54.410630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.412678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:54.425579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.430008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.431103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.432188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.433277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.436804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.731706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.745896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.748026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.750581 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f28a08f5-569c-4dcf-b360-567fe0ac86d1 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2549 microversion: 2.32 time: 0.421098 Oct 29 20:56:54.751843 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1137/2365] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:54 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2549 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:54.760861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.761592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:54.769418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.770158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.770653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.771411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:54.771863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:54.778518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:54.819596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.833424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.835425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:54.836430 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-35aa3e88-cc5f-4f75-b3ba-e86863ddada8 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.432529 Oct 29 20:56:54.840314 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1229/2366] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:54 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:54.858355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7413053e-66ac-407c-ae8a-05d0d0d61f1b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa1714f51f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.863505 ncdv-master-1 devstack@n-api.service[138885]: WARNING oslo_db.sqlalchemy.utils [None req-7413053e-66ac-407c-ae8a-05d0d0d61f1b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 20:56:54.882253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7413053e-66ac-407c-ae8a-05d0d0d61f1b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.040648 Oct 29 20:56:54.884147 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1230/2367] 10.222.0.36 () {60 vars in 1177 bytes} [Sat Oct 29 20:56:54 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:54.896519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-708b021f-3cc3-4fc2-837d-4a4518f65e1b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] Calling method '.version_select at 0x7fa171974280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:54.936034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-708b021f-3cc3-4fc2-837d-4a4518f65e1b tempest-KeyPairsV22TestJSON-512375745 tempest-KeyPairsV22TestJSON-512375745-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503541083" status: 204 len: 0 microversion: 2.2 time: 0.043301 Oct 29 20:56:54.936621 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1231/2368] 10.222.0.36 () {60 vars in 1258 bytes} [Sat Oct 29 20:56:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503541083 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:54.948540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c75c3e53-6522-4279-b8f9-03a7352604e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1714e7700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:55.005941 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c75c3e53-6522-4279-b8f9-03a7352604e3 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.060761 Oct 29 20:56:55.006551 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1232/2369] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:54 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:55.109531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lazy-loading 'services' on Instance uuid b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:56:55.275035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:55.276229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:55.291778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:55.293875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:55.296848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:55.297860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:55.304231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:55.304970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:55.353162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:55.806455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:55.821372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-257b9387-c22e-4349-996c-738f1e39aefd tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.550550 Oct 29 20:56:55.826516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1233/2370] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:55 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:56:55.827411 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-86f88eb0-ba48-4710-add3-065f8c53fa82 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments/62815267-2fed-492c-86da-0f37a8b4198f" status: 202 len: 0 microversion: 2.1 time: 1.071188 Oct 29 20:56:55.828455 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1138/2371] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 20:56:54 2022] DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments/62815267-2fed-492c-86da-0f37a8b4198f => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:56:55.841610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:55.846241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:55.866377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:55.866785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:55.869470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:55.870670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:55.872913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:55.874808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:55.875545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:55.878051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:55.902301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:55.903401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:55.904515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:55.905797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:55.906419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:55.907754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:56.239352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:56.251815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:56.259548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:56.263751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55385934-07f9-4182-a9ff-adca1272e7d1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.395097 Oct 29 20:56:56.264708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1139/2372] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:55 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:56.276480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-40407080-e82b-4e8b-900d-11bcc2e09543 req-342afa9f-eaab-4aea-aaaf-d127eea7d195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-deleted", "tag": "63d60491-c21a-48b5-a73d-567ca98d992e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:56.293210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-40407080-e82b-4e8b-900d-11bcc2e09543 req-342afa9f-eaab-4aea-aaaf-d127eea7d195 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:56.294381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-40407080-e82b-4e8b-900d-11bcc2e09543 req-342afa9f-eaab-4aea-aaaf-d127eea7d195 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:56.295009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-40407080-e82b-4e8b-900d-11bcc2e09543 req-342afa9f-eaab-4aea-aaaf-d127eea7d195 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:56.313891 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-40407080-e82b-4e8b-900d-11bcc2e09543 req-342afa9f-eaab-4aea-aaaf-d127eea7d195 service nova] Creating event network-vif-deleted:63d60491-c21a-48b5-a73d-567ca98d992e for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:56.320607 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-40407080-e82b-4e8b-900d-11bcc2e09543 req-342afa9f-eaab-4aea-aaaf-d127eea7d195 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054027 Oct 29 20:56:56.321754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1140/2373] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:56.328328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:56.328980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-72060f6d-b923-4fa4-83a4-559a7d7f9051 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa176246f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:56.345525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:56.348139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:56.357710 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9422038-de43-4b25-a330-1e0a0d027434 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2502 microversion: 2.32 time: 0.528224 Oct 29 20:56:56.358364 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1234/2374] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:55 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2502 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:56.434474 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-72060f6d-b923-4fa4-83a4-559a7d7f9051 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.111007 Oct 29 20:56:56.443340 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1141/2375] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:56 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:56.856951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:56.857645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:56.871887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:56.872242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:56.872691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:56.877719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:56.878234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:56.878691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:57.243556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-97a0318e-09ac-4dae-8330-b988142243a9 req-27dda48b-d20f-4592-ad79-2d0dc2298c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48232db-4cad-4419-8a60-b51f8812f61b", "tag": "8591c42c-bb09-4189-8762-966fee70ab4f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:57.256400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-97a0318e-09ac-4dae-8330-b988142243a9 req-27dda48b-d20f-4592-ad79-2d0dc2298c04 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:57.257109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-97a0318e-09ac-4dae-8330-b988142243a9 req-27dda48b-d20f-4592-ad79-2d0dc2298c04 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:57.257759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-97a0318e-09ac-4dae-8330-b988142243a9 req-27dda48b-d20f-4592-ad79-2d0dc2298c04 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:57.269876 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-97a0318e-09ac-4dae-8330-b988142243a9 req-27dda48b-d20f-4592-ad79-2d0dc2298c04 service nova] Creating event network-changed:8591c42c-bb09-4189-8762-966fee70ab4f for instance a48232db-4cad-4419-8a60-b51f8812f61b on nch2-master-1 Oct 29 20:56:57.281642 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-97a0318e-09ac-4dae-8330-b988142243a9 req-27dda48b-d20f-4592-ad79-2d0dc2298c04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Oct 29 20:56:57.282820 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1142/2376] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:57.297372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:57.298800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:57.305976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:57.306753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:57.307422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:57.308360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:57.309444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:57.310011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:57.606923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:57.622689 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8af520e3-f187-4eb9-815d-bdbb76b07187 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.770290 Oct 29 20:56:57.623530 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1235/2377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:56 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:57.630195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:57.631143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:57.638425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:57.639231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:57.639731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:57.640504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:57.641032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:57.642162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:57.985131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:58.001446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:58.023020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:58.029447 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4cab7e1b-ff5a-4778-96a1-a38acf216043 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.737353 Oct 29 20:56:58.030128 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1143/2378] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:57 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:56:58.055833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-821718ce-df87-4a59-b9d8-9ec49eb782c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17264a1f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:58.155792 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-821718ce-df87-4a59-b9d8-9ec49eb782c9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.118236 Oct 29 20:56:58.171493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1144/2379] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:58 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:58.177194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:58.182684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:58.201203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.204606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.205404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.206496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.207974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.210037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.284974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:58.285165 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a83aa0ad-f73d-42cd-a687-c3ae1530227b tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112179 Oct 29 20:56:58.288063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1145/2380] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:56:58 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:56:58.325907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:58.332580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:58.338155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b395db0-7ab1-4746-bba0-c27b1c2a7e3e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2341 microversion: 2.32 time: 0.711985 Oct 29 20:56:58.342084 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1236/2381] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:57 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2341 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:58.353525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3937306b-0be7-422a-a4b2-ab9541f589c8 req-3c880808-5595-4116-bbe0-f36cb2fb294b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beff40db-1248-41ac-bfc3-33299f73eb0e", "name": "network-vif-plugged", "status": "completed", "tag": "a71ba1a5-d419-4940-bdd1-bb22b699fa7a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:58.381982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3937306b-0be7-422a-a4b2-ab9541f589c8 req-3c880808-5595-4116-bbe0-f36cb2fb294b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.383217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3937306b-0be7-422a-a4b2-ab9541f589c8 req-3c880808-5595-4116-bbe0-f36cb2fb294b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.384704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3937306b-0be7-422a-a4b2-ab9541f589c8 req-3c880808-5595-4116-bbe0-f36cb2fb294b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.399046 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3937306b-0be7-422a-a4b2-ab9541f589c8 req-3c880808-5595-4116-bbe0-f36cb2fb294b service nova] Creating event network-vif-plugged:a71ba1a5-d419-4940-bdd1-bb22b699fa7a for instance beff40db-1248-41ac-bfc3-33299f73eb0e on nch1-master-1 Oct 29 20:56:58.406931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:58.410582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:58.419375 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3937306b-0be7-422a-a4b2-ab9541f589c8 req-3c880808-5595-4116-bbe0-f36cb2fb294b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080016 Oct 29 20:56:58.420698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.421871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.422574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.423737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.424444 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1146/2382] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:56:58.424875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.425492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.468676 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab4f9e50-60e2-48b1-a61a-d484f69cde52 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065599 Oct 29 20:56:58.471753 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1237/2383] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 20:56:58 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:56:58.496177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c95e4796-e0e0-4092-9d0b-72948a9a9ae9 req-60102718-ec65-4869-8ef5-1cc2e641d886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-deleted", "tag": "04b9470e-35a4-48e8-9216-737abadca683"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:58.509479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c95e4796-e0e0-4092-9d0b-72948a9a9ae9 req-60102718-ec65-4869-8ef5-1cc2e641d886 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.510327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c95e4796-e0e0-4092-9d0b-72948a9a9ae9 req-60102718-ec65-4869-8ef5-1cc2e641d886 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.510972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c95e4796-e0e0-4092-9d0b-72948a9a9ae9 req-60102718-ec65-4869-8ef5-1cc2e641d886 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.524539 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c95e4796-e0e0-4092-9d0b-72948a9a9ae9 req-60102718-ec65-4869-8ef5-1cc2e641d886 service nova] Creating event network-vif-deleted:04b9470e-35a4-48e8-9216-737abadca683 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:56:58.530540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c95e4796-e0e0-4092-9d0b-72948a9a9ae9 req-60102718-ec65-4869-8ef5-1cc2e641d886 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038328 Oct 29 20:56:58.531804 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1147/2384] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:56:58.569565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:58.570488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:58.585136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.586096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.586847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.589127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.590020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.590840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.630711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:56:58.656720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:58.659381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:58.695082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.696216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.696900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.698265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.703774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.707984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.804979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-614eeb62-c7b7-48c8-b639-11a533a65828 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 204 len: 0 microversion: 2.1 time: 0.240873 Oct 29 20:56:58.811273 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1238/2385] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:56:58 2022] DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:56:58.826148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:58.826148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:58.836376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.837528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.839216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:58.842099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:58.843289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:58.844594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:59.041945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:59.085976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:59.101733 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8bce2504-1594-4869-9766-b56702f6431f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.457981 Oct 29 20:56:59.103004 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1148/2386] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:58 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:59.116851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:59.117699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:59.131714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:59.132318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:59.134025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:59.134950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:59.138196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:59.139669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:59.370445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:59.379527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9c88180a-04a2-47cf-88cd-f156559a3f4c tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1677 microversion: 2.1 time: 0.564744 Oct 29 20:56:59.380117 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1239/2387] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:56:58 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1677 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:59.390347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd356138-9385-4b05-9c3b-ef8eedc61669 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1714f5160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:59.465005 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd356138-9385-4b05-9c3b-ef8eedc61669 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.078243 Oct 29 20:56:59.466077 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1240/2388] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:56:59 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:56:59.477178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "tag": "76e6e194-7707-47e0-b36a-757e8a00d177"}, {"name": "network-changed", "server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "tag": "9f39a931-363c-4d76-9b48-0f0e6517f4d5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:56:59.484424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:59.497031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:56:59.497571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:59.499328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:56:59.500953 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f732bee-f846-4656-8318-66a9c2202aec tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.397455 Oct 29 20:56:59.502801 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1149/2389] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:59 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:56:59.518042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:59.518344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:56:59.518683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:59.521787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:59.522038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:56:59.531826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:59.532427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:59.532818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:59.534200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:56:59.534674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:56:59.536694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:56:59.539492 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] Creating event network-changed:76e6e194-7707-47e0-b36a-757e8a00d177 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:56:59.540348 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] Creating event network-changed:9f39a931-363c-4d76-9b48-0f0e6517f4d5 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:56:59.546945 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d5209e48-bf75-482a-ab31-38a5413381e8 req-12e3f881-7ffd-4ba8-b828-d442c2656af2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079067 Oct 29 20:56:59.548257 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1241/2390] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:00.104078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:00.114062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:00.115544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:00.116806 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-790bfd00-2344-4bfa-bbb0-7e556bb7de6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 2159 microversion: 2.32 time: 0.612331 Oct 29 20:57:00.129621 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1150/2391] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:56:59 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 2159 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:00.134744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:00.136123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:00.147398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:00.148262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:00.148740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:00.150270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:00.150886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:00.151337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:00.403683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:00.404700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:00.422178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:00.427012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:00.428338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:00.431392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:00.432113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:00.434279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.361225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:01.405569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:01.432817 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b3f98ec-e9c4-49d9-9c9e-8a7c7a21b01a tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1677 microversion: 2.1 time: 1.033422 Oct 29 20:57:01.447096 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1151/2392] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:00 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1677 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:01.484721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-815a9e47-56eb-4f34-beaf-a3c0c6914547 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171d499d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:01.600747 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-815a9e47-56eb-4f34-beaf-a3c0c6914547 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.138092 Oct 29 20:57:01.601751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1152/2393] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:01 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:01.613651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:01.614672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:01.633983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:01.634847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:01.636329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.638389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:01.647754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:01.654133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.702662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:01.716288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87532b5e-8c0d-44da-a848-75e3b19c3eff tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 1.595582 Oct 29 20:57:01.730030 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1242/2394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:00 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:01.741629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f65bcd5c-1384-4b42-b021-dba81dc501e9 req-28523df4-c2d5-4e28-bcdc-53630902660f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d07776-23bf-4c50-b3fb-c71b2420a571", "name": "network-vif-deleted", "tag": "8143b14b-a1cc-4d09-b1ee-95d78e193450"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:01.759960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f65bcd5c-1384-4b42-b021-dba81dc501e9 req-28523df4-c2d5-4e28-bcdc-53630902660f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:01.760862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f65bcd5c-1384-4b42-b021-dba81dc501e9 req-28523df4-c2d5-4e28-bcdc-53630902660f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:01.761601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f65bcd5c-1384-4b42-b021-dba81dc501e9 req-28523df4-c2d5-4e28-bcdc-53630902660f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.792070 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f65bcd5c-1384-4b42-b021-dba81dc501e9 req-28523df4-c2d5-4e28-bcdc-53630902660f service nova] Creating event network-vif-deleted:8143b14b-a1cc-4d09-b1ee-95d78e193450 for instance 99d07776-23bf-4c50-b3fb-c71b2420a571 on nch1-master-1 Oct 29 20:57:01.806230 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f65bcd5c-1384-4b42-b021-dba81dc501e9 req-28523df4-c2d5-4e28-bcdc-53630902660f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074440 Oct 29 20:57:01.806973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1243/2395] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:01.848030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:01.849947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:01.856787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:01.858403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:01.859063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.860027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:01.860705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:01.861341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.943396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:01.944211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:01.945100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:01.945951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lazy-loading 'fault' on Instance uuid 99d07776-23bf-4c50-b3fb-c71b2420a571 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:02.242433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:02.253112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:02.256635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47e571be08a14d40951a503df48a7c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddac3a85fca49df9c83c7863e9d3ac3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:02.261698 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad1cc600-74fe-48e8-9f52-e37d25570bc2 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 200 len: 1370 microversion: 2.32 time: 0.447200 Oct 29 20:57:02.262410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1244/2396] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:01 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 1370 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:02.432073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:02.460356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:02.460998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:02.478254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:02.484704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:02.487295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:02.487956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:02.488410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:02.489156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:02.489646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:02.490076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:02.518569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f1300570-f736-4052-8cac-ba673eefc940 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.902151 Oct 29 20:57:02.519302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1153/2397] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:01 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:02.623236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b116dcf9-9a60-4a3b-a21f-b8b8a963f20f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762dd5e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:02.710457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b116dcf9-9a60-4a3b-a21f-b8b8a963f20f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.095921 Oct 29 20:57:02.728552 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1154/2398] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:02 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:02.748397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:02.749018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:02.764838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:02.766626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:02.768696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:02.770607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:02.771257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:02.772000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:03.364383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:03.383634 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5950def2-c5cb-449a-b805-92051bce00e9 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1677 microversion: 2.1 time: 0.921161 Oct 29 20:57:03.384691 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1245/2399] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:02 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1677 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:03.396956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:03.398153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:03.416568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:03.417350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:03.418225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:03.419129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:03.419738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:03.420309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:03.461076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:03.486523 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b9c100b-f92b-42c5-8bc4-389691e927f1 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.741881 Oct 29 20:57:03.492453 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1155/2400] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:02 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:03.494823 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] HTTP exception thrown: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Request method failure captured: Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 HTTP/1.1 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZI9DoCJjZUsfGKarHExVqFNjK5mW44SIBJCe-IwvbEw8rHNMnotymG2_WSdiNsGcdoWslFMgXsPvIssD9u54Poz6nymU-Y6mfe6JQeVdoIkevELqD6ip217OfV-f7jpN1AbXjFK44Na3wwwbAlVhTEFm3czDwqVcer2m3BAoTWQvB8 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 7ddac3a85fca49df9c83c7863e9d3ac3 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 7ddac3a85fca49df9c83c7863e9d3ac3 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TaggedBootDevicesTest-1807794048-project Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 47e571be08a14d40951a503df48a7c3d Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TaggedBootDevicesTest-1807794048-project Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '99d07776-23bf-4c50-b3fb-c71b2420a571'} Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:03.497909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:03.502189 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:03.503508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Returning 404 to user: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:03.506569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31123ca6-59ab-4959-9023-cdfafa242196 tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 404 len: 111 microversion: 2.32 time: 0.120740 Oct 29 20:57:03.509879 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1246/2401] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:03 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:57:03.526339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9ed71f1-311c-4500-b857-eed12455bc6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '.version_select at 0x7fa1762463a0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:03.551595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:03.552235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:03.563165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:03.563663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:03.564102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:03.569915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:03.570529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:03.570986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:03.604849 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9ed71f1-311c-4500-b857-eed12455bc6e tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45205272" status: 204 len: 0 microversion: 2.32 time: 0.089530 Oct 29 20:57:03.606509 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1156/2402] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 20:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45205272 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:57:03.752792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13dff0bf-43e3-415b-8e3e-fe3bbe265c2a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762990d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:03.867040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13dff0bf-43e3-415b-8e3e-fe3bbe265c2a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.121285 Oct 29 20:57:03.872203 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1157/2403] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:03 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:03.909681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-aaae9593-0d88-42eb-83bb-3721ad319c7f req-37ed8583-63af-4bd1-b828-df67ede6b71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "tag": "0ba3aeed-6403-4e58-99d8-2b7129bb09fa"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:03.943195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:03.952402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:03.958926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:03.960258 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36748a90-1eb7-4f4c-b7ce-e8cdd6170e6d tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.414547 Oct 29 20:57:03.962343 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1247/2404] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:03 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:03.985179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aaae9593-0d88-42eb-83bb-3721ad319c7f req-37ed8583-63af-4bd1-b828-df67ede6b71e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:03.995111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aaae9593-0d88-42eb-83bb-3721ad319c7f req-37ed8583-63af-4bd1-b828-df67ede6b71e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:03.996011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aaae9593-0d88-42eb-83bb-3721ad319c7f req-37ed8583-63af-4bd1-b828-df67ede6b71e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:04.030804 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-aaae9593-0d88-42eb-83bb-3721ad319c7f req-37ed8583-63af-4bd1-b828-df67ede6b71e service nova] Creating event network-changed:0ba3aeed-6403-4e58-99d8-2b7129bb09fa for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:04.047975 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-aaae9593-0d88-42eb-83bb-3721ad319c7f req-37ed8583-63af-4bd1-b828-df67ede6b71e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172454 Oct 29 20:57:04.048927 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1158/2405] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:04.411081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:04.411781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:04.425601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:04.430234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:04.431029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:04.432173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:04.436286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:04.437079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:04.516818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:04.518972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:04.528782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=36 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:04.534910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:04.537294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:04.544983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:04.547666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:04.549327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:04.552410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:04.740118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:04.750897 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2abb8fc2-275d-473b-8af2-c0de458b9bd1 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1612 microversion: 2.1 time: 0.346469 Oct 29 20:57:04.762695 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1248/2406] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:04 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1612 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:04.883783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2232e6f4-0fe0-4572-8222-17d964aa21cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17189bee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:04.954794 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2232e6f4-0fe0-4572-8222-17d964aa21cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.074992 Oct 29 20:57:04.955436 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1249/2407] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:04 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:04.991550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:04.992475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:05.004835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:05.010012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:05.010480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:05.011250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:05.011722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:05.012227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:06.208193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:06.222143 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-661c1af0-f40f-483b-b0a7-193e96ac7c75 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 1.710501 Oct 29 20:57:06.240316 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1159/2408] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:04 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:06.248104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-da80b183-c444-4906-96a6-19d17e55f892 req-2cc05d37-3b6a-4374-ac10-0d6a57e1efcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48232db-4cad-4419-8a60-b51f8812f61b", "name": "network-vif-plugged", "status": "completed", "tag": "8591c42c-bb09-4189-8762-966fee70ab4f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:06.261371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-da80b183-c444-4906-96a6-19d17e55f892 req-2cc05d37-3b6a-4374-ac10-0d6a57e1efcf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:06.262187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-da80b183-c444-4906-96a6-19d17e55f892 req-2cc05d37-3b6a-4374-ac10-0d6a57e1efcf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:06.262792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-da80b183-c444-4906-96a6-19d17e55f892 req-2cc05d37-3b6a-4374-ac10-0d6a57e1efcf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:06.279314 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-da80b183-c444-4906-96a6-19d17e55f892 req-2cc05d37-3b6a-4374-ac10-0d6a57e1efcf service nova] Creating event network-vif-plugged:8591c42c-bb09-4189-8762-966fee70ab4f for instance a48232db-4cad-4419-8a60-b51f8812f61b on nch2-master-1 Oct 29 20:57:06.286516 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-da80b183-c444-4906-96a6-19d17e55f892 req-2cc05d37-3b6a-4374-ac10-0d6a57e1efcf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044723 Oct 29 20:57:06.288041 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1160/2409] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:06.302949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:06.304047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:06.327993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:06.332442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:06.335761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:06.336866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:06.337572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:06.338010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:06.338824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:06.354790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:06.359533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:06.367132 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ba81b70-ef8d-4908-ade3-547fbb52bbc4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 1.373399 Oct 29 20:57:06.373604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1250/2410] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:04 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:06.392413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:06.393961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:06.394087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef19898d-4ae1-4bb9-8353-97d94088d46b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17144ae50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:06.394878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:06.396160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lazy-loading 'fault' on Instance uuid b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:06.467052 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef19898d-4ae1-4bb9-8353-97d94088d46b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.092254 Oct 29 20:57:06.468268 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1251/2411] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:06 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:06.481200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-52fbf31c-fc67-40cf-b4e7-2c60b05fd6f7 req-7607bd7b-4b4d-4532-af06-56fd3ec726f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07", "name": "network-vif-deleted", "tag": "be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:06.513063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-52fbf31c-fc67-40cf-b4e7-2c60b05fd6f7 req-7607bd7b-4b4d-4532-af06-56fd3ec726f2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:06.513873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-52fbf31c-fc67-40cf-b4e7-2c60b05fd6f7 req-7607bd7b-4b4d-4532-af06-56fd3ec726f2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:06.516275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-52fbf31c-fc67-40cf-b4e7-2c60b05fd6f7 req-7607bd7b-4b4d-4532-af06-56fd3ec726f2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:06.544411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-52fbf31c-fc67-40cf-b4e7-2c60b05fd6f7 req-7607bd7b-4b4d-4532-af06-56fd3ec726f2 service nova] Creating event network-vif-deleted:be7cc6c9-c39f-4dbc-b5a6-e9bd03f4c045 for instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 on nch1-master-1 Oct 29 20:57:06.557662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-52fbf31c-fc67-40cf-b4e7-2c60b05fd6f7 req-7607bd7b-4b4d-4532-af06-56fd3ec726f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086902 Oct 29 20:57:06.561472 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1252/2412] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:06.580235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95819256e6c74cf182933860544dae77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2137acee38429eaf0246a35c495060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:06.602004 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd6e14ca-a30f-4100-87e5-251e72848037 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 200 len: 1331 microversion: 2.1 time: 0.307986 Oct 29 20:57:06.603260 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1161/2413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:06 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 1331 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:07.248083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:07.249078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:07.266716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:07.267480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:07.268084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:07.268979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:07.269663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:07.270258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:07.636592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:07.637397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:07.648788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:07.651836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:07.652354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:07.653220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:07.655387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:07.657519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:07.800923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:07.805997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:07.826351 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-77f5c2d1-648c-44fa-b7d2-ad2a76ede74a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.583733 Oct 29 20:57:07.828028 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1253/2414] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:07 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:07.837607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8f2f8e1-58cd-4d51-8b27-4b30b6aea89a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17189bdc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:07.978302 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8f2f8e1-58cd-4d51-8b27-4b30b6aea89a tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.144880 Oct 29 20:57:07.979856 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1254/2415] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:07 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:07.996273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:08.004811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:08.042298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:08.043904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:08.046407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:08.055443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:08.057244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:08.062053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:08.163923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] HTTP exception thrown: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Request method failure captured: Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 HTTP/1.1 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZLg8EHOVIHAyD4vI_0JguAcBK3OHWqpp4GzdMd5rJ35viok_xDJta9jzcPrsM9I3rRtSCg_tJx8AEia8d5jH2e6pK8H4t4p7tXhIyzvNizs07ug8gdxxTckrWpEZsZ9D4cw2b-1ypmcpmq3xOW5aodSzXq1ejQ_nitKCzEuFfp_xBg Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: db2137acee38429eaf0246a35c495060 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db2137acee38429eaf0246a35c495060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_db2137acee38429eaf0246a35c495060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db2137acee38429eaf0246a35c495060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/db2137acee38429eaf0246a35c495060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: db2137acee38429eaf0246a35c495060 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachSCSIVolumeTestJSON-1701230677-project Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 95819256e6c74cf182933860544dae77 Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1701230677-project Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07'} Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:08.175501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:57:08.179181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Returning 404 to user: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:08.182277 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72792d17-cb76-475f-b7a1-bc29f75d3151 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 404 len: 111 microversion: 2.1 time: 0.195933 Oct 29 20:57:08.193335 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1255/2416] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:07 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:57:08.203668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf486a83-a8d5-42db-ba17-e5931f6e3aa6 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '.version_select at 0x7fa171c4a040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:08.225366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:08.241779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:08.247812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:08.249372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3133eb3-cd16-4109-805f-b2e4b21fbdc0 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1279 microversion: 2.25 time: 0.856842 Oct 29 20:57:08.256213 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1162/2417] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:07 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1279 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:08.269273 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf486a83-a8d5-42db-ba17-e5931f6e3aa6 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034285978" status: 202 len: 0 microversion: 2.1 time: 0.074530 Oct 29 20:57:08.276452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1256/2418] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 20:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034285978 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:57:08.851823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:08.853044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:08.865347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:08.870267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:08.870988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:08.871937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:08.872580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:08.873983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:08.929078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:08.997014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5480f134-3b9c-4831-8667-87b44cb31011 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17189bb80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:09.082249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5480f134-3b9c-4831-8667-87b44cb31011 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.089680 Oct 29 20:57:09.083717 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1257/2419] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:08 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:09.281324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:09.282230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:09.293418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:09.297293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:09.298145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:09.299658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:09.302154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:09.302945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:09.761163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:09.778204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c09cb29-1ae8-4b56-b954-c192dab1ae72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.931054 Oct 29 20:57:09.779008 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1163/2420] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:08 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:10.010480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:10.029652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:10.032078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:10.033962 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ded264b-c950-4c15-a81f-b5ce002906b5 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1475 microversion: 2.25 time: 0.756789 Oct 29 20:57:10.035916 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1258/2421] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:09 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1475 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:10.061406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:10.062964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:10.075774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:10.076807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:10.077692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:10.078787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:10.079469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:10.080708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:10.099240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea016925-033d-439f-8308-e27b05e0e63b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1714f1f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:10.740202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid a48232db-4cad-4419-8a60-b51f8812f61b {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:10.789964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7663e2a4-beca-4bcd-b765-23e90ef6908f tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1966 microversion: 2.25 time: 0.733447 Oct 29 20:57:10.790607 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1164/2422] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:10 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1966 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:10.805524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:10.806156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:10.828317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:10.842380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:10.843186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:10.844212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:10.845074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:10.845726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:11.284932 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea016925-033d-439f-8308-e27b05e0e63b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 1.190104 Oct 29 20:57:11.287259 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1259/2423] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:10 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:11.295536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:11.297107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:11.331367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:11.331577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:11.331905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:11.332667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:11.339271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:11.340365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.552434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:12.577064 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-489a1fb0-b3da-4b0c-aca2-4e29119ace32 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 1.771357 Oct 29 20:57:12.579352 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1165/2424] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:10 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:12.604752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4302f2a-3492-44c2-9a99-37b75ab09839 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17625b0d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:12.716588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4302f2a-3492-44c2-9a99-37b75ab09839 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.128245 Oct 29 20:57:12.718149 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1166/2425] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:12 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:12.731668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:12.733369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:12.758214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:12.760749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:12.762472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.763191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid a48232db-4cad-4419-8a60-b51f8812f61b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:12.766030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:12.766706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:12.768974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.805098 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3eb148c6-f7ef-4563-811a-7138c1d96116 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1966 microversion: 2.25 time: 1.515453 Oct 29 20:57:12.808802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1260/2426] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:11 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1966 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:12.845050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:12.847723 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] HTTP exception thrown: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Request method failure captured: Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 HTTP/1.1 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZLg8EHOVIHAyD4vI_0JguAcBK3OHWqpp4GzdMd5rJ35viok_xDJta9jzcPrsM9I3rRtSCg_tJx8AEia8d5jH2e6pK8H4t4p7tXhIyzvNizs07ug8gdxxTckrWpEZsZ9D4cw2b-1ypmcpmq3xOW5aodSzXq1ejQ_nitKCzEuFfp_xBg Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: db2137acee38429eaf0246a35c495060 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db2137acee38429eaf0246a35c495060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_db2137acee38429eaf0246a35c495060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db2137acee38429eaf0246a35c495060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/db2137acee38429eaf0246a35c495060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: db2137acee38429eaf0246a35c495060 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachSCSIVolumeTestJSON-1701230677-project Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 95819256e6c74cf182933860544dae77 Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1701230677-project Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07'} Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:12.849797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.853901 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.855524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Returning 404 to user: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:12.856348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:12.857108 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0f39966e-93c1-49f2-955e-a600c3152837 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 404 len: 111 microversion: 2.1 time: 0.135800 Oct 29 20:57:12.857891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:12.859264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.859790 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1167/2427] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:57:12 2022] DELETE /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:57:12.860840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:12.863720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:12.865278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.873806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:12.874523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] [instance: b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:12.895964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:12.896484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:12.900943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.902048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:12.903761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:12.904841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:12.953271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3773f920-37dd-4d00-abfa-48163beb0704 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.115547 Oct 29 20:57:12.954264 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] HTTP exception thrown: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Request method failure captured: Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 HTTP/1.1 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZLg8EHOVIHAyD4vI_0JguAcBK3OHWqpp4GzdMd5rJ35viok_xDJta9jzcPrsM9I3rRtSCg_tJx8AEia8d5jH2e6pK8H4t4p7tXhIyzvNizs07ug8gdxxTckrWpEZsZ9D4cw2b-1ypmcpmq3xOW5aodSzXq1ejQ_nitKCzEuFfp_xBg Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: db2137acee38429eaf0246a35c495060 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db2137acee38429eaf0246a35c495060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_db2137acee38429eaf0246a35c495060"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/db2137acee38429eaf0246a35c495060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/db2137acee38429eaf0246a35c495060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: db2137acee38429eaf0246a35c495060 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1701230677 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachSCSIVolumeTestJSON-1701230677-project Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 95819256e6c74cf182933860544dae77 Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1701230677-project Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07'} Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:12.956686 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. Oct 29 20:57:12.972959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:12.974538 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1261/2428] 10.222.0.36 () {60 vars in 1217 bytes} [Sat Oct 29 20:57:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:57:12.976786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:12.977898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] Returning 404 to user: Instance b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:12.982079 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-987aba58-4eab-4c33-876a-b9dc17f114b7 tempest-AttachSCSIVolumeTestJSON-1701230677 tempest-AttachSCSIVolumeTestJSON-1701230677-project] 10.222.0.36 "GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07" status: 404 len: 111 microversion: 2.1 time: 0.118456 Oct 29 20:57:12.983495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:12.984021 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1168/2429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:12 2022] GET /compute/v2.1/servers/b59e6920-6e8d-41d0-ac4b-b6ac75f4ac07 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:57:13.010175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:13.014657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:13.015338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:13.016303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:13.017544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:13.020485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:13.101053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'flavor' on Instance uuid a48232db-4cad-4419-8a60-b51f8812f61b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:13.147565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Going to try to live migrate instance to nch1-master-1 {{(pid=138885) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 20:57:13.612566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:13.613307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:13.637329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:13.678373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:13.681352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:13.684131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:13.687221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:13.693150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:14.991097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:15.009821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14772c59-1e9c-4196-863b-c3008334aee4 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 1.399791 Oct 29 20:57:15.037805 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1169/2430] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:13 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:15.053605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-311e8c14-31b4-4b78-9238-03ca63f73a2e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa176354af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:15.140113 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-311e8c14-31b4-4b78-9238-03ca63f73a2e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.099752 Oct 29 20:57:15.141587 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1170/2431] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:15 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:16.040891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:16.042050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:16.074554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:16.084744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:16.085316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:16.088098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:16.089723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:16.091321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:16.874540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:16.906147 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6db49bc6-7180-4c6b-a385-07dd971063f3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.868784 Oct 29 20:57:16.907002 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1171/2432] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:16 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:16.920681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e934724d-8d9b-491d-90fe-8114964687b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1763a2a60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:17.050831 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e934724d-8d9b-491d-90fe-8114964687b8 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.142392 Oct 29 20:57:17.054904 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1172/2433] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:16 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:17.077718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:17.080758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:17.106302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:17.106815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:17.108212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:17.109015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:17.109549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:17.109987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:17.127410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] HTTP exception thrown: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Request method failure captured: Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 HTTP/1.1 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZI9DoCJjZUsfGKarHExVqFNjK5mW44SIBJCe-IwvbEw8rHNMnotymG2_WSdiNsGcdoWslFMgXsPvIssD9u54Poz6nymU-Y6mfe6JQeVdoIkevELqD6ip217OfV-f7jpN1AbXjFK44Na3wwwbAlVhTEFm3czDwqVcer2m3BAoTWQvB8 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 7ddac3a85fca49df9c83c7863e9d3ac3 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 7ddac3a85fca49df9c83c7863e9d3ac3 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TaggedBootDevicesTest-1807794048-project Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 47e571be08a14d40951a503df48a7c3d Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TaggedBootDevicesTest-1807794048-project Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '99d07776-23bf-4c50-b3fb-c71b2420a571'} Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:17.135007 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.138990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.140363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Returning 404 to user: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:17.141416 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f0c65846-9d5c-411b-8f12-13f977466f7d tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "DELETE /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 404 len: 111 microversion: 2.32 time: 0.084221 Oct 29 20:57:17.142993 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1173/2434] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:57:17 2022] DELETE /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:57:17.151258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:17.152291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] [instance: 99d07776-23bf-4c50-b3fb-c71b2420a571] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:17.162964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:17.165539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:17.166763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:17.168405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:17.171128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:17.173085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:17.197001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] HTTP exception thrown: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Request method failure captured: Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 HTTP/1.1 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZI9DoCJjZUsfGKarHExVqFNjK5mW44SIBJCe-IwvbEw8rHNMnotymG2_WSdiNsGcdoWslFMgXsPvIssD9u54Poz6nymU-Y6mfe6JQeVdoIkevELqD6ip217OfV-f7jpN1AbXjFK44Na3wwwbAlVhTEFm3czDwqVcer2m3BAoTWQvB8 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 7ddac3a85fca49df9c83c7863e9d3ac3 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7ddac3a85fca49df9c83c7863e9d3ac3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 7ddac3a85fca49df9c83c7863e9d3ac3 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1807794048 Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TaggedBootDevicesTest-1807794048-project Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 47e571be08a14d40951a503df48a7c3d Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TaggedBootDevicesTest-1807794048-project Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '99d07776-23bf-4c50-b3fb-c71b2420a571'} Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.199384 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. Oct 29 20:57:17.205428 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:17.208056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] Returning 404 to user: Instance 99d07776-23bf-4c50-b3fb-c71b2420a571 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:17.209841 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b3ccc00c-3fad-4bb6-a6c9-eb2f6dcdd9fe tempest-TaggedBootDevicesTest-1807794048 tempest-TaggedBootDevicesTest-1807794048-project] 10.222.0.36 "GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571" status: 404 len: 111 microversion: 2.32 time: 0.062381 Oct 29 20:57:17.214878 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1174/2435] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:17 2022] GET /compute/v2.1/servers/99d07776-23bf-4c50-b3fb-c71b2420a571 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:57:17.943136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:17.944015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:17.958619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:17.965870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:17.969066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:17.971799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:17.972474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:17.973406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:18.156833 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-463c1b4d-9454-40cc-8755-3d9fb12e674b tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b/action" status: 202 len: 0 microversion: 2.25 time: 5.185561 Oct 29 20:57:18.162098 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1262/2436] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:57:12 2022] POST /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b/action => generated 0 bytes in 5193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:57:18.185523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0b3fb03-a841-4dd2-97b0-1917a3c72a33 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1712500d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:18.325592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0b3fb03-a841-4dd2-97b0-1917a3c72a33 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.156579 Oct 29 20:57:18.326258 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1263/2437] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:18 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:18.345090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:18.350584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:18.377978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:18.379765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:18.381589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:18.385431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:18.387646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:18.390170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:19.858937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:19.878015 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4eaee5aa-0b5b-4ea9-8cf4-307e716d20e5 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 1.940710 Oct 29 20:57:19.879784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1175/2438] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:17 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:20.083722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:20.114889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:20.130302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:20.134000 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e90babba-c617-4e5b-bdad-bc897ec268b3 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 1.801996 Oct 29 20:57:20.134997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-960504790", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "bdd5709c-57b5-48ac-9292-04dbbd807548"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:20.143745 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1264/2439] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:18 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:20.170191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38cd2410-4fb8-472c-942e-69f25aa08a19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1711f7160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:20.418719 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38cd2410-4fb8-472c-942e-69f25aa08a19 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.273700 Oct 29 20:57:20.419312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1265/2440] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:20 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:20.451407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] validate_networks() for [('bdd5709c-57b5-48ac-9292-04dbbd807548', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:57:20.908592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:20.909016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:20.945242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:20.946061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:20.947032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:20.950054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:20.950856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:20.951890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:21.687006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:57:21.688036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:57:21.688728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:57:21.690273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:57:21.690945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:57:21.715985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:21.721283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:21.723556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:21.727788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:21.731737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:21.735561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:21.850992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Getting quotas for project 822d84a41ce34d9f8dca67d21c47ee9b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:57:21.877149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Getting quotas for user 60bbbaab390c4b078d30c1c3f8e8f942 and project 822d84a41ce34d9f8dca67d21c47ee9b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:57:21.911782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:21.929793 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf1885fb-ae39-4f8e-ae25-148574fa8ebe tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 1.025445 Oct 29 20:57:21.932517 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1266/2441] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:20 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:21.946886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:21.947950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:21.948300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:57:21.957298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:57:21.971437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:21.973859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:21.975190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:21.977559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:21.978996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:21.980560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:22.194135 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a65f2ce5-fb93-4c45-a42f-e6f82c2732ca tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.312943 Oct 29 20:57:22.200031 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1176/2442] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:57:22.426716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d7ed505-c230-46a0-b7d8-ad3a32464e66 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa17639f9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1262058825", "description": "tempest-description-1687336278"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:22.647089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:22.662879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:22.667194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:22.670871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c516761a-1898-4064-bb79-64b180b7e38f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.735105 Oct 29 20:57:22.672283 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1267/2443] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:21 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:22.716426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c10cb07b-1a84-4e93-928d-f203d2d22e04 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1714f5940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:22.828649 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c10cb07b-1a84-4e93-928d-f203d2d22e04 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.135445 Oct 29 20:57:22.829574 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1268/2444] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:22 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:22.840516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-390e4301-249d-45ab-8712-01a7b00c0ccf req-c1894c83-b9ad-449c-87c8-2d679d6e5af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-plugged", "status": "completed", "tag": "0ba3aeed-6403-4e58-99d8-2b7129bb09fa"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:22.883487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-390e4301-249d-45ab-8712-01a7b00c0ccf req-c1894c83-b9ad-449c-87c8-2d679d6e5af3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:22.885922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-390e4301-249d-45ab-8712-01a7b00c0ccf req-c1894c83-b9ad-449c-87c8-2d679d6e5af3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:22.887208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-390e4301-249d-45ab-8712-01a7b00c0ccf req-c1894c83-b9ad-449c-87c8-2d679d6e5af3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:22.900785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:22.941794 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-390e4301-249d-45ab-8712-01a7b00c0ccf req-c1894c83-b9ad-449c-87c8-2d679d6e5af3 service nova] Creating event network-vif-plugged:0ba3aeed-6403-4e58-99d8-2b7129bb09fa for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:22.951376 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-390e4301-249d-45ab-8712-01a7b00c0ccf req-c1894c83-b9ad-449c-87c8-2d679d6e5af3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120180 Oct 29 20:57:22.955594 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1269/2445] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:22.964468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-671937ea-55c7-4966-a593-2eb2904762a1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:22.965163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-671937ea-55c7-4966-a593-2eb2904762a1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:23.138760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-671937ea-55c7-4966-a593-2eb2904762a1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:23.152724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-671937ea-55c7-4966-a593-2eb2904762a1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:23.157386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-671937ea-55c7-4966-a593-2eb2904762a1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:23.161873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-671937ea-55c7-4966-a593-2eb2904762a1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1258 microversion: 2.21 time: 0.205123 Oct 29 20:57:23.162838 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1270/2446] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:22 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:23.196090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:23.199584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:23.249887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:23.250549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:23.251008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:23.273266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:23.274316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:23.274774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:23.585423 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d7ed505-c230-46a0-b7d8-ad3a32464e66 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.379104 Oct 29 20:57:23.586698 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1177/2447] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:57:22 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:23.613472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b6258c06-a75e-4e0f-bb10-5071c8ca5425 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa171d57550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-530697608", "description": "tempest-description-213237076"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:24.000806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.018216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24bed59c-e700-4f54-8f0c-6f46e0679531 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.837311 Oct 29 20:57:24.022745 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1271/2448] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:23 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:24.044257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:24.048069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:24.070985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:24.073700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:24.074591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:24.078255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:24.079198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:24.081997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:24.547813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b6258c06-a75e-4e0f-bb10-5071c8ca5425 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.942726 Oct 29 20:57:24.548491 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1178/2449] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:57:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:24.564039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.568752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-09c380cc-cd15-4e30-b461-b16b62bb6267 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171d49310>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:24.615504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.618499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.625873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bbec99b4-0e03-4ea5-b280-a66ff744993f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.599207 Oct 29 20:57:24.646624 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1272/2450] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:24 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:24.652800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:24.653669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:24.664743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:24.668484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:24.670759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:24.672812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:24.675359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:24.676243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:24.709339 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-09c380cc-cd15-4e30-b461-b16b62bb6267 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.157909 Oct 29 20:57:24.712785 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1179/2451] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:24 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:24.737768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-619048570", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "08ef992e-00e9-4da3-afbc-82ffcfec15d9"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:24.808119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.810681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:24.826328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.828388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:24.831691 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81bf915b-46c4-4c8b-94cc-5200a051af62 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1310 microversion: 2.21 time: 0.182189 Oct 29 20:57:24.834093 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1273/2452] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:24 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1310 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:24.992383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] validate_networks() for [('08ef992e-00e9-4da3-afbc-82ffcfec15d9', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:57:25.055919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:25.057235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:25.090416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.094040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.097592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.098643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.101970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.112984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.446385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:25.462157 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c2e55f8-4d19-4134-b925-ec38f3501482 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.409810 Oct 29 20:57:25.463674 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1274/2453] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:25 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:25.652819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-33a5d2fa-61f4-4452-8422-7400b835b406 req-8fcb4d25-d70d-4c75-9145-87b5f3aab2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-plugged", "status": "completed", "tag": "9f39a931-363c-4d76-9b48-0f0e6517f4d5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:25.715611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-33a5d2fa-61f4-4452-8422-7400b835b406 req-8fcb4d25-d70d-4c75-9145-87b5f3aab2ff service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.717110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-33a5d2fa-61f4-4452-8422-7400b835b406 req-8fcb4d25-d70d-4c75-9145-87b5f3aab2ff service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.724794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-33a5d2fa-61f4-4452-8422-7400b835b406 req-8fcb4d25-d70d-4c75-9145-87b5f3aab2ff service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.729711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:57:25.730160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:57:25.730386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:57:25.730779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:57:25.731521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:57:25.746763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.751233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.753005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.754104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.756899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.757559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.771051 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-33a5d2fa-61f4-4452-8422-7400b835b406 req-8fcb4d25-d70d-4c75-9145-87b5f3aab2ff service nova] Creating event network-vif-plugged:9f39a931-363c-4d76-9b48-0f0e6517f4d5 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:25.781197 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-33a5d2fa-61f4-4452-8422-7400b835b406 req-8fcb4d25-d70d-4c75-9145-87b5f3aab2ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313154 Oct 29 20:57:25.784067 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1275/2454] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:25.800015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Getting quotas for project 82f4e9f3706446a9968a2a42a2125bb4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:57:25.805995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:25.806601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Getting quotas for user 6ce1ee927fb74b81933abbf58ed4810e and project 82f4e9f3706446a9968a2a42a2125bb4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:57:25.807414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:25.820970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.821804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.822466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.823382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:25.824068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:25.824709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:25.865287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:57:25.867624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:57:25.985708 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-969f43b4-42b8-4d01-9db3-bbc28b45d163 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270490 Oct 29 20:57:25.986933 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1180/2455] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:57:26.004707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a786cf44-fcd4-4283-9787-3e2c7ce83151 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171a39ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:26.099964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a786cf44-fcd4-4283-9787-3e2c7ce83151 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.101237 Oct 29 20:57:26.104611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1181/2456] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:25 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:26.128498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:26.131061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:26.138603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.142887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:26.143773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:26.144613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:26.145553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:26.146338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:26.146924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:26.151796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.164406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.182843 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1f3049a3-87aa-4b97-b359-3e2c6b45829c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.385741 Oct 29 20:57:26.186170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1276/2457] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:25 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:26.205867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c645983-1ee4-40c4-b12c-b57038ff102a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:26.208263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c645983-1ee4-40c4-b12c-b57038ff102a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:26.265625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.276835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.278806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.283270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23f48a8d-8625-42aa-ba88-6e95364417e1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1316 microversion: 2.21 time: 0.177097 Oct 29 20:57:26.302725 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1182/2458] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:26 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:26.354392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c645983-1ee4-40c4-b12c-b57038ff102a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.364936 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c645983-1ee4-40c4-b12c-b57038ff102a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1215 microversion: 2.1 time: 0.177351 Oct 29 20:57:26.367233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1277/2459] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:26 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:26.493063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:26.493815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:26.501782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:26.502572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:26.503245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:26.504173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:26.504833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:26.506132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:26.941686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:26.961400 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9eb3a32-bef3-4bc8-b6a9-323439e2107c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.476966 Oct 29 20:57:26.964934 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1183/2460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:26 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:27.120422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-701ed24c-cb66-4c3b-8da9-31d249995ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1714f50d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:27.217146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:27.218118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:27.241681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-701ed24c-cb66-4c3b-8da9-31d249995ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.125039 Oct 29 20:57:27.246062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.247132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1278/2461] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:27 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:27.251311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.252652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.253592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.254190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.256054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.315453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:27.316418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:27.333335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.334045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.340259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.341990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.343032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.346491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.569283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.589198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.593914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.597138 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1a78756d-abdf-4c6b-804c-f0d2048c4bb8 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1316 microversion: 2.21 time: 0.286980 Oct 29 20:57:27.599219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1279/2462] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:27 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:27.604530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:27.605947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:27.613795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.624835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.633894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.634932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.635424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.635871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.684574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.696407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.700256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.702051 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4c5562b-5bdf-4da7-9fe1-bbce00b7e20c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.489051 Oct 29 20:57:27.719335 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1184/2463] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:27 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:27.811664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-46e7bc66-06b7-4271-a032-dc262e650b28 req-d0e24e2f-b9c6-41cd-99c2-01266cd7ac88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-plugged", "status": "completed", "tag": "76e6e194-7707-47e0-b36a-757e8a00d177"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:27.835253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:27.839580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:27.845735 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-deb9f985-6a8e-4165-8a08-ded4c0f6d3fb tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1267 microversion: 2.1 time: 0.244602 Oct 29 20:57:27.846497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46e7bc66-06b7-4271-a032-dc262e650b28 req-d0e24e2f-b9c6-41cd-99c2-01266cd7ac88 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:27.847953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46e7bc66-06b7-4271-a032-dc262e650b28 req-d0e24e2f-b9c6-41cd-99c2-01266cd7ac88 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:27.848415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46e7bc66-06b7-4271-a032-dc262e650b28 req-d0e24e2f-b9c6-41cd-99c2-01266cd7ac88 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:27.865482 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1280/2464] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:27 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:27.872214 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-46e7bc66-06b7-4271-a032-dc262e650b28 req-d0e24e2f-b9c6-41cd-99c2-01266cd7ac88 service nova] Creating event network-vif-plugged:76e6e194-7707-47e0-b36a-757e8a00d177 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:27.889690 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-46e7bc66-06b7-4271-a032-dc262e650b28 req-d0e24e2f-b9c6-41cd-99c2-01266cd7ac88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079682 Oct 29 20:57:27.890729 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1185/2465] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:57:27.991554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:27.992393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:28.000763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.001598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.002356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.003238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.003849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.004434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.264017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84783aa5-eb68-4d00-b8a7-5b93cf34af42 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa171a39af0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:28.414887 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84783aa5-eb68-4d00-b8a7-5b93cf34af42 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.155882 Oct 29 20:57:28.426017 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1186/2466] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:28 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:28.591068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:28.626019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:28.629221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a9134ec-f3f4-4d9e-8a28-3413d77d539e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.642746 Oct 29 20:57:28.630184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:28.630842 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1281/2467] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:27 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:28.649419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.649949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.654430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.661077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.662585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.667323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.731119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:28.731897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:28.748237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.748763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.749218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.750140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.751104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.778559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.850832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:28.863698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:28.865807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:28.879899 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35b06b21-6495-4e06-9239-44293628e584 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1316 microversion: 2.21 time: 0.257463 Oct 29 20:57:28.882204 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1187/2468] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:28 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:28.888491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:28.889344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:28.896489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.897293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.898048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:28.899065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:28.899691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:28.900359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:29.065508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:29.092192 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-88b89bf6-5072-452b-922a-ec1c9a819f55 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1273 microversion: 2.1 time: 0.208362 Oct 29 20:57:29.093202 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1188/2469] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:28 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:29.265192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:29.285146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:29.290514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:29.292780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0977ac1e-485e-4647-a8bf-f95b313ce0f1 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.567176 Oct 29 20:57:29.294436 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1282/2470] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:28 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:29.432130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23984ea0-f205-4922-bea0-e12d5636ac3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa172764550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:29.513528 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23984ea0-f205-4922-bea0-e12d5636ac3e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1411 microversion: 2.1 time: 0.083369 Oct 29 20:57:29.526515 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1189/2471] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:29 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:29.634431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e7295b18-5f0f-424d-ab3d-f636c43f99ab req-affa72bf-73c7-4522-a0cf-c4738ae0b406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48232db-4cad-4419-8a60-b51f8812f61b", "name": "network-vif-unplugged", "status": "completed", "tag": "8591c42c-bb09-4189-8762-966fee70ab4f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:29.653798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:29.654407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:29.657472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e7295b18-5f0f-424d-ab3d-f636c43f99ab req-affa72bf-73c7-4522-a0cf-c4738ae0b406 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:29.658920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e7295b18-5f0f-424d-ab3d-f636c43f99ab req-affa72bf-73c7-4522-a0cf-c4738ae0b406 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:29.659832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e7295b18-5f0f-424d-ab3d-f636c43f99ab req-affa72bf-73c7-4522-a0cf-c4738ae0b406 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:29.663919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:29.664520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:29.678943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:29.680741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:29.682518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:29.684784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:29.711913 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e7295b18-5f0f-424d-ab3d-f636c43f99ab req-affa72bf-73c7-4522-a0cf-c4738ae0b406 service nova] Creating event network-vif-unplugged:8591c42c-bb09-4189-8762-966fee70ab4f for instance a48232db-4cad-4419-8a60-b51f8812f61b on nch2-master-1 Oct 29 20:57:29.719485 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e7295b18-5f0f-424d-ab3d-f636c43f99ab req-affa72bf-73c7-4522-a0cf-c4738ae0b406 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.184407 Oct 29 20:57:29.722238 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1283/2472] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:57:29.911042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:29.915721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:29.934963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:29.935473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:29.935924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:29.936682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:29.937143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:29.937617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:30.182692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.200652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd800740-3192-4f8c-9625-1f55b0f07e14 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1355 microversion: 2.1 time: 0.550801 Oct 29 20:57:30.201587 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1190/2473] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:29 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1355 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:30.207544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:30.208457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:30.231036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:30.231746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:30.235982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:30.237042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:30.237747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:30.238394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:30.369437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.379809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.391656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.393244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25b363ec-b60a-4b5e-a0e3-cfa8ca2a0d8a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.488623 Oct 29 20:57:30.394016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1284/2474] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:29 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:30.399297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:30.409163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:30.411835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:30.422703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:30.426249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:30.426884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:30.430793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:30.431500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:30.432875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:30.461817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.473814 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1fe5e065-70bd-4e65-bdcc-79b4b6aa3a5c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1273 microversion: 2.1 time: 0.270559 Oct 29 20:57:30.474687 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1191/2475] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:30 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:30.529132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12cf9448-69f6-4649-af74-2817dc4b5d4e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17107c040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:30.616533 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12cf9448-69f6-4649-af74-2817dc4b5d4e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1420 microversion: 2.1 time: 0.091148 Oct 29 20:57:30.617131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1192/2476] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:30 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:30.633086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ecc7a7a0-4ea3-469f-b0ef-a051dee9b2f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17204d5e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:30.726955 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ecc7a7a0-4ea3-469f-b0ef-a051dee9b2f4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 200 len: 1420 microversion: 2.1 time: 0.096551 Oct 29 20:57:30.728383 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1193/2477] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:57:30 2022] GET /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:30.883937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.887855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1157674611", "imageRef": "19fea62f-176e-4e04-b8c9-68ce0f077d25", "flavorRef": "452", "networks": [{"uuid": "1cc8922f-83e5-42c2-bce3-6544d389a499"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:30.895169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.895941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:30.897688 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4fd730e7-672f-46d8-b3b4-18733e4e6aac tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.502018 Oct 29 20:57:30.910617 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1285/2478] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:30 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:30.984830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] validate_networks() for [('1cc8922f-83e5-42c2-bce3-6544d389a499', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:57:31.225665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:31.226632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:31.234075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:31.234960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:31.235644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:31.236631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:31.237307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:31.238044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.240931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:32.268796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fda6b9d9-1eec-4039-b4fc-756a8f226cb9 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1804 microversion: 2.1 time: 1.047961 Oct 29 20:57:32.277552 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1286/2479] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:31 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1804 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:32.296014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:32.297629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:32.305601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.306545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.307212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.308686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.309347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.314687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.420363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:57:32.421753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:57:32.422415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:57:32.424669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:57:32.425486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:57:32.440612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.441362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.442103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.443043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.443969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.445038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.490536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:57:32.505363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for user d1c5ef005ddf4a96828abd5376fffa37 and project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:57:32.535518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:57:32.543150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='19fea62f-176e-4e04-b8c9-68ce0f077d25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:57:32.613764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c42037a5-981b-42e2-a803-284e8849c209 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732421 Oct 29 20:57:32.621184 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1194/2480] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:57:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:57:32.625691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:32.626537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:32.633353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.634292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.634992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.636056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.636801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.637748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.739557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:32.766893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:32.773664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:32.778319 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-010c92a9-db88-4204-96a3-831fad476871 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.499545 Oct 29 20:57:32.791541 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1287/2481] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:32 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:32.802101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f65088c9-995d-4095-adf0-f8fcaeac0d51 req-35fdbde4-5e01-4b0a-bceb-2d22688a38ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48232db-4cad-4419-8a60-b51f8812f61b", "tag": "8591c42c-bb09-4189-8762-966fee70ab4f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:32.844110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f65088c9-995d-4095-adf0-f8fcaeac0d51 req-35fdbde4-5e01-4b0a-bceb-2d22688a38ad service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.844605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f65088c9-995d-4095-adf0-f8fcaeac0d51 req-35fdbde4-5e01-4b0a-bceb-2d22688a38ad service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.845104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f65088c9-995d-4095-adf0-f8fcaeac0d51 req-35fdbde4-5e01-4b0a-bceb-2d22688a38ad service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.862558 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f65088c9-995d-4095-adf0-f8fcaeac0d51 req-35fdbde4-5e01-4b0a-bceb-2d22688a38ad service nova] Creating event network-changed:8591c42c-bb09-4189-8762-966fee70ab4f for instance a48232db-4cad-4419-8a60-b51f8812f61b on nch2-master-1 Oct 29 20:57:32.868590 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f65088c9-995d-4095-adf0-f8fcaeac0d51 req-35fdbde4-5e01-4b0a-bceb-2d22688a38ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070362 Oct 29 20:57:32.869624 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1288/2482] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:32.875356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:32.876576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:32.896394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.897158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.897790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:32.898676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:32.899545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:32.900276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.023438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:33.027345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:33.043018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3efaecfa-c2ff-4dd0-bb58-01c46c08105d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.420700 Oct 29 20:57:33.045706 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1195/2483] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:32 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:33.059423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:33.061742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:33.075232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.078240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.078799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.079850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.083339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.084090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.146869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a74658d-0447-40e2-a70b-35c34a174b99 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d/ips" status: 200 len: 217 microversion: 2.1 time: 0.098062 Oct 29 20:57:33.153590 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1196/2484] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 20:57:33 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d/ips => generated 217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:33.163153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2617007b-f020-43e4-9dc5-95c2692f01f0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:33.167235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2617007b-f020-43e4-9dc5-95c2692f01f0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:33.380848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2617007b-f020-43e4-9dc5-95c2692f01f0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:33.393005 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2617007b-f020-43e4-9dc5-95c2692f01f0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1208 microversion: 2.1 time: 0.237422 Oct 29 20:57:33.399467 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1197/2485] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:33 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1208 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:33.410399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:33.417476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:33.419281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:33.426211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:33.432036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:33.436604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6fadb46-77ea-4fd9-a313-385eead8dda6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.565473 Oct 29 20:57:33.437759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.441905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.442727 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1289/2486] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:32 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:33.443371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.447011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.449140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.451171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.554469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:57:33.692571 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55cf9917-5e48-454c-a07b-870003c33130 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 204 len: 0 microversion: 2.1 time: 0.289813 Oct 29 20:57:33.694202 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1198/2487] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:57:33 2022] DELETE /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:57:33.704079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:33.705909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:33.716258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.717343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.718132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.719359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.720024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.721573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.810756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:33.811734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:33.819784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.821743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.822374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:33.823350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:33.823970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:33.825175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.056281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.069525 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5432f5bb-27a9-4cb7-8261-c498a49c3c53 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1810 microversion: 2.1 time: 0.370020 Oct 29 20:57:34.070959 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1290/2488] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:33 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1810 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:34.087041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:34.088710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:34.103109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.104160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.104687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.105651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.106175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.106866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.134458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.150082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.154731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.158029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d1be4008-4d91-4c53-9842-97e54c15c7da tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.350609 Oct 29 20:57:34.164937 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1199/2489] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:33 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:34.170302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-df44bdc1-a062-49c3-9e7e-ec0f2fc271d9 req-18bebf7b-477b-4c59-b80d-79ad6ed0bc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beff40db-1248-41ac-bfc3-33299f73eb0e", "name": "network-vif-unplugged", "status": "completed", "tag": "a71ba1a5-d419-4940-bdd1-bb22b699fa7a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:34.191234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-df44bdc1-a062-49c3-9e7e-ec0f2fc271d9 req-18bebf7b-477b-4c59-b80d-79ad6ed0bc2c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.192032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-df44bdc1-a062-49c3-9e7e-ec0f2fc271d9 req-18bebf7b-477b-4c59-b80d-79ad6ed0bc2c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.192614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-df44bdc1-a062-49c3-9e7e-ec0f2fc271d9 req-18bebf7b-477b-4c59-b80d-79ad6ed0bc2c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.240603 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-df44bdc1-a062-49c3-9e7e-ec0f2fc271d9 req-18bebf7b-477b-4c59-b80d-79ad6ed0bc2c service nova] Creating event network-vif-unplugged:a71ba1a5-d419-4940-bdd1-bb22b699fa7a for instance beff40db-1248-41ac-bfc3-33299f73eb0e on nch1-master-1 Oct 29 20:57:34.248589 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-df44bdc1-a062-49c3-9e7e-ec0f2fc271d9 req-18bebf7b-477b-4c59-b80d-79ad6ed0bc2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081687 Oct 29 20:57:34.249993 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1200/2490] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:34.363623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.374350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24c3975f-0ca4-4cc3-826e-1cbdffb1e1b9 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.301939 Oct 29 20:57:34.375637 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1291/2491] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:34 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:34.428026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:34.428751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:34.440812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.441966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.442795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.444201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.444660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.446180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.473043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:34.474410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:34.483369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.484109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.484824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.486282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:34.486897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:34.488275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:34.629915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.638512 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1295f0ea-0afb-40f3-947c-341dbf05de51 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1212 microversion: 2.1 time: 0.215084 Oct 29 20:57:34.639117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1201/2492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:34 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1212 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:34.783246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.796928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.799850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:34.803164 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e174965-f214-435e-a12a-9bc8dee6c0be tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.335518 Oct 29 20:57:34.804221 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1292/2493] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:34 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:35.094752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:35.096762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:35.106359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.108016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.108810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.110017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.110743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.111589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.187699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:35.189163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:35.196798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.197538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.198144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.199008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.199604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.200293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.598574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:35.636273 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-838b7e03-af59-46f1-b3db-bcbe85bf35c0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1810 microversion: 2.1 time: 0.530771 Oct 29 20:57:35.641081 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1202/2494] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:35 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1810 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:35.656084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-44bc0017-e67b-4aea-b261-c8b93cbb343d req-3133f591-1bc5-4cad-9dbc-8a1e8e09bf25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a031530-0776-4fad-8a66-9ee1a4b89b8b", "tag": "977dc82f-0d81-4ad3-b6f2-165f20de96a8"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:35.687569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-44bc0017-e67b-4aea-b261-c8b93cbb343d req-3133f591-1bc5-4cad-9dbc-8a1e8e09bf25 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.699137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-44bc0017-e67b-4aea-b261-c8b93cbb343d req-3133f591-1bc5-4cad-9dbc-8a1e8e09bf25 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.702148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-44bc0017-e67b-4aea-b261-c8b93cbb343d req-3133f591-1bc5-4cad-9dbc-8a1e8e09bf25 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.736389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-44bc0017-e67b-4aea-b261-c8b93cbb343d req-3133f591-1bc5-4cad-9dbc-8a1e8e09bf25 service nova] Creating event network-changed:977dc82f-0d81-4ad3-b6f2-165f20de96a8 for instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b on nch1-master-1 Oct 29 20:57:35.753637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-44bc0017-e67b-4aea-b261-c8b93cbb343d req-3133f591-1bc5-4cad-9dbc-8a1e8e09bf25 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109972 Oct 29 20:57:35.754501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1203/2495] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:35.764184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:35.769870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:35.770081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:35.779439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.786310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.788653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.792216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:35.792500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.802389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.803272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:35.803491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.808474 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-116332f9-8c3f-49f5-a351-f38de53ae000 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.625100 Oct 29 20:57:35.815773 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1293/2496] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:35 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:35.854062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:35.854762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:35.879986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.880322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.880770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:35.882689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:35.883277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:35.883721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:36.050592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:36.084468 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc9e87e7-b438-4786-9358-921e4ef17ed6 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1204 microversion: 2.1 time: 0.238005 Oct 29 20:57:36.114691 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1294/2497] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:35 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1204 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:36.121410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:36.122314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:36.151662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:36.152605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:36.154494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:36.155697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:36.156263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:36.157365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:36.252479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:36.271472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-067e6dd4-95c4-45e2-8306-e194c3c089ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.514481 Oct 29 20:57:36.276183 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1204/2498] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:35 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:36.401990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:36.664738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:36.665420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:36.685382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:36.685941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:36.691650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:36.692622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:36.694052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:36.695384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.104016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.114226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.115837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.117540 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24868f8f-8bea-40d6-b676-de08925a8748 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 1.001192 Oct 29 20:57:37.118280 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1295/2499] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:36 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:37.127514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:37.128785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:37.135872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.136602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.137173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.138207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.138857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.139427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.184399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.196814 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c796ff3-e54c-4e24-8cab-f5be17fe7e98 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1810 microversion: 2.1 time: 0.536221 Oct 29 20:57:37.209541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1205/2500] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:36 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1810 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:37.220904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:37.230175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:37.245616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.246362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.247051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.247989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.248855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.249905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.421672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.435988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7eccc948-7de4-4535-990f-1bcca8867ba5 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1260 microversion: 2.1 time: 0.224506 Oct 29 20:57:37.436660 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1206/2501] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:37 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:37.446363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:37.447386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:37.456980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.457561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.459056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.459439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.460097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.460674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.574289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.593168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.597774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:37.600223 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de8acba1-f165-4f82-916b-166000512989 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.480586 Oct 29 20:57:37.603165 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1296/2502] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:37 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:37.834970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e722f44c-7101-4519-992a-385c4300762d req-9ff52deb-2512-426b-a96d-d7440480362c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ae7e10-059c-4abb-a613-8d39f0f18a31", "tag": "187afd1d-a55b-4f2f-af00-bc6d4b1b3c44"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:37.853763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e722f44c-7101-4519-992a-385c4300762d req-9ff52deb-2512-426b-a96d-d7440480362c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:37.854966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e722f44c-7101-4519-992a-385c4300762d req-9ff52deb-2512-426b-a96d-d7440480362c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:37.855424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e722f44c-7101-4519-992a-385c4300762d req-9ff52deb-2512-426b-a96d-d7440480362c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:37.881607 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e722f44c-7101-4519-992a-385c4300762d req-9ff52deb-2512-426b-a96d-d7440480362c service nova] Creating event network-changed:187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 for instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 on nch2-master-1 Oct 29 20:57:37.911336 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e722f44c-7101-4519-992a-385c4300762d req-9ff52deb-2512-426b-a96d-d7440480362c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080226 Oct 29 20:57:37.911955 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1297/2503] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:57:38.150127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:38.150856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:38.165888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:38.174402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:38.175224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:38.176372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:38.186421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:38.187293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:38.562764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:38.576015 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-babd47e7-6207-41ea-9c27-de0d87675efc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 1.137305 Oct 29 20:57:38.579185 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1207/2504] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:37 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:38.591544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:38.596117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:38.615482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:38.616870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:38.618125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:38.620791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:38.622025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:38.623375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.152422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:39.191664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:39.204631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:39.215410 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8992cc13-2173-4b72-b69a-6206c6ba2c95 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 1.065205 Oct 29 20:57:39.215410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1298/2505] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:38 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:39.239898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:39.241171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:39.261577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.261577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.261577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.262666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.267275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.267763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.324014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:39.519655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:39.545283 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65792861-cb74-4654-8dca-54fe3fb7e2a2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1266 microversion: 2.1 time: 0.331375 Oct 29 20:57:39.567745 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1299/2506] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:39 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1266 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:39.574179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:39.575156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:39.584869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.585585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.586213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.587097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.588006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.589499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.822317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:39.838952 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-527ab681-20fa-41f6-b816-4ee32bd402d7 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1789 microversion: 2.1 time: 1.253655 Oct 29 20:57:39.840099 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1208/2507] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:38 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1789 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:39.844864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9b14818f-181d-40e3-b4bd-0c6358072ca5 req-d66d4cec-2f81-4754-8d7c-419ed567ac7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-unplugged", "status": "completed", "tag": "0ba3aeed-6403-4e58-99d8-2b7129bb09fa"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:39.855466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9b14818f-181d-40e3-b4bd-0c6358072ca5 req-d66d4cec-2f81-4754-8d7c-419ed567ac7b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.856899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9b14818f-181d-40e3-b4bd-0c6358072ca5 req-d66d4cec-2f81-4754-8d7c-419ed567ac7b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.856899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9b14818f-181d-40e3-b4bd-0c6358072ca5 req-d66d4cec-2f81-4754-8d7c-419ed567ac7b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.874389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9b14818f-181d-40e3-b4bd-0c6358072ca5 req-d66d4cec-2f81-4754-8d7c-419ed567ac7b service nova] Creating event network-vif-unplugged:0ba3aeed-6403-4e58-99d8-2b7129bb09fa for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:39.883382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9b14818f-181d-40e3-b4bd-0c6358072ca5 req-d66d4cec-2f81-4754-8d7c-419ed567ac7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041770 Oct 29 20:57:39.885017 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1209/2508] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:39.894673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:39.895658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:39.905968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.907791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.918445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:39.922923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:39.923656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:39.924354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.308125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.320077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.322217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.323861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90ecc0c0-eb4e-401d-9a23-680c6fd5f7bb tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.754555 Oct 29 20:57:40.324602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1300/2509] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:39 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:40.350547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7438d020-69e0-446c-bc75-bcab47f26a44 req-09caac0a-ea51-4b31-80c6-3a4c48e13fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-deleted", "tag": "9f39a931-363c-4d76-9b48-0f0e6517f4d5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:40.359105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.363439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7438d020-69e0-446c-bc75-bcab47f26a44 req-09caac0a-ea51-4b31-80c6-3a4c48e13fc9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.364147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7438d020-69e0-446c-bc75-bcab47f26a44 req-09caac0a-ea51-4b31-80c6-3a4c48e13fc9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.364776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7438d020-69e0-446c-bc75-bcab47f26a44 req-09caac0a-ea51-4b31-80c6-3a4c48e13fc9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.374444 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6640ea4e-fe21-40b4-af74-89ff4713d155 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.484952 Oct 29 20:57:40.381371 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7438d020-69e0-446c-bc75-bcab47f26a44 req-09caac0a-ea51-4b31-80c6-3a4c48e13fc9 service nova] Creating event network-vif-deleted:9f39a931-363c-4d76-9b48-0f0e6517f4d5 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:40.390646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7438d020-69e0-446c-bc75-bcab47f26a44 req-09caac0a-ea51-4b31-80c6-3a4c48e13fc9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064451 Oct 29 20:57:40.391571 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1301/2510] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:40.396499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1210/2511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:39 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:40.402449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:40.403718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:40.415838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.416930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.424784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.427100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.427906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.428717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.573748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:40.574652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:40.590652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.591545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.593414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.594389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.595127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.595757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.740785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.756771 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04e07c26-331f-4a79-bfcd-dae88e5b338c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1266 microversion: 2.1 time: 0.186766 Oct 29 20:57:40.759302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1211/2512] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:40 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:40.840375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.858501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.870609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:40.872593 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8764f02f-73a4-45d4-b7b8-6c1ae2fd1eb9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.478976 Oct 29 20:57:40.885672 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1302/2513] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:40 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:40.885849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:40.886525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:40.896291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.896842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.897445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:40.900303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:40.901089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:40.902492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:41.340933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:41.359743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:41.360204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-264c09a8-f0ca-4a82-b1a2-c4fdad5e47fc tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1768 microversion: 2.1 time: 0.499043 Oct 29 20:57:41.360990 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1212/2514] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:40 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1768 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:41.361581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:41.375505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:41.377272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:41.388878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:41.390241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:41.390889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:41.391586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:41.405896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:41.411152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:41.437431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:41.438138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:41.440934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:41.442938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:41.444045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:41.445954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.055246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.065598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.067203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.068392 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c9aef5b-b4de-4712-8742-c4299f87aea6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.714229 Oct 29 20:57:42.081847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1303/2515] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:41 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:42.096277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:42.096372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:42.122764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.127729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.128311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.129271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.131496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.132133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.197606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.211713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43874652-6290-4213-86af-d4257be0be72 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.809702 Oct 29 20:57:42.222028 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1213/2516] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:41 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:42.227968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-460a0fc8-62ca-499f-9bcc-3233e9f84434 req-3bf62f15-fdbc-4c78-89f8-e586a0783423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-unplugged", "status": "completed", "tag": "76e6e194-7707-47e0-b36a-757e8a00d177"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:42.247589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-460a0fc8-62ca-499f-9bcc-3233e9f84434 req-3bf62f15-fdbc-4c78-89f8-e586a0783423 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.255144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-460a0fc8-62ca-499f-9bcc-3233e9f84434 req-3bf62f15-fdbc-4c78-89f8-e586a0783423 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.255817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-460a0fc8-62ca-499f-9bcc-3233e9f84434 req-3bf62f15-fdbc-4c78-89f8-e586a0783423 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.262606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:42.284546 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-460a0fc8-62ca-499f-9bcc-3233e9f84434 req-3bf62f15-fdbc-4c78-89f8-e586a0783423 service nova] Creating event network-vif-unplugged:76e6e194-7707-47e0-b36a-757e8a00d177 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:42.303600 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-460a0fc8-62ca-499f-9bcc-3233e9f84434 req-3bf62f15-fdbc-4c78-89f8-e586a0783423 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079708 Oct 29 20:57:42.304873 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1214/2517] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:42.318869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:42.319871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:42.332266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.338261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.338984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.339911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.340528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.341120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.459052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:42.763180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.779460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.781006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:42.782286 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06716e3e-9167-4d15-9917-c9876d5630c9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 0.476101 Oct 29 20:57:42.783612 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1215/2518] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:42 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:42.799528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:42.800173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:42.821404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.822118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.822464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:42.823241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:42.823723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:42.824201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:43.069604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:43.086052 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3041b40b-3c1b-44bb-bf28-77e50badb3ed tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 1.002778 Oct 29 20:57:43.087300 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1304/2519] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:42 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:43.100809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ba0f32e3-a5c7-470f-85e8-b07c97a126b7 req-266b4b4c-b449-4893-b6bd-8ff15b381b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-deleted", "tag": "0ba3aeed-6403-4e58-99d8-2b7129bb09fa"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:43.125628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ba0f32e3-a5c7-470f-85e8-b07c97a126b7 req-266b4b4c-b449-4893-b6bd-8ff15b381b48 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:43.128947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ba0f32e3-a5c7-470f-85e8-b07c97a126b7 req-266b4b4c-b449-4893-b6bd-8ff15b381b48 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:43.133179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ba0f32e3-a5c7-470f-85e8-b07c97a126b7 req-266b4b4c-b449-4893-b6bd-8ff15b381b48 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:43.162719 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ba0f32e3-a5c7-470f-85e8-b07c97a126b7 req-266b4b4c-b449-4893-b6bd-8ff15b381b48 service nova] Creating event network-vif-deleted:0ba3aeed-6403-4e58-99d8-2b7129bb09fa for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:43.174536 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ba0f32e3-a5c7-470f-85e8-b07c97a126b7 req-266b4b4c-b449-4893-b6bd-8ff15b381b48 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085663 Oct 29 20:57:43.181038 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1305/2520] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:43.195991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:43.198294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:43.213287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:43.217752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:43.218575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:43.220310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:43.222165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:43.222918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:43.387525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=20 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:43.552074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:43.569861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:43.571715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:43.587592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdea9fd0-fb7c-446f-b35e-8082948d3e3b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.403760 Oct 29 20:57:43.588255 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1306/2521] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:43 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:43.607512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:43.608215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:43.634490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:43.635641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:43.636228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:43.637015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:43.643043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:43.643043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:45.097061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:45.115929 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be48de2f-b98b-45e9-ad5e-85e2712a583c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1611 microversion: 2.1 time: 2.328356 Oct 29 20:57:45.117412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1216/2522] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:42 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1611 bytes in 2333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:45.123671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:45.124607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:45.133139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:45.136769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:45.138578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:45.140892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:45.145177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:45.145941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:45.147871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:46.062259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:46.093958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0651398a-c045-4237-b8c8-09f60703f4c6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 2.491659 Oct 29 20:57:46.095353 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1307/2523] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:43 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:46.108897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:46.118752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:46.145904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:46.148011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:46.152203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:46.154946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:46.156944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:46.157716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:46.633203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:46.653137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:46.658609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:46.661780 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79cb5d84-2cc9-4891-9450-d877e331b75c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1485 microversion: 2.25 time: 1.541414 Oct 29 20:57:46.664986 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1217/2524] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:45 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1485 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:46.698597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:46.700856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:46.738700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:46.743771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:46.752211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:46.754533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:46.757638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:46.761513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:46.832456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:46.847048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7e156b85-336f-4dbf-935d-68b16f9ba514 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.750150 Oct 29 20:57:46.847961 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1308/2525] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:46 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:46.853930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:46.854781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:46.866635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:46.866965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:46.867584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:46.868720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:46.869523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:46.870099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:47.045770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:47.060044 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1929d73-3569-4b22-b720-407a2db3e300 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1455 microversion: 2.1 time: 0.210327 Oct 29 20:57:47.069616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1309/2526] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:46 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1455 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:47.080593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ad6ec34f-a8f4-4102-8fd2-ddbc060bfdbf req-7a7468ee-7888-411c-8fa5-670d1a5cab23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a031530-0776-4fad-8a66-9ee1a4b89b8b", "name": "network-vif-plugged", "status": "completed", "tag": "977dc82f-0d81-4ad3-b6f2-165f20de96a8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:47.119700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ad6ec34f-a8f4-4102-8fd2-ddbc060bfdbf req-7a7468ee-7888-411c-8fa5-670d1a5cab23 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:47.125754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ad6ec34f-a8f4-4102-8fd2-ddbc060bfdbf req-7a7468ee-7888-411c-8fa5-670d1a5cab23 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:47.126650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ad6ec34f-a8f4-4102-8fd2-ddbc060bfdbf req-7a7468ee-7888-411c-8fa5-670d1a5cab23 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:47.171222 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ad6ec34f-a8f4-4102-8fd2-ddbc060bfdbf req-7a7468ee-7888-411c-8fa5-670d1a5cab23 service nova] Creating event network-vif-plugged:977dc82f-0d81-4ad3-b6f2-165f20de96a8 for instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b on nch1-master-1 Oct 29 20:57:47.188968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ad6ec34f-a8f4-4102-8fd2-ddbc060bfdbf req-7a7468ee-7888-411c-8fa5-670d1a5cab23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117824 Oct 29 20:57:47.191409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1310/2527] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:47.214053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2a810de1-2154-41ce-85c6-a77082f77283 req-c9aac2fa-1508-441e-9947-169d326b54bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bbe430e-7190-4a59-a7c3-a1e17af42d0d", "name": "network-vif-deleted", "tag": "76e6e194-7707-47e0-b36a-757e8a00d177"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:47.253257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2a810de1-2154-41ce-85c6-a77082f77283 req-c9aac2fa-1508-441e-9947-169d326b54bb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:47.253745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2a810de1-2154-41ce-85c6-a77082f77283 req-c9aac2fa-1508-441e-9947-169d326b54bb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:47.254298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2a810de1-2154-41ce-85c6-a77082f77283 req-c9aac2fa-1508-441e-9947-169d326b54bb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:47.295275 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2a810de1-2154-41ce-85c6-a77082f77283 req-c9aac2fa-1508-441e-9947-169d326b54bb service nova] Creating event network-vif-deleted:76e6e194-7707-47e0-b36a-757e8a00d177 for instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d on nch1-master-1 Oct 29 20:57:47.323478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2a810de1-2154-41ce-85c6-a77082f77283 req-c9aac2fa-1508-441e-9947-169d326b54bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124931 Oct 29 20:57:47.327681 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1311/2528] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:47.340619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:47.359017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:47.371750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:47.378087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:47.378877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:47.379890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:47.387664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:47.396567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:47.992129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.091443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.101216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.104424 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-135b3b79-4efc-4231-b8e1-1871442551bf tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 1.437950 Oct 29 20:57:48.108274 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1218/2529] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:46 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:48.215719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.240122 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b9636c1-d642-40f4-b6e8-48535fe9abbf tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.910626 Oct 29 20:57:48.241109 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1312/2530] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:47 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:48.263128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:48.270401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:48.290709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.292409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.293039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.294697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.299501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.301979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.432542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9d77e265-56c0-4b00-9e07-4be4a1780740 req-143d6dc8-b917-4c7d-afc7-56c8c317650e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b215b43-b0f1-4c4d-90aa-d1f845d7b311", "tag": "ae78b4a8-48c3-4bc9-88f8-4e25dbe15dc0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:48.458486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9d77e265-56c0-4b00-9e07-4be4a1780740 req-143d6dc8-b917-4c7d-afc7-56c8c317650e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.459084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9d77e265-56c0-4b00-9e07-4be4a1780740 req-143d6dc8-b917-4c7d-afc7-56c8c317650e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.459536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9d77e265-56c0-4b00-9e07-4be4a1780740 req-143d6dc8-b917-4c7d-afc7-56c8c317650e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.504091 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9d77e265-56c0-4b00-9e07-4be4a1780740 req-143d6dc8-b917-4c7d-afc7-56c8c317650e service nova] Creating event network-changed:ae78b4a8-48c3-4bc9-88f8-4e25dbe15dc0 for instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 on nch1-master-1 Oct 29 20:57:48.525987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9d77e265-56c0-4b00-9e07-4be4a1780740 req-143d6dc8-b917-4c7d-afc7-56c8c317650e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413575 Oct 29 20:57:48.526619 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1219/2531] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:48.545290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:48.546086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:48.558670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.559289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.559687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.560559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.561027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.561905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.738140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.759762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.761565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.762993 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0536da3e-df46-4bb8-9d05-ebff7f7c8079 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1475 microversion: 2.25 time: 0.520563 Oct 29 20:57:48.764394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1313/2532] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:48 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1475 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:48.772280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:48.773234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:48.781838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.783187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.784444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.785222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.786345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.787083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.861095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.862678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.863391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.864008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.864656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lazy-loading 'fault' on Instance uuid 4bbe430e-7190-4a59-a7c3-a1e17af42d0d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:48.875163 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e45b8459-9230-44f6-9b30-265f5f4f2cde tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.344383 Oct 29 20:57:48.887796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1220/2533] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:48 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:48.902961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e95a4f0-4fbd-47c1-9eb5-e21a0ba5f23c tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '.version_select at 0x7fa1710d9040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:48.914937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e95a4f0-4fbd-47c1-9eb5-e21a0ba5f23c tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:48.916320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e95a4f0-4fbd-47c1-9eb5-e21a0ba5f23c tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:48.917593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e95a4f0-4fbd-47c1-9eb5-e21a0ba5f23c tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:48.957255 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e95a4f0-4fbd-47c1-9eb5-e21a0ba5f23c tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.050106 Oct 29 20:57:48.961080 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1221/2534] 10.222.0.36 () {60 vars in 1184 bytes} [Sat Oct 29 20:57:48 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:48.966711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:48.980727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:48.982353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:48.992250 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c59f1c23-ca5b-4ed7-bf78-5f547b40c78e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1303 microversion: 2.1 time: 0.226070 Oct 29 20:57:48.993902 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1314/2535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:48 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:49.003943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.005750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.007930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.011008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.016127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.018717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.145610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:49.145610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:49.177898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.181637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.193858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.199052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.200151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.204103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.371572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] Lazy-loading 'services' on Instance uuid a48232db-4cad-4419-8a60-b51f8812f61b {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:49.404830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d94d3c3-c7e6-4b6c-ab4f-2fc269c94795 tempest-LiveAutoBlockMigrationV225Test-798039788 tempest-LiveAutoBlockMigrationV225Test-798039788-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1966 microversion: 2.25 time: 0.429187 Oct 29 20:57:49.427401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1222/2536] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:48 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1966 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:49.446679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:49.453039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:49.485351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.487341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.490188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.493835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.494751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.499692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.699241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:49.711527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:49.715771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:49.719304 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab5a0a3d-d170-491a-839e-f9c721551d79 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.584475 Oct 29 20:57:49.720977 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1315/2537] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:49 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:49.727321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:49.730623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:49.749253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.749796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.750232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.750946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.751438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:49.751871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:49.833218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:57:49.910923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:49.922071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e92b88a8-6dfa-4183-89cb-26f8532cb2e6 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.490709 Oct 29 20:57:49.924086 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1223/2538] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:49 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:49.955584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9939de72-b251-4fa9-ad47-0ffaae43b6d1 req-d1094fb5-c7fc-42e3-8397-4d844e252020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ae7e10-059c-4abb-a613-8d39f0f18a31", "name": "network-vif-plugged", "status": "completed", "tag": "187afd1d-a55b-4f2f-af00-bc6d4b1b3c44"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:49.993166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9939de72-b251-4fa9-ad47-0ffaae43b6d1 req-d1094fb5-c7fc-42e3-8397-4d844e252020 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:49.996769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:49.999890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9939de72-b251-4fa9-ad47-0ffaae43b6d1 req-d1094fb5-c7fc-42e3-8397-4d844e252020 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.000653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9939de72-b251-4fa9-ad47-0ffaae43b6d1 req-d1094fb5-c7fc-42e3-8397-4d844e252020 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.029246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9939de72-b251-4fa9-ad47-0ffaae43b6d1 req-d1094fb5-c7fc-42e3-8397-4d844e252020 service nova] Creating event network-vif-plugged:187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 for instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 on nch2-master-1 Oct 29 20:57:50.035523 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9939de72-b251-4fa9-ad47-0ffaae43b6d1 req-d1094fb5-c7fc-42e3-8397-4d844e252020 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109733 Oct 29 20:57:50.036709 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1224/2539] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:50.045037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:50.046177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:50.056078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.056975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.057122 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 204 len: 0 microversion: 2.25 time: 0.331395 Oct 29 20:57:50.057970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.058879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.059498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.062620 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1316/2540] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:57:49 2022] DELETE /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:57:50.063311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.077122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:50.079334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:50.121112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.127404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.146067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.146067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.146067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.146067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.242659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.243691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.244438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.245132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lazy-loading 'fault' on Instance uuid 4bbe430e-7190-4a59-a7c3-a1e17af42d0d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:50.386722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:50.404684 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-22f1a838-36db-49fb-a19a-93f3ad5d8933 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1303 microversion: 2.1 time: 0.343185 Oct 29 20:57:50.408221 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1317/2541] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:50 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1303 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:50.454757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:50.457301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:50.479512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.480726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.482133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.485046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.487568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.488364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.518540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:50.526931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffd86447-fe35-4702-8e16-6a238869c2e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.488581 Oct 29 20:57:50.546717 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1225/2542] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:50 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:50.754115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:50.754115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:50.776818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.777444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.779097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.781846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.785001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.785579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.885199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:50.912201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:50.920081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:50.934663 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07e84fe8-3ad6-4bc6-8961-e279eeb6813b tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1481 microversion: 2.25 time: 0.522830 Oct 29 20:57:50.935600 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1318/2543] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:50 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1481 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:50.952564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:50.958771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:50.976168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.978638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.979335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:50.981866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:50.982927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:50.985122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.350351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:51.366728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:51.374282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:51.374282 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8e91719-b747-45a3-b800-3a2ecbe0ac2b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1358 microversion: 2.21 time: 0.627645 Oct 29 20:57:51.410927 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1226/2544] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:50 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1358 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:51.436516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:51.437163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:51.458007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:51.469322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:51.471050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.475211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:51.475860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:51.476997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.563127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:51.564944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:51.565675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.567772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lazy-loading 'fault' on Instance uuid 4bbe430e-7190-4a59-a7c3-a1e17af42d0d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:51.604245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:51.624200 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39e18a3c-3e68-4aa3-bb7a-9107e8496644 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1315 microversion: 2.1 time: 0.674487 Oct 29 20:57:51.627330 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1319/2545] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:50 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:51.636757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:51.653661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:51.661916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:51.665327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:51.670561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.674986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:51.675629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:51.676883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.694311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:51.706929 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7047b2df-f661-421d-8e97-3b84bf3e1a22 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 200 len: 1303 microversion: 2.1 time: 0.274410 Oct 29 20:57:51.730504 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1227/2546] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:51 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 1303 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:51.969299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:51.971228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:51.994942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:51.995455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:51.995902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:51.996625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:52.005404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:52.005404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:52.494522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:52.542349 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5bb5ecb3-3f99-402b-b843-6679af575f82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.880414 Oct 29 20:57:52.546363 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1320/2547] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:51 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:52.558810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:52.560251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:52.570428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:52.572230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:52.573226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:52.574591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:52.575515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:52.576857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:52.631998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:52.684295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:52.705757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:52.717371 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b8a46cf-4aa9-4126-917b-00573c439451 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1481 microversion: 2.25 time: 0.752126 Oct 29 20:57:52.723890 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1228/2548] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:51 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1481 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:57:52.754407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:52.759487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:52.799954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:52.800621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:52.805312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:52.808696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:52.811720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:52.812229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.438261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:53.450672 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5bddf30b-165a-465d-b8c9-330dc11c774f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1504 microversion: 2.1 time: 0.723385 Oct 29 20:57:53.451336 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1229/2549] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:52 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:53.456939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:53.477210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:53.477625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:53.481324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:53.483668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:53.491071 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9223975a-7de8-47b3-aaf6-1bda5f73ec15 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1550 microversion: 2.21 time: 0.940919 Oct 29 20:57:53.492328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1321/2550] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:52 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1550 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:53.504302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1262058825"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:53.505886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:53.514441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.515016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.515650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.516636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.517861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.518593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.525487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.534268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.535444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.536474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.536837 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] HTTP exception thrown: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:57:53.537740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.538362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Request method failure captured: Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d HTTP/1.1 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOBr3TY0X36GDOoijZuRr9C86MafTjuEa2pQMT02YGqjCseQh8PE32hd1zMWUb4IlEC3aJmwaR2QFh05PZc6MNze9I_0vPcIbAkeQJeg1Qjvr0JlK7Hs1GkROG7KyQYa_Qj0R1QN61VrdRQiPnv8gHaqfVhR-Asu7xtogKG9WB43jU Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e380500f114891bf674438936e8e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e380500f114891bf674438936e8e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestMultiNic-1574421259 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 00a550d419d943628a9f73797cb7f36b Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4bbe430e-7190-4a59-a7c3-a1e17af42d0d'} Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:53.539215 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:57:53.543045 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:53.545699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Returning 404 to user: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:53.547233 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a8b4986-3b00-4cd9-8c4c-226b7651d232 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 404 len: 111 microversion: 2.1 time: 0.085708 Oct 29 20:57:53.551475 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1230/2551] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:53 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:57:53.559770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:53.560542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:53.568751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.569604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.570290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.571466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.572202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.572927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.632812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:57:53.767471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:57:53.838498 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d037ecf2-1223-4bee-a4ca-8a58f9ce94dd tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 204 len: 0 microversion: 2.21 time: 0.285243 Oct 29 20:57:53.846282 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1231/2552] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:57:53 2022] DELETE /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:57:53.862421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:53.865109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:53.882614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.883897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.884899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:53.886580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:53.888820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:53.890221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:54.128890 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Adding security group a3c181a9-a264-45b1-9c6b-cf2a1abcb749 to port 187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 Oct 29 20:57:54.490287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:54.498762 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bb1cf47a-c4ad-48c7-a2fb-8c3c93c35a83 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.647955 Oct 29 20:57:54.499423 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1232/2553] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:53 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:54.503983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:54.504634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:54.510997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:54.511491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:54.511932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:54.512637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:54.513355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:54.513813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:54.710567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:54.718878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:54.720924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:54.722129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87932cfd-c1c8-4f35-b1df-f241f5499bd6 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1264 microversion: 2.25 time: 0.221781 Oct 29 20:57:54.722698 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1233/2554] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:54 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:54.727086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4ed93299-7dfd-4836-9df0-df1be85025d1 req-f21a7e26-aba7-49f8-839e-2eb30e885dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48232db-4cad-4419-8a60-b51f8812f61b", "name": "network-vif-deleted", "tag": "8591c42c-bb09-4189-8762-966fee70ab4f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:54.736611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4ed93299-7dfd-4836-9df0-df1be85025d1 req-f21a7e26-aba7-49f8-839e-2eb30e885dea service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:54.737323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4ed93299-7dfd-4836-9df0-df1be85025d1 req-f21a7e26-aba7-49f8-839e-2eb30e885dea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:54.737939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4ed93299-7dfd-4836-9df0-df1be85025d1 req-f21a7e26-aba7-49f8-839e-2eb30e885dea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:54.751861 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4ed93299-7dfd-4836-9df0-df1be85025d1 req-f21a7e26-aba7-49f8-839e-2eb30e885dea service nova] Creating event network-vif-deleted:8591c42c-bb09-4189-8762-966fee70ab4f for instance a48232db-4cad-4419-8a60-b51f8812f61b on nch1-master-1 Oct 29 20:57:54.756757 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4ed93299-7dfd-4836-9df0-df1be85025d1 req-f21a7e26-aba7-49f8-839e-2eb30e885dea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Oct 29 20:57:54.757796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1234/2555] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:54.765231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:54.765973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:54.774598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:54.775150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:54.775606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:54.776330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:54.776959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:54.777392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:55.439994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:55.454925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:55.467823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:55.479187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-122e8dc7-35e7-41ce-adbb-e3aaaaa8bdad tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1556 microversion: 2.21 time: 0.713713 Oct 29 20:57:55.483617 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1235/2556] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:54 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1556 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:55.514810 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-79964b1f-4afd-4b42-9bda-b3e7ad340df8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31/action" status: 202 len: 0 microversion: 2.1 time: 2.020766 Oct 29 20:57:55.516161 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1322/2557] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:57:53 2022] POST /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31/action => generated 0 bytes in 2023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:57:55.526187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1f9639bb-0408-45e6-8f45-07be5b87e66b req-cecb80e1-d3c7-44b3-b47a-494eeface148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ae7e10-059c-4abb-a613-8d39f0f18a31", "tag": "187afd1d-a55b-4f2f-af00-bc6d4b1b3c44"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:55.533686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-530697608"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:55.534952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:55.561085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:55.561688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:55.564878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:55.565654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:55.566128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:55.566546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1f9639bb-0408-45e6-8f45-07be5b87e66b req-cecb80e1-d3c7-44b3-b47a-494eeface148 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:55.567023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1f9639bb-0408-45e6-8f45-07be5b87e66b req-cecb80e1-d3c7-44b3-b47a-494eeface148 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:55.569888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:55.571767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1f9639bb-0408-45e6-8f45-07be5b87e66b req-cecb80e1-d3c7-44b3-b47a-494eeface148 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:55.607328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1f9639bb-0408-45e6-8f45-07be5b87e66b req-cecb80e1-d3c7-44b3-b47a-494eeface148 service nova] Creating event network-changed:187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 for instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 on nch2-master-1 Oct 29 20:57:55.618523 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1f9639bb-0408-45e6-8f45-07be5b87e66b req-cecb80e1-d3c7-44b3-b47a-494eeface148 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096868 Oct 29 20:57:55.619708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1236/2558] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:55.631840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:55.632894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:55.645749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:55.646343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:55.646899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:55.647710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:55.648521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:55.649054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:55.804248 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Adding security group 1600103f-0b23-45e9-b05a-e96aa699b5fd to port 187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 Oct 29 20:57:55.976519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:55.986241 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aee748c3-649b-413d-8491-ea2625fbf8c2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.365134 Oct 29 20:57:55.990332 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1237/2559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:55 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:56.004004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:56.005521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:56.018910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:56.019495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:56.020021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:56.022177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:56.022755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:56.025003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:56.158555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:56.168415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:56.170147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:56.172082 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8436bb1-0bdb-4580-92e2-ad0d8a6b3e99 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1264 microversion: 2.25 time: 0.180218 Oct 29 20:57:56.172658 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1238/2560] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:55 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:56.507743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:56.508591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:56.515662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:56.516506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:56.517969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:56.519023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:56.519925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:56.520771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:56.679872 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-089107a1-19f8-4581-93f5-b9960095fbb1 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31/action" status: 202 len: 0 microversion: 2.1 time: 1.155247 Oct 29 20:57:56.681701 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1323/2561] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:57:55 2022] POST /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31/action => generated 0 bytes in 1160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:57:56.692317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:56.704323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:56.750655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:56.753113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:56.754046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:56.758837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:56.760964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:56.761631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:56.882594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:56.892579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:56.899795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:56.903484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c095091-bef5-4e10-9554-36adfd27f5b9 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1556 microversion: 2.21 time: 0.399595 Oct 29 20:57:56.905870 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1239/2562] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:56 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1556 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:57.013167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:57.014577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:57.027159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.030055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.030725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:57.033771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.035114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.035718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:57.341347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-720f823a-0209-4d55-b26a-2e03f2cdb488 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.654458 Oct 29 20:57:57.342324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1324/2563] 10.222.0.36 () {58 vars in 1293 bytes} [Sat Oct 29 20:57:56 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31/os-security-groups => generated 1157 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:57.347673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:57.348498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:57.362287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.363991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.365241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:57.366319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.367197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.367857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:57.429082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:57.440912 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67852bfb-0e6a-421a-a73b-3cc822429ead tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.432445 Oct 29 20:57:57.442133 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1240/2564] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:57 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:57:57.448131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b45ca26d-3ae7-42ef-a848-770088d79e60 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa1724450d0>, body: {"security_group": {"name": " tempest-securitygroup -1051297379 ", "description": "tempest-description-597198296"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:57.487222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:57.498710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:57.500592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:57.509151 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b080aebb-afb3-4ee3-b2d4-0024f940d179 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1264 microversion: 2.25 time: 0.165747 Oct 29 20:57:57.528203 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1325/2565] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:57 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:57.690574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1e009fbf-36bf-4891-9f81-26d6c5c68dc6 req-72de5e0b-bd58-473c-a2bd-8ffd0abfa16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ae7e10-059c-4abb-a613-8d39f0f18a31", "tag": "187afd1d-a55b-4f2f-af00-bc6d4b1b3c44"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:57.714737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1e009fbf-36bf-4891-9f81-26d6c5c68dc6 req-72de5e0b-bd58-473c-a2bd-8ffd0abfa16f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.715619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1e009fbf-36bf-4891-9f81-26d6c5c68dc6 req-72de5e0b-bd58-473c-a2bd-8ffd0abfa16f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.716990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1e009fbf-36bf-4891-9f81-26d6c5c68dc6 req-72de5e0b-bd58-473c-a2bd-8ffd0abfa16f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:57.735752 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1e009fbf-36bf-4891-9f81-26d6c5c68dc6 req-72de5e0b-bd58-473c-a2bd-8ffd0abfa16f service nova] Creating event network-changed:187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 for instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 on nch2-master-1 Oct 29 20:57:57.744947 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1e009fbf-36bf-4891-9f81-26d6c5c68dc6 req-72de5e0b-bd58-473c-a2bd-8ffd0abfa16f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064961 Oct 29 20:57:57.747584 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1326/2566] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:57.949941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:57.950975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:57.964193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.965253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.966090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:57.968289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:57.969207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:57.970562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:58.231085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b45ca26d-3ae7-42ef-a848-770088d79e60 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.787331 Oct 29 20:57:58.232245 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1241/2567] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:57:57 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:58.256148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc81374a-26cb-4b19-be03-992463301d0b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171cfdca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:58.644289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc81374a-26cb-4b19-be03-992463301d0b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2" status: 200 len: 223 microversion: 2.1 time: 0.394133 Oct 29 20:57:58.649187 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1242/2568] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:57:58 2022] GET /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 => generated 223 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:57:58.678769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:58.680281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:58.706517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:58.707408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:58.708092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:58.711181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:58.717072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:58.717865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:58.779452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:58.812811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:58.825681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:58.830323 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4db03e5f-3d9a-462c-be4c-d158562d2bf3 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1556 microversion: 2.21 time: 0.894170 Oct 29 20:57:58.832894 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1327/2569] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:57 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1556 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:58.842234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:58.843260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:58.856903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:58.857875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:58.858824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:58.859744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:58.861668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:58.862372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:58.931778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:58.932284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:58.932924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:58.933529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lazy-loading 'fault' on Instance uuid a48232db-4cad-4419-8a60-b51f8812f61b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:57:59.021195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:59.102973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:59.110810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:59.114210 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a53de62-cd11-45fd-9a05-2a5bbe139199 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1269 microversion: 2.25 time: 0.279221 Oct 29 20:57:59.115122 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1328/2570] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:58 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1269 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:57:59.131432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:57:59.140141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38c71088-6fd1-45a6-ac78-0b59b882cfa0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171523430>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:59.162887 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35ed2c54-990a-44a7-addb-5cefcdbb3b49 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.511103 Oct 29 20:57:59.164273 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1243/2571] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:57:58 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:57:59.687827 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38c71088-6fd1-45a6-ac78-0b59b882cfa0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2" status: 202 len: 0 microversion: 2.1 time: 0.570538 Oct 29 20:57:59.692671 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1329/2572] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:57:59 2022] DELETE /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:57:59.699974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171a72820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:59.798979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:57:59.799629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.security_group_api [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 not found {{(pid=138884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:57:59.800173 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.800173 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 HTTP/1.1 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9f3e2ab0-27aa-4891-a0b4-5396cb707eb2'} Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:57:59.802209 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-352af31a-88c8-4481-83ec-757e439090a3'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:57:59.806039 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f13c2a1d-0d6d-40a6-a3ec-b18e2acf8cb0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2" status: 404 len: 194 microversion: 2.1 time: 0.107883 Oct 29 20:57:59.811009 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1244/2573] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:57:59 2022] GET /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:57:59.815426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5216ede5-79ec-4af6-8acb-390d1bff38e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa1714e7040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1931661652", "description": "tempest-description-1785562567"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:57:59.859593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:57:59.864484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:57:59.884381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:59.885173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:59.885802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:57:59.886788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:57:59.888569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:57:59.889217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:00.505860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:00.520463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:00.524364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:00.528154 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35f4eef9-facb-4faf-8d9e-9a745c232a05 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1556 microversion: 2.21 time: 0.675693 Oct 29 20:58:00.530123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1245/2574] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:57:59 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1556 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:00.544451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:00.545360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:00.562119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:00.567094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:00.567931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:00.569642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:00.571523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:00.572170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:00.606886 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5216ede5-79ec-4af6-8acb-390d1bff38e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.795361 Oct 29 20:58:00.607497 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1330/2575] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:57:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:00.622566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:00.623216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:00.627579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:00.639562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:00.642111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:00.643549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:00.646099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:00.646813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:00.650051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:00.670780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:00.671278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:00.674856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:00.677040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lazy-loading 'fault' on Instance uuid a48232db-4cad-4419-8a60-b51f8812f61b {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:00.951350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:00.968226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:00.969903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:00.975899 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b93dca59-12b6-4f29-8f6a-8504db5cde85 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 200 len: 1269 microversion: 2.25 time: 0.438909 Oct 29 20:58:00.976520 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1246/2576] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:00 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 1269 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:01.010162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e5223c6-e359-4cf0-afe9-dd1344526c02 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa171a07c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1193444695", "description": "tempest-description-252415194"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:01.280420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:01.352310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-927ccb83-9cb7-45e4-99f7-153d64d8228e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.741238 Oct 29 20:58:01.354020 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1331/2577] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:00 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:01.568532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:01.570043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:01.614889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:01.617008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:01.617722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:01.628459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:01.633946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e5223c6-e359-4cf0-afe9-dd1344526c02 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.641093 Oct 29 20:58:01.644828 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1247/2578] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:58:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:01.645046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:01.645046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:01.651713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3bf8b761-1517-4a36-9436-30eba1663d54 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa171ffad30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1674184297", "description": "tempest-description-1017312140"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:02.086749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:02.098103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:02.103772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:02.105127 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f75b12f2-c30a-4479-aac5-faac480b94f1 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1556 microversion: 2.21 time: 0.549426 Oct 29 20:58:02.109874 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1332/2579] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:01 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1556 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:02.130821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:02.131814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: a48232db-4cad-4419-8a60-b51f8812f61b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:02.145904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:02.155115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:02.155713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:02.161694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:02.162309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:02.162770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:02.218231 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] HTTP exception thrown: Instance a48232db-4cad-4419-8a60-b51f8812f61b could not be found. Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Request method failure captured: Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b HTTP/1.1 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJmEZ01IrPFWW8FDIBQtP4SRT4j_eV5E8mFocukdar8QEPLby4SOJwwzBVu6YBCMvbjB59kfSuhbGcNazr1uVCRZCRi5s2sjXkzlTVxYjWIgcr_q8wYpr9zG6vAJp2DKD-FJXIyDMABFwj42cNkzKZYUwy_vscM1oxOYvaixKUZWSk Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a637980654ed411a96672f36bab6214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a637980654ed411a96672f36bab6214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3e4d267d3b344928a2ca0a6e79eadb4 Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a48232db-4cad-4419-8a60-b51f8812f61b could not be found. Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a48232db-4cad-4419-8a60-b51f8812f61b'} Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48232db-4cad-4419-8a60-b51f8812f61b could not be found. Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48232db-4cad-4419-8a60-b51f8812f61b could not be found. Oct 29 20:58:02.223517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48232db-4cad-4419-8a60-b51f8812f61b could not be found. Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Returning 404 to user: Instance a48232db-4cad-4419-8a60-b51f8812f61b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-66880ccd-3a63-4c7c-a289-b47773bbcfe9 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b" status: 404 len: 111 microversion: 2.25 time: 0.113312 Oct 29 20:58:02.228928 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1333/2580] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:02 2022] GET /compute/v2.1/servers/a48232db-4cad-4419-8a60-b51f8812f61b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:02.284453 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3bf8b761-1517-4a36-9436-30eba1663d54 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.637023 Oct 29 20:58:02.287038 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1248/2581] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:58:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:02.301838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-075e5e2e-831c-4f22-a07f-879f63531fe5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171125280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:02.381215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:02.381836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:02.403321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:02.406189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:02.407516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:02.413890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:02.414421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:02.415089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:03.592878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:03.652599 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-83de9a30-5c25-43f8-8caf-9a372568ca00 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 1.275609 Oct 29 20:58:03.657331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1249/2582] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:02 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:03.683709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:03.685750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:03.711916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:03.714246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:03.717194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:03.719159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:03.721046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:03.722119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.230438 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-075e5e2e-831c-4f22-a07f-879f63531fe5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 1.934070 Oct 29 20:58:04.237158 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1334/2583] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:58:02 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:04.262913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7847bbe5-2599-4657-b679-304b62e688a4 req-afe11309-2f74-46ac-8876-401a33b527e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a031530-0776-4fad-8a66-9ee1a4b89b8b", "name": "network-vif-unplugged", "status": "completed", "tag": "977dc82f-0d81-4ad3-b6f2-165f20de96a8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:04.306799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7847bbe5-2599-4657-b679-304b62e688a4 req-afe11309-2f74-46ac-8876-401a33b527e3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.307508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7847bbe5-2599-4657-b679-304b62e688a4 req-afe11309-2f74-46ac-8876-401a33b527e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.309234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7847bbe5-2599-4657-b679-304b62e688a4 req-afe11309-2f74-46ac-8876-401a33b527e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.323727 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7847bbe5-2599-4657-b679-304b62e688a4 req-afe11309-2f74-46ac-8876-401a33b527e3 service nova] Creating event network-vif-unplugged:977dc82f-0d81-4ad3-b6f2-165f20de96a8 for instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b on nch1-master-1 Oct 29 20:58:04.332906 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7847bbe5-2599-4657-b679-304b62e688a4 req-afe11309-2f74-46ac-8876-401a33b527e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093793 Oct 29 20:58:04.334217 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1335/2584] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:04.343056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:04.344155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:04.355559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.356407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.357005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.358872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.359502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.360704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.461281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:04.480213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.483436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.483920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.486892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lazy-loading 'fault' on Instance uuid 8a031530-0776-4fad-8a66-9ee1a4b89b8b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:04.491561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:04.495436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:04.502224 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-edc2b383-2dd7-41e3-8c33-e758d996dd17 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2957 microversion: 2.42 time: 0.838226 Oct 29 20:58:04.507539 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1250/2585] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:03 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2957 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:04.518539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:04.521912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:04.540704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.541137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.545700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.549427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.549967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.551829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.596982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:04.613273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:04.614341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:04.619477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60bbbaab390c4b078d30c1c3f8e8f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d84a41ce34d9f8dca67d21c47ee9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:04.623459 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-420709d2-5b42-44f0-8d43-6318f89f934b tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 200 len: 1348 microversion: 2.21 time: 0.285694 Oct 29 20:58:04.662307 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1336/2586] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:04 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 1348 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:04.692029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2e075140-2bb2-47b7-a672-e1b932ecf585 req-b5d6beae-669d-44b0-a31a-4a65ad340984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a031530-0776-4fad-8a66-9ee1a4b89b8b", "name": "network-vif-deleted", "tag": "977dc82f-0d81-4ad3-b6f2-165f20de96a8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:04.734479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e075140-2bb2-47b7-a672-e1b932ecf585 req-b5d6beae-669d-44b0-a31a-4a65ad340984 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.736727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e075140-2bb2-47b7-a672-e1b932ecf585 req-b5d6beae-669d-44b0-a31a-4a65ad340984 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.738408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e075140-2bb2-47b7-a672-e1b932ecf585 req-b5d6beae-669d-44b0-a31a-4a65ad340984 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.781997 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2e075140-2bb2-47b7-a672-e1b932ecf585 req-b5d6beae-669d-44b0-a31a-4a65ad340984 service nova] Creating event network-vif-deleted:977dc82f-0d81-4ad3-b6f2-165f20de96a8 for instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b on nch1-master-1 Oct 29 20:58:04.802256 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2e075140-2bb2-47b7-a672-e1b932ecf585 req-b5d6beae-669d-44b0-a31a-4a65ad340984 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135791 Oct 29 20:58:04.804040 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1337/2587] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:04.820413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-46c42325-b330-492f-8000-be8c57cc6999 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1716195e0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:04.852863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f04d20a1-128f-4d87-b310-e05bd4013ad4 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 204 len: 0 microversion: 2.25 time: 0.342766 Oct 29 20:58:04.854074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1251/2588] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:58:04 2022] DELETE /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:58:04.864078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:04.864858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:04.872018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.872884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.873613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:04.875329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:04.876287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:04.877225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:05.102985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7c80add-1fbe-447f-a25c-afcb6c178761 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.247455 Oct 29 20:58:05.103628 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1252/2589] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 20:58:04 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044/os-interface => generated 1831 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:05.108601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:05.109449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:05.122731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:05.123463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:05.124645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:05.126344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:05.128957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:05.129656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:05.151297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:05.353202 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-46c42325-b330-492f-8000-be8c57cc6999 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0" status: 202 len: 0 microversion: 2.1 time: 0.547602 Oct 29 20:58:05.357983 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1338/2590] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:58:04 2022] DELETE /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:05.364240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:05.365406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:05.384118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:05.385987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:05.386665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:05.388538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:05.390697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:05.391414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:05.517004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:05.538508 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95438e47-b40f-4367-89f0-66d2a7da7c25 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.428898 Oct 29 20:58:05.539555 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1253/2591] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:05 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:05.545236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1157732459", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "baa8bd65-6cf9-4b88-8694-e22edf6839c4"}, {"uuid": "6cc9fa9f-2fa5-4093-a12d-884a961b4dcc"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:05.645086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] validate_networks() for [('baa8bd65-6cf9-4b88-8694-e22edf6839c4', None, None, None, None, None), ('6cc9fa9f-2fa5-4093-a12d-884a961b4dcc', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:58:05.754678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:05.770772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:05.776434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:05.778110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b86cf757-dbdc-4125-a78a-16bb6db5c561 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1729 microversion: 2.25 time: 0.418287 Oct 29 20:58:05.778732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1339/2592] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:05 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1729 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:05.798871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171250ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:05.947253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:58:05.947941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 5858e7f8-b652-47ab-b322-82158e354da0 not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:58:05.948487 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.948487 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0 HTTP/1.1 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5858e7f8-b652-47ab-b322-82158e354da0'} Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:58:05.953488 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-ca8dae47-e9c3-448c-955b-cbf9e011f743'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e9b2abd-f73f-44e3-813e-09c49ef935be tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0" status: 404 len: 194 microversion: 2.1 time: 0.171780 Oct 29 20:58:05.959245 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1340/2593] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:58:05 2022] GET /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0 => generated 194 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:05.968098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:05.970974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:05.997351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:05.998641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:06.002599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:06.006419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:06.011414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:06.012576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:06.067358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:06.071667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] HTTP exception thrown: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Request method failure captured: Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b HTTP/1.1 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOuRLPXw1YOXTSz3BOKr6IaSPcdim7JU2YOZfXLoRM0T0QIgzsLvQSYsRpl7DfH-6JO4-n8Zq9Tmad9LgfKCcrSD2i5z-jW61-rtUMBLDNUoMwtGxR-gMonJ93QtcaiFfMrZ9MYz0Lm6UE-FG3OrCollvPDefCLbnXHrbJllOh1K4I Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 822d84a41ce34d9f8dca67d21c47ee9b Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 822d84a41ce34d9f8dca67d21c47ee9b Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceActionsV221TestJSON-657263896-project Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 60bbbaab390c4b078d30c1c3f8e8f942 Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceActionsV221TestJSON-657263896-project Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8a031530-0776-4fad-8a66-9ee1a4b89b8b'} Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:06.088245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:06.094294 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:06.100649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Returning 404 to user: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:06.102950 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b44799f6-a4e3-44ff-8871-f1b94f724822 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 404 len: 111 microversion: 2.21 time: 0.142363 Oct 29 20:58:06.106788 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1341/2594] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:05 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:06.111981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-511138b4-7357-423c-80cb-55e2cc7f026e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171134820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:06.656254 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-511138b4-7357-423c-80cb-55e2cc7f026e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db" status: 202 len: 0 microversion: 2.1 time: 0.550669 Oct 29 20:58:06.660530 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1342/2595] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:58:06 2022] DELETE /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:06.687290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '.version_select at 0x7fa1716171f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:06.690349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:06.711960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:06.714819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:06.716071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:06.717918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:06.719018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:06.721620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:06.858161 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-50dc68f5-ef79-438a-9fae-58ababf00d4a tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.195771 Oct 29 20:58:06.866201 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1343/2596] 10.222.0.36 () {60 vars in 1337 bytes} [Sat Oct 29 20:58:06 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b/os-instance-actions => generated 611 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 20:58:06.874889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:06.876134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:06.893318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:06.895500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:06.896460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:06.900291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:06.902184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:06.903780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.369403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:58:07.370239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:58:07.374923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:58:07.377809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:58:07.380299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:58:07.385345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:07.401769 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e37727f-f167-43e9-8cee-73ce1f228fdb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.532675 Oct 29 20:58:07.402749 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1344/2597] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:06 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:07.413704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:07.413704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:07.414499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.416507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:07.417013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:07.417484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.448489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa171687940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:07.491705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Getting quotas for project 86e380500f114891bf674438936e8e97. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:58:07.517630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Getting quotas for user 00a550d419d943628a9f73797cb7f36b and project 86e380500f114891bf674438936e8e97. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:58:07.528607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:58:07.529257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:58:07.530224 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.530224 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db HTTP/1.1 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '87ef5881-f3f0-4b89-8b67-ddb20c5815db'} Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:58:07.543715 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] Oct 29 20:58:07.548492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.553518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:58:07.553518 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-1e9b5463-d3dd-4523-8978-8ffdb24ee574'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:07.558588 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2c11a17-4efa-4cb1-afb0-94d471572d48 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db" status: 404 len: 194 microversion: 2.1 time: 0.137224 Oct 29 20:58:07.561285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1345/2598] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:58:07 2022] GET /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:07.583152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:07.584371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:07.591293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:58:07.601210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:07.603372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:07.603973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:07.604444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.605271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:07.605827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:07.606471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.750124 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f02bd39-eb24-44ef-9775-668da5310177 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207117 Oct 29 20:58:07.753063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1254/2599] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:58:07.764326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:07.765119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:07.791767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:07.792270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:07.794474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.795649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:07.799768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:07.800416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:07.836544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] HTTP exception thrown: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Request method failure captured: Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b HTTP/1.1 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOuRLPXw1YOXTSz3BOKr6IaSPcdim7JU2YOZfXLoRM0T0QIgzsLvQSYsRpl7DfH-6JO4-n8Zq9Tmad9LgfKCcrSD2i5z-jW61-rtUMBLDNUoMwtGxR-gMonJ93QtcaiFfMrZ9MYz0Lm6UE-FG3OrCollvPDefCLbnXHrbJllOh1K4I Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 822d84a41ce34d9f8dca67d21c47ee9b Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 822d84a41ce34d9f8dca67d21c47ee9b Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-InstanceActionsV221TestJSON-657263896-project Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 60bbbaab390c4b078d30c1c3f8e8f942 Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-InstanceActionsV221TestJSON-657263896-project Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '8a031530-0776-4fad-8a66-9ee1a4b89b8b'} Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:07.857970 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:07.863138 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:07.864957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Returning 404 to user: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:07.866163 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ec05201-1cd7-4e0f-b94e-455c73a34ce6 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 404 len: 111 microversion: 2.21 time: 0.111250 Oct 29 20:58:07.867625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1255/2600] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:58:07 2022] DELETE /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:07.983165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:08.012746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:08.024895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:08.039451 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bca6e83-dae0-49fe-9b2b-e33594952e1f tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1729 microversion: 2.25 time: 0.470084 Oct 29 20:58:08.045630 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1346/2601] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:07 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1729 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:08.060511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31d5acb2-d6aa-4264-98e7-5325c22150a4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1714e7310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:08.159216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-69e18e8f-941f-4a9f-b18a-f2c04122cfe4 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Action: 'create', calling method: .version_select at 0x7fa1762ddee0>, body: {"pool": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:08.726000 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31d5acb2-d6aa-4264-98e7-5325c22150a4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135" status: 202 len: 0 microversion: 2.1 time: 0.676914 Oct 29 20:58:08.727040 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1347/2602] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:58:08 2022] DELETE /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:08.735460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-343d2e4e-233d-4841-b120-4b9f865a3621 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:08.736576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-343d2e4e-233d-4841-b120-4b9f865a3621 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:08.944098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-343d2e4e-233d-4841-b120-4b9f865a3621 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:08.988700 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-343d2e4e-233d-4841-b120-4b9f865a3621 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1213 microversion: 2.1 time: 0.255677 Oct 29 20:58:08.989397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1348/2603] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:08 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:09.025342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:09.026063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] [instance: 8a031530-0776-4fad-8a66-9ee1a4b89b8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:09.047621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:09.048214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:09.053008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:09.055373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:09.060477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:09.060941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:09.120143 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] HTTP exception thrown: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Request method failure captured: Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b HTTP/1.1 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOuRLPXw1YOXTSz3BOKr6IaSPcdim7JU2YOZfXLoRM0T0QIgzsLvQSYsRpl7DfH-6JO4-n8Zq9Tmad9LgfKCcrSD2i5z-jW61-rtUMBLDNUoMwtGxR-gMonJ93QtcaiFfMrZ9MYz0Lm6UE-FG3OrCollvPDefCLbnXHrbJllOh1K4I Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 822d84a41ce34d9f8dca67d21c47ee9b Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/822d84a41ce34d9f8dca67d21c47ee9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 822d84a41ce34d9f8dca67d21c47ee9b Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-657263896 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceActionsV221TestJSON-657263896-project Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 60bbbaab390c4b078d30c1c3f8e8f942 Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceActionsV221TestJSON-657263896-project Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8a031530-0776-4fad-8a66-9ee1a4b89b8b'} Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:09.121785 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] Returning 404 to user: Instance 8a031530-0776-4fad-8a66-9ee1a4b89b8b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:09.127657 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa87f711-c30f-4a36-b9a9-19d5ab1e8ad2 tempest-InstanceActionsV221TestJSON-657263896 tempest-InstanceActionsV221TestJSON-657263896-project] 10.222.0.36 "GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b" status: 404 len: 111 microversion: 2.21 time: 0.125756 Oct 29 20:58:09.134447 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1349/2604] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:08 2022] GET /compute/v2.1/servers/8a031530-0776-4fad-8a66-9ee1a4b89b8b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:09.139322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:09.139947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:09.164900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:09.165415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:09.171522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:09.172864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:09.173560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:09.174154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:09.696368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:09.738221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2bd7627-5e7a-4478-af7f-be7bab944e9b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.600678 Oct 29 20:58:09.745354 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1350/2605] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:09 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:09.767812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1714e7310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:10.004218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:58:10.004825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:58:10.005603 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.005603 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 HTTP/1.1 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b6b77bd2-46eb-48a5-9e2a-1b71dadf0135'} Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:58:10.007915 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] Oct 29 20:58:10.012531 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:10.017191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:58:10.017191 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-8bc13460-833c-4aba-9d53-c261680b0711'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:10.018844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2179ff54-d2f8-4b73-8b43-5d2ebe3b5541 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135" status: 404 len: 194 microversion: 2.1 time: 0.270770 Oct 29 20:58:10.019728 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1351/2606] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:58:09 2022] GET /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 => generated 194 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:10.033398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:10.034202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:10.062554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:10.063093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:10.063865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:10.070922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:10.071434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:10.071997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:10.400820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:10.416591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:10.419917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:10.428841 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf659746-071c-4a6e-bbcd-de9120de3060 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 200 len: 1370 microversion: 2.25 time: 0.407845 Oct 29 20:58:10.430041 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1352/2607] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:10 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:10.442583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2e07c831-86a1-4d88-bbbd-786b6214ef66 req-7421aa54-f214-4c85-84cc-3757f1ef697d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623", "name": "network-vif-deleted", "tag": "8719a5b1-e60d-48bc-8e71-ff14e6657083"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:10.504449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e07c831-86a1-4d88-bbbd-786b6214ef66 req-7421aa54-f214-4c85-84cc-3757f1ef697d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:10.506382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e07c831-86a1-4d88-bbbd-786b6214ef66 req-7421aa54-f214-4c85-84cc-3757f1ef697d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:10.509480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e07c831-86a1-4d88-bbbd-786b6214ef66 req-7421aa54-f214-4c85-84cc-3757f1ef697d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:10.556929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2e07c831-86a1-4d88-bbbd-786b6214ef66 req-7421aa54-f214-4c85-84cc-3757f1ef697d service nova] Creating event network-vif-deleted:8719a5b1-e60d-48bc-8e71-ff14e6657083 for instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 on nch2-master-1 Oct 29 20:58:10.576590 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2e07c831-86a1-4d88-bbbd-786b6214ef66 req-7421aa54-f214-4c85-84cc-3757f1ef697d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144380 Oct 29 20:58:10.579830 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1353/2608] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:10.593296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:10.601218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:10.619123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:10.619949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:10.620870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:10.621888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:10.622782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:10.623429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:10.797268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:10.827583 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7dff4da1-8529-4433-8ddb-cc8a10317e43 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1271 microversion: 2.1 time: 0.246239 Oct 29 20:58:10.832512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1354/2609] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:10 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:10.851202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37ae9bb3-7bb7-4882-9b51-171fa9f44528 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1710794c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:11.503075 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37ae9bb3-7bb7-4882-9b51-171fa9f44528 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.667729 Oct 29 20:58:11.503732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1355/2610] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:58:10 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:11.508517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:11.509133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:11.526006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:11.526509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:11.526957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:11.527669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:11.528126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:11.528554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:12.540587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:12.562640 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc97778d-a0ff-4f19-b9ae-45ae649eb5e7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 1.057821 Oct 29 20:58:12.573304 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1356/2611] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:11 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:12.587734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:12.597703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:12.619795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:12.620559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:12.621185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:12.622336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:12.622978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:12.623581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:12.671471 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] HTTP exception thrown: Instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 could not be found. Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Request method failure captured: Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 HTTP/1.1 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJmEZ01IrPFWW8FDIBQtP4SRT4j_eV5E8mFocukdar8QEPLby4SOJwwzBVu6YBCMvbjB59kfSuhbGcNazr1uVCRZCRi5s2sjXkzlTVxYjWIgcr_q8wYpr9zG6vAJp2DKD-FJXIyDMABFwj42cNkzKZYUwy_vscM1oxOYvaixKUZWSk Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a637980654ed411a96672f36bab6214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a637980654ed411a96672f36bab6214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3e4d267d3b344928a2ca0a6e79eadb4 Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 could not be found. Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623'} Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 could not be found. Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 could not be found. Oct 29 20:58:12.679917 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 could not be found. Oct 29 20:58:12.684897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:12.686953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Returning 404 to user: Instance f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:12.691474 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-11557cd8-641d-4b4e-92be-f738202bfa6a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623" status: 404 len: 111 microversion: 2.25 time: 0.115932 Oct 29 20:58:12.692653 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1357/2612] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:12 2022] GET /compute/v2.1/servers/f76690d5-49fa-4b4f-9ef2-3e7d7f1b6623 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:12.702809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93857292-9509-42eb-b647-6db7b9ac23ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa1711f7670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1908082779", "description": "tempest-description-1619756387"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:12.856467 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-69e18e8f-941f-4a9f-b18a-f2c04122cfe4 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.987320 Oct 29 20:58:12.856986 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1256/2613] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:58:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:12.863467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:12.865967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:12.880386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:12.882931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:12.884551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:12.885387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:12.886037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:12.886331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:13.327509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:13.339400 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4356897-bc39-4b0f-b183-ed12dda5200a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1313 microversion: 2.1 time: 0.481471 Oct 29 20:58:13.340602 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1257/2614] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:12 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:13.346292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-384eb9dd-2ccc-4ef2-b062-0a39ec298321 req-b42228f8-a5d2-4158-b097-2c9ece725f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b215b43-b0f1-4c4d-90aa-d1f845d7b311", "name": "network-vif-plugged", "status": "completed", "tag": "ae78b4a8-48c3-4bc9-88f8-4e25dbe15dc0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:13.358287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-384eb9dd-2ccc-4ef2-b062-0a39ec298321 req-b42228f8-a5d2-4158-b097-2c9ece725f04 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:13.359020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-384eb9dd-2ccc-4ef2-b062-0a39ec298321 req-b42228f8-a5d2-4158-b097-2c9ece725f04 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:13.359640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-384eb9dd-2ccc-4ef2-b062-0a39ec298321 req-b42228f8-a5d2-4158-b097-2c9ece725f04 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:13.373103 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-384eb9dd-2ccc-4ef2-b062-0a39ec298321 req-b42228f8-a5d2-4158-b097-2c9ece725f04 service nova] Creating event network-vif-plugged:ae78b4a8-48c3-4bc9-88f8-4e25dbe15dc0 for instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 on nch1-master-1 Oct 29 20:58:13.378739 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-384eb9dd-2ccc-4ef2-b062-0a39ec298321 req-b42228f8-a5d2-4158-b097-2c9ece725f04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036733 Oct 29 20:58:13.379956 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1258/2615] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:13.386340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d88cbcd-8cb3-4741-aab2-ed07cd924604 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '.version_select at 0x7fa171a39820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:13.396299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:13.419254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d88cbcd-8cb3-4741-aab2-ed07cd924604 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659885416" status: 204 len: 0 microversion: 2.25 time: 0.037867 Oct 29 20:58:13.419865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1259/2616] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 20:58:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659885416 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:58:13.428433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c25eb41-3fb8-4ad4-8d86-36aa0c05a9de tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Action: 'create', calling method: .version_select at 0x7fa171a4ff70>, body: {"pool": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:13.633326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93857292-9509-42eb-b647-6db7b9ac23ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.939133 Oct 29 20:58:13.634770 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1358/2617] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:58:12 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:13.651085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:13.654551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:13.665755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:13.666731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:13.667573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:13.668524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:13.669822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:13.670455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:14.476213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:14.489436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d0acdba-b5e2-4474-a7ff-c5cbbe4406bb tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1308 microversion: 2.1 time: 0.839669 Oct 29 20:58:14.493732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1359/2618] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:13 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1308 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:14.521538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edb64c25-4f87-4dea-bd55-384634638822 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa1710911f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-351475643", "description": "tempest-description-1855976738"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:15.330918 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edb64c25-4f87-4dea-bd55-384634638822 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.833911 Oct 29 20:58:15.338372 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1360/2619] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:58:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:15.344091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:15.347137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:15.359699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:15.364001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:15.366038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:15.366821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:15.369533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:15.370030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:16.067453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:16.079288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-22d89087-c9df-4345-a486-77a29e2f601a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1334 microversion: 2.1 time: 0.736476 Oct 29 20:58:16.086200 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1361/2620] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:15 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1334 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:16.218290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1805472054", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e6e77c92-2649-404d-81ad-8e351979c1f6"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:16.318750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] validate_networks() for [('e6e77c92-2649-404d-81ad-8e351979c1f6', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:58:17.449707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:17.561435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:18.256720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:58:18.259795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:58:18.260320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:58:18.261509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:58:18.262047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:58:18.281165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:18.287101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:18.288558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:18.293764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:18.295452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:18.298096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:18.334004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Getting quotas for project 144a1cc162db403fada4229ac4003494. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:58:18.340928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Getting quotas for user 4ffa2564530843c4853df8c247b4d2f2 and project 144a1cc162db403fada4229ac4003494. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:58:18.362482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Going to run 3 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:58:18.366411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:18.412910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=6baff994-d467-4c9f-bb00-fcc619a503f6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:18.467534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=91795f90-cab5-4bb5-8e01-7e59254c0442,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:18.577866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c577b19c-1fe1-4923-b103-e2e8c686a832 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.489649 Oct 29 20:58:18.579204 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1362/2621] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:58:18.585643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:18.586538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:18.597913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:18.599097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:18.600038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:18.601239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:18.602112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:18.603489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:18.889817 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c25eb41-3fb8-4ad4-8d86-36aa0c05a9de tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.465228 Oct 29 20:58:18.898447 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1260/2622] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:58:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:18.898447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-635850037", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "08ef992e-00e9-4da3-afbc-82ffcfec15d9"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:18.999353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] validate_networks() for [('08ef992e-00e9-4da3-afbc-82ffcfec15d9', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:58:19.001887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:19.011663 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0203098-87ee-4fda-8bc9-74f760b1a1c4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1488 microversion: 2.1 time: 0.429082 Oct 29 20:58:19.030160 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1363/2623] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:18 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1488 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:19.035791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-84806814-9030-4bc3-9be4-01cdd4ba5c2a req-c6dc982e-4cc2-442d-b627-edf12392661a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83192146-8efb-4e0d-86aa-a2d5f8df6720", "tag": "457b1148-d178-4540-80ab-1ae635f03e54"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:19.046140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-84806814-9030-4bc3-9be4-01cdd4ba5c2a req-c6dc982e-4cc2-442d-b627-edf12392661a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:19.047183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-84806814-9030-4bc3-9be4-01cdd4ba5c2a req-c6dc982e-4cc2-442d-b627-edf12392661a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:19.047813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-84806814-9030-4bc3-9be4-01cdd4ba5c2a req-c6dc982e-4cc2-442d-b627-edf12392661a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:19.065079 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-84806814-9030-4bc3-9be4-01cdd4ba5c2a req-c6dc982e-4cc2-442d-b627-edf12392661a service nova] Creating event network-changed:457b1148-d178-4540-80ab-1ae635f03e54 for instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 on nch2-master-1 Oct 29 20:58:19.070766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-84806814-9030-4bc3-9be4-01cdd4ba5c2a req-c6dc982e-4cc2-442d-b627-edf12392661a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039193 Oct 29 20:58:19.072056 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1364/2624] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:19.079788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:19.080656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:19.087871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:19.088812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:19.089589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:19.090554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:19.091266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:19.091917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:19.130242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:19.383603 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91a9e054-d06d-4e3d-8afe-92debc9cb11e tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 204 len: 0 microversion: 2.25 time: 0.309565 Oct 29 20:58:19.384650 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1365/2625] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:58:19 2022] DELETE /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:58:19.390304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:19.391024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:19.400462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:19.401262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:19.402216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:19.403141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:19.403756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:19.404797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:19.970771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:19.990748 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a92eb39c-0e2f-4909-88f4-90871bf2d309 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1334 microversion: 2.1 time: 0.603477 Oct 29 20:58:19.995178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1366/2626] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:19 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1334 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:20.009737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:20.015654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:20.032633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:20.079539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:58:20.079968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:58:20.080454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:58:20.080880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:58:20.082734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:58:20.097215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:20.097794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:20.098274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:20.099187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:20.099651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:20.100084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:20.105563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:20.109300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:20.114949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:20.116768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:20.119032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:20.119500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:20.138988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Listed batch of 2 results from cell out of 997 limit. Returned 2 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:58:20.173189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:20.176361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Getting quotas for project 82f4e9f3706446a9968a2a42a2125bb4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:58:20.182912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Getting quotas for user 6ce1ee927fb74b81933abbf58ed4810e and project 82f4e9f3706446a9968a2a42a2125bb4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:58:20.183474 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-954497fe-c8b8-431c-8c5b-73361899fc49 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.187016 Oct 29 20:58:20.184194 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1367/2627] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:58:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:20.195802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a6c2322-3aa8-4f37-a492-3407b2cd5e3e tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Action: 'create', calling method: .version_select at 0x7fa171687b80>, body: {"pool": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:20.224242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:58:20.227953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:20.301881 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96bf6c12-6ddb-4958-98c2-fd39740eb280 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410507 Oct 29 20:58:20.304754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1261/2628] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:58:20.590288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:20.591086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:20.623044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:20.624742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:20.625439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:20.627228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:20.629954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:20.631672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:20.739228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:21.003071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a469abd9-b911-4fe6-b64d-a7a4284ab293 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 204 len: 0 microversion: 2.1 time: 0.695369 Oct 29 20:58:21.004595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1262/2629] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:20 2022] DELETE /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:21.014006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:21.015108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:21.026933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.027946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.028708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.030347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.031965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.033043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.462713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:21.472269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:21.474085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:21.476141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5cf877e6-fea5-430b-b7b4-414b6a9fa21c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1548 microversion: 2.25 time: 0.469814 Oct 29 20:58:21.477307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1263/2630] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:21 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1548 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:21.482551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:21.483385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:21.490756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.491433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.492092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.492968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.493652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.494693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.688551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:21.701972 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c402d59c-593d-445b-8a5f-c9953b29029e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1219 microversion: 2.1 time: 0.222622 Oct 29 20:58:21.702817 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1264/2631] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:21 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:21.709526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:21.710314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:21.750081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.752010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.753114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.754703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.756436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.757711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.903051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:21.913072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee060d90-ba26-40ef-b26a-dc3f44c0da3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1211 microversion: 2.1 time: 0.208512 Oct 29 20:58:21.932579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1265/2632] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:21 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1211 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:21.942239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:21.947506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:21.969806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.972699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.973956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:21.975104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:21.975744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:21.976342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:22.438066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:22.463411 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-574a0989-0019-4d7f-ab45-9256c31033d0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1494 microversion: 2.1 time: 0.529060 Oct 29 20:58:22.464336 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1266/2633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:21 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1494 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:22.469749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:22.470354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:22.483332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:22.484295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:22.485208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:22.488044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:22.488763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:22.489450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:22.925924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:22.937548 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3bdb581-de6f-4771-ae66-737472153e72 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1334 microversion: 2.1 time: 0.472023 Oct 29 20:58:22.938809 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1267/2634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:22 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1334 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:22.961014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-626f6517-330c-436b-90b7-8ff772b79988 req-a0dc5731-ecb5-4c28-8e30-c13972ff34b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83192146-8efb-4e0d-86aa-a2d5f8df6720", "tag": "eddf3aa4-960c-4cdc-8085-65f1fa6ca099"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:22.974707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-626f6517-330c-436b-90b7-8ff772b79988 req-a0dc5731-ecb5-4c28-8e30-c13972ff34b4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:22.975360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-626f6517-330c-436b-90b7-8ff772b79988 req-a0dc5731-ecb5-4c28-8e30-c13972ff34b4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:22.976021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-626f6517-330c-436b-90b7-8ff772b79988 req-a0dc5731-ecb5-4c28-8e30-c13972ff34b4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:22.993477 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-626f6517-330c-436b-90b7-8ff772b79988 req-a0dc5731-ecb5-4c28-8e30-c13972ff34b4 service nova] Creating event network-changed:eddf3aa4-960c-4cdc-8085-65f1fa6ca099 for instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 on nch2-master-1 Oct 29 20:58:23.001201 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-626f6517-330c-436b-90b7-8ff772b79988 req-a0dc5731-ecb5-4c28-8e30-c13972ff34b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045729 Oct 29 20:58:23.007800 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1268/2635] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:23.028677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a6c2322-3aa8-4f37-a492-3407b2cd5e3e tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.838437 Oct 29 20:58:23.029488 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1368/2636] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:58:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:23.043952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:23.044630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:23.048815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:23.050470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:23.057154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.057919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.058535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.058931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.059532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.059886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.060288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.060666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.061248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.061478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.062040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.062714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.137374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.138682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.139235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.139889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lazy-loading 'fault' on Instance uuid 1d324009-d931-499f-83ac-cdd3cc3def5c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:23.212864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:23.213000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:23.218199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:23.220756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:23.222550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0f486137-dc86-4a6f-aa3d-25725b3130ae tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 200 len: 1351 microversion: 2.25 time: 0.213040 Oct 29 20:58:23.229436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c91dae8-5d7e-4e93-9609-4135ec838d32 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1281 microversion: 2.1 time: 0.188997 Oct 29 20:58:23.232019 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1369/2637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:23 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:23.236237 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1269/2638] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:23 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 1351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:23.248972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0a48d2a3-981d-4de2-a480-ee4bba0aa8fe tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Action: 'create', calling method: .version_select at 0x7fa171cfd280>, body: {"pool": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:23.254401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:23.255147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:23.268993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.269713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.270402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.271117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.271576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.272068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.399940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:23.416519 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dfe9df6c-0f36-4480-b6de-d37a13280fa3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1267 microversion: 2.1 time: 0.183038 Oct 29 20:58:23.417590 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1370/2639] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:23 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:23.489376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:23.490555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:23.497273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.497784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.498476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.499324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.500002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.500545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.910915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:23.931197 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-643331fe-9780-4758-9e0a-d962b22b7ff0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1494 microversion: 2.1 time: 0.438672 Oct 29 20:58:23.932653 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1371/2640] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:23 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1494 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:23.968715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:23.972443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:23.987925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.990594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.991296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:23.992207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:23.992842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:23.993480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:24.362497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:24.381711 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d32d634b-2019-4b93-b1d3-a231639a1794 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1334 microversion: 2.1 time: 0.421952 Oct 29 20:58:24.385542 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1372/2641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:23 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1334 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:24.416156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:24.419895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 1d324009-d931-499f-83ac-cdd3cc3def5c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:24.443941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:24.447246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:24.448229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:24.451342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:24.453865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:24.456078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:24.506288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] HTTP exception thrown: Instance 1d324009-d931-499f-83ac-cdd3cc3def5c could not be found. Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Request method failure captured: Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c HTTP/1.1 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZJmEZ01IrPFWW8FDIBQtP4SRT4j_eV5E8mFocukdar8QEPLby4SOJwwzBVu6YBCMvbjB59kfSuhbGcNazr1uVCRZCRi5s2sjXkzlTVxYjWIgcr_q8wYpr9zG6vAJp2DKD-FJXIyDMABFwj42cNkzKZYUwy_vscM1oxOYvaixKUZWSk Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a637980654ed411a96672f36bab6214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a637980654ed411a96672f36bab6214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3e4d267d3b344928a2ca0a6e79eadb4 Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 1d324009-d931-499f-83ac-cdd3cc3def5c could not be found. Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '1d324009-d931-499f-83ac-cdd3cc3def5c'} Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d324009-d931-499f-83ac-cdd3cc3def5c could not be found. Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d324009-d931-499f-83ac-cdd3cc3def5c could not be found. Oct 29 20:58:24.507873 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d324009-d931-499f-83ac-cdd3cc3def5c could not be found. Oct 29 20:58:24.512559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:24.516811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Returning 404 to user: Instance 1d324009-d931-499f-83ac-cdd3cc3def5c could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:24.518508 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-caca053a-dc1b-4a34-ae0d-7dae3394c830 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c" status: 404 len: 111 microversion: 2.25 time: 0.131650 Oct 29 20:58:24.525995 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1373/2642] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:24 2022] GET /compute/v2.1/servers/1d324009-d931-499f-83ac-cdd3cc3def5c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:24.538496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:24.539920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:24.573991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:24.574493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:24.574937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:24.575648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:24.576124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:24.576536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.032178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:25.047281 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-89f51a2a-63ca-4f04-9388-ccdb6a1afd90 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1281 microversion: 2.1 time: 0.519271 Oct 29 20:58:25.048359 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1374/2643] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:24 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1281 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:25.055281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:25.056179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:25.063858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.064557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.065181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.066081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.066722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.067315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.152225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:25.161629 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-33d8b5dd-d29b-420c-9ad8-3f49062e4871 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1273 microversion: 2.1 time: 0.111794 Oct 29 20:58:25.162602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1375/2644] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:25 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:25.168625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:25.169386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:25.171644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:25.182296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.183541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.184511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.186677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.187554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.189068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.226409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:25.370066 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4937eee9-3fa6-47bd-9f1f-e69324519760 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "DELETE /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 204 len: 0 microversion: 2.25 time: 0.205506 Oct 29 20:58:25.371816 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1376/2645] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:58:25 2022] DELETE /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:58:25.380384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b9df1ecd-7d9a-414e-a42b-81e19433605a req-99dfe492-4872-4b53-8096-a235945b7cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83192146-8efb-4e0d-86aa-a2d5f8df6720", "name": "network-vif-plugged", "status": "completed", "tag": "457b1148-d178-4540-80ab-1ae635f03e54"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:25.390646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b9df1ecd-7d9a-414e-a42b-81e19433605a req-99dfe492-4872-4b53-8096-a235945b7cc0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.391235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b9df1ecd-7d9a-414e-a42b-81e19433605a req-99dfe492-4872-4b53-8096-a235945b7cc0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.391783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b9df1ecd-7d9a-414e-a42b-81e19433605a req-99dfe492-4872-4b53-8096-a235945b7cc0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.409870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b9df1ecd-7d9a-414e-a42b-81e19433605a req-99dfe492-4872-4b53-8096-a235945b7cc0 service nova] Creating event network-vif-plugged:457b1148-d178-4540-80ab-1ae635f03e54 for instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 on nch2-master-1 Oct 29 20:58:25.427372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b9df1ecd-7d9a-414e-a42b-81e19433605a req-99dfe492-4872-4b53-8096-a235945b7cc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053660 Oct 29 20:58:25.434466 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1377/2646] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:25.634678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1756216007", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:25.704381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:58:25.705243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:58:25.706065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:58:25.706723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:58:25.707383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:58:25.717372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.718262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.718770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.720176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.720727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.721236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.741264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Getting quotas for project 997a9eff6be44acb9fa8993461f7e51c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:58:25.747322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Getting quotas for user b360881ca12a49998b0a518b08a3b3bf and project 997a9eff6be44acb9fa8993461f7e51c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:58:25.765609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:58:25.768218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:25.800284 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0a48d2a3-981d-4de2-a480-ee4bba0aa8fe tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.562304 Oct 29 20:58:25.801313 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1270/2647] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 20:58:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:25.806040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:25.806852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:25.815059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.816342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.816965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.818354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.818958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.820071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.823664 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be662563-49f9-429b-9915-4789f046c8ce tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.387463 Oct 29 20:58:25.824646 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1378/2648] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 20:58:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 20:58:25.829166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c71c2e20-11c0-4261-9cd4-24daaca738e6 req-6be91706-49d7-4b46-b36a-3d61f87d0271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d324009-d931-499f-83ac-cdd3cc3def5c", "name": "network-vif-deleted", "tag": "2af17672-719d-48fb-a0df-59093ab7beb4"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:25.840070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c71c2e20-11c0-4261-9cd4-24daaca738e6 req-6be91706-49d7-4b46-b36a-3d61f87d0271 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.840876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c71c2e20-11c0-4261-9cd4-24daaca738e6 req-6be91706-49d7-4b46-b36a-3d61f87d0271 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.841604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c71c2e20-11c0-4261-9cd4-24daaca738e6 req-6be91706-49d7-4b46-b36a-3d61f87d0271 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.854106 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c71c2e20-11c0-4261-9cd4-24daaca738e6 req-6be91706-49d7-4b46-b36a-3d61f87d0271 service nova] Creating event network-vif-deleted:2af17672-719d-48fb-a0df-59093ab7beb4 for instance 1d324009-d931-499f-83ac-cdd3cc3def5c on nch1-master-1 Oct 29 20:58:25.859536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.862939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.863828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.864656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lazy-loading 'fault' on Instance uuid 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:25.872289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c71c2e20-11c0-4261-9cd4-24daaca738e6 req-6be91706-49d7-4b46-b36a-3d61f87d0271 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046413 Oct 29 20:58:25.872893 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1379/2649] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:25.886317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:25.887950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:25.896479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.897157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.897805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.898688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.899360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.899948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.944868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:25.953291 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a270e04-2593-46e2-a42e-2b9ea9eec512 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 200 len: 1298 microversion: 2.1 time: 0.150818 Oct 29 20:58:25.954739 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1271/2650] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:25 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:25.960346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:25.961089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:25.974408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.975392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.976584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:25.977553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:25.978507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:25.979343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:26.134937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.148489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.150527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.152261 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60f631ab-39e1-499d-8cf5-1e8865f8a548 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1562 microversion: 2.25 time: 0.270046 Oct 29 20:58:26.153396 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1380/2651] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:25 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1562 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:26.159525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f27613e8-8b84-43fa-bab5-427f27e12a2e tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa171091040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:26.321923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.330906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6886eff9-5be6-4971-87d7-948a4950f68e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1334 microversion: 2.1 time: 0.374825 Oct 29 20:58:26.331538 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1272/2652] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:25 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1334 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:26.354411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef0b5098-3bc4-4a82-be1c-6d0b48097a89 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:26.355043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef0b5098-3bc4-4a82-be1c-6d0b48097a89 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:26.439544 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f27613e8-8b84-43fa-bab5-427f27e12a2e tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/4d63d064-3695-4096-9f6a-366db0d055db" status: 200 len: 141 microversion: 2.1 time: 0.284529 Oct 29 20:58:26.440122 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1381/2653] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:58:26 2022] GET /compute/v2.1/os-floating-ips/4d63d064-3695-4096-9f6a-366db0d055db => generated 141 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:26.451341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef0b5098-3bc4-4a82-be1c-6d0b48097a89 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.454980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:26.455857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:26.462805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:26.463886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:26.464482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:26.466475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef0b5098-3bc4-4a82-be1c-6d0b48097a89 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.467198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:26.467965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:26.468389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef0b5098-3bc4-4a82-be1c-6d0b48097a89 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.468867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:26.477017 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef0b5098-3bc4-4a82-be1c-6d0b48097a89 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1281 microversion: 2.47 time: 0.132642 Oct 29 20:58:26.479061 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1273/2654] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:26 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:26.488315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:26.489166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:26.499764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:26.503428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:26.503854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:26.504606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:26.505076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:26.505551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:26.623214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.632862 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-258dcfbf-0efe-455a-bd85-2192745398e5 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1273 microversion: 2.1 time: 0.149607 Oct 29 20:58:26.633860 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1274/2655] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:26 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:26.639319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f909d33e-c3c2-479b-ad9f-13d7919c32a0 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa171a72dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:26.766513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:26.780755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f65631fd-24f0-415d-878a-1c63a7f47545 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.331048 Oct 29 20:58:26.781349 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1382/2656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:26 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:26.978152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:26.978786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:26.986510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:26.987012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:26.987474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:26.988776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:26.990428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:26.990900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:27.011602 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 HTTP/1.1 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '4b215b43-b0f1-4c4d-90aa-d1f845d7b311'} Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:27.013396 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:27.019933 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-188446ac-4340-4198-90f2-63f1548152dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 404 len: 111 microversion: 2.1 time: 0.044700 Oct 29 20:58:27.024013 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1383/2657] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:26 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:58:27.028856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ba42187-988e-4243-abf1-d2c975ccb215 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1714e7310>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:27.815196 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f909d33e-c3c2-479b-ad9f-13d7919c32a0 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/4d63d064-3695-4096-9f6a-366db0d055db" status: 202 len: 0 microversion: 2.1 time: 1.179967 Oct 29 20:58:27.817214 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1275/2658] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:58:26 2022] DELETE /compute/v2.1/os-floating-ips/4d63d064-3695-4096-9f6a-366db0d055db => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:27.823447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:27.824604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:27.831603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:27.832201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:27.832654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:27.833752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:27.834559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:27.835013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:27.957342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ba42187-988e-4243-abf1-d2c975ccb215 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 204 len: 0 microversion: 2.1 time: 0.932119 Oct 29 20:58:27.961794 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1384/2659] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:27 2022] DELETE /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:27.967040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:27.967905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:27.975144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:27.975943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:27.976617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:27.977561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:27.978238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:27.978878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.010376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.014821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:28.021648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.023442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.024742 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fdeed94a-4e01-4b8a-8891-2a4877e047e7 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1562 microversion: 2.25 time: 0.206541 Oct 29 20:58:28.025434 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1276/2660] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:27 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1562 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:28.030420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ad0e1b5c-3dc8-457e-9c36-7db5d606ceef req-ce6fb0a3-9729-44fc-b746-b63df8d26e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83192146-8efb-4e0d-86aa-a2d5f8df6720", "name": "network-vif-plugged", "status": "completed", "tag": "eddf3aa4-960c-4cdc-8085-65f1fa6ca099"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:28.043611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ad0e1b5c-3dc8-457e-9c36-7db5d606ceef req-ce6fb0a3-9729-44fc-b746-b63df8d26e9c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.044486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ad0e1b5c-3dc8-457e-9c36-7db5d606ceef req-ce6fb0a3-9729-44fc-b746-b63df8d26e9c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.045129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ad0e1b5c-3dc8-457e-9c36-7db5d606ceef req-ce6fb0a3-9729-44fc-b746-b63df8d26e9c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.058627 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ad0e1b5c-3dc8-457e-9c36-7db5d606ceef req-ce6fb0a3-9729-44fc-b746-b63df8d26e9c service nova] Creating event network-vif-plugged:eddf3aa4-960c-4cdc-8085-65f1fa6ca099 for instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 on nch2-master-1 Oct 29 20:58:28.063609 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ad0e1b5c-3dc8-457e-9c36-7db5d606ceef req-ce6fb0a3-9729-44fc-b746-b63df8d26e9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036798 Oct 29 20:58:28.067770 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1277/2661] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:28.073349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:28.074529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:28.082110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.083050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.083804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.084754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.085383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.086130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.193983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.206293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.208291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.210187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c67ba3c2-ebe5-4647-95f3-6d01ebff3eb0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1339 microversion: 2.47 time: 0.141030 Oct 29 20:58:28.227275 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1278/2662] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:28 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:28.256400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.262460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:28.263102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:28.269326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-867cd98a-a999-49f7-88d6-98b35ee4a9ac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1334 microversion: 2.1 time: 0.305912 Oct 29 20:58:28.271566 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1385/2663] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:27 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1334 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:28.275412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.275925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.276371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.279566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:28.280425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:28.283133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.283627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.284078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.291858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.292461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.293380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.294373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.295060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.295722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.526342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.532283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:28.541151 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a763b95-7483-4f48-823b-61d20ed980a7 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.267405 Oct 29 20:58:28.542154 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1386/2664] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:28 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:28.544354 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-871be4b1-e270-4691-8f7d-9d8e1a6c45d2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.315384 Oct 29 20:58:28.545258 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1279/2665] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:28 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:28.549713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba3ac3cf-a834-4f06-bac2-d73ad1248e7f tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa171e52040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:28.557355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-78c74811-bae2-41b3-923a-857a4f02d6b3 req-38191a6e-0570-4cf6-97ce-545aeb87e56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b215b43-b0f1-4c4d-90aa-d1f845d7b311", "name": "network-vif-deleted", "tag": "ae78b4a8-48c3-4bc9-88f8-4e25dbe15dc0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:28.569669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-78c74811-bae2-41b3-923a-857a4f02d6b3 req-38191a6e-0570-4cf6-97ce-545aeb87e56d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.570469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-78c74811-bae2-41b3-923a-857a4f02d6b3 req-38191a6e-0570-4cf6-97ce-545aeb87e56d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.571078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-78c74811-bae2-41b3-923a-857a4f02d6b3 req-38191a6e-0570-4cf6-97ce-545aeb87e56d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.583860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-78c74811-bae2-41b3-923a-857a4f02d6b3 req-38191a6e-0570-4cf6-97ce-545aeb87e56d service nova] Creating event network-vif-deleted:ae78b4a8-48c3-4bc9-88f8-4e25dbe15dc0 for instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 on nch1-master-1 Oct 29 20:58:28.588654 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-78c74811-bae2-41b3-923a-857a4f02d6b3 req-38191a6e-0570-4cf6-97ce-545aeb87e56d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042138 Oct 29 20:58:28.589262 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1280/2666] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:28.595040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:28.595636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:28.602176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.602888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.603335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.604047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:28.604679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:28.605125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:28.640127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:28.735848 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53d27d53-d595-4d05-a5d4-075326dfa5b1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 204 len: 0 microversion: 2.1 time: 0.144278 Oct 29 20:58:28.737251 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1281/2667] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:28 2022] DELETE /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:28.873884 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba3ac3cf-a834-4f06-bac2-d73ad1248e7f tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.330472 Oct 29 20:58:28.874543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1387/2668] 10.222.0.36 () {58 vars in 1164 bytes} [Sat Oct 29 20:58:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:58:28.886082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9c5d5fe8-5410-457e-b22e-ce88b6427ada tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa171a725e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:28.905354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2067060295", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1cc8922f-83e5-42c2-bce3-6544d389a499"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:28.977439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] validate_networks() for [('1cc8922f-83e5-42c2-bce3-6544d389a499', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:58:29.236054 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9c5d5fe8-5410-457e-b22e-ce88b6427ada tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.354233 Oct 29 20:58:29.236923 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1282/2669] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 20:58:28 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:29.242002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:29.243134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:29.252912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.254085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.254721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.255639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.256254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.256839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.347879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:29.357796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:29.359902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:29.362400 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db27dba7-742a-40ae-99f6-342d00d92d5c tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1520 microversion: 2.25 time: 0.123194 Oct 29 20:58:29.367892 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1283/2670] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:29 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1520 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:29.384037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:29.385334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:29.400804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.401424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.401985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.402942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.403619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.404281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.505710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:29.517703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:29.520370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:29.521826 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6230804-1299-4c5d-9d7f-a9b7e5caf905 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1339 microversion: 2.47 time: 0.152113 Oct 29 20:58:29.522907 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1284/2671] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:29 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:29.538013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02566e36-33a6-4cb5-a987-5a92395cd2d7 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa171951d30>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:29.751532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:58:29.752105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:58:29.752695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:58:29.753221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:58:29.753815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:58:29.766230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.767518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.768144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.768902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.769569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.770004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.788427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:58:29.794216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Getting quotas for user d1c5ef005ddf4a96828abd5376fffa37 and project 483ebf5b1bac414b85bd03ad6c1ac6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:58:29.808925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:58:29.811589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:29.877173 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9ad6224-a21d-405b-aa3f-ac2f881753a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971646 Oct 29 20:58:29.884073 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1388/2672] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 20:58:29.903287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:29.906061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:29.918020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.919544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.920181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:29.921191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:29.922621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:29.923228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.148704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:30.265950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.274368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97b3c8e7-35ce-4caa-8cb7-c29899d1da95 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1669 microversion: 2.1 time: 0.388979 Oct 29 20:58:30.277365 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1389/2673] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:29 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:30.283919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:30.284657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:30.306163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.306914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.307463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.308769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.309499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.310672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.541078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.545729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:30.552134 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0eff4d27-3c46-4bf0-9b94-33a9be05bc2b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.273221 Oct 29 20:58:30.552731 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1390/2674] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:30 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:30.571517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:30.574157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:30.581803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.582562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.583001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.583715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.584172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.584603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.749442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02566e36-33a6-4cb5-a987-5a92395cd2d7 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/c1bf9692-1fbb-4e21-9f9d-511c06b7f1e3" status: 202 len: 0 microversion: 2.1 time: 1.225305 Oct 29 20:58:30.751925 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1285/2675] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:58:29 2022] DELETE /compute/v2.1/os-floating-ips/c1bf9692-1fbb-4e21-9f9d-511c06b7f1e3 => generated 0 bytes in 1228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:30.758033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:30.759434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:30.766669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.768217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.768734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.769538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.770220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.770731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.793920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.802288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62e0c3f2-4211-4e6e-a7ae-22e282bf30c0 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.248260 Oct 29 20:58:30.803143 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1391/2676] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:30 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:30.808007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:30.808775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:30.819923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.820419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.821170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.822129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.822772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.823377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.840096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.848958 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62ea6560-0da0-4b92-aa0e-789a3dda6838 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1212 microversion: 2.1 time: 0.095719 Oct 29 20:58:30.849764 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1286/2677] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:30 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:30.850466 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bc2b947-2697-4736-b698-3ae4969bb14a tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720/ips" status: 200 len: 179 microversion: 2.1 time: 0.046082 Oct 29 20:58:30.851218 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1392/2678] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 20:58:30 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720/ips => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:30.861315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:30.861965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:30.862652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:30.864525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:30.869674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.870246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.871033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.871871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.872713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.873251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.875950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.876687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.877380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.878131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.880207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.880881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.947856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.957186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.959363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.960583 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-58558a37-a473-4a1b-bb8e-13a08583a2b2 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1346 microversion: 2.25 time: 0.104535 Oct 29 20:58:30.973480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1287/2679] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:30 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:30.973818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.973926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828d0c05-713e-47b5-a8d5-369061b2c2d7", "name": "network-vif-deleted", "tag": "3b65ac57-f1c5-439c-8011-36c2b01a3c62"}, {"name": "network-changed", "server_uuid": "6baff994-d467-4c9f-bb00-fcc619a503f6", "tag": "b51c0574-0ee6-4ee6-8978-2587b5ddfcd3"}, {"name": "network-changed", "server_uuid": "5e0bb8db-bb65-4c99-9016-bfd75ae44944", "tag": "c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5"}, {"name": "network-changed", "server_uuid": "74dde29f-7cab-40b9-bef5-85d996cbdad6", "tag": "769ff437-bb99-4d76-b04e-9e3b05416f92"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:30.983085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.984080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:30.984629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:30.984791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:30.985399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:30.986524 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f0c0f4e-46af-4bff-bfba-83702e685b70 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1339 microversion: 2.47 time: 0.134115 Oct 29 20:58:30.987087 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1393/2680] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:30 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:30.994733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-840f3f4e-b472-406e-945c-3110a5d0a670 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa17643dc10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:31.009635 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Creating event network-vif-deleted:3b65ac57-f1c5-439c-8011-36c2b01a3c62 for instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 on nch1-master-1 Oct 29 20:58:31.010166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Creating event network-changed:b51c0574-0ee6-4ee6-8978-2587b5ddfcd3 for instance 6baff994-d467-4c9f-bb00-fcc619a503f6 on nch2-master-1 Oct 29 20:58:31.010688 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Creating event network-changed:c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 for instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 on nch2-master-1 Oct 29 20:58:31.011224 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] Creating event network-changed:769ff437-bb99-4d76-b04e-9e3b05416f92 for instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 on nch2-master-1 Oct 29 20:58:31.024816 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f46d898f-cba4-471c-ac69-1d63ed764abf req-ed0bfb92-b7b8-4126-8035-4c184fba390d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.061801 Oct 29 20:58:31.025440 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1288/2681] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:31.030934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:31.031585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:31.038636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:31.039182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:31.039627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:31.040439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:31.040914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:31.041411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:31.081933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:31.169562 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce0924eb-cf6e-48e4-aa63-0943c31a45c3 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "DELETE /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 204 len: 0 microversion: 2.1 time: 0.142442 Oct 29 20:58:31.170309 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1289/2682] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:31 2022] DELETE /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:31.181160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:31.181929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:31.190195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:31.190523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:31.191093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:31.191869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:31.192325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:31.192751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:31.842742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:31.851416 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1c1b0e7c-61cb-477f-b7d8-c92a53c50aa0 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1675 microversion: 2.1 time: 0.675764 Oct 29 20:58:31.852009 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1290/2683] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:31 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1675 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:31.856487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:31.857159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:31.865522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:31.866219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:31.866845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:31.868117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:31.868913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:31.869671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.081363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.114255 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54ac3aa2-f6fe-4149-9d08-298934416d53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.261073 Oct 29 20:58:32.126268 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1291/2684] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:31 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:32.138287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:32.138531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:32.145098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.145625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.146076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.146882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.147254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.147687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.323847 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-840f3f4e-b472-406e-945c-3110a5d0a670 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/854d6686-a519-474d-b3da-68f4d8519028" status: 202 len: 0 microversion: 2.1 time: 1.335472 Oct 29 20:58:32.324513 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1394/2685] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:58:30 2022] DELETE /compute/v2.1/os-floating-ips/854d6686-a519-474d-b3da-68f4d8519028 => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:32.330448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:32.331075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:32.339996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.340526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.341151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.341952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.342612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.343051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.355799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.363709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d7c19ef0-1c1d-40bc-b87e-4c78f48f26db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.236322 Oct 29 20:58:32.364349 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1292/2686] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:32 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:32.377693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:32.377693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:32.377693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.377693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.377693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.378149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.378298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.378736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.407571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.410419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:32.412744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.413248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.413908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.414374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lazy-loading 'fault' on Instance uuid 828d0c05-713e-47b5-a8d5-369061b2c2d7 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:32.416124 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25b1dfd3-a48d-431f-9b3f-cd694868c4ac tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1204 microversion: 2.1 time: 0.090295 Oct 29 20:58:32.416795 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1395/2687] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:32 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:32.422506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:32.423065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:32.429283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.429810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.430257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.430943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.431403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.431834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.462879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.466675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:32.473189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.474769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3e4d267d3b344928a2ca0a6e79eadb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a637980654ed411a96672f36bab6214a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.476044 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5926402f-62d1-434a-8402-67c93c625520 tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 200 len: 1351 microversion: 2.25 time: 0.110826 Oct 29 20:58:32.476695 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1293/2688] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:32 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:32.482032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f9496aa-fab8-4341-a074-d4f25bd95988 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] Calling method '.version_select at 0x7fa171866790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:32.507226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.515570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.517670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:32.518825 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae2e6000-c3bb-43f3-b0bd-1738432575e0 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1339 microversion: 2.47 time: 0.101096 Oct 29 20:58:32.519392 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1396/2689] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:32 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:32.876843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:32.877414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:32.883568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.884061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.884505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:32.885207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:32.885695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:32.886127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.107118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.115832 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-170a6a5e-b277-4450-8002-0338b350d3ba tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1675 microversion: 2.1 time: 0.243419 Oct 29 20:58:33.123719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1397/2690] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:32 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1675 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:33.130863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-17b5bf5c-d07f-40ed-a573-a176fed0084a req-fab88f53-9782-4485-965a-6f37c6418b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91795f90-cab5-4bb5-8e01-7e59254c0442", "tag": "57d8b089-4ff5-4bd4-993c-b5dd66291e7e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:33.143917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17b5bf5c-d07f-40ed-a573-a176fed0084a req-fab88f53-9782-4485-965a-6f37c6418b5e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.144788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17b5bf5c-d07f-40ed-a573-a176fed0084a req-fab88f53-9782-4485-965a-6f37c6418b5e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.145912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17b5bf5c-d07f-40ed-a573-a176fed0084a req-fab88f53-9782-4485-965a-6f37c6418b5e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.164817 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-17b5bf5c-d07f-40ed-a573-a176fed0084a req-fab88f53-9782-4485-965a-6f37c6418b5e service nova] Creating event network-changed:57d8b089-4ff5-4bd4-993c-b5dd66291e7e for instance 91795f90-cab5-4bb5-8e01-7e59254c0442 on nch1-master-1 Oct 29 20:58:33.172283 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-17b5bf5c-d07f-40ed-a573-a176fed0084a req-fab88f53-9782-4485-965a-6f37c6418b5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045480 Oct 29 20:58:33.173783 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1398/2691] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:33.178757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:33.179454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:33.185792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.186282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.186716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.187477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.188390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.189439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.458028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.469243 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-942531d7-48d8-4f05-bbe0-c2660febba9c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.294289 Oct 29 20:58:33.472930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1399/2692] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:33 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:33.480704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:33.485811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:33.507687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.508193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.508656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.509345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.510568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.511170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.520021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f9496aa-fab8-4341-a074-d4f25bd95988 tempest-FloatingIPDetailsTestJSON-1612236888 tempest-FloatingIPDetailsTestJSON-1612236888-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/ad0dd57c-85b4-498b-a983-18afdb1190ff" status: 202 len: 0 microversion: 2.1 time: 1.042182 Oct 29 20:58:33.521139 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1294/2693] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 20:58:32 2022] DELETE /compute/v2.1/os-floating-ips/ad0dd57c-85b4-498b-a983-18afdb1190ff => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:33.526759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:33.528042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:33.541690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.542468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.543131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.544059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.544763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.545961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.687124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.696999 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b1f2d6d5-315d-4f7a-a358-7495e3520377 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1260 microversion: 2.1 time: 0.174476 Oct 29 20:58:33.698408 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1295/2694] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:33 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:33.703877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:33.704654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] [instance: 828d0c05-713e-47b5-a8d5-369061b2c2d7] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:33.716738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.717244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.717714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.718432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.718950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.719377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.735868 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] HTTP exception thrown: Instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 could not be found. Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Request method failure captured: Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 HTTP/1.1 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZJmEZ01IrPFWW8FDIBQtP4SRT4j_eV5E8mFocukdar8QEPLby4SOJwwzBVu6YBCMvbjB59kfSuhbGcNazr1uVCRZCRi5s2sjXkzlTVxYjWIgcr_q8wYpr9zG6vAJp2DKD-FJXIyDMABFwj42cNkzKZYUwy_vscM1oxOYvaixKUZWSk Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a637980654ed411a96672f36bab6214a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a637980654ed411a96672f36bab6214a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a637980654ed411a96672f36bab6214a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a637980654ed411a96672f36bab6214a Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d3e4d267d3b344928a2ca0a6e79eadb4 Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1817678524-project Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 could not be found. Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '828d0c05-713e-47b5-a8d5-369061b2c2d7'} Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 could not be found. Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 could not be found. Oct 29 20:58:33.737600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 could not be found. Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] Returning 404 to user: Instance 828d0c05-713e-47b5-a8d5-369061b2c2d7 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:33.742246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55ada6c5-c250-40db-a294-579e0cb8655a tempest-LiveAutoBlockMigrationV225Test-1817678524 tempest-LiveAutoBlockMigrationV225Test-1817678524-project] 10.222.0.36 "GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7" status: 404 len: 111 microversion: 2.25 time: 0.039310 Oct 29 20:58:33.743732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1296/2695] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:33 2022] GET /compute/v2.1/servers/828d0c05-713e-47b5-a8d5-369061b2c2d7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:33.756684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:33.757594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:33.768416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.769411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.770035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.770917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.772526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.773815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.815821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.825760 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-075535fa-c82c-4fed-bac3-6c2e671fb8b2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.349131 Oct 29 20:58:33.826699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1400/2696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:33 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:33.884433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.897991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.899401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:33.900609 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91d9de3e-d0b3-4ce5-8782-b8ef67adcc3c tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1360 microversion: 2.47 time: 0.155724 Oct 29 20:58:33.906948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1297/2697] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:33 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:33.931608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-131254125"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:33.935047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:33.942794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.943288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.943903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:33.944774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:33.946523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:33.947188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.139252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:34.140208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:34.148835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.150004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.150682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.151665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.152360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.153158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.224041 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2d81d4d-a93c-433a-919f-7492ea3d150a tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "POST /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b/action" status: 202 len: 52 microversion: 2.47 time: 0.296369 Oct 29 20:58:34.230844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1401/2698] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 20:58:33 2022] POST /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b/action => generated 52 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 29 20:58:34.238815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:34.239509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:34.245813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.246496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.247335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.248058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.248537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.248964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.285669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:34.396161 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f420185-360b-4162-935c-379ad43675ff tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 204 len: 0 microversion: 2.47 time: 0.162415 Oct 29 20:58:34.400010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:34.400171 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1402/2699] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 20:58:34 2022] DELETE /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 20:58:34.407414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:34.407797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:34.412026 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7310071e-a730-4f7c-9284-d5e7922da19e tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1675 microversion: 2.1 time: 0.275442 Oct 29 20:58:34.415215 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1298/2700] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:34 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:34.427825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.433110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.433719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.434536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.435057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.436098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.496740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:34.498120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:34.506912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.508074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.508747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.509742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.510423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.511076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.531709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:34.545680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:34.550233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:34.554858 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62708465-7ffa-4852-91ef-d5fe0e46f9e2 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1366 microversion: 2.47 time: 0.151193 Oct 29 20:58:34.555676 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1403/2701] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:34 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:34.719558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:34.721348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:34.731904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.732552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.733498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.735446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.736970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.737219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.764619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:34.776169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c03d9b5-baf5-4759-830c-86e9596b6189 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.283267 Oct 29 20:58:34.792427 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1299/2702] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:34 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:34.843726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:34.852544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:34.853579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-792c0447-8b5f-4882-a97c-cb9042cd2d69 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1268 microversion: 2.1 time: 0.137616 Oct 29 20:58:34.854970 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1404/2703] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:34 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1268 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:34.855696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:34.866057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.867014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.867740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:34.868881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:34.870164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:34.871032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.238752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-39abb8dc-f38c-4a8a-98e3-cc512e02eb25 req-0d0e23e8-c629-4386-82e3-96135e58d530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beff40db-1248-41ac-bfc3-33299f73eb0e", "name": "network-vif-deleted", "tag": "a71ba1a5-d419-4940-bdd1-bb22b699fa7a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:35.256783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39abb8dc-f38c-4a8a-98e3-cc512e02eb25 req-0d0e23e8-c629-4386-82e3-96135e58d530 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.257620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39abb8dc-f38c-4a8a-98e3-cc512e02eb25 req-0d0e23e8-c629-4386-82e3-96135e58d530 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.258257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39abb8dc-f38c-4a8a-98e3-cc512e02eb25 req-0d0e23e8-c629-4386-82e3-96135e58d530 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.273187 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-39abb8dc-f38c-4a8a-98e3-cc512e02eb25 req-0d0e23e8-c629-4386-82e3-96135e58d530 service nova] Creating event network-vif-deleted:a71ba1a5-d419-4940-bdd1-bb22b699fa7a for instance beff40db-1248-41ac-bfc3-33299f73eb0e on nch1-master-1 Oct 29 20:58:35.281382 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-39abb8dc-f38c-4a8a-98e3-cc512e02eb25 req-0d0e23e8-c629-4386-82e3-96135e58d530 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049613 Oct 29 20:58:35.282582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1405/2704] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:58:35.383852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:35.394828 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e62bcf62-1bb9-4a35-a8de-0634ee0a05e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.548972 Oct 29 20:58:35.413480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1300/2705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:34 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:35.443591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:35.444401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:35.452088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.453202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.455183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.456166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.456832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.457517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.584308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:35.585306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:35.592056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.592803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.594345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.595263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.596096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.596847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.716048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:35.733702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:35.735811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:35.736607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:35.738890 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ea8a289-5fd7-407b-a56b-dda2d0aadef1 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1366 microversion: 2.47 time: 0.160079 Oct 29 20:58:35.744155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-58cab0d8-f2dd-400a-a58a-05caaea42fac tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1675 microversion: 2.1 time: 0.307550 Oct 29 20:58:35.747666 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1406/2706] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:35 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1675 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:35.751243 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1301/2707] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:35 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 20:58:35.800688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:35.801912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:35.809567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.810408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.811016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.812435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.812963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.813408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.850405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:35.879339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:35.882356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:35.900437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.901295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.901962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:35.903097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:35.907625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:35.909857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:36.194021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:36.214224 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7c71127-33f8-40b8-ba88-298d0a11bc80 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1268 microversion: 2.1 time: 0.339405 Oct 29 20:58:36.216347 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1302/2708] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:35 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1268 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:36.434960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:36.435782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:36.446337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:36.447282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:36.448059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:36.448982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:36.449757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:36.451179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:36.456599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:36.577987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:36.592542 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65bf8390-d4d8-45e8-a45e-d4f67f710dcb tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.796563 Oct 29 20:58:36.596029 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1407/2709] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:35 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:36.768186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:36.769221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:36.785693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:36.786359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:36.787028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:36.787755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:36.788463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:36.789111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:36.972949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:36.985626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:36.994838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:36.996440 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8dd927fc-229a-4519-9ae5-cec7173bcc7d tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1366 microversion: 2.47 time: 0.233370 Oct 29 20:58:36.997239 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1408/2710] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:36 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:37.016772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:37.017804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:37.033163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.034078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.034777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.036503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.037239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.038427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.146000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:37.160637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7085be3b-651a-4671-9bb8-bbd8a774d53c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.736529 Oct 29 20:58:37.163273 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1303/2711] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:36 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:37.243769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:37.244430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:37.255419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.255922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.259132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.260070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.260562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.265898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.442561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:37.463040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f7ad95fe-505b-45c7-a8da-5bcb29a79564 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1266 microversion: 2.1 time: 0.224597 Oct 29 20:58:37.467004 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1304/2712] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:37 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:37.492109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d409109a-1931-4548-9b71-7aeb9f5d9a53 req-02d4092d-a081-4865-884a-3542a5574016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6baff994-d467-4c9f-bb00-fcc619a503f6", "name": "network-vif-plugged", "status": "completed", "tag": "b51c0574-0ee6-4ee6-8978-2587b5ddfcd3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:37.513487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d409109a-1931-4548-9b71-7aeb9f5d9a53 req-02d4092d-a081-4865-884a-3542a5574016 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.514807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d409109a-1931-4548-9b71-7aeb9f5d9a53 req-02d4092d-a081-4865-884a-3542a5574016 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.515255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d409109a-1931-4548-9b71-7aeb9f5d9a53 req-02d4092d-a081-4865-884a-3542a5574016 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.524257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:37.533934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-85b8d501-b47f-4872-be5c-d0445221f89f tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1675 microversion: 2.1 time: 0.535180 Oct 29 20:58:37.538278 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1409/2713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:36 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1675 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:37.557304 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d409109a-1931-4548-9b71-7aeb9f5d9a53 req-02d4092d-a081-4865-884a-3542a5574016 service nova] Creating event network-vif-plugged:b51c0574-0ee6-4ee6-8978-2587b5ddfcd3 for instance 6baff994-d467-4c9f-bb00-fcc619a503f6 on nch2-master-1 Oct 29 20:58:37.575520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d409109a-1931-4548-9b71-7aeb9f5d9a53 req-02d4092d-a081-4865-884a-3542a5574016 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102850 Oct 29 20:58:37.576955 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1305/2714] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:37.621283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:37.622481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:37.628872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:37.630978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.631850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.633582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.634607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:37.635301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:37.636146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:37.987933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:38.005845 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a08e756d-a9f4-4c0f-82f1-ced77de0fe9a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.388433 Oct 29 20:58:38.008570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1410/2715] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:37 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:38.028897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:38.029866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:38.037005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:38.046215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:38.047418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:38.048327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:38.048969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:38.049571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:38.192288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:38.195584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:38.212591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:38.218335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:38.228725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:38.230029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:38.231241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:38.232230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:38.232724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:38.233972 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4afbc0ae-dcd3-46a5-9944-64fc120efd5e tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1366 microversion: 2.47 time: 0.209598 Oct 29 20:58:38.235047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:38.237757 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1306/2716] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:38 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:38.244462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:38.491326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:38.491961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:38.503277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:38.510945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:38.516956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:38.517967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:38.518645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:38.519246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.143617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.153656 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b039c506-e810-4f04-8e2e-a431e55f1b90 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1266 microversion: 2.1 time: 0.666770 Oct 29 20:58:39.160045 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1307/2717] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:38 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1266 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:39.179005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:39.181098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:39.191351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.195457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.197034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.198575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.199267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.201576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.352516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.369896 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b36cbed-dd3f-4ae8-a8da-a6cac930cb3c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 1.183675 Oct 29 20:58:39.370499 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1411/2718] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:38 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:39.387465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-72c3b5b8-addb-4894-bbd4-f5e2f4cbd9c5 req-b7fd9687-bc1f-4a3b-b5d0-58f762542388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83192146-8efb-4e0d-86aa-a2d5f8df6720", "name": "network-vif-deleted", "tag": "457b1148-d178-4540-80ab-1ae635f03e54"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:39.408841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-72c3b5b8-addb-4894-bbd4-f5e2f4cbd9c5 req-b7fd9687-bc1f-4a3b-b5d0-58f762542388 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.409329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-72c3b5b8-addb-4894-bbd4-f5e2f4cbd9c5 req-b7fd9687-bc1f-4a3b-b5d0-58f762542388 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.409790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-72c3b5b8-addb-4894-bbd4-f5e2f4cbd9c5 req-b7fd9687-bc1f-4a3b-b5d0-58f762542388 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.431335 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-72c3b5b8-addb-4894-bbd4-f5e2f4cbd9c5 req-b7fd9687-bc1f-4a3b-b5d0-58f762542388 service nova] Creating event network-vif-deleted:457b1148-d178-4540-80ab-1ae635f03e54 for instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 on nch2-master-1 Oct 29 20:58:39.437419 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-72c3b5b8-addb-4894-bbd4-f5e2f4cbd9c5 req-b7fd9687-bc1f-4a3b-b5d0-58f762542388 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054165 Oct 29 20:58:39.439605 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1412/2719] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:39.445190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:39.447816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:39.454864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.455636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.456253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.457157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.457988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.458796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.570627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.585584 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6de85c4e-5331-4ccd-8baf-9c6484d02d79 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1654 microversion: 2.1 time: 0.423977 Oct 29 20:58:39.599419 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1308/2720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:39 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1654 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:39.607474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:39.608386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:39.618522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.619912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.620527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.622279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:39.622951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:39.623554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:39.770479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.770910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.777704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:39.785826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.787330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f84089f-ad2a-4988-9349-bffd9c5b8aa2 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.346307 Oct 29 20:58:39.787922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:39.788308 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1413/2721] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:39 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:39.789853 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-912578cc-443a-4085-8038-c60e04af7496 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1366 microversion: 2.47 time: 0.188869 Oct 29 20:58:39.790889 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1309/2722] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:39 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:40.186724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:40.188452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:40.194467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=20 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:40.196291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.197016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.197788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.198750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.199433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.200082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.395871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:40.397536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:40.405431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.406917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.407697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.408645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.409331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.410055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.439464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:40.451049 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-758f3198-5f22-477d-a305-1945d2dbcf4c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.266764 Oct 29 20:58:40.467469 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1414/2723] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:40 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:40.618894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:40.620047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:40.630858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.631770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.632442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.633540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.634524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.636254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.801118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:40.817860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3ec48ac-0fa0-4486-a290-582e044116ae tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.427262 Oct 29 20:58:40.819782 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1310/2724] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:40 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:40.826780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:40.827889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:40.835919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.836627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.837649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:40.838739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:40.839844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:40.840707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.097095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:41.108613 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f1063c8-986e-4c77-9320-ed1b22c59f7c tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1496 microversion: 2.1 time: 0.503213 Oct 29 20:58:41.128601 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1415/2725] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:40 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1496 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:41.134902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:41.135758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:41.143210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.143928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.144985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.146022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.146770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.147653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.152654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:41.163104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4abc835-f868-450f-a4ec-e50348b88f62 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.341671 Oct 29 20:58:41.164769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1311/2726] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:40 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:41.169600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e0d1536e-b4b1-46ab-94c2-3fdee98720a7 req-b9ff2b32-880b-4f75-b532-c4dd24a02cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91795f90-cab5-4bb5-8e01-7e59254c0442", "name": "network-vif-plugged", "status": "completed", "tag": "57d8b089-4ff5-4bd4-993c-b5dd66291e7e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:41.182149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e0d1536e-b4b1-46ab-94c2-3fdee98720a7 req-b9ff2b32-880b-4f75-b532-c4dd24a02cec service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.182887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e0d1536e-b4b1-46ab-94c2-3fdee98720a7 req-b9ff2b32-880b-4f75-b532-c4dd24a02cec service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.183475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e0d1536e-b4b1-46ab-94c2-3fdee98720a7 req-b9ff2b32-880b-4f75-b532-c4dd24a02cec service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.221775 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e0d1536e-b4b1-46ab-94c2-3fdee98720a7 req-b9ff2b32-880b-4f75-b532-c4dd24a02cec service nova] Creating event network-vif-plugged:57d8b089-4ff5-4bd4-993c-b5dd66291e7e for instance 91795f90-cab5-4bb5-8e01-7e59254c0442 on nch1-master-1 Oct 29 20:58:41.232865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e0d1536e-b4b1-46ab-94c2-3fdee98720a7 req-b9ff2b32-880b-4f75-b532-c4dd24a02cec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066236 Oct 29 20:58:41.234888 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1312/2727] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:41.261386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:41.275843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:41.280565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:41.283453 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68a6f6b7-25ee-4676-a78b-ce404ad6bff3 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1366 microversion: 2.47 time: 0.152665 Oct 29 20:58:41.298769 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1416/2728] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:41 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:41.496078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:41.496885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:41.514798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.518375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.520617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.523182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.524868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.526568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.595623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:41.842886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-54cd856c-e50a-4936-a157-f04874d467af req-f5c99ec0-4348-498f-8631-6d0ec30e0f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83192146-8efb-4e0d-86aa-a2d5f8df6720", "name": "network-vif-deleted", "tag": "eddf3aa4-960c-4cdc-8085-65f1fa6ca099"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:41.876588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-54cd856c-e50a-4936-a157-f04874d467af req-f5c99ec0-4348-498f-8631-6d0ec30e0f7c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.877327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-54cd856c-e50a-4936-a157-f04874d467af req-f5c99ec0-4348-498f-8631-6d0ec30e0f7c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.884921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-54cd856c-e50a-4936-a157-f04874d467af req-f5c99ec0-4348-498f-8631-6d0ec30e0f7c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.922252 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-54cd856c-e50a-4936-a157-f04874d467af req-f5c99ec0-4348-498f-8631-6d0ec30e0f7c service nova] Creating event network-vif-deleted:eddf3aa4-960c-4cdc-8085-65f1fa6ca099 for instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 on nch2-master-1 Oct 29 20:58:41.941182 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-54cd856c-e50a-4936-a157-f04874d467af req-f5c99ec0-4348-498f-8631-6d0ec30e0f7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105090 Oct 29 20:58:41.942388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1417/2729] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:41.948120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:41.953517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:41.970470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.970802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.971261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.975800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:41.979611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:41.980779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:41.990924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.015366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-66efad94-76e0-4847-a159-986b70f7df9e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.535621 Oct 29 20:58:42.018677 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1313/2730] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:41 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:42.146714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:42.147366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:42.158511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.162017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.162484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.163227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.163692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.164129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.285945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.286730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.287528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.288550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lazy-loading 'fault' on Instance uuid 83192146-8efb-4e0d-86aa-a2d5f8df6720 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:42.412120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a550d419d943628a9f73797cb7f36b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e380500f114891bf674438936e8e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.425938 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1511275e-848f-4292-8e9e-8d101dd93231 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 200 len: 1303 microversion: 2.1 time: 0.289727 Oct 29 20:58:42.426551 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1314/2731] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:42 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:42.492573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:42.501947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:42.532998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.534616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.535355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.536024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.537031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.537752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.538592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.541373 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08320509-b38d-4407-808b-4939ddd5bffc tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.597641 Oct 29 20:58:42.545269 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1418/2732] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:41 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:42.560797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:42.561428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:42.578551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.579133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.590510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.591312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.591802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.592248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.729524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:42.757323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:42.757857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:42.758796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lazy-loading 'fault' on Instance uuid 30505013-b70d-4d8b-83d3-2abf95c5da7b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:58:42.847677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.848367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.857615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-077faa4f-055e-4f5d-ba62-8c00d9b6ee53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.417176 Oct 29 20:58:42.858851 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1315/2733] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:42 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:42.883832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.886094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b360881ca12a49998b0a518b08a3b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997a9eff6be44acb9fa8993461f7e51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:42.887899 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea00073e-0bff-47e2-ba13-7a0bf811dc01 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 200 len: 1371 microversion: 2.47 time: 0.341731 Oct 29 20:58:42.888686 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1419/2734] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:42 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 20:58:43.043302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:43.045877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:43.072462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.074777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.077780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.079032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.081166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.084242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.257004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dde29f-7cab-40b9-bef5-85d996cbdad6", "name": "network-vif-plugged", "status": "completed", "tag": "769ff437-bb99-4d76-b04e-9e3b05416f92"}, {"server_uuid": "5e0bb8db-bb65-4c99-9016-bfd75ae44944", "name": "network-vif-plugged", "status": "completed", "tag": "c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:43.294071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.298064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.298753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.318883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:43.326474 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] Creating event network-vif-plugged:769ff437-bb99-4d76-b04e-9e3b05416f92 for instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 on nch2-master-1 Oct 29 20:58:43.327004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] Creating event network-vif-plugged:c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 for instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 on nch2-master-1 Oct 29 20:58:43.328730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-24f2f6a4-12cf-4d10-bcbd-0f01015e5b61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.291489 Oct 29 20:58:43.329401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1316/2735] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:43 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:43.334953 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a6521c48-b43c-4a44-873d-a475a47e8558 req-05cdda87-1ef8-4b99-876c-9f15c2b06365 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082533 Oct 29 20:58:43.336437 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1420/2736] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:58:43.450854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:43.452787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:43.466683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.467464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.468038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.469677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.470256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.470799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.487753 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] HTTP exception thrown: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Request method failure captured: Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 HTTP/1.1 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOBr3TY0X36GDOoijZuRr9C86MafTjuEa2pQMT02YGqjCseQh8PE32hd1zMWUb4IlEC3aJmwaR2QFh05PZc6MNze9I_0vPcIbAkeQJeg1Qjvr0JlK7Hs1GkROG7KyQYa_Qj0R1QN61VrdRQiPnv8gHaqfVhR-Asu7xtogKG9WB43jU Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e380500f114891bf674438936e8e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e380500f114891bf674438936e8e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 00a550d419d943628a9f73797cb7f36b Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '83192146-8efb-4e0d-86aa-a2d5f8df6720'} Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:43.489693 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Returning 404 to user: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-708a1b8b-593c-4824-8960-f5a6dc00d93d tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 404 len: 111 microversion: 2.1 time: 0.044600 Oct 29 20:58:43.493556 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1317/2737] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:43 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:43.569397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:43.570146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:43.576895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.577737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.578754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.579480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.579954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.580374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.885623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:43.886262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:43.899862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.900509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.901088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:43.902416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:43.902889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:43.903498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:44.053895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:44.066896 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa6630e6-bc02-40b3-88eb-2b725fbdd468 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.501651 Oct 29 20:58:44.068756 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1421/2738] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:43 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:44.076201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:44.077626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] [instance: 30505013-b70d-4d8b-83d3-2abf95c5da7b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:44.086268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:44.091153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:44.092175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:44.092940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:44.093412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:44.093906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:44.111808 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] HTTP exception thrown: Instance 30505013-b70d-4d8b-83d3-2abf95c5da7b could not be found. Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Request method failure captured: Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b HTTP/1.1 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZPwxn2e2Y1hNuWXsx_bfgN8czZDOjs1SyjRC3gVPXrwnZrOL9h1-yfVedTev8To3p6j6S8VptcdGSygXJs7fupp6M-iDVweWfjRyq0jgFFovASZ2fRn8EAcIECpzhcjxsfxKWeHMoOCpcy_SRM1Ia5OGMYSHHOVZxj_SQgrATi_y-U Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 997a9eff6be44acb9fa8993461f7e51c Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAaction247Test-47928247 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/997a9eff6be44acb9fa8993461f7e51c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_997a9eff6be44acb9fa8993461f7e51c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/997a9eff6be44acb9fa8993461f7e51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/997a9eff6be44acb9fa8993461f7e51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAaction247Test-47928247 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 997a9eff6be44acb9fa8993461f7e51c Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAaction247Test-47928247 Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAaction247Test-47928247-project Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b360881ca12a49998b0a518b08a3b3bf Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAaction247Test-47928247-project Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 30505013-b70d-4d8b-83d3-2abf95c5da7b could not be found. Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '30505013-b70d-4d8b-83d3-2abf95c5da7b'} Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30505013-b70d-4d8b-83d3-2abf95c5da7b could not be found. Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30505013-b70d-4d8b-83d3-2abf95c5da7b could not be found. Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:44.113541 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30505013-b70d-4d8b-83d3-2abf95c5da7b could not be found. Oct 29 20:58:44.117597 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:44.120766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] Returning 404 to user: Instance 30505013-b70d-4d8b-83d3-2abf95c5da7b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:44.128266 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83a751e0-a588-43c9-b297-212937987fc6 tempest-ServersAaction247Test-47928247 tempest-ServersAaction247Test-47928247-project] 10.222.0.36 "GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b" status: 404 len: 111 microversion: 2.47 time: 0.057894 Oct 29 20:58:44.129985 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1422/2739] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 20:58:44 2022] GET /compute/v2.1/servers/30505013-b70d-4d8b-83d3-2abf95c5da7b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:44.140909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4231abca-4357-4a6e-bc58-74a6cc9de4f2 req-b8e9801f-2a41-441d-906b-3886a6106459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaec58b3-bc47-443c-a3ae-fdcd0c7feffb", "tag": "a2a75856-02f8-4104-b0ec-7799ebfadc5e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:44.152080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4231abca-4357-4a6e-bc58-74a6cc9de4f2 req-b8e9801f-2a41-441d-906b-3886a6106459 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:44.153227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4231abca-4357-4a6e-bc58-74a6cc9de4f2 req-b8e9801f-2a41-441d-906b-3886a6106459 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:44.153944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4231abca-4357-4a6e-bc58-74a6cc9de4f2 req-b8e9801f-2a41-441d-906b-3886a6106459 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:44.168870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4231abca-4357-4a6e-bc58-74a6cc9de4f2 req-b8e9801f-2a41-441d-906b-3886a6106459 service nova] Creating event network-changed:a2a75856-02f8-4104-b0ec-7799ebfadc5e for instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb on nch1-master-1 Oct 29 20:58:44.175752 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4231abca-4357-4a6e-bc58-74a6cc9de4f2 req-b8e9801f-2a41-441d-906b-3886a6106459 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044320 Oct 29 20:58:44.177106 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1423/2740] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:44.353423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:44.354657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:44.367525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:44.368469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:44.369031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:44.369897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:44.370425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:44.370947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:44.618169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:44.638834 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d90a42a6-3e36-4534-89c0-caf52878c62b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1323 microversion: 2.1 time: 0.760427 Oct 29 20:58:44.639442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1318/2741] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:43 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:44.960278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:44.982940 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-18bd9507-b362-41c3-80a6-24ccb6ebc1b4 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.633712 Oct 29 20:58:44.985604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1424/2742] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:44 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:45.091067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:45.091937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:45.101200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:45.101897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:45.102664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:45.103668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:45.104365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:45.104959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:45.519105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:45.528097 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2ae20c3-af72-4854-92df-e2007124ce3f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1315 microversion: 2.1 time: 0.441198 Oct 29 20:58:45.529700 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1319/2743] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:45 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:45.666694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:45.667953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:45.680522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:45.681426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:45.682336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:45.684581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:45.699743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:45.700516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.011143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:46.012915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:46.028002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.029447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.031583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.035655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.036174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.037246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.225427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:46.239995 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fcba40c1-c31e-4db8-932b-3ff5fce34f8e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 200 len: 1516 microversion: 2.1 time: 0.576935 Oct 29 20:58:46.240598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1425/2744] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:45 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 1516 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:46.266497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:46.267386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:46.274569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.275351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.276017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.276927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.277615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.278656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.578921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:46.586811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:46.597448 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-efd21215-6f0f-466f-ac62-27b8d0263ba9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442" status: 200 len: 1515 microversion: 2.1 time: 0.334999 Oct 29 20:58:46.600029 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1426/2745] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:46 2022] GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:46.625530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:46.631164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:46.634251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:46.640502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.641267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.644705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.647100 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c98dcb15-c102-48d3-baff-18e425c52249 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.643698 Oct 29 20:58:46.647778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.648449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.649172 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1320/2746] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:46 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:46.668429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.678789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:46.680601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:46.700109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.701087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.705373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:46.706428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:46.707145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:46.707975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:47.143908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:47.160304 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-684b4261-3b05-425d-a595-34a50993ba5a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 200 len: 1515 microversion: 2.1 time: 0.492064 Oct 29 20:58:47.162413 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1321/2747] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:46 2022] GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 1515 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:47.187566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:47.188421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:47.216760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:47.217514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:47.221103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:47.224672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:47.225426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:47.226106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:47.294197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:47.338948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:47.352067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bdb8cf0a-4e07-425b-b1b1-fbffd42cecc4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1503 microversion: 2.1 time: 0.748780 Oct 29 20:58:47.353942 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1427/2748] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:46 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1503 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:47.380277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1908082779"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:47.381376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:47.401602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:47.403528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:47.404676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:47.407491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:47.408312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:47.409364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:47.452496 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ac4e3097-8d59-4b2e-ab62-60212fa66128 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 204 len: 0 microversion: 2.1 time: 0.269043 Oct 29 20:58:47.465443 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1322/2749] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:47 2022] DELETE /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:47.474805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:47.475806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:47.492986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:47.497229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:47.497795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:47.498477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:47.498943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:47.499416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:48.302288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:48.315228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7600f7e6-56d8-4128-bd72-96ace01c39a9 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 200 len: 1521 microversion: 2.1 time: 0.844666 Oct 29 20:58:48.317231 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1323/2750] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:47 2022] GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:48.335178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:48.337751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:48.356261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:48.357034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:48.358965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:48.360336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:48.360803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:48.361236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:48.367712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Adding security group 0b365395-5b57-4982-97d1-099988590eee to port c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 Oct 29 20:58:48.996709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:49.013764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43cf65f2-eb1a-4f2b-92b5-fa47cc85d638 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.695152 Oct 29 20:58:49.014937 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1324/2751] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:48 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:49.248150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-773121b2-6982-4412-92a5-60bccf042e31 req-9d9542fa-3697-4ce2-8c55-f7c80366a33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaec58b3-bc47-443c-a3ae-fdcd0c7feffb", "name": "network-vif-plugged", "status": "completed", "tag": "a2a75856-02f8-4104-b0ec-7799ebfadc5e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:49.276352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-773121b2-6982-4412-92a5-60bccf042e31 req-9d9542fa-3697-4ce2-8c55-f7c80366a33a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:49.282166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-773121b2-6982-4412-92a5-60bccf042e31 req-9d9542fa-3697-4ce2-8c55-f7c80366a33a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:49.282921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-773121b2-6982-4412-92a5-60bccf042e31 req-9d9542fa-3697-4ce2-8c55-f7c80366a33a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:49.324053 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-773121b2-6982-4412-92a5-60bccf042e31 req-9d9542fa-3697-4ce2-8c55-f7c80366a33a service nova] Creating event network-vif-plugged:a2a75856-02f8-4104-b0ec-7799ebfadc5e for instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb on nch1-master-1 Oct 29 20:58:49.355193 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-773121b2-6982-4412-92a5-60bccf042e31 req-9d9542fa-3697-4ce2-8c55-f7c80366a33a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109684 Oct 29 20:58:49.356460 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1325/2752] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:58:49.364792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:49.365985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:49.373439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:49.374254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:49.375442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:49.376410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:49.377034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:49.378257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:49.640682 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bf061a4-b483-41e6-abef-65bbef301776 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944/action" status: 202 len: 0 microversion: 2.1 time: 2.269042 Oct 29 20:58:49.642331 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1428/2753] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:58:47 2022] POST /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944/action => generated 0 bytes in 2271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:58:49.650590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e5ededd-361a-4682-991d-a3dfed4a3ae8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1764503a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:49.752139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:49.763472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-33ef6556-b2a7-4c5a-b9c5-239ddde1cb72 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 200 len: 1521 microversion: 2.1 time: 0.405632 Oct 29 20:58:49.765275 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1326/2754] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:49 2022] GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:49.779524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9a387c1b-b511-48de-9739-c61b26718cb8 req-0a091daa-8eb1-4961-8e57-2e3c88706bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0bb8db-bb65-4c99-9016-bfd75ae44944", "tag": "c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:49.791555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a387c1b-b511-48de-9739-c61b26718cb8 req-0a091daa-8eb1-4961-8e57-2e3c88706bdf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:49.792364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a387c1b-b511-48de-9739-c61b26718cb8 req-0a091daa-8eb1-4961-8e57-2e3c88706bdf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:49.792964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a387c1b-b511-48de-9739-c61b26718cb8 req-0a091daa-8eb1-4961-8e57-2e3c88706bdf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:49.809706 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9a387c1b-b511-48de-9739-c61b26718cb8 req-0a091daa-8eb1-4961-8e57-2e3c88706bdf service nova] Creating event network-changed:c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 for instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 on nch2-master-1 Oct 29 20:58:49.816789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9a387c1b-b511-48de-9739-c61b26718cb8 req-0a091daa-8eb1-4961-8e57-2e3c88706bdf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049844 Oct 29 20:58:49.817705 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1327/2755] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:50.039793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:50.040531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:50.055409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.055921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.056377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.059841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.060665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.061440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.140057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-7e5ededd-361a-4682-991d-a3dfed4a3ae8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0b365395-5b57-4982-97d1-099988590eee in use.", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:58:50.141565 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7e5ededd-361a-4682-991d-a3dfed4a3ae8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.141565 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e5ededd-361a-4682-991d-a3dfed4a3ae8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee HTTP/1.1 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: exception: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '0b365395-5b57-4982-97d1-099988590eee'} Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:58:50.143982 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] Oct 29 20:58:50.148432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.152324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e5ededd-361a-4682-991d-a3dfed4a3ae8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 400 to user: Security Group 0b365395-5b57-4982-97d1-099988590eee in use. Oct 29 20:58:50.152324 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-df58ba63-0fa4-4f8b-a27d-a3f5bf0ab209'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:50.153434 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7e5ededd-361a-4682-991d-a3dfed4a3ae8 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee" status: 400 len: 185 microversion: 2.1 time: 0.507316 Oct 29 20:58:50.154193 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1429/2756] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:58:49 2022] DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee => generated 185 bytes in 509 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:50.164556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:50.167336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:50.174547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.175254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.175901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.176976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.177635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.178233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.298214 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25222fe8-5723-4349-8bbb-3c418fb4e785 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944/action" status: 202 len: 0 microversion: 2.1 time: 0.138695 Oct 29 20:58:50.299421 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1430/2757] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:58:50 2022] POST /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:58:50.315207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:50.319810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:50.337940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.353759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.355801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.356867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.357855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.358523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.801404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:50.813211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62cf8263-499b-4e56-ba33-d78847755e61 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1308 microversion: 2.1 time: 0.777035 Oct 29 20:58:50.814026 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1328/2758] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:50 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:50.834547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:50.835275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:50.844072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.844735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.845367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.846236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.846814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.847361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.873778 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] HTTP exception thrown: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Request method failure captured: Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 HTTP/1.1 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOBr3TY0X36GDOoijZuRr9C86MafTjuEa2pQMT02YGqjCseQh8PE32hd1zMWUb4IlEC3aJmwaR2QFh05PZc6MNze9I_0vPcIbAkeQJeg1Qjvr0JlK7Hs1GkROG7KyQYa_Qj0R1QN61VrdRQiPnv8gHaqfVhR-Asu7xtogKG9WB43jU Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e380500f114891bf674438936e8e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e380500f114891bf674438936e8e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 00a550d419d943628a9f73797cb7f36b Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '83192146-8efb-4e0d-86aa-a2d5f8df6720'} Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:50.876979 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:50.881841 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:50.885856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Returning 404 to user: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:50.887637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7466ffe-3979-4600-bda0-a18a28e561a6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "DELETE /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 404 len: 111 microversion: 2.1 time: 0.072212 Oct 29 20:58:50.888927 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1329/2759] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:50 2022] DELETE /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:50.895726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:50.897371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:50.906884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.907817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.908514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:50.910023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:50.910842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:50.911519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.075526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:51.083687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:51.089724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:51.096585 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0775ab65-b558-4240-bc46-d278dde1c603 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1574 microversion: 2.1 time: 0.792536 Oct 29 20:58:51.099779 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa890104-e675-4b76-bd03-e2931714ac9b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 200 len: 1479 microversion: 2.1 time: 0.209310 Oct 29 20:58:51.114344 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1431/2760] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:50 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1574 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:51.123600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:51.124312 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1330/2761] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:50 2022] GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 1479 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:51.125215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 83192146-8efb-4e0d-86aa-a2d5f8df6720] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:51.133364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.134538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.135663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.136881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.138095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.138959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.149244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8884d660-8fcc-4665-b4ae-d0440ff4897d req-ab187341-036c-40e7-a9ce-8c4c57e8b725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6baff994-d467-4c9f-bb00-fcc619a503f6", "name": "network-vif-deleted", "tag": "b51c0574-0ee6-4ee6-8978-2587b5ddfcd3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:51.188034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8884d660-8fcc-4665-b4ae-d0440ff4897d req-ab187341-036c-40e7-a9ce-8c4c57e8b725 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.190478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8884d660-8fcc-4665-b4ae-d0440ff4897d req-ab187341-036c-40e7-a9ce-8c4c57e8b725 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.191442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8884d660-8fcc-4665-b4ae-d0440ff4897d req-ab187341-036c-40e7-a9ce-8c4c57e8b725 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.203550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] HTTP exception thrown: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Request method failure captured: Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 HTTP/1.1 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOBr3TY0X36GDOoijZuRr9C86MafTjuEa2pQMT02YGqjCseQh8PE32hd1zMWUb4IlEC3aJmwaR2QFh05PZc6MNze9I_0vPcIbAkeQJeg1Qjvr0JlK7Hs1GkROG7KyQYa_Qj0R1QN61VrdRQiPnv8gHaqfVhR-Asu7xtogKG9WB43jU Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e380500f114891bf674438936e8e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e380500f114891bf674438936e8e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 00a550d419d943628a9f73797cb7f36b Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '83192146-8efb-4e0d-86aa-a2d5f8df6720'} Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:51.210485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. Oct 29 20:58:51.214460 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.219357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Returning 404 to user: Instance 83192146-8efb-4e0d-86aa-a2d5f8df6720 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:51.226517 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-403b3eb3-c462-45c5-8f17-b23b34e614e2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720" status: 404 len: 111 microversion: 2.1 time: 0.108605 Oct 29 20:58:51.228412 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1432/2762] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:51 2022] GET /compute/v2.1/servers/83192146-8efb-4e0d-86aa-a2d5f8df6720 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:51.248270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8884d660-8fcc-4665-b4ae-d0440ff4897d req-ab187341-036c-40e7-a9ce-8c4c57e8b725 service nova] Creating event network-vif-deleted:b51c0574-0ee6-4ee6-8978-2587b5ddfcd3 for instance 6baff994-d467-4c9f-bb00-fcc619a503f6 on nch2-master-1 Oct 29 20:58:51.250414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:51.251072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:51.261388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8884d660-8fcc-4665-b4ae-d0440ff4897d req-ab187341-036c-40e7-a9ce-8c4c57e8b725 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117993 Oct 29 20:58:51.262775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1331/2763] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:58:51.265549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.266406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.266984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.268104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.269044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.269763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.289158 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] HTTP exception thrown: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Request method failure captured: Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d HTTP/1.1 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOBr3TY0X36GDOoijZuRr9C86MafTjuEa2pQMT02YGqjCseQh8PE32hd1zMWUb4IlEC3aJmwaR2QFh05PZc6MNze9I_0vPcIbAkeQJeg1Qjvr0JlK7Hs1GkROG7KyQYa_Qj0R1QN61VrdRQiPnv8gHaqfVhR-Asu7xtogKG9WB43jU Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e380500f114891bf674438936e8e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e380500f114891bf674438936e8e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 00a550d419d943628a9f73797cb7f36b Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '4bbe430e-7190-4a59-a7c3-a1e17af42d0d'} Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:51.291000 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.294725 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.299861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Returning 404 to user: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:51.301096 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-255140d0-4fb7-44e6-98be-543671118ea2 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 404 len: 111 microversion: 2.1 time: 0.067762 Oct 29 20:58:51.302292 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1433/2764] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:51 2022] DELETE /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:51.312500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:51.313715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] [instance: 4bbe430e-7190-4a59-a7c3-a1e17af42d0d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:51.329909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.331452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.333712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.335125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.336258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.337051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.372396 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] HTTP exception thrown: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Request method failure captured: Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d HTTP/1.1 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOBr3TY0X36GDOoijZuRr9C86MafTjuEa2pQMT02YGqjCseQh8PE32hd1zMWUb4IlEC3aJmwaR2QFh05PZc6MNze9I_0vPcIbAkeQJeg1Qjvr0JlK7Hs1GkROG7KyQYa_Qj0R1QN61VrdRQiPnv8gHaqfVhR-Asu7xtogKG9WB43jU Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_86e380500f114891bf674438936e8e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/86e380500f114891bf674438936e8e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/86e380500f114891bf674438936e8e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 86e380500f114891bf674438936e8e97 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestMultiNic-1574421259 Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 00a550d419d943628a9f73797cb7f36b Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestMultiNic-1574421259-project Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4bbe430e-7190-4a59-a7c3-a1e17af42d0d'} Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:51.379815 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. Oct 29 20:58:51.386233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:51.390844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] Returning 404 to user: Instance 4bbe430e-7190-4a59-a7c3-a1e17af42d0d could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:51.392623 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7eca3e12-7736-409d-857d-e45c6e3501c6 tempest-ServersTestMultiNic-1574421259 tempest-ServersTestMultiNic-1574421259-project] 10.222.0.36 "GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d" status: 404 len: 111 microversion: 2.1 time: 0.086215 Oct 29 20:58:51.395448 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1332/2765] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:51 2022] GET /compute/v2.1/servers/4bbe430e-7190-4a59-a7c3-a1e17af42d0d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:51.839815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:51.840443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:51.850935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.851420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.851855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:51.852561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:51.853011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:51.853431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.127537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:52.128164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:52.135424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.136189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.136869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.137775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.138473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.139098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.547866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:52.569391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d891f2da-a038-4b81-b2ae-3ba0d8ddacee tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1488 microversion: 2.1 time: 0.734597 Oct 29 20:58:52.570973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1434/2766] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:51 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1488 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:52.577501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:52.578936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:52.585731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.586391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.587277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.588147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.588817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.589409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.608385 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] HTTP exception thrown: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 HTTP/1.1 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6baff994-d467-4c9f-bb00-fcc619a503f6'} Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.610078 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:52.613934 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.615034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 404 to user: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:52.616036 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3950d110-0cff-422f-8787-026e6d79185b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 404 len: 111 microversion: 2.1 time: 0.043974 Oct 29 20:58:52.620637 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1435/2767] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:52 2022] GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:52.626647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1369860089"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:52.629286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:52.635996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.636772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.637207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.637954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.638572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.638999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.674906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:52.691060 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c822d94-9cc0-4beb-bd2d-04dd1e39bd9f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1574 microversion: 2.1 time: 0.567478 Oct 29 20:58:52.691646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1333/2768] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:52 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1574 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:52.743869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:52.754405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:52.755577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:52.770207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.771021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.772183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.773111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.778306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.778942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.905701 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c69ebace-28f7-4dee-81d1-8f3df689d326 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.195901 Oct 29 20:58:52.914444 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1334/2769] 10.222.0.36 () {58 vars in 1230 bytes} [Sat Oct 29 20:58:52 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:58:52.923128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d51058e2-066b-4566-bdfe-9dd324b3694d tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d51058e2-066b-4566-bdfe-9dd324b3694d tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 20:58:52.933556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:52.939181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d51058e2-066b-4566-bdfe-9dd324b3694d tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:52.941035 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d51058e2-066b-4566-bdfe-9dd324b3694d tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023964 Oct 29 20:58:52.946169 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1335/2770] 10.222.0.36 () {58 vars in 1182 bytes} [Sat Oct 29 20:58:52 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:52.952959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:52.960444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:52.961800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:52.969438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.970775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.971623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:52.972709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:52.973623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:52.974342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.001356 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a95c01e-29a6-4acb-8380-192edcac17cf tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "POST /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb/action" status: 202 len: 0 microversion: 2.1 time: 0.377769 Oct 29 20:58:53.005512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1436/2771] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:58:52 2022] POST /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 20:58:53.021752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf6448a6-9cfc-4404-b8cf-65fdfc960948 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17644eee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.025586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:58:53.072991 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e3a1185-37e6-4564-90bb-1d54ab6d37d4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.125491 Oct 29 20:58:53.082104 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1336/2772] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:58:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:53.087783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.094047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:53.094816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.servers [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Removing options 'limit' from query {{(pid=138884) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 20:58:53.095704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:53.102302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.103155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.103860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.105602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.106384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.107069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.108019 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf6448a6-9cfc-4404-b8cf-65fdfc960948 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94" status: 200 len: 1412 microversion: 2.1 time: 0.095365 Oct 29 20:58:53.119828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1437/2773] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:53.140041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23f075ba-7596-4d44-8303-2619b369ddd0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17644d3a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.142315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:58:53.189121 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d38b6419-62a3-4d61-8810-35c74aa994f6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.105664 Oct 29 20:58:53.197974 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1337/2774] 10.222.0.36 () {58 vars in 1144 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:58:53.215214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b6f288b-77ab-48da-8077-d800832044d6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b6f288b-77ab-48da-8077-d800832044d6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi '-1' Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 20:58:53.220522 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b6f288b-77ab-48da-8077-d800832044d6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b6f288b-77ab-48da-8077-d800832044d6 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017518 Oct 29 20:58:53.228944 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1338/2775] 10.222.0.36 () {58 vars in 1142 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:53.237555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a86e637f-9c50-4585-bb17-5afb3f13578b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a86e637f-9c50-4585-bb17-5afb3f13578b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: action_args: {} Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'testing' Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 20:58:53.243159 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 20:58:53.248521 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.250673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a86e637f-9c50-4585-bb17-5afb3f13578b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:53.250790 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23f075ba-7596-4d44-8303-2619b369ddd0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94" status: 200 len: 1412 microversion: 2.1 time: 0.125115 Oct 29 20:58:53.251395 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1438/2776] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:53.254099 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a86e637f-9c50-4585-bb17-5afb3f13578b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.022815 Oct 29 20:58:53.259011 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1339/2777] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:58:53.270904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ab674c0-932f-47c2-acd6-fa5205ffc26f tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.282931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ab674c0-932f-47c2-acd6-fa5205ffc26f tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:53.284215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ac6a993a-430e-44c2-81d8-1f7d2496fbd1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa173262dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.287363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ab674c0-932f-47c2-acd6-fa5205ffc26f tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:53.301713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.servers [None req-5ab674c0-932f-47c2-acd6-fa5205ffc26f tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Flavor 'non_existing_flavor' could not be found {{(pid=138885) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 29 20:58:53.303030 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ab674c0-932f-47c2-acd6-fa5205ffc26f tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.041681 Oct 29 20:58:53.303724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1439/2778] 10.222.0.36 () {58 vars in 1178 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 20:58:53.319334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.324542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:53.325342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:53.333623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.334437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.335099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.336077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.336791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.337425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.463453 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e3d2bd8-1b4e-415c-b52c-492ad16b6b53 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.147974 Oct 29 20:58:53.464759 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1440/2779] 10.222.0.36 () {58 vars in 1174 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:58:53.479505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.495047 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ac6a993a-430e-44c2-81d8-1f7d2496fbd1 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94" status: 204 len: 0 microversion: 2.1 time: 0.229770 Oct 29 20:58:53.496118 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1340/2780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:53 2022] DELETE /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:53.496748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:53.497856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:53.505607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddb67ba0-a06d-4699-8f5e-282e2c6cc2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1718daee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.519405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.520196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.520830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.521882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.522527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.523911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.535789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-ddb67ba0-a06d-4699-8f5e-282e2c6cc2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Image not found. Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddb67ba0-a06d-4699-8f5e-282e2c6cc2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 HTTP/1.1 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '48f7b91f-282e-41cb-aa5d-45e9d2360e94'} Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48f7b91f-282e-41cb-aa5d-45e9d2360e94 Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 20:58:53.538092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48f7b91f-282e-41cb-aa5d-45e9d2360e94 could not be found. Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddb67ba0-a06d-4699-8f5e-282e2c6cc2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ddb67ba0-a06d-4699-8f5e-282e2c6cc2dd tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94" status: 404 len: 62 microversion: 2.1 time: 0.039631 Oct 29 20:58:53.548010 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1341/2781] 10.222.0.36 () {58 vars in 1233 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:58:53.555236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.555236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:53.571219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.571728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.575674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.576514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.577002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.577449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.796449 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8871a92e-9027-4825-b9dc-ac9d9ca78ba8 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.322567 Oct 29 20:58:53.797327 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1441/2782] 10.222.0.36 () {58 vars in 1184 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:58:53.818384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.820255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:53.827537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:53.832838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.833588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.834258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.835394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.836020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.836606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.845734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-86c62994-cbb0-44e8-a825-0238f3c3077c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1500 microversion: 2.1 time: 0.298345 Oct 29 20:58:53.847850 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1342/2783] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1500 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:53.857653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:53.881146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:53.882996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:53.898847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.899870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.900321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.901523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:53.905185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:53.909643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:53.970273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:58:54.085915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:54.107911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.110631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.110770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:54.112651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.123680 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee2bc3d0-e3b6-404f-acb2-239a1dc5571c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1574 microversion: 2.1 time: 0.312548 Oct 29 20:58:54.123905 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1442/2784] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1574 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:54.459317 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e7984e25-4fb7-4c82-b382-a92260c957de tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.610010 Oct 29 20:58:54.460125 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1343/2785] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 20:58:53 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:54.488344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ca2c433-57a8-4b77-bd41-a99a82b86bcd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:54.493654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ca2c433-57a8-4b77-bd41-a99a82b86bcd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:54.495004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ca2c433-57a8-4b77-bd41-a99a82b86bcd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012558 Oct 29 20:58:54.495850 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1443/2786] 10.222.0.36 () {58 vars in 1178 bytes} [Sat Oct 29 20:58:54 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:58:54.508539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:54.514946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:54.516175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Searching by: {'deleted': False, 'project_id': '144a1cc162db403fada4229ac4003494'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:58:54.524676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:54.530802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.532548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.533174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.534262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.535805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.536909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.585487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:58:54.639215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20a1059d-8499-4aec-83a6-19bd8544778a tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.134546 Oct 29 20:58:54.641397 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1344/2787] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:58:54 2022] GET /compute/v2.1/servers => generated 683 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:58:54.654585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:54.658520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:54.670415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.681665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.683210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.687526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.688025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.688473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.706981 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] HTTP exception thrown: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 HTTP/1.1 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6baff994-d467-4c9f-bb00-fcc619a503f6'} Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:54.708969 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:58:54.713543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 404 to user: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:54.714428 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d43e1680-7393-4f4d-a193-bdfe43d083ce tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 404 len: 111 microversion: 2.1 time: 0.063752 Oct 29 20:58:54.715080 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1444/2788] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:54 2022] DELETE /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:54.723797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:54.724430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:54.735949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.738929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.739784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.740643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.741112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.745866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.786566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:54.870729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:54.871645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:54.885315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.891193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.891710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.893863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.896786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.897440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.948409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ac0c3fa9-537a-4811-964b-5aef1521da5c tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "DELETE /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442" status: 204 len: 0 microversion: 2.1 time: 0.228432 Oct 29 20:58:54.954562 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1345/2789] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:54 2022] DELETE /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:54.967077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:54.967708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:54.982285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.982795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.985090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:54.985915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:54.986564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:54.989059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.060647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:58:55.219508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:55.240095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-22739524-04d1-42da-85d8-d4fdeeefbc41 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1500 microversion: 2.1 time: 0.373436 Oct 29 20:58:55.240855 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1445/2790] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:54 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1500 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:55.258732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:55.259503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:55.267409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b454423-579e-463b-8de6-c7a4b978b86e tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 204 len: 0 microversion: 2.1 time: 0.310541 Oct 29 20:58:55.270501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1346/2791] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:58:54 2022] DELETE /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:58:55.277749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:55.278652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:55.279273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.280202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:55.282126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:55.282742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.283158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:55.283994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 6baff994-d467-4c9f-bb00-fcc619a503f6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:55.304058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:55.304945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:55.306192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.309113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:55.309970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:55.315184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.349860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] HTTP exception thrown: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 HTTP/1.1 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '6baff994-d467-4c9f-bb00-fcc619a503f6'} Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:55.352709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 404 to user: Instance 6baff994-d467-4c9f-bb00-fcc619a503f6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-416e6b62-c190-44c4-8734-0b244046b2e0 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6" status: 404 len: 111 microversion: 2.1 time: 0.080032 Oct 29 20:58:55.356479 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1347/2792] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:55 2022] GET /compute/v2.1/servers/6baff994-d467-4c9f-bb00-fcc619a503f6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:58:55.376457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:55.379310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:55.390024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:55.397248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:55.397874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.398755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:55.399348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:55.399889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:55.701516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:55.714041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fac15b0a-597b-4ce4-99b6-c746007a6ae3 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442" status: 200 len: 1521 microversion: 2.1 time: 0.351175 Oct 29 20:58:55.715579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1348/2793] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:55 2022] GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:55.850644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:55.862101 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-71a9494b-2d45-4f9b-94ef-d545cce52a2b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1574 microversion: 2.1 time: 0.619338 Oct 29 20:58:55.877752 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1446/2794] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:55 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1574 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:56.269124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:56.269965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:56.288331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:56.290341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:56.296375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:56.297889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:56.300009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:56.304432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:56.620138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:56.631588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2694d134-b3b8-41db-a1e1-05f70d1a6597 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1506 microversion: 2.1 time: 0.369900 Oct 29 20:58:56.634620 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1349/2795] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:56 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:56.738623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:56.739640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:56.768947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:56.769836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:56.773664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:56.776417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:56.780136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:56.781319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:56.887390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:56.888969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:56.901638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:56.902672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:56.904518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:56.905362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:56.905987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:56.906545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:56.933696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:58:57.433205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:57.462036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-784556ff-ef48-48b4-a21c-b032840cd1c3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1574 microversion: 2.1 time: 0.576817 Oct 29 20:58:57.482545 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1350/2796] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:56 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1574 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:57.503944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:57.513617 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90bef495-d4ba-469a-80ba-25bd9f5562a4 tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442" status: 200 len: 1521 microversion: 2.1 time: 0.779521 Oct 29 20:58:57.514656 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1447/2797] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:56 2022] GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:57.664849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:57.665589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:57.674542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:57.677609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:57.678233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:57.679506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:57.681439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:57.683856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:57.734595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-296465315", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:58:57.842708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:58:58.966997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:58.980564 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00dfe6da-408a-4c08-89f1-8718d63fc9ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1506 microversion: 2.1 time: 1.321146 Oct 29 20:58:59.002558 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1448/2798] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:57 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1506 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:58:59.011058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:59.013773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:59.024362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:59.025072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:59.025787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:59.026966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:59.027587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:59.029313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:59.231488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:58:59.232629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:58:59.234015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:58:59.234756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:58:59.244632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:58:59.282245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:59.282995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:59.283589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:59.284497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:59.285142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:59.285779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:59.334424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:58:59.347795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:58:59.386869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:58:59.405968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:58:59.542121 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bd1db301-57dd-4ad4-ab5f-60d1e0ca46c2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994678 Oct 29 20:58:59.544991 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1351/2799] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:58:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:58:59.559001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:59.595064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:59.638151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:59.641796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:59.642516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:59.646863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:58:59.649168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:58:59.652505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:58:59.765822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:59.774188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a3888bda-899c-4fc3-b4c4-25784418568c tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1574 microversion: 2.1 time: 0.770088 Oct 29 20:58:59.783518 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1449/2800] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:59 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1574 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:59.801598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-584531fa-bba1-489b-a3af-d4a2d9f9aa2f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:58:59.814372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-584531fa-bba1-489b-a3af-d4a2d9f9aa2f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:58:59.871644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffa2564530843c4853df8c247b4d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144a1cc162db403fada4229ac4003494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:59.923085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-584531fa-bba1-489b-a3af-d4a2d9f9aa2f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:58:59.931041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-07732cb7-b239-4352-b7b6-da9f0439265b tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442" status: 200 len: 1479 microversion: 2.1 time: 0.355710 Oct 29 20:58:59.933347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-584531fa-bba1-489b-a3af-d4a2d9f9aa2f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1216 microversion: 2.1 time: 0.144166 Oct 29 20:58:59.934206 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1352/2801] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:59 2022] GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 => generated 1479 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:59.935607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1450/2802] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:59 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:58:59.992787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ac57e6e4-15da-42dc-8b58-65ca301035b8 req-ab28aab7-a12c-4cdb-9258-8048b534955f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaec58b3-bc47-443c-a3ae-fdcd0c7feffb", "name": "network-vif-plugged", "status": "completed", "tag": "a2a75856-02f8-4104-b0ec-7799ebfadc5e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:00.004765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:00.005240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:00.013166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:00.013691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:00.014221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:00.014827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:00.015303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:00.015738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:00.079729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:00.125256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ac57e6e4-15da-42dc-8b58-65ca301035b8 req-ab28aab7-a12c-4cdb-9258-8048b534955f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:00.128163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ac57e6e4-15da-42dc-8b58-65ca301035b8 req-ab28aab7-a12c-4cdb-9258-8048b534955f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:00.129168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ac57e6e4-15da-42dc-8b58-65ca301035b8 req-ab28aab7-a12c-4cdb-9258-8048b534955f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:00.190322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ac57e6e4-15da-42dc-8b58-65ca301035b8 req-ab28aab7-a12c-4cdb-9258-8048b534955f service nova] Creating event network-vif-plugged:a2a75856-02f8-4104-b0ec-7799ebfadc5e for instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb on nch1-master-1 Oct 29 20:59:00.231355 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ac57e6e4-15da-42dc-8b58-65ca301035b8 req-ab28aab7-a12c-4cdb-9258-8048b534955f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242328 Oct 29 20:59:00.236771 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1353/2803] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:00.247087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6c6d3315-5033-4038-a841-663d65e53cc0 req-9954a1f6-1fd2-4355-b471-6244d4645013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91795f90-cab5-4bb5-8e01-7e59254c0442", "name": "network-vif-deleted", "tag": "57d8b089-4ff5-4bd4-993c-b5dd66291e7e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:00.274155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6c6d3315-5033-4038-a841-663d65e53cc0 req-9954a1f6-1fd2-4355-b471-6244d4645013 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:00.275013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6c6d3315-5033-4038-a841-663d65e53cc0 req-9954a1f6-1fd2-4355-b471-6244d4645013 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:00.277099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6c6d3315-5033-4038-a841-663d65e53cc0 req-9954a1f6-1fd2-4355-b471-6244d4645013 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:00.319129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6c6d3315-5033-4038-a841-663d65e53cc0 req-9954a1f6-1fd2-4355-b471-6244d4645013 service nova] Creating event network-vif-deleted:57d8b089-4ff5-4bd4-993c-b5dd66291e7e for instance 91795f90-cab5-4bb5-8e01-7e59254c0442 on nch1-master-1 Oct 29 20:59:00.334811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6c6d3315-5033-4038-a841-663d65e53cc0 req-9954a1f6-1fd2-4355-b471-6244d4645013 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094298 Oct 29 20:59:00.338124 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1354/2804] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:00.811267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:00.813501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:00.849672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:00.850976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:00.852302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:00.855792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:00.859473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:00.860553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:01.525755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:01.561041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6fd377b5-2c0f-455c-a804-87739bfb180b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1572 microversion: 2.1 time: 0.755568 Oct 29 20:59:01.575653 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1355/2805] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:00 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1572 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:01.627168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:01.628841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 91795f90-cab5-4bb5-8e01-7e59254c0442] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:01.642328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:01.644151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:01.644684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:01.645748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:01.659105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:01.663389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:01.698366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] HTTP exception thrown: Instance 91795f90-cab5-4bb5-8e01-7e59254c0442 could not be found. Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 HTTP/1.1 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 91795f90-cab5-4bb5-8e01-7e59254c0442 could not be found. Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '91795f90-cab5-4bb5-8e01-7e59254c0442'} Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91795f90-cab5-4bb5-8e01-7e59254c0442 could not be found. Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91795f90-cab5-4bb5-8e01-7e59254c0442 could not be found. Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:01.714381 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91795f90-cab5-4bb5-8e01-7e59254c0442 could not be found. Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 404 to user: Instance 91795f90-cab5-4bb5-8e01-7e59254c0442 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:01.719665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a468f6fa-6016-44a1-9dfb-705887ea1afd tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442" status: 404 len: 111 microversion: 2.1 time: 0.140030 Oct 29 20:59:01.726805 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1356/2806] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:01 2022] GET /compute/v2.1/servers/91795f90-cab5-4bb5-8e01-7e59254c0442 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:01.731988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:01.739261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:01.755374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:01.756701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:01.757185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:01.759129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:01.760142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:01.762963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:01.943134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:01.967248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:01.987472 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96211145-1250-4f00-b130-c35527ad6066 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1506 microversion: 2.1 time: 1.984553 Oct 29 20:59:01.988271 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1451/2807] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:58:59 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1506 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:01.991623 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12bd4c6b-371f-40fa-9edf-f5c0f99725cc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1268 microversion: 2.1 time: 0.263409 Oct 29 20:59:02.012040 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1357/2808] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:01 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1268 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:02.034264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-351475643"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:02.039422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:02.040890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:02.044950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] [instance: 74dde29f-7cab-40b9-bef5-85d996cbdad6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:02.064879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:02.065621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:02.066249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:02.066987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:02.067448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:02.067895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:02.087999 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] HTTP exception thrown: Instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 could not be found. Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Request method failure captured: Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 HTTP/1.1 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZPmqKEedm6uJQD1Ge1HFIDtRD-YJra-6LKUODLKWLdBc8BSSrxvc5iCdU1vwx96Xu2KRWg_3h07hi__AOX1UNnnLNNsCBpvr2dL6T3cQs2IHhJHHwCBE7SBYtTEbAuo6fO5OLD9qJGe6NW1diTH-bZXmyn0msPrL3xbbNfsjnvhst8 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_144a1cc162db403fada4229ac4003494"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/144a1cc162db403fada4229ac4003494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/144a1cc162db403fada4229ac4003494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 144a1cc162db403fada4229ac4003494 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1209113158 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4ffa2564530843c4853df8c247b4d2f2 Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServersNegativeTestJSON-1209113158-project Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 could not be found. Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '74dde29f-7cab-40b9-bef5-85d996cbdad6'} Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 could not be found. Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 could not be found. Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:02.089634 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 could not be found. Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] Returning 404 to user: Instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31dc0a4c-b343-4518-992b-655c1dbbd4ae tempest-ListServersNegativeTestJSON-1209113158 tempest-ListServersNegativeTestJSON-1209113158-project] 10.222.0.36 "GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6" status: 404 len: 111 microversion: 2.1 time: 0.077961 Oct 29 20:59:02.094911 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1358/2809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:02 2022] GET /compute/v2.1/servers/74dde29f-7cab-40b9-bef5-85d996cbdad6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:02.096377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:02.096950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:02.097397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:02.098339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:02.099129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:02.099858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:02.402826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ece42144-b281-4898-a6a1-f63b55f8bfb7 req-64e06f3a-becd-4807-996c-6eef1a217ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dde29f-7cab-40b9-bef5-85d996cbdad6", "name": "network-vif-deleted", "tag": "769ff437-bb99-4d76-b04e-9e3b05416f92"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:02.438957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ece42144-b281-4898-a6a1-f63b55f8bfb7 req-64e06f3a-becd-4807-996c-6eef1a217ba3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:02.441709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ece42144-b281-4898-a6a1-f63b55f8bfb7 req-64e06f3a-becd-4807-996c-6eef1a217ba3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:02.444106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ece42144-b281-4898-a6a1-f63b55f8bfb7 req-64e06f3a-becd-4807-996c-6eef1a217ba3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:02.493638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ece42144-b281-4898-a6a1-f63b55f8bfb7 req-64e06f3a-becd-4807-996c-6eef1a217ba3 service nova] Creating event network-vif-deleted:769ff437-bb99-4d76-b04e-9e3b05416f92 for instance 74dde29f-7cab-40b9-bef5-85d996cbdad6 on nch2-master-1 Oct 29 20:59:02.518216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ece42144-b281-4898-a6a1-f63b55f8bfb7 req-64e06f3a-becd-4807-996c-6eef1a217ba3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135994 Oct 29 20:59:02.519224 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1359/2810] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:59:02.630211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f5db9f7-0b9d-4d94-8187-9334084bfba2 tempest-FloatingIPDetailsNegativeTestJSON-2018059589 tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project] Calling method '.version_select at 0x7fa172678d30>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:03.127856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-6f5db9f7-0b9d-4d94-8187-9334084bfba2 tempest-FloatingIPDetailsNegativeTestJSON-2018059589 tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ff35f9a2-cab1-49cc-a52f-34b52da43ebf could not be found", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:03.128086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-6f5db9f7-0b9d-4d94-8187-9334084bfba2 tempest-FloatingIPDetailsNegativeTestJSON-2018059589 tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project] HTTP exception thrown: Floating IP not found for ID ff35f9a2-cab1-49cc-a52f-34b52da43ebf Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f5db9f7-0b9d-4d94-8187-9334084bfba2 tempest-FloatingIPDetailsNegativeTestJSON-2018059589 tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project] Request method failure captured: Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-floating-ips/ff35f9a2-cab1-49cc-a52f-34b52da43ebf HTTP/1.1 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQWvSL9n3lsFOaSTOEldOrB4oW_y_HU7I_PuWD9UiVV28NIllMqQD5ZiQXcRzqYmtxXftXGOOKzAlt6l_uHXkFbieTWCVBY1KDNWeyqqVBc5BRQPXXil9rXHE05gWG8mlcICgQEXLSRfbHTW2Vn5Ui3owmPs4qDtX-EzOtVlCDEXOU Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 471efba7f4754d47b8fc2e0db3254ccf Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2018059589 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/471efba7f4754d47b8fc2e0db3254ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_471efba7f4754d47b8fc2e0db3254ccf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/471efba7f4754d47b8fc2e0db3254ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/471efba7f4754d47b8fc2e0db3254ccf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2018059589 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 471efba7f4754d47b8fc2e0db3254ccf Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2018059589 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6ffd49059adb4c8a88c6837c4afab0ca Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: exception: Floating IP not found for ID ff35f9a2-cab1-49cc-a52f-34b52da43ebf Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ff35f9a2-cab1-49cc-a52f-34b52da43ebf'} Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:03.131578 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ff35f9a2-cab1-49cc-a52f-34b52da43ebf could not be found Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d833c76-61d1-42f3-b415-4b3f912752fd'] Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ff35f9a2-cab1-49cc-a52f-34b52da43ebf. Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ff35f9a2-cab1-49cc-a52f-34b52da43ebf Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ff35f9a2-cab1-49cc-a52f-34b52da43ebf Oct 29 20:59:03.136018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:03.139577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f5db9f7-0b9d-4d94-8187-9334084bfba2 tempest-FloatingIPDetailsNegativeTestJSON-2018059589 tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project] Returning 404 to user: Floating IP not found for ID ff35f9a2-cab1-49cc-a52f-34b52da43ebf {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:03.140713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f5db9f7-0b9d-4d94-8187-9334084bfba2 tempest-FloatingIPDetailsNegativeTestJSON-2018059589 tempest-FloatingIPDetailsNegativeTestJSON-2018059589-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/ff35f9a2-cab1-49cc-a52f-34b52da43ebf" status: 404 len: 111 microversion: 2.1 time: 0.620389 Oct 29 20:59:03.141844 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1360/2811] 10.222.0.36 () {58 vars in 1260 bytes} [Sat Oct 29 20:59:02 2022] GET /compute/v2.1/os-floating-ips/ff35f9a2-cab1-49cc-a52f-34b52da43ebf => generated 111 bytes in 622 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:03.152270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:03.154347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:03.173157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:03.180187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:03.180984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:03.181944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:03.182580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:03.183190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:03.194023 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Adding security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 to port c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 Oct 29 20:59:03.606852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:03.773926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:03.794410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c579196-2af9-4bb6-9cb9-0ee9ec1736ba tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1488 microversion: 2.1 time: 0.650995 Oct 29 20:59:03.798457 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1361/2812] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:03 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1488 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:03.805320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:03.808246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:03.818206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:03.818744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:03.819194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:03.820023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:03.820481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:03.821129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:03.991726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:04.002213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b9de0a3-6be1-499d-8014-a83fa4d5662b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1274 microversion: 2.1 time: 0.202157 Oct 29 20:59:04.020528 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1362/2813] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:03 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:04.027988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:04.028838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:04.037691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.038608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.039373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.040846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.042245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.043045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.086619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:59:04.261354 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af36e7dc-36d7-4d16-9254-3ee97cac3ae0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 204 len: 0 microversion: 2.1 time: 0.238953 Oct 29 20:59:04.265306 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1363/2814] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:04 2022] DELETE /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:59:04.278266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06aa175e-e629-40dc-aa60-24f651f1e396 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17166ea60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-06aa175e-e629-40dc-aa60-24f651f1e396 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Image not found. Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06aa175e-e629-40dc-aa60-24f651f1e396 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 HTTP/1.1 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '48f7b91f-282e-41cb-aa5d-45e9d2360e94'} Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 48f7b91f-282e-41cb-aa5d-45e9d2360e94 to delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48f7b91f-282e-41cb-aa5d-45e9d2360e94 could not be found. Oct 29 20:59:04.317569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06aa175e-e629-40dc-aa60-24f651f1e396 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06aa175e-e629-40dc-aa60-24f651f1e396 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94" status: 404 len: 62 microversion: 2.1 time: 0.044838 Oct 29 20:59:04.321611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1364/2815] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:04 2022] DELETE /compute/v2.1/images/48f7b91f-282e-41cb-aa5d-45e9d2360e94 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 20:59:04.328344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:04.328344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:04.351357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.351871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.352545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.353777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.354107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.354757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.410206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:59:04.489741 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.api [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Instance is already in deleting state, ignoring this request Oct 29 20:59:04.491253 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-036c04cb-61d8-4d46-8b0f-6742f3a9398c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 204 len: 0 microversion: 2.1 time: 0.166822 Oct 29 20:59:04.495337 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1365/2816] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:04 2022] DELETE /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 20:59:04.511326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:04.511966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:04.518468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.518967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.519625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.520341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.520803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.521237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.669960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e7b7b80-db4c-46b6-ac35-bde228039215 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944/action" status: 202 len: 0 microversion: 2.1 time: 2.675428 Oct 29 20:59:04.674358 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1452/2817] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:59:01 2022] POST /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944/action => generated 0 bytes in 2684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:59:04.705479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf937856-76fc-4d42-9cd9-144aa1385340 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa17644d550>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:04.886431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:04.897978 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a7453f2b-2c19-4c6a-bf1b-8decae1deab7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1494 microversion: 2.1 time: 0.401366 Oct 29 20:59:04.912287 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1366/2818] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:04 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1494 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:04.940929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c88ee0d8-a3b5-48bb-93e4-d49220143ada req-5df42ccd-6ebe-4afb-b9c4-ead6be8f9855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e0bb8db-bb65-4c99-9016-bfd75ae44944", "tag": "c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:04.972991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c88ee0d8-a3b5-48bb-93e4-d49220143ada req-5df42ccd-6ebe-4afb-b9c4-ead6be8f9855 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:04.973728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c88ee0d8-a3b5-48bb-93e4-d49220143ada req-5df42ccd-6ebe-4afb-b9c4-ead6be8f9855 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:04.974343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c88ee0d8-a3b5-48bb-93e4-d49220143ada req-5df42ccd-6ebe-4afb-b9c4-ead6be8f9855 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:04.990823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c88ee0d8-a3b5-48bb-93e4-d49220143ada req-5df42ccd-6ebe-4afb-b9c4-ead6be8f9855 service nova] Creating event network-changed:c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 for instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 on nch2-master-1 Oct 29 20:59:05.006622 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c88ee0d8-a3b5-48bb-93e4-d49220143ada req-5df42ccd-6ebe-4afb-b9c4-ead6be8f9855 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084208 Oct 29 20:59:05.009212 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1367/2819] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:05.033642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:05.034868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:05.050854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:05.052317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:05.053084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:05.054441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:05.055425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:05.056329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:05.464791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:05.486946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afb9d198-3555-4154-977e-71f98cc3ec54 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1274 microversion: 2.1 time: 0.459525 Oct 29 20:59:05.504416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1368/2820] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:05 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1274 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:05.586560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6e48b21b-3b74-4b83-9078-a2e695685fb4 req-f2b59142-14de-4f5d-be75-978984210ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaec58b3-bc47-443c-a3ae-fdcd0c7feffb", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a75856-02f8-4104-b0ec-7799ebfadc5e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:05.608593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6e48b21b-3b74-4b83-9078-a2e695685fb4 req-f2b59142-14de-4f5d-be75-978984210ecb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:05.610986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6e48b21b-3b74-4b83-9078-a2e695685fb4 req-f2b59142-14de-4f5d-be75-978984210ecb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:05.613565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6e48b21b-3b74-4b83-9078-a2e695685fb4 req-f2b59142-14de-4f5d-be75-978984210ecb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:05.644768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6e48b21b-3b74-4b83-9078-a2e695685fb4 req-f2b59142-14de-4f5d-be75-978984210ecb service nova] Creating event network-vif-unplugged:a2a75856-02f8-4104-b0ec-7799ebfadc5e for instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb on nch1-master-1 Oct 29 20:59:05.653877 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6e48b21b-3b74-4b83-9078-a2e695685fb4 req-f2b59142-14de-4f5d-be75-978984210ecb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071794 Oct 29 20:59:05.657883 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1369/2821] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:05.677301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-bf937856-76fc-4d42-9cd9-144aa1385340 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use.", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:05.678907 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-bf937856-76fc-4d42-9cd9-144aa1385340 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.678907 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf937856-76fc-4d42-9cd9-144aa1385340 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9 HTTP/1.1 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: exception: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd4f6342b-bb1f-40df-b4c0-aacb06673ce9'} Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:05.685791 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] Oct 29 20:59:05.690328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:05.696642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf937856-76fc-4d42-9cd9-144aa1385340 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 400 to user: Security Group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 in use. Oct 29 20:59:05.696642 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-b1d07d5a-2c6b-47a3-9834-2945d885d857'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:05.698400 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf937856-76fc-4d42-9cd9-144aa1385340 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9" status: 400 len: 185 microversion: 2.1 time: 1.019879 Oct 29 20:59:05.699350 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1453/2822] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:04 2022] DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9 => generated 185 bytes in 1022 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:59:05.708958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:05.709767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:05.723828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:05.725851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:05.726412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:05.731697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:05.732351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:05.732918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:05.829016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:59:05.878717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:05.960281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:05.963488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:05.998165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:06.002124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:06.006896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:06.010909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:06.012126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:06.013341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:06.095254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ccf688eb-c441-4b0a-a71c-fd5f0edbc2ab tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 204 len: 0 microversion: 2.1 time: 0.388697 Oct 29 20:59:06.099253 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1370/2823] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:05 2022] DELETE /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:59:06.127832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:06.128674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:06.152740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:06.163651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:06.164202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:06.166798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:06.167298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:06.167747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:07.382870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:07.397982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1be886fa-aa52-40b3-bd90-f22c321aeae2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1494 microversion: 2.1 time: 1.460621 Oct 29 20:59:07.403920 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1454/2824] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:05 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1494 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:07.611631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1965371945", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:07.628489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:07.639836 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b998d76c-9ff0-4df9-8cd9-000dd06d4030 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1646 microversion: 2.1 time: 1.534959 Oct 29 20:59:07.640482 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1371/2825] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:06 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1646 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:07.663227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:07.663859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:07.683381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:07.683889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:07.684342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:07.685068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:07.692260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:07.692954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:07.721229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] validate_networks() for [('de04bd19-23e0-46bc-981c-3043ca16684b', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:59:08.225143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:08.255206 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82877b69-50c7-4e98-9696-52b01c0f8534 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.601608 Oct 29 20:59:08.262464 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1372/2826] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:07 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:08.443500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:08.446165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:08.488840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:08.489786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:08.491641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:08.494052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:08.497262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:08.498163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:08.771510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c5ef005ddf4a96828abd5376fffa37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483ebf5b1bac414b85bd03ad6c1ac6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:08.790502 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3966263b-792b-4877-aa4f-8b98d5e072f2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 200 len: 1452 microversion: 2.1 time: 0.360536 Oct 29 20:59:08.791488 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1373/2827] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:08 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 1452 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:08.796912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:08.797878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:08.812475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:08.813244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:08.813877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:08.814782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:08.816563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:08.821062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:09.296043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:09.309003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:09.321562 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-86a3dc07-c40b-4414-9bb4-a81acc5f63d4 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1646 microversion: 2.1 time: 0.528819 Oct 29 20:59:09.329291 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1374/2828] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:08 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1646 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:09.336663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a4135b9d-a3c1-44c5-8701-7bc38b0d48ec req-9d791d71-897d-4bbd-9e94-038f752bd030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaec58b3-bc47-443c-a3ae-fdcd0c7feffb", "name": "network-vif-deleted", "tag": "a2a75856-02f8-4104-b0ec-7799ebfadc5e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:09.374415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:09.377240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a4135b9d-a3c1-44c5-8701-7bc38b0d48ec req-9d791d71-897d-4bbd-9e94-038f752bd030 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:09.377896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a4135b9d-a3c1-44c5-8701-7bc38b0d48ec req-9d791d71-897d-4bbd-9e94-038f752bd030 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:09.378530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a4135b9d-a3c1-44c5-8701-7bc38b0d48ec req-9d791d71-897d-4bbd-9e94-038f752bd030 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:09.417120 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a4135b9d-a3c1-44c5-8701-7bc38b0d48ec req-9d791d71-897d-4bbd-9e94-038f752bd030 service nova] Creating event network-vif-deleted:a2a75856-02f8-4104-b0ec-7799ebfadc5e for instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb on nch1-master-1 Oct 29 20:59:09.430909 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a4135b9d-a3c1-44c5-8701-7bc38b0d48ec req-9d791d71-897d-4bbd-9e94-038f752bd030 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092715 Oct 29 20:59:09.431595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1375/2829] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:09.450775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:09.453808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:09.486608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:09.487335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:09.487932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:09.489939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:09.490643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:09.491625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:09.928665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:10.352341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:59:10.352775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:59:10.353266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:59:10.354131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:59:10.354642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:59:10.356618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=86 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:10.400250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.402396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.404225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.407345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.408023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.408671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.473909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for project 47be3cb65cc34590a94a9a161b94a598. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:10.495284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for user d3525b70b7874e7c99485cd7a1efa78d and project 47be3cb65cc34590a94a9a161b94a598. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:10.550025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:59:10.555281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:10.610414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:10.620174 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-235e0c26-1bfc-456f-a472-7494d0803f39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 1.183315 Oct 29 20:59:10.623556 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1376/2830] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:09 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:10.638605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:10.641309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: aaec58b3-bc47-443c-a3ae-fdcd0c7feffb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:10.656325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:10.674675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.676504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.678404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.680563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.682615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.683612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.743079 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c73d5ae-0bc0-4608-9ef7-0ab0578f4051 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.337468 Oct 29 20:59:10.743666 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb could not be found. Oct 29 20:59:10.745060 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1455/2831] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb HTTP/1.1 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb could not be found. Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'aaec58b3-bc47-443c-a3ae-fdcd0c7feffb'} Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb could not be found. Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb could not be found. Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:10.750113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:10.754249 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:10.754249 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:10.754249 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:10.754249 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:10.754249 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb could not be found. Oct 29 20:59:10.754249 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:10.759701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance aaec58b3-bc47-443c-a3ae-fdcd0c7feffb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:10.763383 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-750a4bd1-e887-4bca-91f4-aea865bfc66e tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb" status: 404 len: 111 microversion: 2.1 time: 0.135757 Oct 29 20:59:10.765886 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1377/2832] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:10 2022] GET /compute/v2.1/servers/aaec58b3-bc47-443c-a3ae-fdcd0c7feffb => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:10.782905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:10.783892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:10.788666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6d8653e9-16cb-4fe5-a85e-550fa7528d74 req-410856a7-0ac0-4faf-8866-baf3e884d64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e0bb8db-bb65-4c99-9016-bfd75ae44944", "name": "network-vif-deleted", "tag": "c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:10.802995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.803890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.805662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.806648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.808471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.819890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6d8653e9-16cb-4fe5-a85e-550fa7528d74 req-410856a7-0ac0-4faf-8866-baf3e884d64d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.821055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6d8653e9-16cb-4fe5-a85e-550fa7528d74 req-410856a7-0ac0-4faf-8866-baf3e884d64d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.828040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6d8653e9-16cb-4fe5-a85e-550fa7528d74 req-410856a7-0ac0-4faf-8866-baf3e884d64d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.828703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.872208 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6d8653e9-16cb-4fe5-a85e-550fa7528d74 req-410856a7-0ac0-4faf-8866-baf3e884d64d service nova] Creating event network-vif-deleted:c8a6f98b-2ef2-4f64-b8fd-fedd600fafd5 for instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 on nch2-master-1 Oct 29 20:59:10.881857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:10.882651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:10.883285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:10.883865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lazy-loading 'fault' on Instance uuid 5e0bb8db-bb65-4c99-9016-bfd75ae44944 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:59:10.894296 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6d8653e9-16cb-4fe5-a85e-550fa7528d74 req-410856a7-0ac0-4faf-8866-baf3e884d64d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119245 Oct 29 20:59:10.896399 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1456/2833] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:10.913074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-313d8fa1-f24d-4b31-8acb-d6b22cd3fa26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:10.913908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-313d8fa1-f24d-4b31-8acb-d6b22cd3fa26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.001478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:11.019318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b874b734-0555-4f2b-8487-be7912d7b6e2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 200 len: 1305 microversion: 2.1 time: 0.250771 Oct 29 20:59:11.020162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1378/2834] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:10 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 1305 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:11.026289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.027531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.035089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.035911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.036614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.037701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.038388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.039045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.078531 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 HTTP/1.1 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4b215b43-b0f1-4c4d-90aa-d1f845d7b311'} Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:11.083871 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.090324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.091315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c40276d-9f15-48d0-b863-56810fe44b8c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 404 len: 111 microversion: 2.1 time: 0.069477 Oct 29 20:59:11.092770 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1379/2835] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:11 2022] DELETE /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:11.107359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.108047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 4b215b43-b0f1-4c4d-90aa-d1f845d7b311] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.127381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.129503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.130168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.132319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.133788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.134625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.178731 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.213979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-313d8fa1-f24d-4b31-8acb-d6b22cd3fa26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 HTTP/1.1 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4b215b43-b0f1-4c4d-90aa-d1f845d7b311'} Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.233270 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.237411 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.237411 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.237411 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.237411 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.237411 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. Oct 29 20:59:11.237411 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.238090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-313d8fa1-f24d-4b31-8acb-d6b22cd3fa26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1222 microversion: 2.1 time: 0.328861 Oct 29 20:59:11.238090 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1457/2836] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:10 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1222 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:11.259474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance 4b215b43-b0f1-4c4d-90aa-d1f845d7b311 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.266758 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f99062fb-2d27-4290-a992-a0ef54e75340 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311" status: 404 len: 111 microversion: 2.1 time: 0.168272 Oct 29 20:59:11.268051 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1380/2837] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:11 2022] GET /compute/v2.1/servers/4b215b43-b0f1-4c4d-90aa-d1f845d7b311 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:11.284552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8afeb8f7-1c14-4ff1-b57e-c70c79e75835 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1763843a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.324882 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8afeb8f7-1c14-4ff1-b57e-c70c79e75835 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Image not found. Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8afeb8f7-1c14-4ff1-b57e-c70c79e75835 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 HTTP/1.1 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '19fea62f-176e-4e04-b8c9-68ce0f077d25'} Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 19fea62f-176e-4e04-b8c9-68ce0f077d25 to delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19fea62f-176e-4e04-b8c9-68ce0f077d25 could not be found. Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.327397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:11.331849 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.336245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8afeb8f7-1c14-4ff1-b57e-c70c79e75835 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.337380 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8afeb8f7-1c14-4ff1-b57e-c70c79e75835 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25" status: 404 len: 62 microversion: 2.1 time: 0.064817 Oct 29 20:59:11.341421 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1458/2838] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:11 2022] DELETE /compute/v2.1/images/19fea62f-176e-4e04-b8c9-68ce0f077d25 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:11.348182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.348701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.364657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.365212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.365704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.366433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.366902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.370664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.420032 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.420680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1426386797", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e HTTP/1.1 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'beff40db-1248-41ac-bfc3-33299f73eb0e'} Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:11.427734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.433267 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b13f2292-1ea5-4e66-ac23-c0e900b3e8b9 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 404 len: 111 microversion: 2.1 time: 0.089261 Oct 29 20:59:11.435215 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1381/2839] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:11 2022] DELETE /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:11.465404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.481264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: beff40db-1248-41ac-bfc3-33299f73eb0e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.495950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.496252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.501273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.502772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.503463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.504182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.546773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e HTTP/1.1 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'beff40db-1248-41ac-bfc3-33299f73eb0e'} Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.549404 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.554193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.554193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.554193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.554193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.554193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. Oct 29 20:59:11.554193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.558813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance beff40db-1248-41ac-bfc3-33299f73eb0e could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.561006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-360e5c8a-b745-41d4-a29b-a55392036e11 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e" status: 404 len: 111 microversion: 2.1 time: 0.110929 Oct 29 20:59:11.563441 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1382/2840] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:11 2022] GET /compute/v2.1/servers/beff40db-1248-41ac-bfc3-33299f73eb0e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:11.578427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c837db88-d33a-46bf-9561-a8f1eef672a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1762a13a0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.579566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] validate_networks() for [('de04bd19-23e0-46bc-981c-3043ca16684b', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:59:11.622674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c837db88-d33a-46bf-9561-a8f1eef672a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Image not found. Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c837db88-d33a-46bf-9561-a8f1eef672a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba HTTP/1.1 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '3dbd747e-21e3-43ca-b029-4889965daeba'} Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3dbd747e-21e3-43ca-b029-4889965daeba to delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3dbd747e-21e3-43ca-b029-4889965daeba could not be found. Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.625395 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c837db88-d33a-46bf-9561-a8f1eef672a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.630540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c837db88-d33a-46bf-9561-a8f1eef672a0 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba" status: 404 len: 62 microversion: 2.1 time: 0.059671 Oct 29 20:59:11.636912 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1383/2841] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:11 2022] DELETE /compute/v2.1/images/3dbd747e-21e3-43ca-b029-4889965daeba => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:11.639984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.643315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.663710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.664460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.664983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.666634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.667106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.668765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.707704 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf HTTP/1.1 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e9060230-1b76-4c8b-8dea-7936bfa7cacf'} Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:11.709297 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:11.715417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:11.717117 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-21a03736-cc8b-4a25-a21e-49c4c78911a7 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 404 len: 111 microversion: 2.1 time: 0.081773 Oct 29 20:59:11.718462 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1384/2842] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:11 2022] DELETE /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 20:59:11.730933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:11.732005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:11.747491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.748012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.748452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:11.749190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:11.752607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:11.757720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:12.381810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:12.411166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc120b8a-0e30-4377-b932-779a4c7e8fe7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.691506 Oct 29 20:59:12.415600 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1385/2843] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:11 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:12.420744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:12.429288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: e9060230-1b76-4c8b-8dea-7936bfa7cacf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:12.444065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:12.444861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:12.445487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:12.448726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:12.449496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:12.450133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:12.472204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf HTTP/1.1 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e9060230-1b76-4c8b-8dea-7936bfa7cacf'} Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.481435 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.485992 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:12.485992 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:12.485992 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:12.485992 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:12.485992 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. Oct 29 20:59:12.485992 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.501676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance e9060230-1b76-4c8b-8dea-7936bfa7cacf could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:12.504812 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e527ef4-6ec1-4eb0-9663-2d4fdb27420c tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf" status: 404 len: 111 microversion: 2.1 time: 0.087934 Oct 29 20:59:12.512070 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1386/2844] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:12 2022] GET /compute/v2.1/servers/e9060230-1b76-4c8b-8dea-7936bfa7cacf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:12.524449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:12.525091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:12.538377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:12.539019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:12.539475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:12.541616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:12.542114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:12.542561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:12.572860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 HTTP/1.1 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '5e0bb8db-bb65-4c99-9016-bfd75ae44944'} Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.574487 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:12.579840 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.581259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:12.582674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-242521c6-8093-43b9-a43d-60ce359f018b tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 404 len: 111 microversion: 2.1 time: 0.072294 Oct 29 20:59:12.587028 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1387/2845] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:12 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:12.594397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7db49bbd-9265-4b5a-9ca2-b4548c03e831 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa1717e8670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:12.647092 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7db49bbd-9265-4b5a-9ca2-b4548c03e831 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Image not found. Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7db49bbd-9265-4b5a-9ca2-b4548c03e831 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 HTTP/1.1 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: exception: Image not found. Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '0f291f94-a901-4f7a-88b4-96875e694fa1'} Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f291f94-a901-4f7a-88b4-96875e694fa1 to delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f291f94-a901-4f7a-88b4-96875e694fa1 could not be found. Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.648981 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7db49bbd-9265-4b5a-9ca2-b4548c03e831 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Image not found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7db49bbd-9265-4b5a-9ca2-b4548c03e831 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1" status: 404 len: 62 microversion: 2.1 time: 0.062393 Oct 29 20:59:12.657784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1388/2846] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:12 2022] DELETE /compute/v2.1/images/0f291f94-a901-4f7a-88b4-96875e694fa1 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:12.670491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e5e0ffb-6d36-4305-b7d9-b9bdfbbbdd35 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1762a1310>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:13.336450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:59:13.337772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:59:13.338806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:59:13.340610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:59:13.341419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:59:13.353672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.354536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.355939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.357360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.358104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.359050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.417119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for project 47be3cb65cc34590a94a9a161b94a598. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:13.430224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for user d3525b70b7874e7c99485cd7a1efa78d and project 47be3cb65cc34590a94a9a161b94a598. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:13.449795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:59:13.453214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:13.531885 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b5342959-2277-4764-a010-f15324487a0d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.115712 Oct 29 20:59:13.533232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1459/2847] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:59:13.557201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:13.558359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:13.572027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.572993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.573959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.575095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.575775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.576364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.624008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 HTTP/1.1 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd7d15e3a-29e9-413b-a5fb-507ff4f83211'} Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:13.627490 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:13.633234 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:13.637502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:13.638598 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0dff8bb4-8c42-433a-80ae-dd481bee740f tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 404 len: 111 microversion: 2.1 time: 0.102983 Oct 29 20:59:13.639226 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1460/2848] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:13 2022] DELETE /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:13.659051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-881763ad-8508-44e9-99d7-535e8b5b7e1e req-207a1fcc-7f92-4502-b377-27cb66666783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75e7ef5-74ec-405e-9a01-352979e69378", "tag": "97e61f37-85b0-4b26-8bd1-bf179735f626"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:13.681343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-881763ad-8508-44e9-99d7-535e8b5b7e1e req-207a1fcc-7f92-4502-b377-27cb66666783 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.682005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-881763ad-8508-44e9-99d7-535e8b5b7e1e req-207a1fcc-7f92-4502-b377-27cb66666783 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.682551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-881763ad-8508-44e9-99d7-535e8b5b7e1e req-207a1fcc-7f92-4502-b377-27cb66666783 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.710642 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-881763ad-8508-44e9-99d7-535e8b5b7e1e req-207a1fcc-7f92-4502-b377-27cb66666783 service nova] Creating event network-changed:97e61f37-85b0-4b26-8bd1-bf179735f626 for instance e75e7ef5-74ec-405e-9a01-352979e69378 on nch1-master-1 Oct 29 20:59:13.721215 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-881763ad-8508-44e9-99d7-535e8b5b7e1e req-207a1fcc-7f92-4502-b377-27cb66666783 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078316 Oct 29 20:59:13.725679 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1461/2849] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:13.731311 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e5e0ffb-6d36-4305-b7d9-b9bdfbbbdd35 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee" status: 202 len: 0 microversion: 2.1 time: 1.078619 Oct 29 20:59:13.735782 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1389/2850] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:12 2022] DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:59:13.738644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:13.740151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:13.741625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a78d8c34-a300-415a-94e3-1e02aac42330 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:13.742246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a78d8c34-a300-415a-94e3-1e02aac42330 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:13.762208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.764539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.765297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.766545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:13.767025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:13.767455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:13.934552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a78d8c34-a300-415a-94e3-1e02aac42330 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:13.950908 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a78d8c34-a300-415a-94e3-1e02aac42330 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1222 microversion: 2.1 time: 0.214073 Oct 29 20:59:13.973527 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1390/2851] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:13 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:13.986082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:13.986668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: d7d15e3a-29e9-413b-a5fb-507ff4f83211] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:14.004949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:14.005448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:14.005936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:14.009237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:14.009445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:14.012592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:14.044086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 HTTP/1.1 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'd7d15e3a-29e9-413b-a5fb-507ff4f83211'} Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.045749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance d7d15e3a-29e9-413b-a5fb-507ff4f83211 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91f14939-9245-45d7-9729-82a4638ebd82 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211" status: 404 len: 111 microversion: 2.1 time: 0.082327 Oct 29 20:59:14.052606 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1391/2852] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:13 2022] GET /compute/v2.1/servers/d7d15e3a-29e9-413b-a5fb-507ff4f83211 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:14.056152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8777c719-66af-4845-9f26-17bf7413eb96 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1762a1f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:14.370085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:14.383416 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-116c37ad-1e11-49c7-b7ac-0cb1b5201f3f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.656366 Oct 29 20:59:14.384022 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1462/2853] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:13 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:14.388846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-250b79fd-0cfc-4a62-a5e7-68fb1d6f0109 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '.version_select at 0x7fa17633daf0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:14.430133 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-250b79fd-0cfc-4a62-a5e7-68fb1d6f0109 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Image not found. Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-250b79fd-0cfc-4a62-a5e7-68fb1d6f0109 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc HTTP/1.1 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '50109301-344f-4d0a-af2e-18ccc08ae1dc'} Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50109301-344f-4d0a-af2e-18ccc08ae1dc to delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50109301-344f-4d0a-af2e-18ccc08ae1dc could not be found. Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.440769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:14.445853 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.451706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-250b79fd-0cfc-4a62-a5e7-68fb1d6f0109 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:14.453611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-250b79fd-0cfc-4a62-a5e7-68fb1d6f0109 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc" status: 404 len: 62 microversion: 2.1 time: 0.068295 Oct 29 20:59:14.454746 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1463/2854] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:14 2022] DELETE /compute/v2.1/images/50109301-344f-4d0a-af2e-18ccc08ae1dc => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:14.465472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:14.467386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:14.478973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:14.479972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:14.480577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:14.481486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:14.481945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:14.482378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:14.506126 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 HTTP/1.1 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '00ff39d8-d9c4-48f9-92e9-9c2dac9633d0'} Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:14.508803 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1a304d84-76b9-44ba-a836-793d637720d2 tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 404 len: 111 microversion: 2.1 time: 0.052043 Oct 29 20:59:14.518171 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1464/2855] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:14 2022] DELETE /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:14.522530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:14.523181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] [instance: 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:14.532493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:14.533352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:14.534025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:14.535683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:14.536426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:14.537223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:14.578393 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] HTTP exception thrown: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Request method failure captured: Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 HTTP/1.1 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZK_OpS143igJjbEWUSzCiVoTcwmHd9zoFP1LF5FXoxGB-b1XNsOMQhuSqgQ97eWNWWMolmRvFVrqAKZKjyUoE6RkKe7qBOGmseKvYaz9LI9jZz7PL6vdF0Y9qCSWdpPKzusT3cEeDbhxNtu2qhnSjdFjLmYklJ8fgUPMyggFDb-Fhs Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/483ebf5b1bac414b85bd03ad6c1ac6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 483ebf5b1bac414b85bd03ad6c1ac6f4 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesTestJSON-939257199 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d1c5ef005ddf4a96828abd5376fffa37 Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesTestJSON-939257199-project Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '00ff39d8-d9c4-48f9-92e9-9c2dac9633d0'} Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.583451 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] Returning 404 to user: Instance 00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0734f05a-c401-424c-9c8e-66e1f85f529b tempest-ImagesTestJSON-939257199 tempest-ImagesTestJSON-939257199-project] 10.222.0.36 "GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0" status: 404 len: 111 microversion: 2.1 time: 0.068274 Oct 29 20:59:14.587516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1465/2856] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:14 2022] GET /compute/v2.1/servers/00ff39d8-d9c4-48f9-92e9-9c2dac9633d0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:14.917201 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8777c719-66af-4845-9f26-17bf7413eb96 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9" status: 202 len: 0 microversion: 2.1 time: 0.864619 Oct 29 20:59:14.918132 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1392/2857] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:14 2022] DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9 => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:59:14.933566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8539f1e-6f25-48c3-a2e4-e4d6f7b4635e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'create', calling method: .version_select at 0x7fa17644ea60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1967459624", "description": "tempest-description-646909164"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:14.992324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:14.993337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:15.032225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:15.032995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:15.034711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:15.037061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:15.038071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:15.039342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:15.228168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:15.256886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5644b937-db0b-407d-8d01-a7a351bb0d7c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1274 microversion: 2.1 time: 0.272884 Oct 29 20:59:15.259828 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1393/2858] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:14 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1274 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:15.416164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:15.417184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:15.430759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:15.433863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:15.435195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:15.448595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:15.460962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:15.462673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:15.868767 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8539f1e-6f25-48c3-a2e4-e4d6f7b4635e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.939885 Oct 29 20:59:15.870152 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1466/2859] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 20:59:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:59:15.885143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b53e42cb-c9ce-448c-8ab0-2b57bd411fe2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Action: 'update', calling method: .version_select at 0x7fa1763849d0>, body: {"security_group": {"name": "tempest-sg-hth-1048241553", "description": "tempest-description-hth-461153660"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:16.199850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:16.214788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc0820d8-9965-41ef-a48c-15de0e629456 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.803130 Oct 29 20:59:16.215404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1394/2860] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:15 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:16.281877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:16.282510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:16.297535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:16.298440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:16.299066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:16.299969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:16.300789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:16.301395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:16.550437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:16.561207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-80e38068-38ce-46b2-a617-6a4eed483b4c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1280 microversion: 2.1 time: 0.282946 Oct 29 20:59:16.607748 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1395/2861] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:16 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:17.186233 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b53e42cb-c9ce-448c-8ab0-2b57bd411fe2 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/06ddfd66-4262-4b14-996e-c29961c153ea" status: 200 len: 217 microversion: 2.1 time: 1.303115 Oct 29 20:59:17.189400 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1467/2862] 10.222.0.36 () {60 vars in 1290 bytes} [Sat Oct 29 20:59:15 2022] PUT /compute/v2.1/os-security-groups/06ddfd66-4262-4b14-996e-c29961c153ea => generated 217 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:17.204079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eeb5080c-d768-4c1c-99e2-96af71e4b881 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1718daa60>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:17.247447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:17.250035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:17.259558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:17.260582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:17.261207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:17.263031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:17.265401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:17.269175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:17.611458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:17.629943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65bc8f83-fbe0-4e8c-a7fa-a7581507596b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.387487 Oct 29 20:59:17.642789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1468/2863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:17 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:17.660382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:17.661887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:17.673231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:17.674030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:17.674721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:17.675688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:17.676441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:17.677185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:17.753569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eeb5080c-d768-4c1c-99e2-96af71e4b881 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/06ddfd66-4262-4b14-996e-c29961c153ea" status: 200 len: 217 microversion: 2.1 time: 0.554723 Oct 29 20:59:17.754509 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1396/2864] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:59:17 2022] GET /compute/v2.1/os-security-groups/06ddfd66-4262-4b14-996e-c29961c153ea => generated 217 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:59:17.777114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-370f2fb6-f0ff-419a-ae7c-4c3dd1c72730 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1762a1e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:17.966057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:17.979059 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-483e5507-bcd8-4610-a157-ac459642a348 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1280 microversion: 2.1 time: 0.334761 Oct 29 20:59:17.982137 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1469/2865] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:17 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:18.371733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8459ac0b-1138-4fc3-81fd-f2a5fa4a1b87 req-1da98b93-faef-41b8-9f11-0af051dc9fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9", "tag": "754992b9-b168-405b-9747-f1e7c4cf318b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:18.390992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8459ac0b-1138-4fc3-81fd-f2a5fa4a1b87 req-1da98b93-faef-41b8-9f11-0af051dc9fb7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:18.392859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8459ac0b-1138-4fc3-81fd-f2a5fa4a1b87 req-1da98b93-faef-41b8-9f11-0af051dc9fb7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:18.395567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8459ac0b-1138-4fc3-81fd-f2a5fa4a1b87 req-1da98b93-faef-41b8-9f11-0af051dc9fb7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:18.419521 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8459ac0b-1138-4fc3-81fd-f2a5fa4a1b87 req-1da98b93-faef-41b8-9f11-0af051dc9fb7 service nova] Creating event network-changed:754992b9-b168-405b-9747-f1e7c4cf318b for instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 on nch2-master-1 Oct 29 20:59:18.432440 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8459ac0b-1138-4fc3-81fd-f2a5fa4a1b87 req-1da98b93-faef-41b8-9f11-0af051dc9fb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064507 Oct 29 20:59:18.436036 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1470/2866] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 20:59:18.664025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:18.665162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:18.691299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:18.694794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:18.696474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:18.700090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:18.701069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:18.703370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:19.335199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:19.348005 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-322f7dfa-1bc2-4ccd-aca3-4cd75ef4154c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.694893 Oct 29 20:59:19.349561 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1471/2867] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:18 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:19.538917 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-370f2fb6-f0ff-419a-ae7c-4c3dd1c72730 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/06ddfd66-4262-4b14-996e-c29961c153ea" status: 202 len: 0 microversion: 2.1 time: 1.770544 Oct 29 20:59:19.539512 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1397/2868] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:17 2022] DELETE /compute/v2.1/os-security-groups/06ddfd66-4262-4b14-996e-c29961c153ea => generated 0 bytes in 1772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 20:59:19.546269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:19.547490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:19.562963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:19.563507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:19.563963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:19.569058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:19.569583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:19.570267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:19.676649 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39e76b12-92db-4ed3-8fe7-9ad30108b25c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] 10.222.0.36 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.325780 Oct 29 20:59:19.677979 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1472/2869] 10.222.0.36 () {58 vars in 1128 bytes} [Sat Oct 29 20:59:19 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 20:59:19.757501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2843ac5-5e32-42db-9e0f-9a91ba90f4d6 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-949060966", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:19.761010 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b2843ac5-5e32-42db-9e0f-9a91ba90f4d6 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] HTTP exception thrown: min_count must be <= max_count Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2843ac5-5e32-42db-9e0f-9a91ba90f4d6 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Request method failure captured: Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 183 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQn7Vc-3PV4Fk8LyF7BVuCWCZtjHNanf-D6IrSNlvRrRqwyGWQxf7R_a4GydR9-Y6gqjinE0V74JdXe901d4Tcg2M-5Lb5oBkHihqmUYh_acdpLSrwkFsoiNb52Hj79EJQTvN8eZ4iHXawMKih8rqj02ghnc9qdbSPTXa_AKCYW3fA Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: da2e74c361494a43aedadf3a7961a00f Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-949060966", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: exception: min_count must be <= max_count Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-949060966', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 29 20:59:19.763012 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.772574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2843ac5-5e32-42db-9e0f-9a91ba90f4d6 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Returning 400 to user: min_count must be <= max_count {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:19.772574 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b2843ac5-5e32-42db-9e0f-9a91ba90f4d6 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.092290 Oct 29 20:59:19.772574 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1473/2870] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:19 2022] POST /compute/v2.1/servers => generated 74 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 20:59:19.776766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:19.777265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:19.800092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:19.800689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:19.801257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:19.802118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:19.802648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:19.803196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:19.833824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 HTTP/1.1 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5e0bb8db-bb65-4c99-9016-bfd75ae44944'} Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:19.837671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:19.842201 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.844547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:19.846181 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6612dfab-3451-4be6-a01b-3f7a9e0b6708 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 404 len: 111 microversion: 2.1 time: 0.073130 Oct 29 20:59:19.846870 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1474/2871] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:19 2022] DELETE /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:19.862110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb43a75b-eeee-461b-b4a2-2b0e4798436c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Calling method '.version_select at 0x7fa1763afb80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:19.895263 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cb43a75b-eeee-461b-b4a2-2b0e4798436c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] HTTP exception thrown: Image not found. Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb43a75b-eeee-461b-b4a2-2b0e4798436c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Request method failure captured: Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQmHdg95jawoB09184RTlxph1m0kfGiLKJ4B1EjTT7HKBQNli21nnZ9e_kFmI1mdMH-_4dpOJKj_PqlXb_2_zp98tXV3oHgZkSPSvQwGipm1D1gcIs7hONlK6_WgfF-8xud4btO7PI5BlokEztCDTcPTdWS8VwzI4R6fpiOxWj-hmI Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 617c73db3a6e47048f49f5fc3861b23e Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '-1'} Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.904692 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:19.908733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.915019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb43a75b-eeee-461b-b4a2-2b0e4798436c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:19.920397 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb43a75b-eeee-461b-b4a2-2b0e4798436c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] 10.222.0.36 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.071906 Oct 29 20:59:19.922036 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1475/2872] 10.222.0.36 () {58 vars in 1134 bytes} [Sat Oct 29 20:59:19 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:19.932424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c31d31e1-537d-424f-a66a-66120e52fe7b tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-102016597", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "max_count": 0}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c31d31e1-537d-424f-a66a-66120e52fe7b tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Request method failure captured: Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 167 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQn7Vc-3PV4Fk8LyF7BVuCWCZtjHNanf-D6IrSNlvRrRqwyGWQxf7R_a4GydR9-Y6gqjinE0V74JdXe901d4Tcg2M-5Lb5oBkHihqmUYh_acdpLSrwkFsoiNb52Hj79EJQTvN8eZ4iHXawMKih8rqj02ghnc9qdbSPTXa_AKCYW3fA Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: da2e74c361494a43aedadf3a7961a00f Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-102016597", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "max_count": 0}} Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-102016597', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'max_count': 0}}} Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 0 Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:59:19.941057 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:19.946898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c31d31e1-537d-424f-a66a-66120e52fe7b tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:19.949666 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c31d31e1-537d-424f-a66a-66120e52fe7b tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024691 Oct 29 20:59:19.950521 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1476/2873] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:19 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:59:19.964977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:19.966542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: 5e0bb8db-bb65-4c99-9016-bfd75ae44944] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:19.987972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:19.992047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:19.992600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:19.993377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:19.993886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:19.995865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:20.022344 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 HTTP/1.1 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5e0bb8db-bb65-4c99-9016-bfd75ae44944'} Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.024382 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.030672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Instance 5e0bb8db-bb65-4c99-9016-bfd75ae44944 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.031697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dd4e2701-f15a-4b0f-b436-bec98e495c04 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944" status: 404 len: 111 microversion: 2.1 time: 0.078705 Oct 29 20:59:20.036234 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1477/2874] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:19 2022] GET /compute/v2.1/servers/5e0bb8db-bb65-4c99-9016-bfd75ae44944 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:20.043676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db73a95c-aa87-4cc0-8a4e-e99e3786333c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Calling method '.version_select at 0x7fa17633d790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.081693 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-db73a95c-aa87-4cc0-8a4e-e99e3786333c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] HTTP exception thrown: Image not found. Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db73a95c-aa87-4cc0-8a4e-e99e3786333c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Request method failure captured: Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/ab482025-1fda-436e-ba3f-800a43c869fj HTTP/1.1 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQmHdg95jawoB09184RTlxph1m0kfGiLKJ4B1EjTT7HKBQNli21nnZ9e_kFmI1mdMH-_4dpOJKj_PqlXb_2_zp98tXV3oHgZkSPSvQwGipm1D1gcIs7hONlK6_WgfF-8xud4btO7PI5BlokEztCDTcPTdWS8VwzI4R6fpiOxWj-hmI Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 617c73db3a6e47048f49f5fc3861b23e Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ab482025-1fda-436e-ba3f-800a43c869fj'} Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ab482025-1fda-436e-ba3f-800a43c869fj to delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab482025-1fda-436e-ba3f-800a43c869fj could not be found. Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.083480 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db73a95c-aa87-4cc0-8a4e-e99e3786333c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db73a95c-aa87-4cc0-8a4e-e99e3786333c tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] 10.222.0.36 "DELETE /compute/v2.1/images/ab482025-1fda-436e-ba3f-800a43c869fj" status: 404 len: 62 microversion: 2.1 time: 0.047293 Oct 29 20:59:20.090101 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1478/2875] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/images/ab482025-1fda-436e-ba3f-800a43c869fj => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:20.095429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-39fa67d3-855e-4a66-84a8-be64f2e52440 req-cb981c41-fd6b-4f6e-8f80-d4ce3991a77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75e7ef5-74ec-405e-9a01-352979e69378", "name": "network-vif-plugged", "status": "completed", "tag": "97e61f37-85b0-4b26-8bd1-bf179735f626"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:20.109447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39fa67d3-855e-4a66-84a8-be64f2e52440 req-cb981c41-fd6b-4f6e-8f80-d4ce3991a77e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:20.110149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39fa67d3-855e-4a66-84a8-be64f2e52440 req-cb981c41-fd6b-4f6e-8f80-d4ce3991a77e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:20.114723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39fa67d3-855e-4a66-84a8-be64f2e52440 req-cb981c41-fd6b-4f6e-8f80-d4ce3991a77e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:20.132740 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-39fa67d3-855e-4a66-84a8-be64f2e52440 req-cb981c41-fd6b-4f6e-8f80-d4ce3991a77e service nova] Creating event network-vif-plugged:97e61f37-85b0-4b26-8bd1-bf179735f626 for instance e75e7ef5-74ec-405e-9a01-352979e69378 on nch1-master-1 Oct 29 20:59:20.139620 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-39fa67d3-855e-4a66-84a8-be64f2e52440 req-cb981c41-fd6b-4f6e-8f80-d4ce3991a77e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052542 Oct 29 20:59:20.140692 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1479/2876] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:20.151316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1fae7916-444f-488b-b7ef-f2d4dc573067 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1954012854", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "max_count": 2.5}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1fae7916-444f-488b-b7ef-f2d4dc573067 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Request method failure captured: Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 170 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQn7Vc-3PV4Fk8LyF7BVuCWCZtjHNanf-D6IrSNlvRrRqwyGWQxf7R_a4GydR9-Y6gqjinE0V74JdXe901d4Tcg2M-5Lb5oBkHihqmUYh_acdpLSrwkFsoiNb52Hj79EJQTvN8eZ4iHXawMKih8rqj02ghnc9qdbSPTXa_AKCYW3fA Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: da2e74c361494a43aedadf3a7961a00f Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1954012854", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "max_count": 2.5}} Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1954012854', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'max_count': 2.5}}} Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:59:20.156065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1fae7916-444f-488b-b7ef-f2d4dc573067 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1fae7916-444f-488b-b7ef-f2d4dc573067 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014237 Oct 29 20:59:20.163476 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1480/2877] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:59:20.164801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa17635c4c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.424943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:20.425980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:20.426687 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.426687 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9 HTTP/1.1 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd4f6342b-bb1f-40df-b4c0-aacb06673ce9'} Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:20.430485 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] Oct 29 20:59:20.436325 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.441330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group d4f6342b-bb1f-40df-b4c0-aacb06673ce9 does not exist Oct 29 20:59:20.441330 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-03434444-de80-4b1f-a50d-1b74958ad205'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.441330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e0f0057-31d6-4f56-b9fb-d277b9d06b2a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9" status: 404 len: 194 microversion: 2.1 time: 0.278431 Oct 29 20:59:20.444959 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1481/2878] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/os-security-groups/d4f6342b-bb1f-40df-b4c0-aacb06673ce9 => generated 194 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:20.451497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db6c456e-575d-4758-8ae1-2ada9e1825c8 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Calling method '.version_select at 0x7fa17634bd30>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.479500 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-db6c456e-575d-4758-8ae1-2ada9e1825c8 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] HTTP exception thrown: Image not found. Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db6c456e-575d-4758-8ae1-2ada9e1825c8 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Request method failure captured: Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/af51a3cd-147b-4d01-9480-bc1ec002baa11 HTTP/1.1 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQmHdg95jawoB09184RTlxph1m0kfGiLKJ4B1EjTT7HKBQNli21nnZ9e_kFmI1mdMH-_4dpOJKj_PqlXb_2_zp98tXV3oHgZkSPSvQwGipm1D1gcIs7hONlK6_WgfF-8xud4btO7PI5BlokEztCDTcPTdWS8VwzI4R6fpiOxWj-hmI Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 617c73db3a6e47048f49f5fc3861b23e Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'af51a3cd-147b-4d01-9480-bc1ec002baa11'} Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af51a3cd-147b-4d01-9480-bc1ec002baa11 to delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af51a3cd-147b-4d01-9480-bc1ec002baa11 could not be found. Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.481761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:20.490735 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.495902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db6c456e-575d-4758-8ae1-2ada9e1825c8 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.498242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db6c456e-575d-4758-8ae1-2ada9e1825c8 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] 10.222.0.36 "DELETE /compute/v2.1/images/af51a3cd-147b-4d01-9480-bc1ec002baa11" status: 404 len: 62 microversion: 2.1 time: 0.050826 Oct 29 20:59:20.505498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1482/2879] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/images/af51a3cd-147b-4d01-9480-bc1ec002baa11 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:20.510410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:20.530019 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b106b1a6-b7cb-4fb6-9bee-43adda74553a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.982444 Oct 29 20:59:20.531291 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1398/2880] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:19 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:20.533252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43e0120f-f56a-44ab-b0f4-d1aeafe28eca tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-723515255", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 0}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:20.540960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.543038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43e0120f-f56a-44ab-b0f4-d1aeafe28eca tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Request method failure captured: Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 167 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQn7Vc-3PV4Fk8LyF7BVuCWCZtjHNanf-D6IrSNlvRrRqwyGWQxf7R_a4GydR9-Y6gqjinE0V74JdXe901d4Tcg2M-5Lb5oBkHihqmUYh_acdpLSrwkFsoiNb52Hj79EJQTvN8eZ4iHXawMKih8rqj02ghnc9qdbSPTXa_AKCYW3fA Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: da2e74c361494a43aedadf3a7961a00f Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-723515255", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 0}} Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-723515255', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'min_count': 0}}} Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 0 Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:59:20.543613 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 20:59:20.549301 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.550637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43e0120f-f56a-44ab-b0f4-d1aeafe28eca tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.552755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43e0120f-f56a-44ab-b0f4-d1aeafe28eca tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.045980 Oct 29 20:59:20.553994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1483/2881] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:20 2022] POST /compute/v2.1/servers => generated 130 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:59:20.562079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1763af3a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.565259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:20.566242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:20.567721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:20.568691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:20.569283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:20.569849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:20.606884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:20.708294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b365395-5b57-4982-97d1-099988590eee does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:20.711005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 0b365395-5b57-4982-97d1-099988590eee not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:20.712063 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.712063 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee HTTP/1.1 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '0b365395-5b57-4982-97d1-099988590eee'} Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:20.716182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] Oct 29 20:59:20.722707 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.729311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 0b365395-5b57-4982-97d1-099988590eee does not exist Oct 29 20:59:20.729311 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-085b85ee-14f9-43af-b88c-1bc018487679'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.730994 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8fd02f5b-4a64-4c84-929e-8406cc6060e3 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee" status: 404 len: 194 microversion: 2.1 time: 0.173363 Oct 29 20:59:20.731871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1484/2882] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/os-security-groups/0b365395-5b57-4982-97d1-099988590eee => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:20.738384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f59630b-d9cc-419a-a7fa-6de7c6758fb3 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Calling method '.version_select at 0x7fa17643d820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.767069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8f59630b-d9cc-419a-a7fa-6de7c6758fb3 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] HTTP exception thrown: Image not found. Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f59630b-d9cc-419a-a7fa-6de7c6758fb3 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Request method failure captured: Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/tempest-invalid-480694585 HTTP/1.1 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQmHdg95jawoB09184RTlxph1m0kfGiLKJ4B1EjTT7HKBQNli21nnZ9e_kFmI1mdMH-_4dpOJKj_PqlXb_2_zp98tXV3oHgZkSPSvQwGipm1D1gcIs7hONlK6_WgfF-8xud4btO7PI5BlokEztCDTcPTdWS8VwzI4R6fpiOxWj-hmI Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 617c73db3a6e47048f49f5fc3861b23e Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'tempest-invalid-480694585'} Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-480694585 to delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-480694585 could not be found. Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.771677 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:20.776447 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.780342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f59630b-d9cc-419a-a7fa-6de7c6758fb3 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.780342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f59630b-d9cc-419a-a7fa-6de7c6758fb3 tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] 10.222.0.36 "DELETE /compute/v2.1/images/tempest-invalid-480694585" status: 404 len: 62 microversion: 2.1 time: 0.046599 Oct 29 20:59:20.780342 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1485/2883] 10.222.0.36 () {58 vars in 1203 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/images/tempest-invalid-480694585 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:20.791763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3574988-9b7e-4d62-a251-f6d4fb1d0ab1 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1674481569", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 2.5}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3574988-9b7e-4d62-a251-f6d4fb1d0ab1 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Request method failure captured: Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 170 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQn7Vc-3PV4Fk8LyF7BVuCWCZtjHNanf-D6IrSNlvRrRqwyGWQxf7R_a4GydR9-Y6gqjinE0V74JdXe901d4Tcg2M-5Lb5oBkHihqmUYh_acdpLSrwkFsoiNb52Hj79EJQTvN8eZ4iHXawMKih8rqj02ghnc9qdbSPTXa_AKCYW3fA Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26ebee81cc2d4df3bbc08ca19e2f126b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26ebee81cc2d4df3bbc08ca19e2f126b Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1577930048 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: da2e74c361494a43aedadf3a7961a00f Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1577930048-project Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1674481569", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 2.5}} Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1674481569', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'min_count': 2.5}}} Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 20:59:20.796680 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.802528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3574988-9b7e-4d62-a251-f6d4fb1d0ab1 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.807592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3574988-9b7e-4d62-a251-f6d4fb1d0ab1 tempest-MultipleCreateNegativeTestJSON-1577930048 tempest-MultipleCreateNegativeTestJSON-1577930048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018354 Oct 29 20:59:20.807592 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1486/2884] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:59:20.816827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa17634b9d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:20.960455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:20.961928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:20.962637 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.962637 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 HTTP/1.1 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b6b77bd2-46eb-48a5-9e2a-1b71dadf0135'} Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:20.964927 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] Oct 29 20:59:20.970528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:20.974993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 does not exist Oct 29 20:59:20.974993 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-ff4dc57c-e7d7-45e0-899d-eacab1b37417'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:20.976343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24a61247-b874-4394-ab52-635129931d3d tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135" status: 404 len: 194 microversion: 2.1 time: 0.164159 Oct 29 20:59:20.977446 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1487/2885] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/os-security-groups/b6b77bd2-46eb-48a5-9e2a-1b71dadf0135 => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:20.983534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25a467cf-5096-4e25-aab4-6052673f2fdd tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Calling method '.version_select at 0x7fa17635cb80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.023702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-25a467cf-5096-4e25-aab4-6052673f2fdd tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] HTTP exception thrown: Image not found. Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25a467cf-5096-4e25-aab4-6052673f2fdd tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Request method failure captured: Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/images/b0025b07-8211-49d6-85fd-8c5bb3bc3122 HTTP/1.1 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQmHdg95jawoB09184RTlxph1m0kfGiLKJ4B1EjTT7HKBQNli21nnZ9e_kFmI1mdMH-_4dpOJKj_PqlXb_2_zp98tXV3oHgZkSPSvQwGipm1D1gcIs7hONlK6_WgfF-8xud4btO7PI5BlokEztCDTcPTdWS8VwzI4R6fpiOxWj-hmI Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2084f340f38743a1a16a9ab9a5840085"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2084f340f38743a1a16a9ab9a5840085 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-217771016 Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 617c73db3a6e47048f49f5fc3861b23e Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-217771016-project Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: exception: Image not found. Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b0025b07-8211-49d6-85fd-8c5bb3bc3122'} Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b0025b07-8211-49d6-85fd-8c5bb3bc3122 to delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0025b07-8211-49d6-85fd-8c5bb3bc3122 could not be found. Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.025133 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25a467cf-5096-4e25-aab4-6052673f2fdd tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] Returning 404 to user: Image not found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25a467cf-5096-4e25-aab4-6052673f2fdd tempest-ImagesDeleteNegativeTestJSON-217771016 tempest-ImagesDeleteNegativeTestJSON-217771016-project] 10.222.0.36 "DELETE /compute/v2.1/images/b0025b07-8211-49d6-85fd-8c5bb3bc3122" status: 404 len: 62 microversion: 2.1 time: 0.048238 Oct 29 20:59:21.029560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1488/2886] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:20 2022] DELETE /compute/v2.1/images/b0025b07-8211-49d6-85fd-8c5bb3bc3122 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 20:59:21.051612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa17644a820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.292255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:21.293448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:21.294041 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.294041 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db HTTP/1.1 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '87ef5881-f3f0-4b89-8b67-ddb20c5815db'} Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:21.296770 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 87ef5881-f3f0-4b89-8b67-ddb20c5815db does not exist Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-853aa050-4664-42f2-99ee-358bdb6ccdad'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:21.300898 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1dd3a80c-5cf5-4b85-a3a0-4cd249ebff18 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db" status: 404 len: 194 microversion: 2.1 time: 0.270222 Oct 29 20:59:21.308118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1489/2887] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:21 2022] DELETE /compute/v2.1/os-security-groups/87ef5881-f3f0-4b89-8b67-ddb20c5815db => generated 194 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:21.309533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1763af160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.313491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:21.329979 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e8b1f8f-ebf8-4260-a59f-b6d92b81fa39 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1316 microversion: 2.1 time: 0.796753 Oct 29 20:59:21.333164 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1399/2888] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:20 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1316 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:21.387199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:21.388212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 5858e7f8-b652-47ab-b322-82158e354da0 not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:21.388766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.388766 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0 HTTP/1.1 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5858e7f8-b652-47ab-b322-82158e354da0'} Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:21.391141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 5858e7f8-b652-47ab-b322-82158e354da0 does not exist Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-5926d380-3706-4e33-a7e6-db4c2cab59c8'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:21.395429 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d08999f-35a2-49ac-9bb9-50bc965fbd0e tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0" status: 404 len: 194 microversion: 2.1 time: 0.088736 Oct 29 20:59:21.399764 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1490/2889] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:21 2022] DELETE /compute/v2.1/os-security-groups/5858e7f8-b652-47ab-b322-82158e354da0 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:21.402299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1717e8dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.464234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:21.464894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.security_group_api [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Neutron security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 not found {{(pid=138884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:21.465676 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.465676 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 HTTP/1.1 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9f3e2ab0-27aa-4891-a0b4-5396cb707eb2'} Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:21.468660 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Security group 9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 does not exist Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-770fc8c1-9290-4162-bcd9-61f794353324'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:21.472367 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27935e33-3bb8-4eeb-be87-36987a7835ff tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2" status: 404 len: 194 microversion: 2.1 time: 0.072799 Oct 29 20:59:21.477840 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1400/2890] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:21 2022] DELETE /compute/v2.1/os-security-groups/9f3e2ab0-27aa-4891-a0b4-5396cb707eb2 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:21.479346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.479977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:21.492125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:21.492621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:21.493063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:21.493799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:21.494257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:21.494684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:21.539625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 20:59:21.558452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.559143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:21.576687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:21.577520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:21.578138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:21.579073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:21.579708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:21.580331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:21.693729 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d02e94a-9ff1-4c23-86f8-2ca0b4ca6e79 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 204 len: 0 microversion: 2.1 time: 0.218457 Oct 29 20:59:21.695169 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1491/2891] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 20:59:21 2022] DELETE /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 20:59:21.704893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:21.705495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:21.713986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:21.715011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:21.716262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:21.717817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:21.718596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:21.719042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:22.517304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:22.533374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a24e0015-f8d8-40b5-9c13-80972c00ce11 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.975759 Oct 29 20:59:22.534579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1401/2892] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:21 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:22.541287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:22.542755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:22.560940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:22.563875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:22.564647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:22.566264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:22.566888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:22.567610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:22.989783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:23.004611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97c20e41-6969-4897-a2c8-afff6903d57f tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1647 microversion: 2.1 time: 1.304852 Oct 29 20:59:23.007056 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1492/2893] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:21 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1647 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:23.272578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:23.282258 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9ab94579-6819-489b-b5fd-5dcc290acd26 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1465 microversion: 2.1 time: 0.746438 Oct 29 20:59:23.284342 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1402/2894] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:22 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1465 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:23.385102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:23.442031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=14 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:23.558352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:23.559310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:23.587928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:23.589123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:23.589123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:23.591389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:23.591389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:23.591389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:23.776684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:23.777636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:23.786453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:23.787256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:23.787870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:23.788899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:23.789565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:23.790188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:23.949942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:24.281390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:24.291917 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6702286-1188-44c1-8084-d04dec357e7b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.737454 Oct 29 20:59:24.294491 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1403/2895] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:23 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:24.300747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-170d04f2-1a19-4d99-bab6-de2a5320b322 req-ba876b1a-df6c-49e6-bf8e-8e80c8fc2d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bafcee-4865-4929-842f-d5de12eed8cb", "tag": "c43c74eb-a41f-4f9c-8123-f6fa9262b1b9"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:24.313593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-170d04f2-1a19-4d99-bab6-de2a5320b322 req-ba876b1a-df6c-49e6-bf8e-8e80c8fc2d81 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:24.314451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-170d04f2-1a19-4d99-bab6-de2a5320b322 req-ba876b1a-df6c-49e6-bf8e-8e80c8fc2d81 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:24.315103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-170d04f2-1a19-4d99-bab6-de2a5320b322 req-ba876b1a-df6c-49e6-bf8e-8e80c8fc2d81 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:24.332482 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-170d04f2-1a19-4d99-bab6-de2a5320b322 req-ba876b1a-df6c-49e6-bf8e-8e80c8fc2d81 service nova] Creating event network-changed:c43c74eb-a41f-4f9c-8123-f6fa9262b1b9 for instance 30bafcee-4865-4929-842f-d5de12eed8cb on nch1-master-1 Oct 29 20:59:24.340109 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-170d04f2-1a19-4d99-bab6-de2a5320b322 req-ba876b1a-df6c-49e6-bf8e-8e80c8fc2d81 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042806 Oct 29 20:59:24.341394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1404/2896] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:24.349351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a57d0fc6-a399-449f-9737-5dbbb99d708d req-a8111b5e-947a-4ddd-b0d7-004d10256a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9", "name": "network-vif-plugged", "status": "completed", "tag": "754992b9-b168-405b-9747-f1e7c4cf318b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:24.364371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a57d0fc6-a399-449f-9737-5dbbb99d708d req-a8111b5e-947a-4ddd-b0d7-004d10256a98 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:24.365152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a57d0fc6-a399-449f-9737-5dbbb99d708d req-a8111b5e-947a-4ddd-b0d7-004d10256a98 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:24.365970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a57d0fc6-a399-449f-9737-5dbbb99d708d req-a8111b5e-947a-4ddd-b0d7-004d10256a98 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:24.380479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a57d0fc6-a399-449f-9737-5dbbb99d708d req-a8111b5e-947a-4ddd-b0d7-004d10256a98 service nova] Creating event network-vif-plugged:754992b9-b168-405b-9747-f1e7c4cf318b for instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 on nch2-master-1 Oct 29 20:59:24.395000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a57d0fc6-a399-449f-9737-5dbbb99d708d req-a8111b5e-947a-4ddd-b0d7-004d10256a98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051792 Oct 29 20:59:24.396239 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1405/2897] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:24.403211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:24.405105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:24.419231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:24.420152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:24.421519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:24.422687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:24.423420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:24.424211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:24.487305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:24.489865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:24.494826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:24.495887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lazy-loading 'fault' on Instance uuid f2ae7e10-059c-4abb-a613-8d39f0f18a31 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:59:24.670216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce1ee927fb74b81933abbf58ed4810e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f4e9f3706446a9968a2a42a2125bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:24.690657 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-188e563f-b86f-4313-ac5d-a4d05fe0fd0a tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 200 len: 1305 microversion: 2.1 time: 0.290784 Oct 29 20:59:24.696176 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1406/2898] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:24 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 1305 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:24.711679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-03364a2e-60bb-46c6-a570-dc1c04f43864 req-804f633a-f43f-4d90-bbeb-da9a90574961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ae7e10-059c-4abb-a613-8d39f0f18a31", "name": "network-vif-deleted", "tag": "187afd1d-a55b-4f2f-af00-bc6d4b1b3c44"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:24.736656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-03364a2e-60bb-46c6-a570-dc1c04f43864 req-804f633a-f43f-4d90-bbeb-da9a90574961 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:24.739138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-03364a2e-60bb-46c6-a570-dc1c04f43864 req-804f633a-f43f-4d90-bbeb-da9a90574961 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:24.739918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-03364a2e-60bb-46c6-a570-dc1c04f43864 req-804f633a-f43f-4d90-bbeb-da9a90574961 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:24.775386 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-03364a2e-60bb-46c6-a570-dc1c04f43864 req-804f633a-f43f-4d90-bbeb-da9a90574961 service nova] Creating event network-vif-deleted:187afd1d-a55b-4f2f-af00-bc6d4b1b3c44 for instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 on nch2-master-1 Oct 29 20:59:24.801429 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-03364a2e-60bb-46c6-a570-dc1c04f43864 req-804f633a-f43f-4d90-bbeb-da9a90574961 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102604 Oct 29 20:59:24.804089 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1407/2899] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:25.268932 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5cdffd0-2d3c-49a8-95b2-b77930bd4435 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1616 microversion: 2.1 time: 1.962282 Oct 29 20:59:25.271221 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1493/2900] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:23 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1616 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:25.295137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60a362ba-3704-4138-b5fb-586414956b79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: .version_select at 0x7fa17191a3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1250659953", "policies": ["affinity"]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:25.319868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60a362ba-3704-4138-b5fb-586414956b79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:25.320619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:25.321311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:25.331440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60a362ba-3704-4138-b5fb-586414956b79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:25.335075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:25.337537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:25.342307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:25.347380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:25.348177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:25.348797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:25.445314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60a362ba-3704-4138-b5fb-586414956b79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:25.454304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60a362ba-3704-4138-b5fb-586414956b79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:25.473545 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60a362ba-3704-4138-b5fb-586414956b79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.182922 Oct 29 20:59:25.474884 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1408/2901] 10.222.0.36 () {60 vars in 1174 bytes} [Sat Oct 29 20:59:25 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:25.676284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1762685533", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "45241e72-7724-4fad-946e-ef919852e232"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:25.792850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:59:25.911216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:25.928975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8cefa251-3e2f-42e4-ad41-2c5d2baaef33 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.613752 Oct 29 20:59:25.950271 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1494/2902] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:25 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:25.956893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:25.957833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] [instance: f2ae7e10-059c-4abb-a613-8d39f0f18a31] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:25.964050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:25.964752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:25.965376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:25.966267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:25.966894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:25.967476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:25.989624 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] HTTP exception thrown: Instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 could not be found. Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Request method failure captured: Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 HTTP/1.1 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZOxvErBrbnuZFq1Wjpo-nlsdrykAWandvaSGWZWsuFCHP9nW3HQLGebZacgLSTm-Rre8QjIl_yPOUng0tYUBn2kEVIc8Ykvz286rl9qyZ3AKeoL6wovbIUahM4CM1A9B-7hW34eayseXMAfXpj6u_sCHVtTubbwhHZ_W9eaJTL5Y4Q Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/82f4e9f3706446a9968a2a42a2125bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 82f4e9f3706446a9968a2a42a2125bb4 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1036824926 Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6ce1ee927fb74b81933abbf58ed4810e Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsTestJSON-1036824926-project Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 could not be found. Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'f2ae7e10-059c-4abb-a613-8d39f0f18a31'} Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 could not be found. Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 could not be found. Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:25.993072 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 could not be found. Oct 29 20:59:25.997921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:25.999718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Returning 404 to user: Instance f2ae7e10-059c-4abb-a613-8d39f0f18a31 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:26.000591 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6dcf590e-a07e-4807-937e-7ce18667bee7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31" status: 404 len: 111 microversion: 2.1 time: 0.049193 Oct 29 20:59:26.001156 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1495/2903] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:25 2022] GET /compute/v2.1/servers/f2ae7e10-059c-4abb-a613-8d39f0f18a31 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:26.009826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c642e58e-f747-4fd2-983c-b39ae63367db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1762fe790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:26.287129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:59:26.287629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:59:26.288106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:59:26.288541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:59:26.288956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:59:26.325342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:26.326623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:26.327365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:26.328859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:26.329648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:26.331041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:26.355044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:26.363572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:26.388123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Going to run 2 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:59:26.388262 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c642e58e-f747-4fd2-983c-b39ae63367db tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/1600103f-0b23-45e9-b05a-e96aa699b5fd" status: 202 len: 0 microversion: 2.1 time: 0.382470 Oct 29 20:59:26.388828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1496/2904] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:26 2022] DELETE /compute/v2.1/os-security-groups/1600103f-0b23-45e9-b05a-e96aa699b5fd => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:59:26.396523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c4bfeeb4-363a-472b-984b-2177ac3429f7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] Calling method '.version_select at 0x7fa1762fe1f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:26.399327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:26.454766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=138884) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 29 20:59:26.462117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:26.484067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:26.491367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:26.561086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:26.567080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:26.585616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:26.699236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:26.719723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:26.803346 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c4bfeeb4-363a-472b-984b-2177ac3429f7 tempest-SecurityGroupsTestJSON-1036824926 tempest-SecurityGroupsTestJSON-1036824926-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/a3c181a9-a264-45b1-9c6b-cf2a1abcb749" status: 202 len: 0 microversion: 2.1 time: 0.409404 Oct 29 20:59:26.804071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:26.807638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1497/2905] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:26 2022] DELETE /compute/v2.1/os-security-groups/a3c181a9-a264-45b1-9c6b-cf2a1abcb749 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 20:59:26.815575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:26.875919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc87685b-7420-4add-8793-9322729c4869 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.203890 Oct 29 20:59:26.877316 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1409/2906] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1206 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 29 20:59:26.885802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:26.909371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:26.910947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Searching by: {'deleted': False, 'project_id': '6506ce28d00440bb9f768ec7768a18f7'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 20:59:26.933353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:26.934160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:26.935617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:26.937319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:26.938095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:26.938752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:26.960282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:26.981049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:27.015273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:27.016242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:27.016242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:27.016932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:27.017682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:27.018219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:27.034986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 20:59:27.058910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:27.101898 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-afbbdfa6-bd84-461c-a708-4c06aaf3ad28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.215685 Oct 29 20:59:27.103702 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1498/2907] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 20:59:26 2022] GET /compute/v2.1/servers => generated 1003 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:27.116467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e19307d-5ea4-4726-8b27-16593e5badf8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:27.117180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e19307d-5ea4-4726-8b27-16593e5badf8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:27.406824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e19307d-5ea4-4726-8b27-16593e5badf8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:27.418418 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e19307d-5ea4-4726-8b27-16593e5badf8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1219 microversion: 2.1 time: 0.306030 Oct 29 20:59:27.419187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1499/2908] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:27 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:27.765420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:27.779146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-71ccf273-468d-4d27-8866-cddd28029a26 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.822617 Oct 29 20:59:27.780040 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1410/2909] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:26 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:28.449193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:28.450743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:28.467417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:28.473257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:28.475290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:28.476282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:28.477019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:28.477829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:28.699338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:28.725862 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ada8cfe-3460-4ef1-9e92-696859f743a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1215 microversion: 2.1 time: 0.281849 Oct 29 20:59:28.731320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1500/2910] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:28 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:28.807853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:28.809274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:28.829268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:28.832853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:28.834712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:28.836185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:28.838956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:28.839639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:29.618097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:29.633001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-622473c5-f713-47ea-9185-9c2effbe2ef7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.827898 Oct 29 20:59:29.651775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1411/2911] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:28 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:29.757224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:29.758558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:29.774681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:29.777789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:29.778374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:29.781028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:29.783437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:29.785074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:29.994585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:30.023555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f5c820d-016d-4d3b-a920-4e866dec1f79 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1271 microversion: 2.1 time: 0.269473 Oct 29 20:59:30.024910 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1501/2912] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:29 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:30.656423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:30.657062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:30.663766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:30.676047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:30.676552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:30.677529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:30.679435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:30.680045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:31.078205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:31.079735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:31.129197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:31.130204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:31.130938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:31.132379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:31.135133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:31.135787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:31.456014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:31.464240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:31.466537 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a907fce4-9b3d-4882-8209-756f412cd452 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1277 microversion: 2.1 time: 0.414478 Oct 29 20:59:31.481509 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1502/2913] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:31 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1277 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:31.534680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d0b84d1-8bbf-4bcc-a6d0-1e8dbd9220cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.881962 Oct 29 20:59:31.546277 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1412/2914] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:30 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:32.495050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:32.496301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:32.510893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:32.513304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:32.513798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:32.515024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:32.519355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:32.520072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:32.572040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:32.572797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:32.586231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:32.587619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:32.587619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:32.588133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:32.588800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:32.589436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:32.683412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:32.699852 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-58da6995-2e5f-4054-aba5-7230e3ecd302 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1277 microversion: 2.1 time: 0.209328 Oct 29 20:59:32.715753 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1503/2915] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:32 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:32.961234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:32.990617 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52885eb2-f95a-4341-b64b-c3f6f3656b61 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.426047 Oct 29 20:59:32.992596 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1413/2916] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:32 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:33.724405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:33.725138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:33.732026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:33.732848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:33.733588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:33.734522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:33.735210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:33.735849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:33.930085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:33.947750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83efaa2f-adf9-494a-8c1b-419285a06eae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1277 microversion: 2.1 time: 0.227304 Oct 29 20:59:33.950262 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1504/2917] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:33 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:34.017594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:34.019019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:34.031070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:34.032888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:34.033776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:34.034805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:34.036321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:34.037058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:34.068656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a86942a3-ff71-4547-a104-48344210ce01 req-263baa7f-a37b-4953-9700-95c1c89c440c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bafcee-4865-4929-842f-d5de12eed8cb", "name": "network-vif-plugged", "status": "completed", "tag": "c43c74eb-a41f-4f9c-8123-f6fa9262b1b9"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:34.082191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a86942a3-ff71-4547-a104-48344210ce01 req-263baa7f-a37b-4953-9700-95c1c89c440c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:34.083037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a86942a3-ff71-4547-a104-48344210ce01 req-263baa7f-a37b-4953-9700-95c1c89c440c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:34.083778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a86942a3-ff71-4547-a104-48344210ce01 req-263baa7f-a37b-4953-9700-95c1c89c440c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:34.102534 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a86942a3-ff71-4547-a104-48344210ce01 req-263baa7f-a37b-4953-9700-95c1c89c440c service nova] Creating event network-vif-plugged:c43c74eb-a41f-4f9c-8123-f6fa9262b1b9 for instance 30bafcee-4865-4929-842f-d5de12eed8cb on nch1-master-1 Oct 29 20:59:34.112239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a86942a3-ff71-4547-a104-48344210ce01 req-263baa7f-a37b-4953-9700-95c1c89c440c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048614 Oct 29 20:59:34.113670 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1505/2918] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:34.531332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:34.550114 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8345dd9-e364-4be5-b36d-65d6a62de57a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1322 microversion: 2.1 time: 0.535049 Oct 29 20:59:34.550766 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1414/2919] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:34 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:34.975904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:34.976909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:35.003555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:35.004642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:35.008362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:35.013395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:35.017732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:35.026612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:35.060916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-997129935", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "bad36a5b-055e-432b-a9c1-48ee70be6e17"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:35.183201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] validate_networks() for [('bad36a5b-055e-432b-a9c1-48ee70be6e17', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:59:36.344535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:36.684995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:36.698638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00f384c6-49a6-4bda-ad91-d951eae63be2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 1.727691 Oct 29 20:59:36.715884 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1415/2920] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:34 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:36.723646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:36.727662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:36.736949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:36.738628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:36.739370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:36.740293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:36.740943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:36.741599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:36.826417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=30 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:36.947628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:37.411608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:37.892382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:37.902948 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2fb95dd-9940-4225-9b9d-fb18d95f6b99 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1515 microversion: 2.1 time: 1.185565 Oct 29 20:59:37.903547 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1416/2921] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:36 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1515 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:37.908810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:37.909438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:37.947182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:37.950803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:37.953613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:37.954570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:37.956701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:37.959047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:38.429799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:59:38.430318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:59:38.430680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:59:38.431098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:59:38.445103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:59:38.469956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:38.470777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:38.471279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:38.472132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:38.479306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:38.479933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:38.589179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Getting quotas for project 92ced91d5c874306ae56325583f3bb12. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:38.600146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:38.612796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Getting quotas for user 5e85d4d6aed54dae96f3a7ade33611f6 and project 92ced91d5c874306ae56325583f3bb12. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:38.631374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:59:38.634782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:38.679663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:38.702813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-748d014b-ce3a-4228-b8fa-15c26195195b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 0.798007 Oct 29 20:59:38.703992 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1417/2922] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:37 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:38.743372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:38.760019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:38.779189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eae7986a-961d-4549-99a6-e7e84f5ac90c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.087552 Oct 29 20:59:38.788171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:38.788820 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1506/2923] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:59:38.791263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:38.791920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:38.794833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:38.796122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:38.798097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:38.802946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cab8f4b4-3193-4e99-94f8-66aa2d270019 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:38.803849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cab8f4b4-3193-4e99-94f8-66aa2d270019 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:38.862618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'flavor' on Instance uuid 30bafcee-4865-4929-842f-d5de12eed8cb {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 20:59:38.944502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:38.974562 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c2bdb84-1ca6-4bef-a6fc-1f98cab149ef tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action" status: 200 len: 32 microversion: 2.1 time: 0.268480 Oct 29 20:59:38.975306 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1418/2924] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 20:59:38 2022] POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action => generated 32 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:59:39.006570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:39.009204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:39.040065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cab8f4b4-3193-4e99-94f8-66aa2d270019 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:39.063027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cab8f4b4-3193-4e99-94f8-66aa2d270019 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1217 microversion: 2.1 time: 0.272765 Oct 29 20:59:39.067052 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1507/2925] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:38 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:39.068674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:39.069506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:39.072943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:39.074495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:39.075271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:39.077109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:39.738026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:39.738643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:39.772178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:39.773915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:39.774383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:39.778059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:39.779290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:39.779731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:40.719490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:40.731800 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e1236e28-c35e-4e0b-9b0b-1e35d92188c5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 1.750220 Oct 29 20:59:40.737721 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1419/2926] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:38 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:40.749742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:40.751080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:40.760112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:40.760879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:40.761991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:40.763526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:40.764181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:40.764810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:40.862990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:40.880497 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea88eb77-f780-4677-b81c-98b91f85e64e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1269 microversion: 2.1 time: 0.141071 Oct 29 20:59:40.893992 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1420/2927] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:40 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:40.909610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a73b659e-9a77-44c5-967c-e718d44df4e6 req-fda5e106-d042-4342-a6be-32f400c818ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1", "tag": "495b6acb-43c2-4148-8c3a-5278c7a0b20e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:40.916818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:40.931973 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-326214d0-58b1-47de-b522-23f30e7a839a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 1.206431 Oct 29 20:59:40.942178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1508/2928] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:39 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:40.951853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a73b659e-9a77-44c5-967c-e718d44df4e6 req-fda5e106-d042-4342-a6be-32f400c818ae service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:40.951853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a73b659e-9a77-44c5-967c-e718d44df4e6 req-fda5e106-d042-4342-a6be-32f400c818ae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:40.951853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a73b659e-9a77-44c5-967c-e718d44df4e6 req-fda5e106-d042-4342-a6be-32f400c818ae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:40.972494 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a73b659e-9a77-44c5-967c-e718d44df4e6 req-fda5e106-d042-4342-a6be-32f400c818ae service nova] Creating event network-changed:495b6acb-43c2-4148-8c3a-5278c7a0b20e for instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 on nch2-master-1 Oct 29 20:59:40.985473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a73b659e-9a77-44c5-967c-e718d44df4e6 req-fda5e106-d042-4342-a6be-32f400c818ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088239 Oct 29 20:59:40.987995 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1421/2929] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:41.206443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:41.209352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:41.210149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:41.210854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:41.211942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:41.213174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:41.214865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:41.248494 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d6dc48c-d7f7-4598-9546-717fd171e94d tempest-AZV2TestJSON-1229982118 tempest-AZV2TestJSON-1229982118-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.304640 Oct 29 20:59:41.250906 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1509/2930] 10.222.0.36 () {58 vars in 1164 bytes} [Sat Oct 29 20:59:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 20:59:41.760533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:41.761264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:41.773116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:41.774141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:41.774984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:41.775550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:41.776028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:41.776479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:41.913380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:41.914152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:41.929767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:41.931018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:41.931938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:41.932872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:41.934259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:41.934986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:42.201609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:42.218949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3f60259a-e556-4036-8150-7430a63d254e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1275 microversion: 2.1 time: 0.317351 Oct 29 20:59:42.227326 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1510/2931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:41 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 20:59:42.236488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:42.237138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:42.253756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:42.256337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:42.258179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:42.260328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:42.260989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:42.263048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:42.795059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:42.815017 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea5698a8-65e5-468b-84d3-a34a4030f092 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 1.058604 Oct 29 20:59:42.836853 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1422/2932] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:41 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:43.014215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:43.025732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc966b1f-7f2b-45d4-9685-3c3525e397a4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 0.797126 Oct 29 20:59:43.031689 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1511/2933] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:42 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:43.255617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:43.256654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:43.263812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:43.264689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:43.265411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:43.266406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:43.267104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:43.267763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:43.499066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:43.537442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3213a20-19ba-4eb7-877b-7fa5c6a511ec tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1275 microversion: 2.1 time: 0.287150 Oct 29 20:59:43.557488 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1423/2934] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:43 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:43.840984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:43.842345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:43.852909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:43.853411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:43.857067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:43.858814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:43.861489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:43.863422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:44.062010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:44.063369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:44.091755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:44.095835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:44.107448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:44.111714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:44.113086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:44.116904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:44.338585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:44.355781 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6fd0d8d4-892a-42fa-b078-3d9bcc46e868 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.519688 Oct 29 20:59:44.365491 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1512/2935] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:43 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:44.365491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5e202c0b-3617-4a14-a2ae-901ae8fc4789 req-9a7e25a8-9a2d-4eab-b294-539919a85ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9", "tag": "5505ab66-82a6-4c92-9ae0-fd1973d0b4d0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:44.388554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5e202c0b-3617-4a14-a2ae-901ae8fc4789 req-9a7e25a8-9a2d-4eab-b294-539919a85ee7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:44.389043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5e202c0b-3617-4a14-a2ae-901ae8fc4789 req-9a7e25a8-9a2d-4eab-b294-539919a85ee7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:44.389573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5e202c0b-3617-4a14-a2ae-901ae8fc4789 req-9a7e25a8-9a2d-4eab-b294-539919a85ee7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:44.444764 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5e202c0b-3617-4a14-a2ae-901ae8fc4789 req-9a7e25a8-9a2d-4eab-b294-539919a85ee7 service nova] Creating event network-changed:5505ab66-82a6-4c92-9ae0-fd1973d0b4d0 for instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 on nch2-master-1 Oct 29 20:59:44.450221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5e202c0b-3617-4a14-a2ae-901ae8fc4789 req-9a7e25a8-9a2d-4eab-b294-539919a85ee7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092025 Oct 29 20:59:44.451207 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1513/2936] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:44.573305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:44.574678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:44.591208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:44.612104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc7bf0fb-ddc0-4358-9681-2b8ab59d1cb7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 0.563334 Oct 29 20:59:44.623340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:44.626518 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1424/2937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:44 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:44.630479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:44.631235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:44.634869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:44.637091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:44.643667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:44.909797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:44.926082 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9014e8e-0544-41d1-b425-9a65781ceb1a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1275 microversion: 2.1 time: 0.357422 Oct 29 20:59:44.940267 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1514/2938] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:44 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1275 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:45.385085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:45.386443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:45.416095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:45.417166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:45.421805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:45.424980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:45.427248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:45.430595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:45.654300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:45.656299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:45.694642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:45.700356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:45.701296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:45.707899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:45.709472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:45.711769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:46.116328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:46.126018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b85df139-c0d2-47da-9935-e4aeee31adcc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.746259 Oct 29 20:59:46.145178 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1425/2939] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:45 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:46.152161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:46.153540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:46.160975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:46.161803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:46.162485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:46.164514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:46.165207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:46.166498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:46.496359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:46.509508 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fe86aef5-8128-4846-8bfe-7983fe7665bd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 0.861067 Oct 29 20:59:46.511869 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1515/2940] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:45 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:46.635542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:46.649765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5018669a-9657-4625-94a7-3780a7274e08 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.503079 Oct 29 20:59:46.652326 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1426/2941] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:46 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:46.843313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Calling method '.version_select at 0x7fa17635cca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:46.895485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:46.896626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Neutron security group 9db13330-3a1b-42c0-b672-2491ff92aafe not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:46.897693 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] HTTP exception thrown: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.897693 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Request method failure captured: Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/9db13330-3a1b-42c0-b672-2491ff92aafe HTTP/1.1 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRBl14hQE5Hd6DULgYHTJsbXhoZ8R08PjkUa9FejEKU5BCByd5oo-AbzxJbBb1QpvgU50tzStNnRThsBgAaS8MYNSu-RPgmfBDuftr4BZKA5dMBF82iC1W5fEPmUA-dIcMt2zccb3yRT6ZFgib6MorHH2JzSS3Brp2VVKeENrKt0-w Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1cc1e9f59dbe4dcd95a1fab77d1baec8 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9db13330-3a1b-42c0-b672-2491ff92aafe'} Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:46.900348 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Returning 404 to user: Security group 9db13330-3a1b-42c0-b672-2491ff92aafe does not exist Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-a7a4803f-f974-4a03-8146-de434516ee6b'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7097a554-9bfc-4e72-b382-2ba7b6690519 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/9db13330-3a1b-42c0-b672-2491ff92aafe" status: 404 len: 194 microversion: 2.1 time: 0.387717 Oct 29 20:59:46.904276 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1516/2942] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:46 2022] DELETE /compute/v2.1/os-security-groups/9db13330-3a1b-42c0-b672-2491ff92aafe => generated 194 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:46.938437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1026470191", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "cbaa7903-c033-44ad-a0c0-243af84bb9fd"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:46.969014 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43323721-9470-4c00-a6ae-34a3d5bb5c92 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.052467 Oct 29 20:59:46.970100 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1517/2943] 10.222.0.36 () {58 vars in 1164 bytes} [Sat Oct 29 20:59:46 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 20:59:46.995378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b04a583f-38a9-42aa-bada-438b320d3368 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Calling method '.version_select at 0x7fa17180aa60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:47.066865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] validate_networks() for [('cbaa7903-c033-44ad-a0c0-243af84bb9fd', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:59:47.381358 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b04a583f-38a9-42aa-bada-438b320d3368 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.403735 Oct 29 20:59:47.383287 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1518/2944] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 20:59:46 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:47.410391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:47.411029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:47.421084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:47.421614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:47.422063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:47.423041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:47.423507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:47.424117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:47.806052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:47.815169 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63b89797-7618-4a67-9973-eee2b582c6b5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.422691 Oct 29 20:59:47.820176 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1519/2945] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:47 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:47.843927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-860b5df9-b060-4b29-999b-f1215d6366f8 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Calling method '.version_select at 0x7fa1763aff70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:47.919564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:59:47.923131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:59:47.924049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:59:47.925361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:59:47.926086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:59:47.944078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:47.944683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:47.945305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:47.946916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:47.948560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:47.949668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:47.975398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Getting quotas for project 6a32ad9532c549ac998881289b480b1e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:47.984661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Getting quotas for user f1883d4e1ee043288c2f429da6f2c0e3 and project 6a32ad9532c549ac998881289b480b1e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:48.003345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:59:48.007084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:48.044655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:48.070307 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-01a2dbb5-29a6-4b0e-8e79-957a6997164e tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416608 Oct 29 20:59:48.071317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1427/2946] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:59:48.075674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-860b5df9-b060-4b29-999b-f1215d6366f8 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:48.076377 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-860b5df9-b060-4b29-999b-f1215d6366f8 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 29 20:59:48.076377 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-860b5df9-b060-4b29-999b-f1215d6366f8 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Request method failure captured: Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/020d9739-11a7-46b4-a624-b62fa73b24bd HTTP/1.1 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRBl14hQE5Hd6DULgYHTJsbXhoZ8R08PjkUa9FejEKU5BCByd5oo-AbzxJbBb1QpvgU50tzStNnRThsBgAaS8MYNSu-RPgmfBDuftr4BZKA5dMBF82iC1W5fEPmUA-dIcMt2zccb3yRT6ZFgib6MorHH2JzSS3Brp2VVKeENrKt0-w Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1cc1e9f59dbe4dcd95a1fab77d1baec8 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: exception: Insufficient rights for removing default security group. Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '020d9739-11a7-46b4-a624-b62fa73b24bd'} Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:48.078283 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-860b5df9-b060-4b29-999b-f1215d6366f8 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-fe9fff04-2b0c-49ad-af19-6ec3ba0b03b1'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:48.088239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-860b5df9-b060-4b29-999b-f1215d6366f8 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/020d9739-11a7-46b4-a624-b62fa73b24bd" status: 400 len: 182 microversion: 2.1 time: 0.257361 Oct 29 20:59:48.094526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:48.094526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:48.094858 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1520/2947] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 20:59:47 2022] DELETE /compute/v2.1/os-security-groups/020d9739-11a7-46b4-a624-b62fa73b24bd => generated 182 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 20:59:48.094858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:48.094858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:48.103771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.104183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.105803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:48.106592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.107060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.107493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:48.129239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.131018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.131685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:48.132856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.133715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.134389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:48.327122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:48.339110 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2c1fbf1-f920-4cf8-9a5a-66415fbb250e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 0.266331 Oct 29 20:59:48.359020 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1428/2948] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:48 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:48.372508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-97ca8d18-d515-482f-81ef-97bf5c45a16c tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:48.375883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-97ca8d18-d515-482f-81ef-97bf5c45a16c tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:48.534142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-97ca8d18-d515-482f-81ef-97bf5c45a16c tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:48.547223 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-97ca8d18-d515-482f-81ef-97bf5c45a16c tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1216 microversion: 2.1 time: 0.184753 Oct 29 20:59:48.550577 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1429/2949] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:48 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:48.566007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Calling method '.version_select at 0x7fa171853ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:48.573516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:48.590534 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e227491e-32ec-4f4f-9649-b62f8cffa47f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.500367 Oct 29 20:59:48.613994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1521/2950] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:48 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:48.628616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8b9c9430-e248-4519-9de6-7b97470be00b req-647fbe8c-4686-4223-829f-1adfaaa14d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1", "name": "network-vif-plugged", "status": "completed", "tag": "495b6acb-43c2-4148-8c3a-5278c7a0b20e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:48.651844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b9c9430-e248-4519-9de6-7b97470be00b req-647fbe8c-4686-4223-829f-1adfaaa14d92 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.653603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b9c9430-e248-4519-9de6-7b97470be00b req-647fbe8c-4686-4223-829f-1adfaaa14d92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.654380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b9c9430-e248-4519-9de6-7b97470be00b req-647fbe8c-4686-4223-829f-1adfaaa14d92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:48.665408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:48.668141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.security_group_api [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Neutron security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 not found {{(pid=138884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:48.669017 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] HTTP exception thrown: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.669017 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] Oct 29 20:59:48.669712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8b9c9430-e248-4519-9de6-7b97470be00b req-647fbe8c-4686-4223-829f-1adfaaa14d92 service nova] Creating event network-vif-plugged:495b6acb-43c2-4148-8c3a-5278c7a0b20e for instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 on nch2-master-1 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Request method failure captured: Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-security-groups/5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 HTTP/1.1 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRBl14hQE5Hd6DULgYHTJsbXhoZ8R08PjkUa9FejEKU5BCByd5oo-AbzxJbBb1QpvgU50tzStNnRThsBgAaS8MYNSu-RPgmfBDuftr4BZKA5dMBF82iC1W5fEPmUA-dIcMt2zccb3yRT6ZFgib6MorHH2JzSS3Brp2VVKeENrKt0-w Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1cc1e9f59dbe4dcd95a1fab77d1baec8 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50'} Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:48.673378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Returning 404 to user: Security group 5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 does not exist Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-922d9997-584e-493c-89c2-87f95a9174d2'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d5f75fea-f4bf-4183-a8bf-ffd5a49f7679 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50" status: 404 len: 194 microversion: 2.1 time: 0.122560 Oct 29 20:59:48.677679 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1430/2951] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 20:59:48 2022] GET /compute/v2.1/os-security-groups/5fd2fb21-fca3-4d6f-bd74-990c2dcbcb50 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:48.686326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8b9c9430-e248-4519-9de6-7b97470be00b req-647fbe8c-4686-4223-829f-1adfaaa14d92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070664 Oct 29 20:59:48.687347 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1522/2952] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:48.692114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Action: 'update', calling method: .version_select at 0x7fa17191af70>, body: {"security_group": {"name": "tempest-sg-2085172", "description": "tempest-description-2001731595"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:48.751535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG neutronclient.v2_0.client [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist", "detail": ""}} {{(pid=138884) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 20:59:48.752159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.security_group_api [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Neutron security group e56053f7-3850-4de7-9a71-97fee6144d3c not found {{(pid=138884) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 20:59:48.752736 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] HTTP exception thrown: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.752736 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Request method failure captured: Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/os-security-groups/e56053f7-3850-4de7-9a71-97fee6144d3c HTTP/1.1 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 99 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRBl14hQE5Hd6DULgYHTJsbXhoZ8R08PjkUa9FejEKU5BCByd5oo-AbzxJbBb1QpvgU50tzStNnRThsBgAaS8MYNSu-RPgmfBDuftr4BZKA5dMBF82iC1W5fEPmUA-dIcMt2zccb3yRT6ZFgib6MorHH2JzSS3Brp2VVKeENrKt0-w Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/19cbf4b957344e558d379a4c4c9b15de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 19cbf4b957344e558d379a4c4c9b15de Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1cc1e9f59dbe4dcd95a1fab77d1baec8 Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2069362138-project Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: {"security_group": {"name": "tempest-sg-2085172", "description": "tempest-description-2001731595"}} Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: exception: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e56053f7-3850-4de7-9a71-97fee6144d3c', 'body': {'security_group': {'name': 'tempest-sg-2085172', 'description': 'tempest-description-2001731595'}}} Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 20:59:48.756723 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] Returning 404 to user: Security group e56053f7-3850-4de7-9a71-97fee6144d3c does not exist Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: Neutron server returns request_ids: ['req-b80644c0-9171-4671-9896-6abb6435b544'] {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4cae9572-bc5c-4d11-bbb8-7ff354e2a389 tempest-SecurityGroupsNegativeTestJSON-2069362138 tempest-SecurityGroupsNegativeTestJSON-2069362138-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/e56053f7-3850-4de7-9a71-97fee6144d3c" status: 404 len: 194 microversion: 2.1 time: 0.076468 Oct 29 20:59:48.760931 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1431/2953] 10.222.0.36 () {60 vars in 1289 bytes} [Sat Oct 29 20:59:48 2022] PUT /compute/v2.1/os-security-groups/e56053f7-3850-4de7-9a71-97fee6144d3c => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 20:59:48.848552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:48.850132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:48.862958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.863678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.865300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:48.868562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:48.869088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:48.869749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:49.058061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:49.301184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:49.332073 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1d377dd9-e704-49d9-ad3d-d2a644effe3f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.488526 Oct 29 20:59:49.332671 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1523/2954] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:48 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:49.363568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:49.364219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:49.377735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:49.378152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:49.378604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:49.379333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:49.379910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:49.380355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:49.576621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:49.577262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:49.612205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:49.613008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:49.614831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:49.618327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:49.620374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:49.620834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:49.711410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:50.451336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:50.468583 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-19ae337d-3cbd-45cc-8186-4f484885d9e5 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1220 microversion: 2.1 time: 0.893938 Oct 29 20:59:50.469553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1524/2955] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:49 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1220 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:50.478725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:50.482581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:50.501789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:50.502446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:50.510449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:50.513487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:50.514614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:50.515108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:50.590305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:50.603135 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-01928a8b-198f-4bbb-9802-44c7cbefdb88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 1.243093 Oct 29 20:59:50.603905 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1432/2956] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:49 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:50.717157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1608091469", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:50.812239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 20:59:50.948198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:50.958864 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c31b11f-cfa4-4284-95af-966107c4737e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.488193 Oct 29 20:59:50.960118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1525/2957] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:50 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:50.974968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:50.978796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:50.989507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:50.996140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:50.996839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.000975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.001502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.001997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.232183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:51.364862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:51.395239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-185a091c-889e-472e-b996-48c965cbaa83 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.433392 Oct 29 20:59:51.399685 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1526/2958] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:50 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:51.420126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-82b01a4c-bea9-4c83-bb9c-a91bf40a300f req-2745f0db-0770-4187-9494-cdbd8312b341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8192935b-cb3d-467f-ba5c-327b1f415b3a", "tag": "862f0b76-ffcf-4d9c-9371-e3d198eb4d22"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:51.463725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-82b01a4c-bea9-4c83-bb9c-a91bf40a300f req-2745f0db-0770-4187-9494-cdbd8312b341 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.468443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-82b01a4c-bea9-4c83-bb9c-a91bf40a300f req-2745f0db-0770-4187-9494-cdbd8312b341 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.470309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-82b01a4c-bea9-4c83-bb9c-a91bf40a300f req-2745f0db-0770-4187-9494-cdbd8312b341 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.502078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-82b01a4c-bea9-4c83-bb9c-a91bf40a300f req-2745f0db-0770-4187-9494-cdbd8312b341 service nova] Creating event network-changed:862f0b76-ffcf-4d9c-9371-e3d198eb4d22 for instance 8192935b-cb3d-467f-ba5c-327b1f415b3a on nch1-master-1 Oct 29 20:59:51.514662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-82b01a4c-bea9-4c83-bb9c-a91bf40a300f req-2745f0db-0770-4187-9494-cdbd8312b341 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112433 Oct 29 20:59:51.516169 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1527/2959] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:51.528643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:51.534866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:51.549197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.550524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.551501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.552467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.553291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.554546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.731941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:51.752843 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c7279124-dd24-413b-b4c4-1d9a07226519 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1274 microversion: 2.1 time: 0.235174 Oct 29 20:59:51.753435 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1528/2960] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:51 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:51.772915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:51.773561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:51.798232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.798729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.799164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.800312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.800930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.802161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.939445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 20:59:51.940428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 20:59:51.941072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 20:59:51.941704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 20:59:51.942306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 20:59:51.960140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.962061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.964600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:51.970292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:51.971008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:51.971754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:52.014535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 20:59:52.027315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 20:59:52.069470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 20:59:52.076083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 20:59:52.208954 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-277c6efd-8750-4958-aa9c-d125a544ab1a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603914 Oct 29 20:59:52.215788 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1433/2961] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 20:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 20:59:52.249797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:52.254095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:52.277264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:52.278130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:52.283468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:52.284522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:52.285338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:52.285994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:52.568361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:52.577240 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-51b28893-cb6f-4093-bff1-9e080389107b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1319 microversion: 2.1 time: 0.807550 Oct 29 20:59:52.597041 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1529/2962] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:51 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1319 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:52.597041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-037a0e52-0698-4999-9f46-3ff4efe62cdb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:52.597041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-037a0e52-0698-4999-9f46-3ff4efe62cdb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:52.723007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-037a0e52-0698-4999-9f46-3ff4efe62cdb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:52.734428 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-037a0e52-0698-4999-9f46-3ff4efe62cdb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1193 microversion: 2.1 time: 0.148974 Oct 29 20:59:52.736558 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1530/2963] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:52 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:52.751544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:52.752502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:52.770922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:52.774811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:52.777361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:52.778531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:52.782235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:52.784894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:52.819528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:52.832457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8db65652-08a6-4a4d-8497-709171a82158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.615353 Oct 29 20:59:52.837325 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1434/2964] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:52 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:52.856651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:52.859449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:52.877630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:52.878129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:52.878773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:52.879819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:52.883088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:52.883894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:53.009867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:53.035862 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a85b356a-5f3f-4127-9d57-36842a35cbc8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1274 microversion: 2.1 time: 0.185760 Oct 29 20:59:53.038348 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1435/2965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:52 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:53.336128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:53.352289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f13ee093-c78b-4a3e-93db-90c5ed9673df tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.613572 Oct 29 20:59:53.354344 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1531/2966] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:52 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:53.604866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:53.607111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:53.622641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:53.623170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:53.626119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:53.627219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:53.627762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:53.630853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:53.763631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:53.764302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:53.779035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:53.782495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:53.786172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:53.788859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:53.791343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:53.792009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:53.934280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:53.950362 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34e54df7-9296-455a-83ec-e74f3a2f2445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1197 microversion: 2.1 time: 0.191424 Oct 29 20:59:53.957100 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1532/2967] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:53 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:53.968262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:53.969131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:53.979661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:53.983779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:53.987512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:53.990949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:53.991766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:53.992453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:54.141588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:54.157188 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95ad4645-9f0f-41cc-b332-737a55d6b40e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1468 microversion: 2.1 time: 0.556745 Oct 29 20:59:54.163562 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1436/2968] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:53 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1468 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:54.183109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:54.183959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:54.196103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:54.197628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:54.199297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:54.201142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:54.206625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:54.207443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:54.813550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:54.824008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2747eb0b-3e2e-436b-9733-c31772f5fc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.865493 Oct 29 20:59:54.824596 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1533/2969] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:53 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:54.838178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:54.839098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:54.851291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:54.852307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:54.852307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:54.852904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:54.862047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:54.862371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:54.905090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:54.921690 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a66757f0-5b81-421e-9060-36876bc1f604 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.756712 Oct 29 20:59:54.924324 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1437/2970] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:54 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:54.952942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:54.954489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:54.975579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:54.984584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:54.985251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:54.986287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:54.986981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:54.987649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:55.330503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:55.341556 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c1f5a4f-a998-44a0-84c8-6addc414e32d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1319 microversion: 2.1 time: 0.514457 Oct 29 20:59:55.353233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1534/2971] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:54 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:55.359480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:55.365181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:55.383927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:55.384431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:55.384869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:55.385625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:55.386079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:55.386505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:56.306462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:56.321352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:56.323786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-245c6342-d6ec-42e1-aabf-990681a9b29a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1189 microversion: 2.1 time: 0.970047 Oct 29 20:59:56.324628 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1535/2972] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:55 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1189 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:56.331429 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad416bb2-fe41-4550-84b7-511b12dabdad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 1.396422 Oct 29 20:59:56.332014 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1438/2973] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:54 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:56.340224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:56.341179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:56.348228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:56.348854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:56.355022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:56.360343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:56.360926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:56.361806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:56.362532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:56.363217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:56.378065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:56.378588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:56.380331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:56.381090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:56.381580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:56.382013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.016013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:57.035702 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-748d3a0e-b718-4ab3-89c1-17d931581da0 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.696173 Oct 29 20:59:57.050372 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1439/2974] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:56 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:57.063990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9c3b33b7-8859-4441-a338-5feb56eee860 req-83cd6d15-c5d7-43df-bc77-50188235757a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e30ba39-b480-4515-b34c-d5e0efc0be8b", "tag": "3cf2eb2c-9398-4f1b-b0e1-a60b4eb84ce3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:57.082548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9c3b33b7-8859-4441-a338-5feb56eee860 req-83cd6d15-c5d7-43df-bc77-50188235757a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.083348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9c3b33b7-8859-4441-a338-5feb56eee860 req-83cd6d15-c5d7-43df-bc77-50188235757a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.084042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9c3b33b7-8859-4441-a338-5feb56eee860 req-83cd6d15-c5d7-43df-bc77-50188235757a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.093614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 20:59:57.112051 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9c3b33b7-8859-4441-a338-5feb56eee860 req-83cd6d15-c5d7-43df-bc77-50188235757a service nova] Creating event network-changed:3cf2eb2c-9398-4f1b-b0e1-a60b4eb84ce3 for instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b on nch2-master-1 Oct 29 20:59:57.133886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9c3b33b7-8859-4441-a338-5feb56eee860 req-83cd6d15-c5d7-43df-bc77-50188235757a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076586 Oct 29 20:59:57.134497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:57.135905 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1440/2975] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:57.146599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:57.149597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:57.151910 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-42a5ae00-4496-44ba-b811-c0ae660fdcb8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.825188 Oct 29 20:59:57.160089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.161303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.162119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.163255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.164020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.164700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.171817 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1536/2976] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:56 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:57.354663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:57.355304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:57.367438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.368223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.370034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.371008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.378307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.379054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.597860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:57.612441 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-640e6919-730b-4df6-a306-e292bb75c1f6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1251 microversion: 2.1 time: 0.264259 Oct 29 20:59:57.633328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1537/2977] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:57 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1251 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:57.641367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:57.647173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:57.657643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.658649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.659317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:57.660258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:57.660949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:57.661706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:58.342806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:58.352392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43e80414-0d8a-435f-8f5b-e3d8ff3ed6b9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1319 microversion: 2.1 time: 1.214837 Oct 29 20:59:58.357524 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1441/2978] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:57 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1319 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:58.368941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:58.372322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:58.386218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:58.393370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:58.393858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:58.395008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:58.395742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:58.396349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:58.400184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:58.415297 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e87f7930-180e-4980-96cf-b52f6f536ef6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.780415 Oct 29 20:59:58.441860 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1538/2979] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:57 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:58.448052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:58.450316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:58.463057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:58.463917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:58.465154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:58.466118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:58.466748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:58.468484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:58.979846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:58.994278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-39767aa0-02e7-4da4-bc11-1a86d6cde70b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.635288 Oct 29 20:59:58.995145 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1442/2980] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:58 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:59.000684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:59.001302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:59.020924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.021717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.022338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:59.023226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.025680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.026376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:59.052789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:59.073913 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ce9c3d8-672f-4c52-8f54-70dc7ae5a5bd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.629013 Oct 29 20:59:59.077805 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1539/2981] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:58 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:59.099242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d6768032-2a10-429d-9583-0b3effcd86cd req-48be7c86-569e-440e-beaa-80b9821a3151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9", "name": "network-vif-plugged", "status": "completed", "tag": "5505ab66-82a6-4c92-9ae0-fd1973d0b4d0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 20:59:59.126694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d6768032-2a10-429d-9583-0b3effcd86cd req-48be7c86-569e-440e-beaa-80b9821a3151 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.130424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d6768032-2a10-429d-9583-0b3effcd86cd req-48be7c86-569e-440e-beaa-80b9821a3151 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.130961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d6768032-2a10-429d-9583-0b3effcd86cd req-48be7c86-569e-440e-beaa-80b9821a3151 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:59.158783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d6768032-2a10-429d-9583-0b3effcd86cd req-48be7c86-569e-440e-beaa-80b9821a3151 service nova] Creating event network-vif-plugged:5505ab66-82a6-4c92-9ae0-fd1973d0b4d0 for instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 on nch2-master-1 Oct 29 20:59:59.172960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d6768032-2a10-429d-9583-0b3effcd86cd req-48be7c86-569e-440e-beaa-80b9821a3151 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093337 Oct 29 20:59:59.174050 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1540/2982] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 20:59:59.383524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:59.384617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:59.391556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.392453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.393109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:59.394178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.394849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.395497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:59.479770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 20:59:59.507868 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e23eb632-b9d2-46bb-96d3-9d31fb28265d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.511466 Oct 29 20:59:59.513109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1443/2983] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:58 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 20:59:59.519139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 20:59:59.538799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 20:59:59.557284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.568800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.589268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 20:59:59.591421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 20:59:59.600954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 20:59:59.602625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:00.255654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:00.289412 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b66aa30-3d35-4206-bf0f-4e2543fc2f95 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1319 microversion: 2.1 time: 0.904583 Oct 29 21:00:00.308398 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1541/2984] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:59 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1319 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:00.309337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:00.310609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:00.344786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:00.351312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:00.353199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:00.362835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:00.363413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:00.364715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:00.586615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:00.610655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5bbe6d2b-49c0-44a6-8966-2ca592d2b9f2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 1.095222 Oct 29 21:00:00.611412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1444/2985] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 20:59:59 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:00.623828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:00.624765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:00.641232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:00.642852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:00.645641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:00.646738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:00.647332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:00.647910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.183631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:01.199718 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b200f6ff-734a-4c0b-bc3b-03e1efa8d9ed tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.587016 Oct 29 21:00:01.202553 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1445/2986] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:00 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:01.207411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:01.208207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:01.209513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:01.220881 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1ae830c5-53c1-42ef-84bc-961777b4305f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.926146 Oct 29 21:00:01.222885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.223038 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1542/2987] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:00 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:01.225866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.226546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.230377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.230974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.231493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.250010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-29bf94ad-6c3f-49d6-b418-cc800462fdc6 req-857bb2e0-22e9-4e6d-8c73-2adf01a6115c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8192935b-cb3d-467f-ba5c-327b1f415b3a", "name": "network-vif-plugged", "status": "completed", "tag": "862f0b76-ffcf-4d9c-9371-e3d198eb4d22"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:01.275771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-29bf94ad-6c3f-49d6-b418-cc800462fdc6 req-857bb2e0-22e9-4e6d-8c73-2adf01a6115c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.276379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-29bf94ad-6c3f-49d6-b418-cc800462fdc6 req-857bb2e0-22e9-4e6d-8c73-2adf01a6115c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.276638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-29bf94ad-6c3f-49d6-b418-cc800462fdc6 req-857bb2e0-22e9-4e6d-8c73-2adf01a6115c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.297843 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-29bf94ad-6c3f-49d6-b418-cc800462fdc6 req-857bb2e0-22e9-4e6d-8c73-2adf01a6115c service nova] Creating event network-vif-plugged:862f0b76-ffcf-4d9c-9371-e3d198eb4d22 for instance 8192935b-cb3d-467f-ba5c-327b1f415b3a on nch1-master-1 Oct 29 21:00:01.303683 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-29bf94ad-6c3f-49d6-b418-cc800462fdc6 req-857bb2e0-22e9-4e6d-8c73-2adf01a6115c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058789 Oct 29 21:00:01.312768 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1543/2988] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:01.323883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:01.326419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:01.336559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.337983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.338680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.339966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.341780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.342987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.367952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:01.614195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:01.626090 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-161a027d-c149-466e-ba32-8e34e091e665 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.422241 Oct 29 21:00:01.626689 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1446/2989] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:01 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:01.657086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:01.658201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:01.679552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.680358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.681122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.681732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:01.682211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:01.682633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:01.823118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:01.836527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c86cc09-8445-4838-94d6-b617331ad189 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1319 microversion: 2.1 time: 0.522249 Oct 29 21:00:01.842682 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1544/2990] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:01 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:01.962918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:01.974455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b9eb70f3-3ba0-4f62-a42e-2774d615fc61 req-6fa85009-4eaf-462e-afec-ef1e2617afae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6ba4b7-b2b8-4a27-8b72-071029f7e3db", "tag": "a092463f-6017-47bf-8c5c-1eca16d4b176"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:01.996882 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ac1bc7dd-5e05-472a-94a3-bb88395186dc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.349989 Oct 29 21:00:01.999225 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1447/2991] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:01 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:02.002322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b9eb70f3-3ba0-4f62-a42e-2774d615fc61 req-6fa85009-4eaf-462e-afec-ef1e2617afae service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.002928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b9eb70f3-3ba0-4f62-a42e-2774d615fc61 req-6fa85009-4eaf-462e-afec-ef1e2617afae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.003755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b9eb70f3-3ba0-4f62-a42e-2774d615fc61 req-6fa85009-4eaf-462e-afec-ef1e2617afae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.040907 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b9eb70f3-3ba0-4f62-a42e-2774d615fc61 req-6fa85009-4eaf-462e-afec-ef1e2617afae service nova] Creating event network-changed:a092463f-6017-47bf-8c5c-1eca16d4b176 for instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db on nch1-master-1 Oct 29 21:00:02.047075 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b9eb70f3-3ba0-4f62-a42e-2774d615fc61 req-6fa85009-4eaf-462e-afec-ef1e2617afae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078726 Oct 29 21:00:02.048396 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1545/2992] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:02.224574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:02.225206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:02.227192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:02.228267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=14 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:02.236655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.236768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.237200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.237862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.239287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.239287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.250261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:02.251259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:02.270945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.288256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.289043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.290396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.290966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.291499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.633485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:02.652788 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2747b02-bf2c-47be-b97b-89fa2a59ec0d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.408197 Oct 29 21:00:02.653605 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1546/2993] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:02 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:02.664264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:02.665601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:02.672987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:02.684634 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d88c6ba7-b0ab-4d38-ae8e-aedd2c99f34a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1317 microversion: 2.1 time: 0.464339 Oct 29 21:00:02.685230 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1448/2994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:02 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:02.690256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.690751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.691188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.691894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.693207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.693928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.732553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:02.872736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:02.873394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:02.880903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.881636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.882847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.883953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:02.884588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:02.886941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:02.908219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:02.924737 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eba1fb29-67d0-4ef2-b7c6-b92f4666dda9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.268401 Oct 29 21:00:02.925555 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1547/2995] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:02 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:03.023374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:03.024744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:03.037235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.037988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.041220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.042246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.045536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.046210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.222294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:03.233284 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c57c61c1-fa98-40ad-b9c8-33909db17185 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1469 microversion: 2.1 time: 0.364977 Oct 29 21:00:03.238032 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1449/2996] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:02 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:03.333327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:03.358412 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64df163c-812e-4638-9cb7-79b8c5021cdf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.336263 Oct 29 21:00:03.375420 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1548/2997] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:03 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:03.385155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:03.392528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:03.394963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Searching by: {'reservation_id': 'r-y4oelbyv', 'deleted': False, 'project_id': '6506ce28d00440bb9f768ec7768a18f7'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:03.415586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.417921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.420652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.421912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.423417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.425847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.453113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9ac267b-43cc-4bb6-b6a5-2035a24a4fc4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Action: 'create', calling method: .version_select at 0x7fa1717da430>, body: {"keypair": {"name": "tempest-keypair-87961250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND9UfC454hZOs32YbaNkypTwCkghwcwzvumyX6cQhwVLcR+7JwPB9gBoYyXS1mD8Gm7Gy6NyeuwhlWC8tdZa1gAlv5f5fKbzHy0D7UNIM/OoP/NK77xmNrjZyrW4oVO2Q=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:03.490705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c9ac267b-43cc-4bb6-b6a5-2035a24a4fc4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Getting quotas for project 709aa4b8c6024e04bd16f02cdbe1d6f0. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:03.499740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c9ac267b-43cc-4bb6-b6a5-2035a24a4fc4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Getting quotas for user 041ea2e030a84da2a3e866238e7318cd and project 709aa4b8c6024e04bd16f02cdbe1d6f0. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:03.533404 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9ac267b-43cc-4bb6-b6a5-2035a24a4fc4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.292061 Oct 29 21:00:03.535236 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1450/2998] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:03.563534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3241c219-c6e0-4be4-869a-aff2b68c1823 req-c47e2f32-57c0-4144-b28d-601926a4750c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e30ba39-b480-4515-b34c-d5e0efc0be8b", "name": "network-vif-plugged", "status": "completed", "tag": "3cf2eb2c-9398-4f1b-b0e1-a60b4eb84ce3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:03.580118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3241c219-c6e0-4be4-869a-aff2b68c1823 req-c47e2f32-57c0-4144-b28d-601926a4750c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.581091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3241c219-c6e0-4be4-869a-aff2b68c1823 req-c47e2f32-57c0-4144-b28d-601926a4750c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.582172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3241c219-c6e0-4be4-869a-aff2b68c1823 req-c47e2f32-57c0-4144-b28d-601926a4750c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.598945 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3241c219-c6e0-4be4-869a-aff2b68c1823 req-c47e2f32-57c0-4144-b28d-601926a4750c service nova] Creating event network-vif-plugged:3cf2eb2c-9398-4f1b-b0e1-a60b4eb84ce3 for instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b on nch2-master-1 Oct 29 21:00:03.600714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:03.606837 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3241c219-c6e0-4be4-869a-aff2b68c1823 req-c47e2f32-57c0-4144-b28d-601926a4750c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049777 Oct 29 21:00:03.611033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1451/2999] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:03.679959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:03.680782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:03.696262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.696762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.699629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.702578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.703667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.704274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.782933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:03.802858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:03.807142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:03.808150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:03.971239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:03.984116 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb0cc83d-4923-472a-acd2-674ad9ba0b3d tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.309854 Oct 29 21:00:03.985851 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1452/3000] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:03 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:03.998757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:04.006519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:04.018952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.019459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.019899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.020618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.021075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.021530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.290092 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc661dcc-b8b7-4647-9052-3aea5564a81d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-y4oelbyv" status: 200 len: 2930 microversion: 2.1 time: 0.912758 Oct 29 21:00:04.291479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1549/3001] 10.222.0.36 () {58 vars in 1197 bytes} [Sat Oct 29 21:00:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-y4oelbyv => generated 2930 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:04.322714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:04.324018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:04.346441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.349509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.351163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.356652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.358292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.359739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.432199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:04.447215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6bc0c746-6b21-4b5f-8242-1e35b869b619 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1507 microversion: 2.1 time: 0.457710 Oct 29 21:00:04.447907 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1453/3002] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:03 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:04.453439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4e693472-5480-4529-8bc9-6f7ef70460b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:04.494700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.server_groups [None req-4e693472-5480-4529-8bc9-6f7ef70460b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Querying cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) for 2 instances {{(pid=138884) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 21:00:04.495955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e693472-5480-4529-8bc9-6f7ef70460b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.496934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e693472-5480-4529-8bc9-6f7ef70460b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.500190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e693472-5480-4529-8bc9-6f7ef70460b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.543969 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4e693472-5480-4529-8bc9-6f7ef70460b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/45241e72-7724-4fad-946e-ef919852e232" status: 200 len: 266 microversion: 2.1 time: 0.094671 Oct 29 21:00:04.551445 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1454/3003] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:00:04 2022] GET /compute/v2.1/os-server-groups/45241e72-7724-4fad-946e-ef919852e232 => generated 266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:04.556809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:04.558047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:04.567972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.569890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.570652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.571819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.572945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.573685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.751425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:04.765253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c04877db-5dd9-48fe-8c1f-4dafd4066c29 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.469002 Oct 29 21:00:04.766598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1550/3004] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:04 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:04.779834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:04.781589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:04.794464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.797934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.798603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.800178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.803035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.803706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.854037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:04.864178 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e92d3c0a-9329-4450-8b61-7614397ee132 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.311309 Oct 29 21:00:04.870189 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1455/3005] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:04 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:04.881106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:04.888166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:04.895539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.895539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.895539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:04.896244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:04.896711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:04.897144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.145281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:05.155984 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-314f1636-0dbf-46be-ab9d-2c9628fe0f92 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1507 microversion: 2.1 time: 0.388099 Oct 29 21:00:05.157181 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1551/3006] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:04 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:05.162732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:05.163457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:05.166227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:05.172228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.173223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.174403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.175370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.176073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.176712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.296181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1e9d3ec5-f4bb-4fb2-b969-aa742c74a93d tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1620 microversion: 2.1 time: 0.422889 Oct 29 21:00:05.297404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1456/3007] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:04 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1620 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:05.303240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "OS-DCF:diskConfig": "AUTO"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:05.323644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:05.339603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.340362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.342598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.344137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.344778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.345761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.545851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:05.546548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:05.547294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:05.548138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:05.548790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:05.587388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:05.597278 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e0ff6899-491a-4768-a168-ea4f20eed648 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1316 microversion: 2.1 time: 0.438760 Oct 29 21:00:05.604238 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1552/3008] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:05 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:05.622878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:05.624025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:05.644494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.645322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.646337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.647294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.648003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.648808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.673175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:05.694268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.697281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.698654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.699617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.700069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.700553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.715072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:05.773177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67728b77-a828-487a-9ebb-f2eebb19ea9e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "POST /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a/action" status: 202 len: 1109 microversion: 2.1 time: 0.474099 Oct 29 21:00:05.773865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1457/3009] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:05 2022] POST /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a/action => generated 1109 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 21:00:05.866441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1491626269", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "124d3f22-ec1d-4628-8a18-613319f9be07"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:05.947061 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac205bc3-a8f5-4adb-a80f-bb7dabf3cda8 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 200 len: 1619 microversion: 2.1 time: 0.341087 Oct 29 21:00:05.949254 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1553/3010] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:05 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 1619 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:05.959900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] validate_networks() for [('124d3f22-ec1d-4628-8a18-613319f9be07', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:05.976851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:05.977843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:05.985537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.986182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.987306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:05.988504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:05.989232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:05.989817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:06.608241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:06.619908 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fc523eb7-a4a7-438c-8612-6e1589323060 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.669508 Oct 29 21:00:06.623760 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1554/3011] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:05 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:06.638449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:06.644665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:06.653649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:06.654166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:06.655276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:06.656447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:06.657102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:06.658058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:06.994255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:07.003755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8988a2a-0484-4780-95bf-48a945bcad84 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.377580 Oct 29 21:00:07.004346 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1555/3012] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:06 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:07.014326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:07.016466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:07.024031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:07.024531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:07.025053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:07.025785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:07.026245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:07.026673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:07.227469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:07.228073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:07.228585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:07.229010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:07.229427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:07.239674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:07.240165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:07.240610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:07.241347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:07.241835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:07.242479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:07.261655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Getting quotas for project 3236a32c26f94f90975d4e417177f175. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:07.267352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Getting quotas for user 80d6086f20614063923d7ed5c042e195 and project 3236a32c26f94f90975d4e417177f175. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:07.269869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:07.282506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:07.283814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:07.286377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:07.290937 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83363683-2266-460d-bbcd-a13ad7bd38dd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.285547 Oct 29 21:00:07.291884 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1556/3013] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:07 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:07.299036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: .version_select at 0x7fa176344c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1274754782", "policies": ["anti-affinity"]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:07.318628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:07.324635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:07.336002 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5424d81b-08d6-4f98-b83c-820d2b25e2a4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560436 Oct 29 21:00:07.336667 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1458/3014] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:07.348328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:07.348328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:07.354592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:07.355106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:07.355664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:07.356383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:07.356852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:07.359555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:07.375484 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [22be7d3f-3c68-493e-a533-41213e7f7ed6] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:00:07.515632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:07.524207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a51dc48-0d1b-4c82-92a0-acc8c99bb1a8 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1505 microversion: 2.1 time: 0.185058 Oct 29 21:00:07.525810 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1459/3015] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:07 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:07.531678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b4a2921a-e1ea-4478-81b7-96fd157d7549"}], "security_groups": [{"name": "tempest-securitygroup--1508623022"}], "key_name": "tempest-keypair-87961250", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:07.651288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] validate_networks() for [('b4a2921a-e1ea-4478-81b7-96fd157d7549', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:08.110719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:08.112019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:08.112836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:08.113648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:08.114172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:08.127749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:08.128626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:08.129766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:08.130894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:08.131703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:08.132734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:08.155821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Getting quotas for project 709aa4b8c6024e04bd16f02cdbe1d6f0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:08.162363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Getting quotas for user 041ea2e030a84da2a3e866238e7318cd and project 709aa4b8c6024e04bd16f02cdbe1d6f0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:08.181091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:08.183896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:08.261378 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b746595-fcef-4dc3-966a-44f7381e5d5e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.734236 Oct 29 21:00:08.262249 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1460/3016] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:08.268877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-665636335", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "124d3f22-ec1d-4628-8a18-613319f9be07"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:08.346049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] validate_networks() for [('124d3f22-ec1d-4628-8a18-613319f9be07', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:08.385492 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [22be7d3f-3c68-493e-a533-41213e7f7ed6] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56322. Oct 29 21:00:08.408072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:08.414079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:08.455035 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92c8f134-fedc-4705-9e62-219fdc171895 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 1.161477 Oct 29 21:00:08.456852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1557/3017] 10.222.0.36 () {60 vars in 1174 bytes} [Sat Oct 29 21:00:07 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:08.464190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:08.465628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:08.476848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:08.477913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:08.479154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:08.480138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:08.480832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:08.481570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:08.515441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:00:08.624453 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7143ac88-73a3-4e56-87b1-4f818dd249fd tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 204 len: 0 microversion: 2.1 time: 0.165090 Oct 29 21:00:08.625980 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1558/3018] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:00:08 2022] DELETE /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:08.632839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:08.633955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:08.641409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:08.642319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:08.643212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:08.644162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:08.644851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:08.645955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.026836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:09.041966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d345e5bb-792f-4f9e-8651-d0e3a24eeff0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.414414 Oct 29 21:00:09.043394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1559/3019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:08 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:09.049105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:09.049997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:09.066260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.066893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.067454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.068206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.068878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.070158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.077232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:09.167145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:09.167585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:09.168098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:09.168781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:09.169211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:09.179145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.179748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.180099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.180827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.181291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.181754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.200817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Getting quotas for project 3236a32c26f94f90975d4e417177f175. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:09.206885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Getting quotas for user 80d6086f20614063923d7ed5c042e195 and project 3236a32c26f94f90975d4e417177f175. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:09.221895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:09.224229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:09.241287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:09.249645 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f05aaaa8-08e6-47ba-8382-46ce80bbcefe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.205041 Oct 29 21:00:09.250224 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1560/3020] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:09 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:09.267626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:09.268261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:09.270542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-abdf89a6-4e9c-4b24-b04e-fb29f40fc1df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006652 Oct 29 21:00:09.271734 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1461/3021] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:09.275061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.275546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.276038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.276748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.277822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.278248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.283467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:09.284262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:09.291704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.292207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.292657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.293372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.294026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.294474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.363229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:09.370869 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-747c24b4-6a03-4071-b7b1-39f272d08800 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1228 microversion: 2.1 time: 0.107040 Oct 29 21:00:09.377508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1561/3022] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:09 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1228 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:09.379826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:09.380087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:09.387029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.388396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.389569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.390445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.390905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.391337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.512798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:09.521489 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e901e09-98ef-4c73-818e-9d480222cbc8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1521 microversion: 2.1 time: 0.242491 Oct 29 21:00:09.522063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1462/3023] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:09 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:09.526781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1960402119", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4fc28cd3-2fe0-4f47-81c6-dd9816786b61"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:09.571266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:09.583971 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b898c0e-4bde-4f7a-a3d1-09a62dd45045 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1511 microversion: 2.1 time: 0.211116 Oct 29 21:00:09.589230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:09.604258 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1562/3024] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:09 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:09.609531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-621184289", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "451", "networks": [{"uuid": "124d3f22-ec1d-4628-8a18-613319f9be07"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:09.671707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] validate_networks() for [('124d3f22-ec1d-4628-8a18-613319f9be07', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:09.975597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:09.976873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:09.977678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:09.978273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:09.978860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:09.997067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.997575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:09.998570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:09.999365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:09.999769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.000202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.021425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:10.030144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:10.046087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Going to run 2 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:10.054096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:10.112814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:10.118898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:10.162067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:10.168136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:10.211620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=77f58caf-98ff-43b0-ac4e-a9521e2b81ea,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:10.235316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:10.236633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:10.238319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:10.238896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:10.239445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:10.255136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.256024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.256724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.257813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.258542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.259193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.285139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Getting quotas for project 3236a32c26f94f90975d4e417177f175. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:10.291025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Getting quotas for user 80d6086f20614063923d7ed5c042e195 and project 3236a32c26f94f90975d4e417177f175. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:10.305639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:10.308373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:10.341602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:10.350398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:10.371990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:10.396822 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-029dc099-3f60-401f-a263-10e46a5672c7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791286 Oct 29 21:00:10.397617 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1563/3025] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:10.422087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:10.430311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'server_group_members'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:10.513806 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e047afa8-43ed-4959-b08e-6d523d250039 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.990407 Oct 29 21:00:10.517396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1463/3026] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 21:00:10.526188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:10.526826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:10.556676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.557241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.557838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.558617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.559092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.559579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.691525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:10.692320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:10.706722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.707445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.718017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.722180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.724803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.726047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:10.803859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:00:10.924082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:10.935523 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5be8da0d-940a-4da3-91bc-d73671a36ef2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.416335 Oct 29 21:00:10.941086 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1464/3027] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:10 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:10.949615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-910bc883-34cc-4754-909e-be11fb32de10 req-49b5b840-8c79-409b-a6d4-32113562a950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6ba4b7-b2b8-4a27-8b72-071029f7e3db", "name": "network-vif-plugged", "status": "completed", "tag": "a092463f-6017-47bf-8c5c-1eca16d4b176"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:10.974885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-910bc883-34cc-4754-909e-be11fb32de10 req-49b5b840-8c79-409b-a6d4-32113562a950 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:10.977363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-910bc883-34cc-4754-909e-be11fb32de10 req-49b5b840-8c79-409b-a6d4-32113562a950 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:10.978530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-910bc883-34cc-4754-909e-be11fb32de10 req-49b5b840-8c79-409b-a6d4-32113562a950 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.000512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7463e5de-4d26-4eaa-bd35-659013d52969 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 204 len: 0 microversion: 2.42 time: 0.601389 Oct 29 21:00:11.003322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-910bc883-34cc-4754-909e-be11fb32de10 req-49b5b840-8c79-409b-a6d4-32113562a950 service nova] Creating event network-vif-plugged:a092463f-6017-47bf-8c5c-1eca16d4b176 for instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db on nch1-master-1 Oct 29 21:00:11.004866 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1564/3028] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:00:10 2022] DELETE /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:00:11.010495 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-910bc883-34cc-4754-909e-be11fb32de10 req-49b5b840-8c79-409b-a6d4-32113562a950 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067399 Oct 29 21:00:11.011276 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1465/3029] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:11.017395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.018530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.026939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.027871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.028684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.029693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.031222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.031896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.045814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.046818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.074945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.077791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.078176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.078978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.088076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.088523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.214524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.223162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a27dda8c-783a-49b1-8c71-a2272a14c215 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1276 microversion: 2.1 time: 0.210562 Oct 29 21:00:11.226866 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1466/3030] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.241919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f0c75008-20ea-4596-bb28-721934142f8c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.242670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f0c75008-20ea-4596-bb28-721934142f8c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.331328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f0c75008-20ea-4596-bb28-721934142f8c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.346089 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f0c75008-20ea-4596-bb28-721934142f8c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1220 microversion: 2.1 time: 0.115829 Oct 29 21:00:11.347236 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1467/3031] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.354947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.356365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.365142 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3e19346b-72a6-4e91-adb8-2b53cc1a5856 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.345136 Oct 29 21:00:11.370476 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1565/3032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.381040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.381295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.381807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.383250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Searching by: {'deleted': False, 'project_id': '6506ce28d00440bb9f768ec7768a18f7'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:11.389954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.390947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.391498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.392300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.394363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.395085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.411603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.412872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.413330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.414320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.415018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.415465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.451101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:11.504314 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad99daf4-cc08-40e4-9357-e00bfb280e28 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.155832 Oct 29 21:00:11.504920 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1468/3033] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.516282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.517018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.523129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.523619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.524061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.524767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.525430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.525786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.662112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.676399 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61cb479c-5296-4fdb-b3a4-61317fab643a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1501 microversion: 2.1 time: 0.303177 Oct 29 21:00:11.677302 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1566/3034] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1501 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.687058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.687549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.695856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.702604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.703173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.703541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.704271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.704731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.705445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.708111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-123c2fdd-0eab-486a-a2c2-eb29d1f3f488 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1469 microversion: 2.1 time: 0.202088 Oct 29 21:00:11.708958 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1469/3035] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.714322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be6e2b8e-7d31-4469-bc72-b98e44c536b4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.715346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be6e2b8e-7d31-4469-bc72-b98e44c536b4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.807757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be6e2b8e-7d31-4469-bc72-b98e44c536b4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:11.816963 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be6e2b8e-7d31-4469-bc72-b98e44c536b4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1219 microversion: 2.1 time: 0.106670 Oct 29 21:00:11.817675 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1470/3036] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:11.827641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:11.828279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:11.847249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.847771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.848846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:11.849169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:11.849676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:11.850203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.152028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.156094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.162166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.163475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.165062 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e975fbb-000a-4492-82e1-5d52817819d6 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2963 microversion: 2.42 time: 0.486440 Oct 29 21:00:12.165695 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1567/3037] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2963 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:12.166377 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f008c4c3-4706-4ff7-8933-1cd69fe514a6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1516 microversion: 2.1 time: 0.347653 Oct 29 21:00:12.169834 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1471/3038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:11 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1516 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:12.170714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-71cca3fb-30c4-4f12-96b6-f7846d738047 req-c399acd6-52d5-47d6-a617-a783dd10eb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e30ba39-b480-4515-b34c-d5e0efc0be8b", "name": "network-vif-deleted", "tag": "3cf2eb2c-9398-4f1b-b0e1-a60b4eb84ce3"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:12.177705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.178324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.182201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-71cca3fb-30c4-4f12-96b6-f7846d738047 req-c399acd6-52d5-47d6-a617-a783dd10eb06 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.183142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-71cca3fb-30c4-4f12-96b6-f7846d738047 req-c399acd6-52d5-47d6-a617-a783dd10eb06 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.183815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-71cca3fb-30c4-4f12-96b6-f7846d738047 req-c399acd6-52d5-47d6-a617-a783dd10eb06 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.194561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.195602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.196231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.197406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.198038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.198631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.198783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-71cca3fb-30c4-4f12-96b6-f7846d738047 req-c399acd6-52d5-47d6-a617-a783dd10eb06 service nova] Creating event network-vif-deleted:3cf2eb2c-9398-4f1b-b0e1-a60b4eb84ce3 for instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b on nch2-master-1 Oct 29 21:00:12.204375 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-71cca3fb-30c4-4f12-96b6-f7846d738047 req-c399acd6-52d5-47d6-a617-a783dd10eb06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037132 Oct 29 21:00:12.205270 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1568/3039] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:12.211329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e33fa6d9-c421-49db-b628-8dfce216966b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:12.213930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e33fa6d9-c421-49db-b628-8dfce216966b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 45bfa30e-a81e-4909-ac11-2c8ea165c18c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.220671 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e33fa6d9-c421-49db-b628-8dfce216966b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Instance 45bfa30e-a81e-4909-ac11-2c8ea165c18c could not be found. Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e33fa6d9-c421-49db-b628-8dfce216966b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/45bfa30e-a81e-4909-ac11-2c8ea165c18c/action HTTP/1.1 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 14 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: {"rescue": {}} Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 45bfa30e-a81e-4909-ac11-2c8ea165c18c could not be found. Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '45bfa30e-a81e-4909-ac11-2c8ea165c18c', 'body': {'rescue': {}}} Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bfa30e-a81e-4909-ac11-2c8ea165c18c could not be found. Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bfa30e-a81e-4909-ac11-2c8ea165c18c could not be found. Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:12.230096 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:12.235877 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:12.235877 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:12.235877 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:12.235877 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:12.235877 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bfa30e-a81e-4909-ac11-2c8ea165c18c could not be found. Oct 29 21:00:12.235877 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:12.237588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e33fa6d9-c421-49db-b628-8dfce216966b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 404 to user: Instance 45bfa30e-a81e-4909-ac11-2c8ea165c18c could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:12.239639 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e33fa6d9-c421-49db-b628-8dfce216966b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/45bfa30e-a81e-4909-ac11-2c8ea165c18c/action" status: 404 len: 111 microversion: 2.1 time: 0.031510 Oct 29 21:00:12.242389 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1569/3040] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:12 2022] POST /compute/v2.1/servers/45bfa30e-a81e-4909-ac11-2c8ea165c18c/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:12.252729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:12.253956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.262544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.263041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.263624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.264847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.265813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.266435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.369310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26230687-5420-4c8e-b22e-4e7ae87e2992 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.121249 Oct 29 21:00:12.370090 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1570/3041] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:12 2022] POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:12.375715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.376424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.384877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.385381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.385956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.386674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.387162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.387601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.426109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.438382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23fcde0d-f037-4873-bce2-0ff49eef7010 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.267316 Oct 29 21:00:12.441543 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1472/3042] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:12.449596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.450356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.460368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.461005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.461578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.462406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.462965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.463492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.493251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.504421 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-116f3ae3-4870-4eab-9893-f4f62c293c8d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1282 microversion: 2.1 time: 0.133168 Oct 29 21:00:12.506865 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1571/3043] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:12.511425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.512032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.518564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.518992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.519432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.520138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.520594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.521028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.556620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.568378 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d9f3c23f-2d69-463b-be9b-f34e9dcfece2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1272 microversion: 2.1 time: 0.124892 Oct 29 21:00:12.570745 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1473/3044] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:12.575694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.576470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.591043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.594253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.594865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.595704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.596271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.601095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.744828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.759503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-04d19638-95e8-4f6f-accd-21eea4eb05cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1521 microversion: 2.1 time: 0.251560 Oct 29 21:00:12.768862 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1572/3045] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:12.783892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:12.793040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7943e707-1085-47d3-96a4-25e7aecfc331 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.220913 Oct 29 21:00:12.801532 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1474/3046] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:12.806748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.807824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.815412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.816591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.817206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.818129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.818595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.819128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.845045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:12.846402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:12.852512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.853138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.853841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:12.854708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:12.855248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:12.855842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.166593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.177979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7b7370c-d381-4606-a78f-f8f5bbeafbd6 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1469 microversion: 2.1 time: 0.406969 Oct 29 21:00:13.178560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1573/3047] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:13.198900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:13.199868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:13.209224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.210190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.210969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.212572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.213774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.214557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.215272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.223871 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f50a670-9b6f-464f-a986-460619215267 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1223 microversion: 2.1 time: 0.383511 Oct 29 21:00:13.238855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1475/3048] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:12 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1223 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:13.465355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:13.466156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:13.475955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.478834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.481097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.482382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.483237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.485422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.520254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.531569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.533040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.534323 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-11e9cfac-95c4-4e5f-97f1-a2e83ae5b007 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2963 microversion: 2.42 time: 0.341058 Oct 29 21:00:13.534878 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1574/3049] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:13 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2963 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:13.550854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:13.552885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:13.575314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.575860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.577502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.578252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.578699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.579131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.687523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.703828 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-311f6b43-1670-4439-93e5-f7948ae2dd61 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1282 microversion: 2.1 time: 0.165536 Oct 29 21:00:13.706233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1575/3050] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:13 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:13.721350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:13.722241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:13.725698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:13.736276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.737136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.737718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.738632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.739766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.740407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.786630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:13.874202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.882694 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c78dfc0e-e667-438d-9b17-bb1fe2537776 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1272 microversion: 2.1 time: 0.173832 Oct 29 21:00:13.885244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:13.895242 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1576/3051] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:13 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:13.897309 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89dfdc74-ad97-42a2-b201-21383f0ef262 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1293 microversion: 2.1 time: 0.436319 Oct 29 21:00:13.899552 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1476/3052] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:13 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1293 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:13.916413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:13.917331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:13.921669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:13.923537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:13.927028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.927527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.931308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.932091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.933696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.934427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.935169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.936191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.936923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:13.937166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:13.937960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:13.938616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.545038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:14.553926 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e06344c1-0261-48b5-a9b8-b8505c08dfb1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.653123 Oct 29 21:00:14.555233 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1477/3053] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:13 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:14.561113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:14.561928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:14.572969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.579500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.580187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.581087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.581737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.582350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.646197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.647955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.650005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:14.651571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.652220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lazy-loading 'fault' on Instance uuid 4e30ba39-b480-4515-b34c-d5e0efc0be8b {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:00:14.662273 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-797f45ff-d30e-49f1-95e3-a18a16177da0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1501 microversion: 2.1 time: 0.765441 Oct 29 21:00:14.674520 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1577/3054] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:13 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1501 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:14.689028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e74ba19d-9134-4c06-9ea1-255409d024bd req-af1ed37e-9d31-4b56-a94e-a30777baf4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dac4092-a0df-4b14-9e9b-7466aa2b9bed", "tag": "113548a2-6bfd-4a9b-888f-e3ae8c805483"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:14.718951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e74ba19d-9134-4c06-9ea1-255409d024bd req-af1ed37e-9d31-4b56-a94e-a30777baf4b8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.719456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e74ba19d-9134-4c06-9ea1-255409d024bd req-af1ed37e-9d31-4b56-a94e-a30777baf4b8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.719883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e74ba19d-9134-4c06-9ea1-255409d024bd req-af1ed37e-9d31-4b56-a94e-a30777baf4b8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.755321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e74ba19d-9134-4c06-9ea1-255409d024bd req-af1ed37e-9d31-4b56-a94e-a30777baf4b8 service nova] Creating event network-changed:113548a2-6bfd-4a9b-888f-e3ae8c805483 for instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed on nch1-master-1 Oct 29 21:00:14.768401 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e74ba19d-9134-4c06-9ea1-255409d024bd req-af1ed37e-9d31-4b56-a94e-a30777baf4b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092350 Oct 29 21:00:14.769486 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1578/3055] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:14.778749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:14.781618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:14.783548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1883d4e1ee043288c2f429da6f2c0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a32ad9532c549ac998881289b480b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:14.788259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:14.800091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.802270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.803045 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5360562a-28ff-400a-87c0-e97ca180c555 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 200 len: 1306 microversion: 2.1 time: 0.246360 Oct 29 21:00:14.804006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.804988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.805957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1478/3056] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:14 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 1306 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:14.806679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.808664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.814668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:14.821284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:14.831897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.837200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.841488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.842526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.843304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.843983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.954995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:14.964042 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3bbb7f9d-6765-45a3-b303-f11ae84f3fb9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1271 microversion: 2.1 time: 0.193353 Oct 29 21:00:14.964882 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1579/3057] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:14 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:14.971031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:14.974708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:14.981301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.983538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.983994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:14.984718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:14.985182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:14.985655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.016489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'flavor' on Instance uuid 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:00:15.034484 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Cannot 'rescue' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state paused Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action HTTP/1.1 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 14 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: {"rescue": {}} Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'rescue' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state paused Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9', 'body': {'rescue': {}}} Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 in vm_state paused. Cannot rescue while the instance is in this state. Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state paused Oct 29 21:00:15.036501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state paused Oct 29 21:00:15.041190 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:15.042925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 409 to user: Cannot 'rescue' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state paused {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:15.044047 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d2210fa-287f-4104-960c-0588c4b08c4d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action" status: 409 len: 144 microversion: 2.1 time: 0.077375 Oct 29 21:00:15.046476 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1580/3058] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:14 2022] POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action => generated 144 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:00:15.074360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:15.075013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:15.085643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.086695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.087211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.088860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.089337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.089833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.332937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:15.346296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:15.348529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:15.351857 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca8224ab-11b2-42e9-acb2-a40f78a5b852 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2963 microversion: 2.42 time: 0.543856 Oct 29 21:00:15.367421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:15.375881 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1479/3059] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:14 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2963 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:15.382878 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ac0e442-7c9c-49f3-9980-04cbd557f3cb tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.335018 Oct 29 21:00:15.383457 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1581/3060] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:15 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:15.387994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:15.393203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:15.399108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:15.399762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:15.408443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.416508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.422136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.422356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.423290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.423784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.424490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.424715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.425257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.425631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.426517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.426636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.566263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:15.579943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-175f4e59-e746-41d4-a161-c626d3bbee72 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1278 microversion: 2.1 time: 0.202512 Oct 29 21:00:15.593620 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1480/3061] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:15 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:15.594610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:15.598223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:15.601773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.602603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.603134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.603963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.604514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.605026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.705997 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5fdf3a3f-bd41-417f-8ca6-07d92589dbda tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.117096 Oct 29 21:00:15.707394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1481/3062] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:15 2022] POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:15.734095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:15.735579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:15.761822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.762433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.762987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.766272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.766907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.767501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.783558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:15.796775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-576ebdc8-f99c-4714-be80-c89bbead77db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1474 microversion: 2.1 time: 0.411741 Oct 29 21:00:15.809489 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1582/3063] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:15 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:15.809489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:15.809489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:15.814618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.815410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.816392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:15.817397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:15.818104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:15.819060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.179577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:16.188180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:16.194283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb15a7b5-6d25-4a62-a7d6-aa490f6750a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.471956 Oct 29 21:00:16.194887 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1482/3064] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:15 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:16.209363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:16.210774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:16.215685 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2e85bf9-6c08-411f-ac7d-ff98332fbe1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1508 microversion: 2.1 time: 0.415643 Oct 29 21:00:16.216842 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1583/3065] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:15 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:16.217679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.218335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.218923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.219816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.220699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.221285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.223270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2091049733", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:16.246831 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b HTTP/1.1 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4e30ba39-b480-4515-b34c-d5e0efc0be8b'} Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:16.251315 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:16.256058 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cee8a2f9-28d0-4bfa-98c0-bb0d3dd1dbcc tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 404 len: 111 microversion: 2.1 time: 0.057212 Oct 29 21:00:16.257844 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1483/3066] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:16 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:16.265743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:16.266671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:16.277910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.278126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.278930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.279774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.280642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.281078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.293127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:16.430074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:16.439457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-88ac4c4f-8a85-4350-89cd-628faf943e9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1271 microversion: 2.1 time: 0.180547 Oct 29 21:00:16.440032 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1484/3067] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:16 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:16.445100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1632345895", "metadata": {"image_type": "test"}}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:16.448005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:16.454789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.455739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.456350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.457241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.458819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.459264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.480249 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b/action HTTP/1.1 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 112 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1632345895", "metadata": {"image_type": "test"}}} Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4e30ba39-b480-4515-b34c-d5e0efc0be8b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1632345895', 'metadata': {'image_type': 'test'}}}} Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 21:00:16.484978 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:16.490670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5af9faa7-f6a9-4c9e-924f-bcf261ea6a90 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "POST /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b/action" status: 404 len: 111 microversion: 2.1 time: 0.047225 Oct 29 21:00:16.496508 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1485/3068] 10.222.0.36 () {60 vars in 1279 bytes} [Sat Oct 29 21:00:16 2022] POST /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:16.502573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c0b41f03-65d1-4137-b8f8-407dc55f938a req-9b60c5ea-8272-45fc-92a9-7bbd5cee7915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f747a7c1-75a9-41a9-a1b6-020088da4261", "tag": "bc32e650-f1fc-4c66-911e-f6315cba5925"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:16.512348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c0b41f03-65d1-4137-b8f8-407dc55f938a req-9b60c5ea-8272-45fc-92a9-7bbd5cee7915 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.513085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c0b41f03-65d1-4137-b8f8-407dc55f938a req-9b60c5ea-8272-45fc-92a9-7bbd5cee7915 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.513662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c0b41f03-65d1-4137-b8f8-407dc55f938a req-9b60c5ea-8272-45fc-92a9-7bbd5cee7915 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.525576 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c0b41f03-65d1-4137-b8f8-407dc55f938a req-9b60c5ea-8272-45fc-92a9-7bbd5cee7915 service nova] Creating event network-changed:bc32e650-f1fc-4c66-911e-f6315cba5925 for instance f747a7c1-75a9-41a9-a1b6-020088da4261 on nch1-master-1 Oct 29 21:00:16.530898 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c0b41f03-65d1-4137-b8f8-407dc55f938a req-9b60c5ea-8272-45fc-92a9-7bbd5cee7915 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033117 Oct 29 21:00:16.531571 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1486/3069] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:16.536960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:16.537796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:16.544158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.544778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.545823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.546578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.547117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.547966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.893746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:16.918255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:16.922242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:16.925807 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dda4452f-995b-4955-b69f-5e4974b0f93d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2963 microversion: 2.42 time: 0.391756 Oct 29 21:00:16.950206 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1487/3070] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:16 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2963 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:16.964336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:16.966013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:16.981885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.982956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.984714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:16.985638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:16.987040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:16.987661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.003804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:17.004403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:17.005178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:17.005864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:17.007682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:17.020914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.021598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.022143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.023591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.024163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.024703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.059794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:17.081639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:17.123647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:17.127580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 554bb8c9-aed0-4928-bea2-6b8b93e1feb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:17.171995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:17.184608 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55d3b995-3530-45e7-bb4c-14ee2afbae06 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.230825 Oct 29 21:00:17.185219 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1488/3071] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:16 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:17.190683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4cb523e-8ea9-4a62-ad45-54d19326166b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1976356115", "metadata": {"image_type": "test"}}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:17.193587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d4cb523e-8ea9-4a62-ad45-54d19326166b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Failed to fetch instance by id tempest-invalid-935996717 {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 21:00:17.194281 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d4cb523e-8ea9-4a62-ad45-54d19326166b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance tempest-invalid-935996717 could not be found. Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4cb523e-8ea9-4a62-ad45-54d19326166b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/tempest-invalid-935996717/action HTTP/1.1 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 112 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1976356115", "metadata": {"image_type": "test"}}} Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance tempest-invalid-935996717 could not be found. Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'tempest-invalid-935996717', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1976356115', 'metadata': {'image_type': 'test'}}}} Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-935996717 could not be found. Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:17.196094 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-935996717 could not be found. Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-935996717 could not be found. Oct 29 21:00:17.200639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.202406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4cb523e-8ea9-4a62-ad45-54d19326166b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance tempest-invalid-935996717 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:17.203482 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4cb523e-8ea9-4a62-ad45-54d19326166b tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "POST /compute/v2.1/servers/tempest-invalid-935996717/action" status: 404 len: 100 microversion: 2.1 time: 0.016576 Oct 29 21:00:17.204211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1489/3072] 10.222.0.36 () {60 vars in 1246 bytes} [Sat Oct 29 21:00:17 2022] POST /compute/v2.1/servers/tempest-invalid-935996717/action => generated 100 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:17.209919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:17.210881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:17.228143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.228970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.229670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.230632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.231311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.231980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.236383 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-88d97890-bf9e-4fe7-a942-a1492fe43ddf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016733 Oct 29 21:00:17.246604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1584/3073] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:17.255782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-17167c56-5895-4b1e-b9c5-953e5585d2a9 req-25cdc7c4-97a0-4cf8-8900-1a9363abd057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-unplugged", "status": "completed", "tag": "0edb5772-4240-4851-ad33-8160a8554967"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:17.278019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17167c56-5895-4b1e-b9c5-953e5585d2a9 req-25cdc7c4-97a0-4cf8-8900-1a9363abd057 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.278718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17167c56-5895-4b1e-b9c5-953e5585d2a9 req-25cdc7c4-97a0-4cf8-8900-1a9363abd057 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.280001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17167c56-5895-4b1e-b9c5-953e5585d2a9 req-25cdc7c4-97a0-4cf8-8900-1a9363abd057 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.297189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-17167c56-5895-4b1e-b9c5-953e5585d2a9 req-25cdc7c4-97a0-4cf8-8900-1a9363abd057 service nova] Creating event network-vif-unplugged:0edb5772-4240-4851-ad33-8160a8554967 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:17.306808 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-17167c56-5895-4b1e-b9c5-953e5585d2a9 req-25cdc7c4-97a0-4cf8-8900-1a9363abd057 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058056 Oct 29 21:00:17.308401 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1585/3074] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:17.319291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a970628-b528-4d41-9af2-621676cba0a3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-128262357"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:17.322911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a970628-b528-4d41-9af2-621676cba0a3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 21:00:17.323621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0a970628-b528-4d41-9af2-621676cba0a3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a970628-b528-4d41-9af2-621676cba0a3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 56 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: {"createImage": {"name": "tempest-test-snap-128262357"}} Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-128262357'}}} Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.325855 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a970628-b528-4d41-9af2-621676cba0a3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:17.330681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a970628-b528-4d41-9af2-621676cba0a3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017827 Oct 29 21:00:17.333243 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1586/3075] 10.222.0.36 () {60 vars in 1275 bytes} [Sat Oct 29 21:00:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:17.338488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:17.339278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:17.352869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.353363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.353856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.356049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.356558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.357045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.430911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:17.443138 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca7d8428-117d-4f16-83f5-04f043559d2f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.237224 Oct 29 21:00:17.444039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1490/3076] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:17 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:17.454639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:17.455580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:17.471341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.473301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.475443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.476235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.476719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.480941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.663901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:17.697721 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3f1a1796-cc57-4eeb-b594-b9312558e3dc tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.363018 Oct 29 21:00:17.706359 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1587/3077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:17 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:17.743100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:17.755478 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d891d0ff-0a6a-46b4-a032-80c2aaa25294 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1516 microversion: 2.1 time: 0.305734 Oct 29 21:00:17.756429 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1491/3078] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:17 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:17.764604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f3247b2-4a7d-4382-b217-1eb2a8408773 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:17.765379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9513e929-f167-47fe-bdac-1f4375c59df3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-379316707"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:17.768382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f3247b2-4a7d-4382-b217-1eb2a8408773 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 554bb8c9-aed0-4928-bea2-6b8b93e1feb5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:17.768823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9513e929-f167-47fe-bdac-1f4375c59df3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 21:00:17.769577 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-9513e929-f167-47fe-bdac-1f4375c59df3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9513e929-f167-47fe-bdac-1f4375c59df3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 56 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: {"createImage": {"name": "tempest-test-snap-379316707"}} Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-379316707'}}} Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.772195 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 21:00:17.776502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:17.778633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9513e929-f167-47fe-bdac-1f4375c59df3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:17.781340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9513e929-f167-47fe-bdac-1f4375c59df3 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.022511 Oct 29 21:00:17.786289 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1492/3079] 10.222.0.36 () {60 vars in 1281 bytes} [Sat Oct 29 21:00:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:17.793932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:17.795593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:17.804574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.805605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.806230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.807247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:17.807903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:17.808570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:17.825308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f3247b2-4a7d-4382-b217-1eb2a8408773 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 554bb8c9-aed0-4928-bea2-6b8b93e1feb5] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:00:18.035296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:18.050998 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-508fcd63-beb0-4eeb-bd39-eff4c1e3900a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1279 microversion: 2.1 time: 0.262314 Oct 29 21:00:18.051587 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1493/3080] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:17 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:18.070528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:18.072516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:18.093524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.097887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.098747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.101581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.102355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.103014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.145824 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b HTTP/1.1 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4e30ba39-b480-4515-b34c-d5e0efc0be8b'} Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:18.158631 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14f3edee-1404-4e7e-acf5-46716a42c733 tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 404 len: 111 microversion: 2.1 time: 0.104821 Oct 29 21:00:18.163057 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1494/3081] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:00:18 2022] DELETE /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:18.168715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:18.169336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:18.193218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.193675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.194175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.194903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.195773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.196218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.421192 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.scheduler.client.report [None req-5f3247b2-4a7d-4382-b217-1eb2a8408773 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Deleted allocations for instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 Oct 29 21:00:18.476616 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f3247b2-4a7d-4382-b217-1eb2a8408773 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5" status: 204 len: 0 microversion: 2.1 time: 0.766914 Oct 29 21:00:18.477260 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1588/3082] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:00:17 2022] DELETE /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:18.486586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:18.487213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] [instance: 4e30ba39-b480-4515-b34c-d5e0efc0be8b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:18.521262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.531277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.533010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.534194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.538813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.540226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.571871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] HTTP exception thrown: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Request method failure captured: Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b HTTP/1.1 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRB09FMKXF1A0ywZYUopvnBmqZR29mFpup-eZEp3ge-ePKQwnHiwCaDC_47IAn9Tlo3x8gmaq3mrC8BxuEmTBul9GvnLPdh5-38LWcXnj_aC8oyMFEpts6zMtjww_EY6yijMPR4MQJ8_Pd7al4pTJEA-yZRhRed_-16X14LPRkkmDM Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a32ad9532c549ac998881289b480b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a32ad9532c549ac998881289b480b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a32ad9532c549ac998881289b480b1e Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1603986296 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f1883d4e1ee043288c2f429da6f2c0e3 Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ImagesNegativeTestJSON-1603986296-project Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '4e30ba39-b480-4515-b34c-d5e0efc0be8b'} Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:18.574074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. Oct 29 21:00:18.579280 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:18.583172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] Returning 404 to user: Instance 4e30ba39-b480-4515-b34c-d5e0efc0be8b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:18.584368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c33f9cd3-0007-4c66-a01d-7ca3d3a8a91f tempest-ImagesNegativeTestJSON-1603986296 tempest-ImagesNegativeTestJSON-1603986296-project] 10.222.0.36 "GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b" status: 404 len: 111 microversion: 2.1 time: 0.105997 Oct 29 21:00:18.585187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1589/3083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:18 2022] GET /compute/v2.1/servers/4e30ba39-b480-4515-b34c-d5e0efc0be8b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:18.590426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:18.591352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:18.600014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.601003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.601670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:18.603685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:18.604329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:18.604923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.030605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.049165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.052120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.054109 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d2f74053-d380-44fc-9a2b-8892b6ad4433 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2942 microversion: 2.42 time: 0.891978 Oct 29 21:00:19.055228 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1495/3084] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:18 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2942 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:19.064303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:19.066033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:19.075594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.076699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.077711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.078899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.079611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.080541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.129603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.144097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59afa7ae-0068-46b8-8381-da5173fa660a tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.557458 Oct 29 21:00:19.144949 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1590/3085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:18 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:19.162270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:19.163292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 554bb8c9-aed0-4928-bea2-6b8b93e1feb5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:19.174465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.174968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.175587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.176459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.177074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.190254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.219663 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 HTTP/1.1 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '554bb8c9-aed0-4928-bea2-6b8b93e1feb5'} Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:19.221558 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:19.225611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:19.225611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:19.225611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:19.225611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:19.225611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:00:19.225611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:19.227611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:19.228692 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90c4701f-8b96-4023-bde5-10d195857f41 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5" status: 404 len: 111 microversion: 2.1 time: 0.082640 Oct 29 21:00:19.229797 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1591/3086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:19 2022] GET /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:19.237322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:19.238361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:19.246089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.246880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.247536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.248549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.249222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.249901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.443478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.454155 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4ba97416-8eaf-4c56-9877-450f9fe6b67a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.397269 Oct 29 21:00:19.455039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1496/3087] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:19 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:19.462124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:19.463116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:19.470466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.470969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.471419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.472254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.472594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.473029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.630231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.640806 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-587b236a-7fd3-49ca-911f-08736eb1cd68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1277 microversion: 2.1 time: 0.184213 Oct 29 21:00:19.651124 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1497/3088] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:19 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:19.664485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1500520641", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:19.666415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:19.681527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f09a8b1-0582-4b77-8996-195f4ac052cd tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.450228 Oct 29 21:00:19.682534 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1592/3089] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:19 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:19.708145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:19.713125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:19.722422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.723285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.723984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.724950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.725665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.726316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.750364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:19.760766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'flavor' on Instance uuid 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:00:19.882926 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a510314b-fe66-4acf-8811-7e3070e6b2f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action" status: 200 len: 32 microversion: 2.1 time: 0.196142 Oct 29 21:00:19.883551 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1593/3090] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:19 2022] POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:00:19.895577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:19.896299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:19.907764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.908374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.908822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:19.910480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:19.910960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:19.911531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.339365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:20.348988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6f8461a-31bc-432b-a7fa-dfa0bdabbeee tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.458370 Oct 29 21:00:20.349633 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1594/3091] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:19 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:20.359112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f5c5aecf-2d5c-433d-9cf9-00a3a211d9f4 req-1da6b801-e5a2-4d30-b589-476b263e4ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc1211c-d363-4842-85d7-aae9dca8ed11", "tag": "71a1e32e-f54b-4ae4-9df4-a9283d8f8353"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:20.372032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f5c5aecf-2d5c-433d-9cf9-00a3a211d9f4 req-1da6b801-e5a2-4d30-b589-476b263e4ee3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:20.372519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f5c5aecf-2d5c-433d-9cf9-00a3a211d9f4 req-1da6b801-e5a2-4d30-b589-476b263e4ee3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:20.372995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f5c5aecf-2d5c-433d-9cf9-00a3a211d9f4 req-1da6b801-e5a2-4d30-b589-476b263e4ee3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.386427 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f5c5aecf-2d5c-433d-9cf9-00a3a211d9f4 req-1da6b801-e5a2-4d30-b589-476b263e4ee3 service nova] Creating event network-changed:71a1e32e-f54b-4ae4-9df4-a9283d8f8353 for instance fbc1211c-d363-4842-85d7-aae9dca8ed11 on nch2-master-1 Oct 29 21:00:20.391551 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f5c5aecf-2d5c-433d-9cf9-00a3a211d9f4 req-1da6b801-e5a2-4d30-b589-476b263e4ee3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040297 Oct 29 21:00:20.392647 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1595/3092] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:20.398328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:20.399042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:20.406190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:20.406825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:20.407275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.407982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:20.408440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:20.408872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.901908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:20.902532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:20.904989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:20.906045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:20.906904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:20.930898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:20.932659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:20.933417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:20.935089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.936227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:20.938243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:20.938791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.948259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:20.949791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:20.955798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f272768f-65ef-495c-8d74-6f872e3354bd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2921 microversion: 2.42 time: 0.561845 Oct 29 21:00:20.958410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1596/3093] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:20 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2921 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:20.979154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:20.979154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:20.984132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:20.990854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:20.993721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:20.994461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:20.997368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:20.999569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:21.002242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:21.003708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:21.007360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:21.008888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:21.010245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:21.047004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:21.087278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-80b10a66-6288-4f1a-a8ff-4bae037800d9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434934 Oct 29 21:00:21.088640 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1498/3094] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:21.095653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:21.096393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:21.105034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:21.106291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:21.106961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:21.107961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:21.108667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:21.109344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:21.958785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:21.970588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:21.973925 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c28e7b0c-b735-40ed-b4ad-8ea1514f1462 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 1.013557 Oct 29 21:00:21.974525 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1597/3095] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:20 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:21.990403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:21.990403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:22.005984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:22.012338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.012879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.014024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a680e82b-1cfb-47ab-a5e2-b07161be8edc tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.921931 Oct 29 21:00:22.015103 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1499/3096] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:21 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:22.026190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:22.027016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.027895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:22.029199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.031575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.033160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.050944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.053682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.054539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.056857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.058440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.060061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.392043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.404321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.437403 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7a702b7-a8ad-4d4d-9912-9abdb08714c6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.414902 Oct 29 21:00:22.439526 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc41166a-971a-42e5-81dc-5196fb3f5cfc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.460697 Oct 29 21:00:22.440355 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1598/3097] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:21 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:22.441056 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1500/3098] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:22 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:22.450803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:22.452539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b1849c7b-7feb-4c58-a35b-cb570cec4314 req-ce731ddc-ec0a-4dc0-9680-302b60b1af71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-unplugged", "status": "completed", "tag": "99491349-fec3-4967-9bed-d1945e2bccad"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:22.454321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:22.467766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.468845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.469962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.471191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.471728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.472376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.482702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b1849c7b-7feb-4c58-a35b-cb570cec4314 req-ce731ddc-ec0a-4dc0-9680-302b60b1af71 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.483606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b1849c7b-7feb-4c58-a35b-cb570cec4314 req-ce731ddc-ec0a-4dc0-9680-302b60b1af71 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.484266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b1849c7b-7feb-4c58-a35b-cb570cec4314 req-ce731ddc-ec0a-4dc0-9680-302b60b1af71 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.521925 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b1849c7b-7feb-4c58-a35b-cb570cec4314 req-ce731ddc-ec0a-4dc0-9680-302b60b1af71 service nova] Creating event network-vif-unplugged:99491349-fec3-4967-9bed-d1945e2bccad for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:22.527650 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b1849c7b-7feb-4c58-a35b-cb570cec4314 req-ce731ddc-ec0a-4dc0-9680-302b60b1af71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084439 Oct 29 21:00:22.528699 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1501/3099] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:22.535088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:22.535891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:22.543396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.544005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.544580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.546041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.546555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.548244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.617704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.627019 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-965bd959-b8d7-4b2f-84de-be4b9b3030a1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1273 microversion: 2.1 time: 0.182668 Oct 29 21:00:22.642578 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1599/3100] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:22 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:22.648775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:22.649662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:22.656770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.657263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.657771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.658586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.659328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.659791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:22.909258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.929678 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f51c4b6e-0bc3-4a11-8d10-30036bef673b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.398634 Oct 29 21:00:22.931145 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1502/3101] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:22 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:22.954894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.964759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ec3955fe-1412-4803-920c-078776d960b4 req-68279696-69b0-4ccf-90dd-52c5b39eae3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e2076d-c50e-4718-bbf3-53d7f7dca2af", "tag": "7e7cb1ab-7f45-45f3-993c-cc5cb44b4ee2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:22.981257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.986564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ec3955fe-1412-4803-920c-078776d960b4 req-68279696-69b0-4ccf-90dd-52c5b39eae3b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:22.988104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:22.989541 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c8fd35b-49ad-4eb6-8126-e26b43f0f140 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2921 microversion: 2.42 time: 0.345732 Oct 29 21:00:22.989814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ec3955fe-1412-4803-920c-078776d960b4 req-68279696-69b0-4ccf-90dd-52c5b39eae3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:22.990452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1600/3102] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:22 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2921 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:22.993586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ec3955fe-1412-4803-920c-078776d960b4 req-68279696-69b0-4ccf-90dd-52c5b39eae3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.009772 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ec3955fe-1412-4803-920c-078776d960b4 req-68279696-69b0-4ccf-90dd-52c5b39eae3b service nova] Creating event network-changed:7e7cb1ab-7f45-45f3-993c-cc5cb44b4ee2 for instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af on nch1-master-1 Oct 29 21:00:23.018969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:23.020817 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ec3955fe-1412-4803-920c-078776d960b4 req-68279696-69b0-4ccf-90dd-52c5b39eae3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060963 Oct 29 21:00:23.022110 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1503/3103] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:23.022264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:23.028903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.030104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.031939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.031939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.031939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.032456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.038625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:23.039343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:23.048235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.049295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.049975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.051511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.052167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.054470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.315442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:23.324990 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdf1196f-756e-4f89-89e6-c6f96c392fc9 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.321476 Oct 29 21:00:23.338140 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1601/3104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:23 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:23.345851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:23.346596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9e8d55d7-fc9f-46e9-b328-24d5fda20b21 req-ed9609ea-3400-4ad0-9b6c-2054864740bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3", "tag": "76fe2d78-74ce-4cb2-9cdc-37877fafce37"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:23.354074 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75d620fd-fb79-4d3c-bf59-2ce3092d2cc8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.319567 Oct 29 21:00:23.355095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1504/3105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:23 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:23.356645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e8d55d7-fc9f-46e9-b328-24d5fda20b21 req-ed9609ea-3400-4ad0-9b6c-2054864740bc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.357171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e8d55d7-fc9f-46e9-b328-24d5fda20b21 req-ed9609ea-3400-4ad0-9b6c-2054864740bc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.358040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e8d55d7-fc9f-46e9-b328-24d5fda20b21 req-ed9609ea-3400-4ad0-9b6c-2054864740bc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.369340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9e8d55d7-fc9f-46e9-b328-24d5fda20b21 req-ed9609ea-3400-4ad0-9b6c-2054864740bc service nova] Creating event network-changed:76fe2d78-74ce-4cb2-9cdc-37877fafce37 for instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 on nch1-master-1 Oct 29 21:00:23.375099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9e8d55d7-fc9f-46e9-b328-24d5fda20b21 req-ed9609ea-3400-4ad0-9b6c-2054864740bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035717 Oct 29 21:00:23.375715 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1602/3106] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:23.468865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:23.469593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:23.473278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:23.473939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:23.480175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.480361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.480668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.480834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.481166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.481633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.481904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.482421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.482853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.483044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.483815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.484564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.696801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:23.704964 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9462f9a6-b837-45cc-af1b-a29f4ccf953f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.240894 Oct 29 21:00:23.718417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:23.719287 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1603/3107] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:23 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:23.722555 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6402f3ae-8d0c-4ddd-a087-f8d4bc66a2ef tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.259721 Oct 29 21:00:23.724356 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1505/3108] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:23 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:23.735500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:23.736581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:23.744302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.744873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.750273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.751247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.752055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.752384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.844488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:23.853618 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0c77066d-8033-45a2-b1cc-3136e99689b0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1281 microversion: 2.1 time: 0.132941 Oct 29 21:00:23.854212 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1604/3109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:23 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1281 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:23.958554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:23.959282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:23.969343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.971125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.971795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:23.972811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:23.974577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:23.975283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:24.023476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:24.024096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:24.036163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:24.036701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:24.037154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:24.037909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:24.038375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:24.038808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:24.388623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:24.404465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:24.407801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:24.413325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b5964ab-4539-4ed3-beee-c4f69ff39583 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2874 microversion: 2.42 time: 0.393635 Oct 29 21:00:24.414004 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1605/3110] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:24 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2874 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:00:24.425932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:24.426838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:24.454970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:24.455798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:24.459846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:24.461013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:24.461707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:24.462315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:24.567253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:24.580229 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98bd22cc-b6bd-49bd-ab52-83b1e62d7eb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.626574 Oct 29 21:00:24.586249 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1506/3111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:23 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:24.592163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:24.596365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:24.616126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:24.616919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:24.617603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:24.618866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:24.622028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:24.623346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.131936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:25.146528 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a814517e-6628-4fbe-8056-2433a4003ca3 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.730670 Oct 29 21:00:25.155805 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1606/3112] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:24 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:25.161263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-unplugged", "status": "completed", "tag": "4f8b913f-10da-41e4-a3f2-8e6662803dda"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-unplugged", "status": "completed", "tag": "abaf2156-3eee-4776-87af-f4ae60c180d6"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-unplugged", "status": "completed", "tag": "498fed4d-2d39-41a9-aa73-628dd56d08c4"}, {"server_uuid": "4dac4092-a0df-4b14-9e9b-7466aa2b9bed", "name": "network-vif-plugged", "status": "completed", "tag": "113548a2-6bfd-4a9b-888f-e3ae8c805483"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:25.182455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:25.187251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.188010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.189283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.193615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-07cea5fe-0883-4c20-aa57-aaebad04abb3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.605138 Oct 29 21:00:25.196511 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1507/3113] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:24 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:25.208046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:25.211785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:25.235041 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Creating event network-vif-unplugged:4f8b913f-10da-41e4-a3f2-8e6662803dda for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:25.238598 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Creating event network-vif-unplugged:abaf2156-3eee-4776-87af-f4ae60c180d6 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:25.238984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.239706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.240979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Creating event network-vif-unplugged:498fed4d-2d39-41a9-aa73-628dd56d08c4 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:25.241693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.242855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] Creating event network-vif-plugged:113548a2-6bfd-4a9b-888f-e3ae8c805483 for instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed on nch1-master-1 Oct 29 21:00:25.245141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.247635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.248625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.273196 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b084098b-15d0-4447-9e21-30a1d1f6b9cd req-50062c08-606e-452c-b4fe-c429d16e72e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.109090 Oct 29 21:00:25.277534 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1607/3114] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:25.295423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:25.296720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:25.314620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.315206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.315894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.316834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.317516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.318156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.727944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:25.737791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:25.742936 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65191533-f947-4cc9-a90d-a2d42d0c51d8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.461179 Oct 29 21:00:25.744016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1608/3115] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:25 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:25.749426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:25.751437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:25.759882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.760606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.761211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.761610 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-97ece782-eb2f-48c1-8715-f78e22b1483a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.562907 Oct 29 21:00:25.762234 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1508/3116] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:25 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:25.762668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.763525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.764121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.766837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f58caf-98ff-43b0-ac4e-a9521e2b81ea", "tag": "d63ecde2-aa99-4ec3-9ef5-6df5a600ae85"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-deleted", "tag": "99491349-fec3-4967-9bed-d1945e2bccad"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:25.779402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.779782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.780208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.795270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] Creating event network-changed:d63ecde2-aa99-4ec3-9ef5-6df5a600ae85 for instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea on nch2-master-1 Oct 29 21:00:25.795792 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] Creating event network-vif-deleted:99491349-fec3-4967-9bed-d1945e2bccad for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:25.803213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2a936128-f401-41ce-8e7e-de8ca83976f5 req-fee483db-b65a-4fda-a289-4a0b20fd82e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039637 Oct 29 21:00:25.803646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1509/3117] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:25.808864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:25.810057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:25.818260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.818944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.819548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.820416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.821395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.822478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.876433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:25.885937 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-66431561-e14d-4edd-8a94-8e65bd9f504a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1279 microversion: 2.1 time: 0.140655 Oct 29 21:00:25.899479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1609/3118] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:25 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:25.911436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:25.912385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:25.920151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.921016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.921743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:25.922980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:25.923569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:25.924229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.084559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:26.098651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:26.101781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:26.103858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7478cf6-9d93-476c-9b96-6fa52f03512f tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2827 microversion: 2.42 time: 0.298364 Oct 29 21:00:26.106206 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1510/3119] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:25 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2827 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:26.137440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:26.148136 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1968909a-f4a9-4dea-998d-b8c4d67be0a8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.247206 Oct 29 21:00:26.148821 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1610/3120] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:25 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:26.182915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:26.183861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:26.190402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.191174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.191848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.192539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.193190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.193656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.217034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:26.218253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:26.230587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.231166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.231604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.232625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.233097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.237641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.441957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:26.456734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b149059-ef9e-421c-b5d7-3c88d9e52d80 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.277551 Oct 29 21:00:26.458416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1511/3121] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:26 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:26.542771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:26.554219 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-307f0e0e-aa59-4062-8387-c1768d29cfb4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.341691 Oct 29 21:00:26.555101 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1611/3122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:26 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:26.767813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:26.768583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:26.783099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.783990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.784171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:26.784984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:26.786268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.787484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.788469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.789136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.792445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.792935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.793379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:26.794107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:26.795401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:26.795552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:27.035703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:27.502609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:27.523022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:27.527901 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f985032c-8697-46da-83b6-764217311c6f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.763877 Oct 29 21:00:27.532211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1512/3123] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:26 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:27.537987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-29a54eae-103f-4319-ab79-67c868d8887b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.752330 Oct 29 21:00:27.544320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:27.545347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:27.550166 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1612/3124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:26 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:27.555553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:27.559595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:27.564744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:27.567393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:27.567873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:27.570124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:27.570819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:27.571430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:27.582826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:27.584997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:27.596841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:27.602187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:27.606502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:27.607850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:27.610146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:27.973332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=24 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:28.041848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.051549 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4a1a66c-9ead-4b82-93c8-a12615e8a30c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.518004 Oct 29 21:00:28.052404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1513/3125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:27 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:28.057701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.057974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:28.058646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:28.065029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.065773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.066406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.067368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.068209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.069129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.080689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.083622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.087211 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db4e1963-8420-42c9-9182-f96a59a5fd25 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2827 microversion: 2.42 time: 0.534941 Oct 29 21:00:28.088187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1613/3126] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:27 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2827 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:28.101938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:28.102588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:28.111514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.112009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.112640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.114119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.114596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.115034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.395818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.396616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.407932 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-957c3fee-5153-4086-8ce0-97e1d7703044 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.318210 Oct 29 21:00:28.408884 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1614/3127] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:28 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:28.414740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:28.415359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:28.423943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.424448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.424955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.426368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.426834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.427271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.432466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:28.435904 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9fb25cbe-4fa9-4b25-83bf-17ef8b6d0bc0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.382200 Oct 29 21:00:28.436555 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1514/3128] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:28 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:28.448161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-20e8c082-3783-4945-b0b1-256c459b5933 req-6a4f1817-ffd1-4bbe-bb36-d059cddf565c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc1211c-d363-4842-85d7-aae9dca8ed11", "name": "network-vif-plugged", "status": "completed", "tag": "71a1e32e-f54b-4ae4-9df4-a9283d8f8353"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:28.485713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-20e8c082-3783-4945-b0b1-256c459b5933 req-6a4f1817-ffd1-4bbe-bb36-d059cddf565c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.486737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-20e8c082-3783-4945-b0b1-256c459b5933 req-6a4f1817-ffd1-4bbe-bb36-d059cddf565c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.487404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-20e8c082-3783-4945-b0b1-256c459b5933 req-6a4f1817-ffd1-4bbe-bb36-d059cddf565c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.512031 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-20e8c082-3783-4945-b0b1-256c459b5933 req-6a4f1817-ffd1-4bbe-bb36-d059cddf565c service nova] Creating event network-vif-plugged:71a1e32e-f54b-4ae4-9df4-a9283d8f8353 for instance fbc1211c-d363-4842-85d7-aae9dca8ed11 on nch2-master-1 Oct 29 21:00:28.519688 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-20e8c082-3783-4945-b0b1-256c459b5933 req-6a4f1817-ffd1-4bbe-bb36-d059cddf565c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081857 Oct 29 21:00:28.524304 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1515/3129] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:28.532909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9a406377-b3d5-4dbc-aacc-b9f4b6e43ff6 req-b601ccd7-0759-4eae-b80e-b959794dd070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-deleted", "tag": "498fed4d-2d39-41a9-aa73-628dd56d08c4"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:28.556058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a406377-b3d5-4dbc-aacc-b9f4b6e43ff6 req-b601ccd7-0759-4eae-b80e-b959794dd070 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.556687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a406377-b3d5-4dbc-aacc-b9f4b6e43ff6 req-b601ccd7-0759-4eae-b80e-b959794dd070 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.557147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a406377-b3d5-4dbc-aacc-b9f4b6e43ff6 req-b601ccd7-0759-4eae-b80e-b959794dd070 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.573067 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9a406377-b3d5-4dbc-aacc-b9f4b6e43ff6 req-b601ccd7-0759-4eae-b80e-b959794dd070 service nova] Creating event network-vif-deleted:498fed4d-2d39-41a9-aa73-628dd56d08c4 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:28.588914 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9a406377-b3d5-4dbc-aacc-b9f4b6e43ff6 req-b601ccd7-0759-4eae-b80e-b959794dd070 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062842 Oct 29 21:00:28.589567 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1516/3130] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:28.619314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:28.623413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:28.640507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.641369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.642211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.643377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.644069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.644669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.653682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.668143 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4761228-f062-49c2-a93b-a390521a0395 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.256096 Oct 29 21:00:28.673871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1615/3131] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:28 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:28.682260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:28.683155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:28.699785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.700555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.705933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.706933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:28.707949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:28.708739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:28.980745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.984474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:28.989935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0da58eeb-cbda-412a-8954-313a8f41b78b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.314555 Oct 29 21:00:28.990662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1616/3132] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:28 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:28.993221 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4eb66dd1-8787-4ca6-8743-9646b9a39b5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.398225 Oct 29 21:00:28.993821 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1517/3133] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:28 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:29.075143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:29.076513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:29.083320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.083880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.084344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.085160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.085684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.086226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.123299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:29.123914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:29.132196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.132688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.133126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.133859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.134311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.134736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.378019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.396732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-32b631b2-7f8f-4cdb-8200-39424f0cb822 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.324991 Oct 29 21:00:29.413542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.415605 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1617/3134] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:29 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:29.421680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.423406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.424641 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27e2fe5d-bc70-4652-ae18-1887e0fd11da tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2374 microversion: 2.42 time: 0.305187 Oct 29 21:00:29.425626 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1518/3135] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:29 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:00:29.438274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:29.438900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:29.445602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.446455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.446905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.447621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.448082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.448548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.466956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:29.467556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:29.474004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.474431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.474877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.475595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.476056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.476737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.686869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.702910 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3357559-c433-485d-8af6-b655342b5ab7 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.269367 Oct 29 21:00:29.705174 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1618/3136] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:29 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:29.707744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.711519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:29.712596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:29.713561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:29.721544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74a8eac6-bc4a-4026-ab79-62b879cfee6c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.259551 Oct 29 21:00:29.724345 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1519/3137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:29 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:29.736948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.738805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.739364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.740227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:29.740928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:29.741684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:29.975741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:29.984500 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54282cbe-97ad-4acf-9af2-b6f9a917f70e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.278075 Oct 29 21:00:29.985584 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1619/3138] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:29 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:30.017009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:30.018009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:30.018477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:30.019776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:30.024688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.025407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.026048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.027042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.027816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.028406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.034652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.035462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.036150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.037112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.038301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.038957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.310495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:30.320442 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f934fc72-7dde-4e35-8935-04f34b6f03c9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.307144 Oct 29 21:00:30.327086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1620/3139] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:30 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:30.339201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:30.355081 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2dca9f0-47bf-46bc-90cf-6db86dd19f68 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.344551 Oct 29 21:00:30.376001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1520/3140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:30 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:30.419174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:30.419837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:30.448320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.448983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.449541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.450358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.451450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.451954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.453153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:30.454118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:30.464585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.465536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.468309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.470099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.471064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.471876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.687896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:30.689385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:30.697647 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb69b91c-7637-4be8-bfbf-67cd23cfd627 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.282289 Oct 29 21:00:30.702617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:30.707688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:30.710418 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-879e1d63-45ac-4e82-9bcf-33b3a2bf055d tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2327 microversion: 2.42 time: 0.262703 Oct 29 21:00:30.710770 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1621/3141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:30 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:30.714476 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1521/3142] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:30 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2327 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:30.725641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f747a7c1-75a9-41a9-a1b6-020088da4261", "name": "network-vif-plugged", "status": "completed", "tag": "bc32e650-f1fc-4c66-911e-f6315cba5925"}, {"server_uuid": "77f58caf-98ff-43b0-ac4e-a9521e2b81ea", "name": "network-vif-plugged", "status": "completed", "tag": "d63ecde2-aa99-4ec3-9ef5-6df5a600ae85"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:30.732871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-deleted", "tag": "abaf2156-3eee-4776-87af-f4ae60c180d6"}, {"name": "network-changed", "server_uuid": "11bddee2-4a83-4178-9ba5-abc01a648538", "tag": "c7b98d8a-b5e2-4881-a559-17dfffee387b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:30.746061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.747000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.748213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.751920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.752411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.752850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.766925 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] Creating event network-vif-plugged:bc32e650-f1fc-4c66-911e-f6315cba5925 for instance f747a7c1-75a9-41a9-a1b6-020088da4261 on nch1-master-1 Oct 29 21:00:30.767442 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] Creating event network-vif-plugged:d63ecde2-aa99-4ec3-9ef5-6df5a600ae85 for instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea on nch2-master-1 Oct 29 21:00:30.770374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] Creating event network-vif-deleted:abaf2156-3eee-4776-87af-f4ae60c180d6 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:30.771658 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] Creating event network-changed:c7b98d8a-b5e2-4881-a559-17dfffee387b for instance 11bddee2-4a83-4178-9ba5-abc01a648538 on nch2-master-1 Oct 29 21:00:30.776387 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-65a09675-7565-463b-ba39-3f7032547aaf req-574c4a18-cced-4709-b682-1ac1e41962a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064239 Oct 29 21:00:30.777626 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1622/3143] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:30.781018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3ba7b5f5-30b1-4240-85b7-d3b98e43e919 req-c637836b-e3fc-4962-ab89-fd928dfeff0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064041 Oct 29 21:00:30.782753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1522/3144] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:30.787651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:30.789260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:30.796032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.796742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:30.796928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.797542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.798150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:30.798862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.799530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.800107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.809439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.810757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.811425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.812312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:30.813278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:30.813907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:30.969777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:30.999665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=54 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:31.109729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:31.114288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:31.120641 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6585cac9-33be-4c09-8100-8fa8835fb170 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.338069 Oct 29 21:00:31.122196 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1623/3145] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:30 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:31.124563 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f54df37-b310-48fa-8c89-5332f5778b51 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.335657 Oct 29 21:00:31.125140 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1523/3146] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:30 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:31.143412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:31.144329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:31.153720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.154109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.154547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.155263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.155781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.156152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.294264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:31.303276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0c7c5021-5e12-4549-9802-b5311a954814 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.179009 Oct 29 21:00:31.303857 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1624/3147] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:31 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:31.343876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:31.344508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:31.350974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.351471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.351917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.352626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.353089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.353545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.380136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:31.380925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:31.387410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.387981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.390250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.391036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.391737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.392350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.553258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:31.562713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c2de6a00-b9f6-4856-862a-ffacaadde9db tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.222510 Oct 29 21:00:31.577981 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1524/3148] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:31 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:31.586231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:31.600074 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-500c0a41-cba2-4d7e-91e3-520c337ad2d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.223684 Oct 29 21:00:31.600677 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1625/3149] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:31 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:31.740040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:31.740942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:31.747137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:31.747943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:31.748718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.749327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.750075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.750909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.751483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.752054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.754848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.755541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.755989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:31.756705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:31.757339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:31.757945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.001503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.016272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.026217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.029407 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af904ba5-1744-4108-8f52-1e40ba182a2a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.293334 Oct 29 21:00:32.030639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.031211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1525/3150] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:31 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:32.032330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f153bd8a-cec7-414a-add5-f479db9aa0cd tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2213 microversion: 2.42 time: 0.289575 Oct 29 21:00:32.046066 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1626/3151] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:31 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2213 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:00:32.144954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:32.145986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:32.147203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:32.147862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:32.152983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.153826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.154747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.155223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.155363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.155668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.156257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.156378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.156717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.156832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.157147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.157277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.414005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.414759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.423004 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98c400d1-155c-42d9-8921-e48552f0722e tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.281902 Oct 29 21:00:32.427006 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1526/3152] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:32 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:32.435990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:32.436827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:32.446634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.447375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.448468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.449584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.450214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.451390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.452869 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea75e512-8373-4fa0-901c-1021bd815152 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.309400 Oct 29 21:00:32.473138 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1627/3153] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:32 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:32.590883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:32.592925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:32.617486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.618389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.621925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.623582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.624832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.625405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.635456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.648138 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ce43f2a-8393-4e95-bb5a-96de41ce31ce tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.219534 Oct 29 21:00:32.649294 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1527/3154] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:32 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:32.654718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:32.655510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:32.662717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.663045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.663519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.664365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.664956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.665482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.866524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.873855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:32.876448 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20e3d5bc-0df4-4f83-9585-40a155e8086e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.292878 Oct 29 21:00:32.877044 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1628/3155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:32 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:32.882561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-deleted", "tag": "0edb5772-4240-4851-ad33-8160a8554967"}, {"server_uuid": "d2f40e26-c010-4bcb-aff7-60bc16c4b044", "name": "network-vif-deleted", "tag": "4f8b913f-10da-41e4-a3f2-8e6662803dda"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:32.883957 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3925fa32-0712-4506-ba1f-88a1ab7a6c45 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.233315 Oct 29 21:00:32.884519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1528/3156] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:32 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:32.893902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:32.894598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:32.895650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:32.916662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] Creating event network-vif-deleted:0edb5772-4240-4851-ad33-8160a8554967 for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:32.917553 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] Creating event network-vif-deleted:4f8b913f-10da-41e4-a3f2-8e6662803dda for instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 on nch2-master-1 Oct 29 21:00:32.926928 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b616447f-4992-4a1b-8708-2a5459aea7c6 req-ad07b817-39f4-443b-8218-0f5280255e3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048000 Oct 29 21:00:32.927895 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1629/3157] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:33.052159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.052837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.060992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.061775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.062288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.062987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.063608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.064498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.065056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.065878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.068012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.068517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.068960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.069698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.070389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.070830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.163000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.174024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.175799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.177039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-daec6c55-74e2-4c8b-9e66-52fabda6cafe tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 2145 microversion: 2.42 time: 0.121019 Oct 29 21:00:33.177639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1630/3158] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 2145 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:33.235373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.244559 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d708108f-4407-440f-aac4-685610ada73d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.196245 Oct 29 21:00:33.245480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1529/3159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:33.431327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b36ac191-7937-449a-84ed-5fc2c4942db2 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Action: 'create', calling method: .version_select at 0x7fa17639dd30>, body: {"keypair": {"name": "tempest-keypair-876399587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl8bSslKdirWj5pGypi9I5WRARnpY3gJLaHyYz7igTW8BuMznJYfeddg+swMCbLzG11JZNDk3p2+pnnZM5fIKoqa3uRo48P+/zuaQQecdF0Xe+YLvZ6HSj5X2CEWL9j9w=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:33.448876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b36ac191-7937-449a-84ed-5fc2c4942db2 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:33.452061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.452691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.455165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b36ac191-7937-449a-84ed-5fc2c4942db2 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for user 825703fd71ab453788423f4c1770c02e and project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:33.459157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.459639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.460085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.461018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.461498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.461932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.482349 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b36ac191-7937-449a-84ed-5fc2c4942db2 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196892 Oct 29 21:00:33.488432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1631/3160] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:33.488432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.488961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.508969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.509546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.510189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.513701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.514201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.514682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.712434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.724387 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4056415-8f72-4a8b-b8b2-3be7e0694d53 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.276093 Oct 29 21:00:33.725117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1530/3161] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:33.729884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d28a4d6-8c9d-493a-bc32-bd4e07845773 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa170e9ec10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.740483 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d28a4d6-8c9d-493a-bc32-bd4e07845773 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-876399587" status: 200 len: 497 microversion: 2.1 time: 0.014191 Oct 29 21:00:33.740643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.744287 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1531/3162] 10.222.0.36 () {58 vars in 1215 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-876399587 => generated 497 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:33.754287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1eb66040-357c-48f3-b733-93691e8bbd60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.269839 Oct 29 21:00:33.757819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.758721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.765374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.766861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.767389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.768195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.769265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.769956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.770596 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1632/3163] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:33.777168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3dc4fee6-5966-481a-ae1b-80682ee0930b tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa17646ab80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.799378 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3dc4fee6-5966-481a-ae1b-80682ee0930b tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876399587" status: 202 len: 0 microversion: 2.1 time: 0.027739 Oct 29 21:00:33.799974 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1633/3164] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876399587 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:33.812477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b2294f9-dae9-4fc6-81fa-2d6779adde9d tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Action: 'create', calling method: .version_select at 0x7fa17644d9d0>, body: {"keypair": {"name": "tempest-keypair-986924973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX/ahekR+PUFR6EwjQ2prkMME2XWb05yX20mM/cBJEO1/+kI4L9lrf3zf2Az2++IvELqBLsVpgxtUwvqMelnUeWtN1AeO/+s/HsWljA4+1qcl04wYoSvCTu3ur5jaM5EA=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:33.830943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5b2294f9-dae9-4fc6-81fa-2d6779adde9d tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:33.836137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5b2294f9-dae9-4fc6-81fa-2d6779adde9d tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for user 825703fd71ab453788423f4c1770c02e and project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:33.869302 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b2294f9-dae9-4fc6-81fa-2d6779adde9d tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061066 Oct 29 21:00:33.871078 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1634/3165] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:00:33.881841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be45c243-521e-4987-8392-a17435fd1922 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa1764508b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.908040 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be45c243-521e-4987-8392-a17435fd1922 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986924973" status: 202 len: 0 microversion: 2.1 time: 0.030303 Oct 29 21:00:33.909487 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1635/3166] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986924973 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:33.918232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.918871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.926710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.927217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.928306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.928986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.929529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:33.929974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:33.976053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:33.986349 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-97dea8a9-4169-490c-b7eb-28f1cd09e1ea tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.233631 Oct 29 21:00:33.987192 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1532/3167] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:33.992216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:33.992837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:33.999091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:33.999837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.000526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.001557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.002412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.003043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.152557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.162204 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ca711ae-5623-496f-88b9-3b1f85d19049 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.248226 Oct 29 21:00:34.171025 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1636/3168] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:34.171025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93d0bc82-930b-49be-a41b-b7a39eda3fd9 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Action: 'create', calling method: .version_select at 0x7fa17633d1f0>, body: {"keypair": {"name": "tempest-keypair-1703240776", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:34.187960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-93d0bc82-930b-49be-a41b-b7a39eda3fd9 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:34.193517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-93d0bc82-930b-49be-a41b-b7a39eda3fd9 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for user 825703fd71ab453788423f4c1770c02e and project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:34.195877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.206129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbca8ce2-413c-4068-995d-30d07e3f6158 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.217501 Oct 29 21:00:34.219241 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1533/3169] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:33 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:34.223770 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93d0bc82-930b-49be-a41b-b7a39eda3fd9 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.059849 Oct 29 21:00:34.224616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1637/3170] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:34 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:34.231838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.232472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:34.235035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b58628b4-858d-4835-ad02-6c72193e41fb tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa176344f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.239388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.239886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.240480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.241199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.241688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.242120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.254930 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b58628b4-858d-4835-ad02-6c72193e41fb tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703240776" status: 202 len: 0 microversion: 2.1 time: 0.023870 Oct 29 21:00:34.255511 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1638/3171] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703240776 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:00:34.267544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73acb8c0-6b5b-45e9-ba6d-7c2a939713d4 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Action: 'create', calling method: .version_select at 0x7fa17644d9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-302113412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbXA2d5Rj5Gb8+xJusU7RcxyvXyTfDewuD58OfPiY1TUj02yWD1oonrge1LuGhceraj9xDp/YZPPvlnHGnNrPKY5Q48gPfKmP6H4HmmB3GofbVOxWdyRVyMgZAfv+2L0A=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:34.284838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-73acb8c0-6b5b-45e9-ba6d-7c2a939713d4 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:34.285021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.285327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.285802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.286257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lazy-loading 'fault' on Instance uuid d2f40e26-c010-4bcb-aff7-60bc16c4b044 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:00:34.290183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-73acb8c0-6b5b-45e9-ba6d-7c2a939713d4 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for user 825703fd71ab453788423f4c1770c02e and project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:34.315490 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73acb8c0-6b5b-45e9-ba6d-7c2a939713d4 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052330 Oct 29 21:00:34.316239 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1639/3172] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:00:34.322309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.323015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:34.326989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:34.330797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.331386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.331976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.332694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.333157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.333623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.334627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.339147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:34.345793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.347265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '014a25f21b294a42986928e0a8df6cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22ac3c92da747c58302269fc6a028f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.348538 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bffef318-f354-4424-b03d-b9f57cc946b1 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 200 len: 1878 microversion: 2.42 time: 0.128235 Oct 29 21:00:34.349100 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1534/3173] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:34 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 1878 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:00:34.353515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c02ef05c-41a2-43ee-a471-c58bf5639ca0 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Action: 'create', calling method: .version_select at 0x7fa170e8e040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2124007806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKugJHFsV+AomL+7KqW69eArizVyO3Ep3joKGZ51eTa9RNIbJDHjt81GoGAUqZ2HQzRvICLnYLGW7ZUvgWxIggzpC7q+ELorCwdxj227oM+RJ1vsBSFlwUgELGQ0ZcRiFw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:34.369331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c02ef05c-41a2-43ee-a471-c58bf5639ca0 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:34.374857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c02ef05c-41a2-43ee-a471-c58bf5639ca0 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for user 825703fd71ab453788423f4c1770c02e and project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:34.398748 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c02ef05c-41a2-43ee-a471-c58bf5639ca0 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048528 Oct 29 21:00:34.399343 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1535/3174] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:34.412385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cf91f2fa-7d58-49eb-b8a2-03663ae162a3 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Action: 'create', calling method: .version_select at 0x7fa170ecf9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1796098007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9xEx0hKDaOF1CwfVQRo6GtQff8L3wlyXMpmzGmr5Hjm60eMvdxX1goAaKCt1JvYJdkh2KLi4hFz4NtVL5zvX4WVe0dkDOh3jPhTWR4nkmhH1kZE+dh5HwRR39xAUPqZw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:34.428977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-cf91f2fa-7d58-49eb-b8a2-03663ae162a3 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:34.435181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-cf91f2fa-7d58-49eb-b8a2-03663ae162a3 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Getting quotas for user 825703fd71ab453788423f4c1770c02e and project 170cc1a913aa4f6bb4ac882056be8592. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:34.461817 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cf91f2fa-7d58-49eb-b8a2-03663ae162a3 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052447 Oct 29 21:00:34.462774 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1536/3175] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:00:34.473705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91d7e1bb-0d42-4eaa-b737-418b8de27f10 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa170e80430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.478083 ncdv-master-1 devstack@n-api.service[138884]: WARNING oslo_db.sqlalchemy.utils [None req-91d7e1bb-0d42-4eaa-b737-418b8de27f10 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 21:00:34.481054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:34.487871 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91d7e1bb-0d42-4eaa-b737-418b8de27f10 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.018548 Oct 29 21:00:34.488428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.488584 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1537/3176] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 21:00:34 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:34.498536 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9c490a7-22fc-4b6b-896e-8ab57d6bb00d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.179888 Oct 29 21:00:34.499680 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1640/3177] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:34 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:34.501383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-363f9bc1-a344-4046-8fb2-f98a81cdaf4d tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa170f364c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.523208 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-363f9bc1-a344-4046-8fb2-f98a81cdaf4d tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1796098007" status: 202 len: 0 microversion: 2.1 time: 0.027955 Oct 29 21:00:34.523797 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1538/3178] 10.222.0.36 () {58 vars in 1278 bytes} [Sat Oct 29 21:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1796098007 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:00:34.532040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b397505-62aa-4733-8725-a43d5094e857 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa176450550>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.562148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b397505-62aa-4733-8725-a43d5094e857 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2124007806" status: 202 len: 0 microversion: 2.1 time: 0.033931 Oct 29 21:00:34.562749 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1641/3179] 10.222.0.36 () {58 vars in 1278 bytes} [Sat Oct 29 21:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2124007806 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:00:34.571169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5998bf66-e45b-4fa8-96b4-c3632b9bde63 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] Calling method '.version_select at 0x7fa170e99c10>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.591797 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5998bf66-e45b-4fa8-96b4-c3632b9bde63 tempest-KeyPairsV2TestJSON-1278750380 tempest-KeyPairsV2TestJSON-1278750380-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-302113412" status: 202 len: 0 microversion: 2.1 time: 0.024592 Oct 29 21:00:34.592387 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1539/3180] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-302113412 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:34.754105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.754679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:34.763695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.765072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.765549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.766614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.767149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.767674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.783698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:34.784332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:34.792410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.792961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.794418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.795561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:34.796798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:34.797423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:34.982439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:34.990444 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6e31b23-194e-49b9-b933-5b54488c5fe6 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.241167 Oct 29 21:00:34.990903 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1642/3181] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:34 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:35.016150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-391ed5a1-6942-4353-aa88-d7933d3aa251 req-45c4cccf-866a-4032-bd19-f05c353e924d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e2076d-c50e-4718-bbf3-53d7f7dca2af", "name": "network-vif-plugged", "status": "completed", "tag": "7e7cb1ab-7f45-45f3-993c-cc5cb44b4ee2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:35.020217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:35.027644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-391ed5a1-6942-4353-aa88-d7933d3aa251 req-45c4cccf-866a-4032-bd19-f05c353e924d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.028126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-391ed5a1-6942-4353-aa88-d7933d3aa251 req-45c4cccf-866a-4032-bd19-f05c353e924d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.028555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-391ed5a1-6942-4353-aa88-d7933d3aa251 req-45c4cccf-866a-4032-bd19-f05c353e924d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.028955 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b6ac6560-24ce-4738-8e01-d597895c43b1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.249310 Oct 29 21:00:35.029544 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1540/3182] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:34 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:35.039893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:35.040509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:35.052072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.052834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.053583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.054448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.055069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.056074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.057605 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-391ed5a1-6942-4353-aa88-d7933d3aa251 req-45c4cccf-866a-4032-bd19-f05c353e924d service nova] Creating event network-vif-plugged:7e7cb1ab-7f45-45f3-993c-cc5cb44b4ee2 for instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af on nch1-master-1 Oct 29 21:00:35.066052 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-391ed5a1-6942-4353-aa88-d7933d3aa251 req-45c4cccf-866a-4032-bd19-f05c353e924d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073157 Oct 29 21:00:35.066983 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1643/3183] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:35.187382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:35.188187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:35.195257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.196042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.196807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.197774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.198433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.199053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.234031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:35.242274 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f7411d6a-0d55-42ed-a590-60d55d6ef968 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.205900 Oct 29 21:00:35.257337 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1541/3184] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:35 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:35.257337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:35.257337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:35.257337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.257337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.257337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.258024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.258469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.259102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.452395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:35.462546 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fed64e82-3aaa-41c3-ab83-2e6110a68b23 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.279902 Oct 29 21:00:35.463383 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1644/3185] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:35 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:35.480243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:35.484291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:35.484410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:35.485358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:35.489883 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-831d9cb7-9416-4bb6-b0d4-eb68a5db8219 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.245002 Oct 29 21:00:35.490810 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1542/3186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:35 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:35.492268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.492730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.493173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.493930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.494570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.495147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.514178 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] HTTP exception thrown: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Request method failure captured: Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 HTTP/1.1 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZMaJ9ubjKcqIFMs8AYACsGRbw5wDaFD6mLhSbfXI7RH_PKV5zEaF0u8MeHsZOlOIY_-XDFE9gvDT-NBJFrvVpxcTOsQ0wMz541h7CE_B8PHN4qzbX7_Byh9XRa3VtbykYO_EWoqtN_dZn5HPPaRfjhMDpG0hfm9Jormyoavjl9xccQ Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c22ac3c92da747c58302269fc6a028f4 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c22ac3c92da747c58302269fc6a028f4 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TaggedBootDevicesTest_v242-1596127670-project Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 014a25f21b294a42986928e0a8df6cfa Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1596127670-project Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd2f40e26-c010-4bcb-aff7-60bc16c4b044'} Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:35.516114 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Returning 404 to user: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:35.520923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ba2da3c-0cc6-40df-bf58-b6f6f8f62644 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 404 len: 111 microversion: 2.42 time: 0.041913 Oct 29 21:00:35.521707 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1645/3187] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:35 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:00:35.525207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:35.525823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:35.529961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ce31fe3-bd1f-408d-b940-b08e94ead4d4 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '.version_select at 0x7fa17644e9d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:35.536669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.537163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.537642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.538351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:35.541848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:35.542293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:35.552050 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1ce31fe3-bd1f-408d-b940-b08e94ead4d4 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075960236" status: 204 len: 0 microversion: 2.42 time: 0.025902 Oct 29 21:00:35.552904 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1646/3188] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 21:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075960236 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 21:00:35.748765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:35.758043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0f54d24-bebe-41b9-9007-84067147bc02 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.238103 Oct 29 21:00:35.759027 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1543/3189] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:35 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:36.015511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:36.016137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:36.023494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.024220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.024803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.026193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.026193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.028476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.058212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:36.059181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:36.070123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.070954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.072190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.078328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.078820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.079277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.295617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:36.303868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:36.305203 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3cd243f8-3335-47f7-a887-26b53aceb881 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1350 microversion: 2.1 time: 0.294973 Oct 29 21:00:36.306185 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1647/3190] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:36 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1350 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:36.311629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:36.312514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:36.319104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.319660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.320114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.320876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.321537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.322787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.329919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b3bf385-1866-4421-a3f1-247dfcccec5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.276065 Oct 29 21:00:36.344396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1544/3191] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:36 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:36.488274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:36.489023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:36.496428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.496920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.498262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.498987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.499440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.500022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.513783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:36.528643 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3558fcb-6db8-4d0a-9a57-f6f1e60d5a0a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.220903 Oct 29 21:00:36.535083 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1648/3192] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:36 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:36.547468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:36.550232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:36.556436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.557233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.557846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:36.558646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:36.559328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:36.559921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.047461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:37.057978 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-433f44c0-dcb7-42cd-ac1f-12ef525daeff tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.573712 Oct 29 21:00:37.074296 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1545/3193] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:36 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:37.079497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:37.080424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:37.087581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.088319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.088948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.089686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.090154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.090614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.108637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:37.120255 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e3aca07-8ef2-4efd-b1a8-f15c04ed95fe tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.583666 Oct 29 21:00:37.140996 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1649/3194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:36 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:37.336340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:37.337225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:37.346812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.348384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.349000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.353940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.354499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.355111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.457400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:37.468045 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6811f14e-f6c9-4c56-a60d-03a252e12ec2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.392399 Oct 29 21:00:37.468648 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1546/3195] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:37 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:37.482106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:37.482106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:37.488605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.489334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.489890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.490696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.491286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.491795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.801100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:37.809436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94d86a89-b0d8-4e14-9f4a-dcda42e3a1d4 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1539 microversion: 2.1 time: 0.479533 Oct 29 21:00:37.811222 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1650/3196] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:37 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1539 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:37.816017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:37.816854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:37.832440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.832988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.833430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.834183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.834643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.835279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.854024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:37.863065 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2eec7a2-b0d4-46ce-a676-836ae9316f18 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.393379 Oct 29 21:00:37.864166 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1547/3197] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:37 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:37.889315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-61bc2f61-5294-457d-ae7e-afa32bcd0e3b req-9afe6b8b-b471-4f4a-a14d-1f69eb6f9c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11bddee2-4a83-4178-9ba5-abc01a648538", "name": "network-vif-plugged", "status": "completed", "tag": "c7b98d8a-b5e2-4881-a559-17dfffee387b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:37.900466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-61bc2f61-5294-457d-ae7e-afa32bcd0e3b req-9afe6b8b-b471-4f4a-a14d-1f69eb6f9c1c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.901262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-61bc2f61-5294-457d-ae7e-afa32bcd0e3b req-9afe6b8b-b471-4f4a-a14d-1f69eb6f9c1c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.902226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-61bc2f61-5294-457d-ae7e-afa32bcd0e3b req-9afe6b8b-b471-4f4a-a14d-1f69eb6f9c1c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.916698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-61bc2f61-5294-457d-ae7e-afa32bcd0e3b req-9afe6b8b-b471-4f4a-a14d-1f69eb6f9c1c service nova] Creating event network-vif-plugged:c7b98d8a-b5e2-4881-a559-17dfffee387b for instance 11bddee2-4a83-4178-9ba5-abc01a648538 on nch2-master-1 Oct 29 21:00:37.925702 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-61bc2f61-5294-457d-ae7e-afa32bcd0e3b req-9afe6b8b-b471-4f4a-a14d-1f69eb6f9c1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043601 Oct 29 21:00:37.926930 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1548/3198] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:37.948812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:37.950049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:37.958712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.959476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.960158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:37.961047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:37.961710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:37.962302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.183244 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-efe5acd6-c63b-4f33-ab40-f8fcf1d46a83 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254703 Oct 29 21:00:38.183891 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1549/3199] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:00:37 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:38.190654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:38.191998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:38.202777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.203357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.203870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.204645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.205339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.206373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.274638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:38.284661 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b63b33ce-87eb-4b38-b43f-b666c9954a34 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1320 microversion: 2.1 time: 0.472180 Oct 29 21:00:38.285586 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1651/3200] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:37 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:38.291068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:38.291965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:38.299162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.299934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.300604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.301546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.302073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.302611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.605209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:38.616342 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2fd459b7-764c-4e9e-9aa3-7425f5c84d10 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.430910 Oct 29 21:00:38.617479 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1550/3201] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:38 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:38.625931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:38.627377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:38.636644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.637494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.639679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.642378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.646083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.648077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.673051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:38.690189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4e1da70-d5d0-4f23-a385-f10a9721612d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.402705 Oct 29 21:00:38.705486 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1652/3202] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:38 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:38.892221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:38.892857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:38.896057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:38.900873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.902059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.902839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.905127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:38.905979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:38.906789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:38.915236 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-715829ee-6909-4ebf-bfa4-2afddd2020ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.295848 Oct 29 21:00:38.929514 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1551/3203] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:38 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:39.165152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:39.177314 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-654ad27a-ce83-4739-97b5-135c843a5bb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.289943 Oct 29 21:00:39.178896 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1653/3204] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:38 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:39.309304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:39.310036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:39.318266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:39.318953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:39.319549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:39.320438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:39.321053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:39.321665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:39.642141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:39.643542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:39.652436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:39.653111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:39.654310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:39.655224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:39.655847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:39.656475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:39.779616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:39.793059 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a5f26fe3-0001-4775-954c-05cc843dcc02 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1511 microversion: 2.1 time: 0.486844 Oct 29 21:00:39.794532 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1552/3205] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:39 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:39.806567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:39.808614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:39.837147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:39.837676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:39.838297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:39.839169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:39.842063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:39.842694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.014824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:40.033711 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9c953d2-66f4-45ce-bd20-cb03eabc5642 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.395870 Oct 29 21:00:40.052766 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1654/3206] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:39 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:40.061219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:40.062378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:40.073996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.074797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.075576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.076608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.077486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.078172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.135483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:40.145775 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5854f690-fd64-4e35-a262-dde9db67bf07 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1514 microversion: 2.1 time: 0.348968 Oct 29 21:00:40.149845 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1553/3207] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:39 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:40.183261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:40.185247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:40.192914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.194418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.195835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.196976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.197729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.198400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.546338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:40.557535 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-82e8a793-1d86-408d-a145-aef7ec0347f9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1511 microversion: 2.1 time: 0.502245 Oct 29 21:00:40.562271 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1655/3208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:40 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:40.578033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-af4e9fe7-fd33-4c78-9d54-657ef7c67650 req-39dd900e-b936-4649-a4da-088ee2c35c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3", "name": "network-vif-plugged", "status": "completed", "tag": "76fe2d78-74ce-4cb2-9cdc-37877fafce37"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:40.602332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-af4e9fe7-fd33-4c78-9d54-657ef7c67650 req-39dd900e-b936-4649-a4da-088ee2c35c8c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.603064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-af4e9fe7-fd33-4c78-9d54-657ef7c67650 req-39dd900e-b936-4649-a4da-088ee2c35c8c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.603708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-af4e9fe7-fd33-4c78-9d54-657ef7c67650 req-39dd900e-b936-4649-a4da-088ee2c35c8c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.625139 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-af4e9fe7-fd33-4c78-9d54-657ef7c67650 req-39dd900e-b936-4649-a4da-088ee2c35c8c service nova] Creating event network-vif-plugged:76fe2d78-74ce-4cb2-9cdc-37877fafce37 for instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 on nch1-master-1 Oct 29 21:00:40.630409 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-af4e9fe7-fd33-4c78-9d54-657ef7c67650 req-39dd900e-b936-4649-a4da-088ee2c35c8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066741 Oct 29 21:00:40.631510 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1656/3209] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:40.632090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:40.644445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:40.646755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:40.657276 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-320d0875-4de8-48db-bab1-6381c4b28ca4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1321 microversion: 2.1 time: 0.479138 Oct 29 21:00:40.661394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.662303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.667535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.668743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.670226 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1554/3210] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:40 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:40.671872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.672643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.680831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-de045422-bb3d-4608-a6df-daaead0ac78b req-4637439c-f6c8-45b9-a84f-005655c12f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f747a7c1-75a9-41a9-a1b6-020088da4261", "tag": "bc32e650-f1fc-4c66-911e-f6315cba5925"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:40.695558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-de045422-bb3d-4608-a6df-daaead0ac78b req-4637439c-f6c8-45b9-a84f-005655c12f44 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.696327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-de045422-bb3d-4608-a6df-daaead0ac78b req-4637439c-f6c8-45b9-a84f-005655c12f44 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.697052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-de045422-bb3d-4608-a6df-daaead0ac78b req-4637439c-f6c8-45b9-a84f-005655c12f44 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.710126 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-de045422-bb3d-4608-a6df-daaead0ac78b req-4637439c-f6c8-45b9-a84f-005655c12f44 service nova] Creating event network-changed:bc32e650-f1fc-4c66-911e-f6315cba5925 for instance f747a7c1-75a9-41a9-a1b6-020088da4261 on nch1-master-1 Oct 29 21:00:40.716864 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-de045422-bb3d-4608-a6df-daaead0ac78b req-4637439c-f6c8-45b9-a84f-005655c12f44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044683 Oct 29 21:00:40.718163 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1555/3211] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:40.728057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:40.728846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:40.741613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.742804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.743417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:40.744318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:40.744947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:40.745577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.117282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:41.128145 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e73c052b-63d3-4800-b438-64a7faa91c4b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.493928 Oct 29 21:00:41.142524 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1657/3212] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:40 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:41.152566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:41.154352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:41.158666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:41.175486 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7f689eb1-b96a-4557-abb9-07547ec38dec tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 200 len: 1510 microversion: 2.1 time: 0.451771 Oct 29 21:00:41.187195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.187805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.188357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.190464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.191687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.197222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.201518 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1556/3213] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:40 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:41.215675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:41.217080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:41.232497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.234154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.234623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.238242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.238739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.239250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.468553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:41.477676 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ebe74509-1d9a-42de-83f5-420f8db73559 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.333526 Oct 29 21:00:41.482813 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1658/3214] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:41 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:41.488976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:41.507670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:41.508854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:41.539448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.539945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.540386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.541117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.547551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.548542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.564572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:41.580974 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b5f35e5-374d-4623-b7c3-21eb639d4647 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.378241 Oct 29 21:00:41.581581 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1557/3215] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:41 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:41.588030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:41.588550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:41.607399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.607903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.608343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.615686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.616339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.616656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:41.732205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:41.815871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:41.824172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:41.824883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:41.825565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.034244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8845c59e-5266-41ef-962e-9b0cac54c8e5 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.550244 Oct 29 21:00:42.048494 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1659/3216] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 29 21:00:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:42.059207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:42.059928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:42.062758 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] HTTP exception thrown: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Request method failure captured: Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 HTTP/1.1 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZMaJ9ubjKcqIFMs8AYACsGRbw5wDaFD6mLhSbfXI7RH_PKV5zEaF0u8MeHsZOlOIY_-XDFE9gvDT-NBJFrvVpxcTOsQ0wMz541h7CE_B8PHN4qzbX7_Byh9XRa3VtbykYO_EWoqtN_dZn5HPPaRfjhMDpG0hfm9Jormyoavjl9xccQ Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c22ac3c92da747c58302269fc6a028f4 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c22ac3c92da747c58302269fc6a028f4 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TaggedBootDevicesTest_v242-1596127670-project Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 014a25f21b294a42986928e0a8df6cfa Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1596127670-project Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'd2f40e26-c010-4bcb-aff7-60bc16c4b044'} Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:42.064764 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.068728 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.070210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.070461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Returning 404 to user: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:42.070732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.071190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.071948 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a0dbd9d-9ba9-490e-869d-6b468daae849 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 404 len: 111 microversion: 2.42 time: 0.489269 Oct 29 21:00:42.072570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.073111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.073662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.075907 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1558/3217] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:00:41 2022] DELETE /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 111 bytes in 494 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:00:42.080348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:42.080646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:42.086008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:42.086881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1491626269', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:42.094012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.094409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.094850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.095576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.096080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.096463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.216651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:42.303850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:42.315314 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d6dadf9-3023-4cbb-b434-2c1dc7549307 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1502 microversion: 2.1 time: 0.265187 Oct 29 21:00:42.317116 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1660/3218] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:42 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:42.330237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:42.332471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] [instance: d2f40e26-c010-4bcb-aff7-60bc16c4b044] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:42.348289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.349655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.350112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.350858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.354508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.354840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.364879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:42.382683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.389977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.390562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.391171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] HTTP exception thrown: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Request method failure captured: Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 HTTP/1.1 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZMaJ9ubjKcqIFMs8AYACsGRbw5wDaFD6mLhSbfXI7RH_PKV5zEaF0u8MeHsZOlOIY_-XDFE9gvDT-NBJFrvVpxcTOsQ0wMz541h7CE_B8PHN4qzbX7_Byh9XRa3VtbykYO_EWoqtN_dZn5HPPaRfjhMDpG0hfm9Jormyoavjl9xccQ Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c22ac3c92da747c58302269fc6a028f4 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c22ac3c92da747c58302269fc6a028f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c22ac3c92da747c58302269fc6a028f4 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1596127670 Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TaggedBootDevicesTest_v242-1596127670-project Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 014a25f21b294a42986928e0a8df6cfa Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1596127670-project Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd2f40e26-c010-4bcb-aff7-60bc16c4b044'} Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.397994 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] Returning 404 to user: Instance d2f40e26-c010-4bcb-aff7-60bc16c4b044 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:42.402931 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61bec53e-f53a-4c21-b4a1-ccadaff467d3 tempest-TaggedBootDevicesTest_v242-1596127670 tempest-TaggedBootDevicesTest_v242-1596127670-project] 10.222.0.36 "GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044" status: 404 len: 111 microversion: 2.42 time: 0.081495 Oct 29 21:00:42.415496 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1661/3219] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:00:42 2022] GET /compute/v2.1/servers/d2f40e26-c010-4bcb-aff7-60bc16c4b044 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:00:42.436210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:42.440397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:42.461667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.462171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.462613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.470372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.471017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.473943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.779911 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf2a7ab1-4607-41fa-84b8-c61ddc3ce9df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1491626269" status: 200 len: 1514 microversion: 2.1 time: 0.702827 Oct 29 21:00:42.780559 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1559/3220] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:00:42 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1491626269 => generated 1514 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:42.789560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:42.790517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:42.802044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.802789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.803392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.806359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.807169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.808082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.822618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:42.840569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72b6c0ad-680e-4455-9495-292161cda005 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1502 microversion: 2.1 time: 0.422061 Oct 29 21:00:42.842412 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1662/3221] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:42 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1502 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:42.858090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:42.859023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:42.867523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.868084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.870759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:42.871703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:42.873650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:42.875448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.107719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:43.116925 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-254cf1df-3410-4f2d-910d-6cb1e39e777e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1502 microversion: 2.1 time: 0.335187 Oct 29 21:00:43.118325 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1560/3222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:42 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:43.123634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:43.124836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:43.131635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.132383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.133061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.138808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.139996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.140472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.152316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:43.189068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:43.199724 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-14607a58-b744-4358-bf42-c2715ae1995a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.354795 Oct 29 21:00:43.201043 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1663/3223] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:42 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:43.226725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:43.238428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:43.243016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:43.262672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.264260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.266290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.268248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.270172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.270805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.440041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:43.462802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:43.474461 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10ce5971-9439-49d6-9327-16708ae7419c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.354730 Oct 29 21:00:43.492139 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1561/3224] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:43 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:43.498820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bbd16be-48af-49ad-ab22-6f9d08ee7373"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:43.501845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:43.508357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.509066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.509702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.510867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.511492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.512085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.538876 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Cannot 'attach_volume' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state rescued Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/os-volume_attachments HTTP/1.1 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 74 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: {"volumeAttachment": {"volumeId": "0bbd16be-48af-49ad-ab22-6f9d08ee7373"}} Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'attach_volume' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state rescued Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'server_id': '2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9', 'body': {'volumeAttachment': {'volumeId': '0bbd16be-48af-49ad-ab22-6f9d08ee7373'}}} Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 29 21:00:43.549113 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state rescued Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state rescued Oct 29 21:00:43.553964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:00:43.556012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 409 to user: Cannot 'attach_volume' instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 while it is in vm_state rescued {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:43.557777 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-897abff1-af58-4dfd-9c4e-11bf48be50ad tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064290 Oct 29 21:00:43.558639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1562/3225] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:00:43 2022] POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:00:43.570522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:43.571251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:43.583629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.584104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.584678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.586658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.587334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.587945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.610206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:43.623629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:00:43.624141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.624845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.627018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.849064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8bac4379-61db-44f7-a54f-ebe4a4508907 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.642184 Oct 29 21:00:43.850927 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1664/3226] 10.222.0.36 () {58 vars in 1173 bytes} [Sat Oct 29 21:00:43 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:43.857159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:43.857737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:43.858631 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8069a03f-5648-4071-a958-67876efdc93c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 204 len: 0 microversion: 2.1 time: 0.297954 Oct 29 21:00:43.864099 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1563/3227] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:00:43 2022] DELETE /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:43.876030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:43.880698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.881276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.881673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:43.882022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.882815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.883350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.886672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.901824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.902331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.902784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:43.903555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:43.904012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:43.904448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.065181 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e2c8ef8-9cd6-46f8-ac8d-fb31abf14caf tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action" status: 202 len: 0 microversion: 2.1 time: 0.211797 Oct 29 21:00:44.066519 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1665/3228] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:43 2022] POST /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:44.077655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:44.089622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:44.092730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.servers [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Removing options 'limit' from query {{(pid=138885) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 21:00:44.093777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:44.101731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.102569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.103209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.104985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.106197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.106910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.158310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:44.162938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:44.169390 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-68527956-61fe-4978-9b19-c737df19130c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1508 microversion: 2.1 time: 0.300721 Oct 29 21:00:44.170708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1564/3229] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:43 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:44.176007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:44.176926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:44.180284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.180840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.184854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.185700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.186369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.187458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.188127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.188849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.189370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.793969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90ad5ba2-9c45-42d9-86be-3f9d6d272062 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.725714 Oct 29 21:00:44.795124 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1666/3230] 10.222.0.36 () {58 vars in 1161 bytes} [Sat Oct 29 21:00:44 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:44.800285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:44.801268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:44.814912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.818042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.818775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.819870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.823604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.824343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.850369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:44.859776 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16ae230c-933c-4bc2-9883-78e5740b6cc2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1510 microversion: 2.1 time: 0.687741 Oct 29 21:00:44.860867 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1565/3231] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:44 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1510 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:44.882606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:44.883249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:44.893837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.907254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.907254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:44.907254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:44.907254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:44.907254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.142981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:45.157867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b557bd7-1987-4fc3-8d63-73b484990a83 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1319 microversion: 2.1 time: 0.355478 Oct 29 21:00:45.165832 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1667/3232] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:44 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:45.171596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:45.178877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:45.179843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:45.191170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.191956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.192712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.193503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.194279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.201320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.275072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:45.276431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:45.289242 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1da29e77-2401-4285-94d6-fdc532804171 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.412794 Oct 29 21:00:45.302315 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1566/3233] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:44 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:45.311882 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eadcff0b-1d69-4fe1-b249-5acdfa4147f8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.144588 Oct 29 21:00:45.312498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1668/3234] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:00:45 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:45.334815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:45.335656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:45.344806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.345301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.345773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.346488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.346967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.347403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.583097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4a2ec75-a402-4b7f-9c05-6e487d7f4aed tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Action: 'create', calling method: .version_select at 0x7fa170e7b430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-942227451", "policies": ["affinity"]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:45.626781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d4a2ec75-a402-4b7f-9c05-6e487d7f4aed tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:45.642253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d4a2ec75-a402-4b7f-9c05-6e487d7f4aed tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:45.671873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:45.684542 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b664577a-c150-4cfa-9a9c-cb6c7998332d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1508 microversion: 2.1 time: 0.360235 Oct 29 21:00:45.686670 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1669/3235] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:45 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:45.714384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:45.731420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:45.732310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.servers [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Removing options 'limit' from query {{(pid=138885) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 21:00:45.734149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:45.752838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.754090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.755530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.758574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.759248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.761697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.762065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d4a2ec75-a402-4b7f-9c05-6e487d7f4aed tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:45.782581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d4a2ec75-a402-4b7f-9c05-6e487d7f4aed tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:45.823284 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4a2ec75-a402-4b7f-9c05-6e487d7f4aed tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.531790 Oct 29 21:00:45.830975 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1567/3236] 10.222.0.36 () {60 vars in 1174 bytes} [Sat Oct 29 21:00:45 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:45.833140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:45.839237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8f1538f0-1d2c-49f5-9ccc-171c31a7f1f7 req-af84c5e4-e8f5-49ae-95a2-c9dc0ecc52a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8192935b-cb3d-467f-ba5c-327b1f415b3a", "name": "network-vif-unplugged", "status": "completed", "tag": "862f0b76-ffcf-4d9c-9371-e3d198eb4d22"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:45.865436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8f1538f0-1d2c-49f5-9ccc-171c31a7f1f7 req-af84c5e4-e8f5-49ae-95a2-c9dc0ecc52a8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.866139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8f1538f0-1d2c-49f5-9ccc-171c31a7f1f7 req-af84c5e4-e8f5-49ae-95a2-c9dc0ecc52a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.866231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8f1538f0-1d2c-49f5-9ccc-171c31a7f1f7 req-af84c5e4-e8f5-49ae-95a2-c9dc0ecc52a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.896601 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8f1538f0-1d2c-49f5-9ccc-171c31a7f1f7 req-af84c5e4-e8f5-49ae-95a2-c9dc0ecc52a8 service nova] Creating event network-vif-unplugged:862f0b76-ffcf-4d9c-9371-e3d198eb4d22 for instance 8192935b-cb3d-467f-ba5c-327b1f415b3a on nch1-master-1 Oct 29 21:00:45.902188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2151a097-646c-41d2-92e2-dab329988fad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.213852 Oct 29 21:00:45.910410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1670/3237] 10.222.0.36 () {58 vars in 1150 bytes} [Sat Oct 29 21:00:45 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:45.914949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1cd7e6ec-3855-454c-bd6e-0b2d53dfbc8f tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Action: 'create', calling method: .version_select at 0x7fa17115c310>, body: {"server_group": {"name": "tempest-server-group-938765471", "policies": ["affinity"]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:45.918292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8f1538f0-1d2c-49f5-9ccc-171c31a7f1f7 req-af84c5e4-e8f5-49ae-95a2-c9dc0ecc52a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085534 Oct 29 21:00:45.919387 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1568/3238] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:45.929202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:45.931902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:45.938459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:45.943634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1cd7e6ec-3855-454c-bd6e-0b2d53dfbc8f tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:45.952325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1cd7e6ec-3855-454c-bd6e-0b2d53dfbc8f tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:45.958728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.959243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.959694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:45.960431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:45.960982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:45.961320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.034339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1cd7e6ec-3855-454c-bd6e-0b2d53dfbc8f tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:46.044508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1cd7e6ec-3855-454c-bd6e-0b2d53dfbc8f tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:46.090324 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1cd7e6ec-3855-454c-bd6e-0b2d53dfbc8f tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.184376 Oct 29 21:00:46.090991 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1671/3239] 10.222.0.36 () {60 vars in 1173 bytes} [Sat Oct 29 21:00:45 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:46.095502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.100744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.101413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:46.107292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:46.109272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.109929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.110406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.111229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.111714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.112165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.147190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:46.205074 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e80daf1-bf8d-458c-a45b-57fb8b6fdf0b tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.112977 Oct 29 21:00:46.205899 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1672/3240] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers => generated 1010 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:46.207784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.223078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b8500f3-9d68-4318-bd3e-622cd9b1ad25 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Action: 'create', calling method: .version_select at 0x7fa17643f3a0>, body: {"server_group": {"name": "tempest-server-group-938765471", "policies": ["affinity"]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:46.226287 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f234792-5454-4aef-9b63-370c550f63d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1510 microversion: 2.1 time: 0.305002 Oct 29 21:00:46.249529 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1569/3241] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:45 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:46.254522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.255162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:46.261447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.261727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8b8500f3-9d68-4318-bd3e-622cd9b1ad25 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:46.262013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.262466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.263227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.263698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.264142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.269201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8b8500f3-9d68-4318-bd3e-622cd9b1ad25 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:46.364420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8b8500f3-9d68-4318-bd3e-622cd9b1ad25 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:46.372964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8b8500f3-9d68-4318-bd3e-622cd9b1ad25 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:46.395583 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8b8500f3-9d68-4318-bd3e-622cd9b1ad25 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.179779 Oct 29 21:00:46.396417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1673/3242] 10.222.0.36 () {60 vars in 1173 bytes} [Sat Oct 29 21:00:46 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:46.400912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.406685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.407369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:46.421569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.421854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.422220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.423217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.423683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.424109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.486346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.496276 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ad5c769-0086-4bc2-b0b4-72b29601b5dc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1469 microversion: 2.1 time: 0.245496 Oct 29 21:00:46.498491 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1570/3243] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:46.503906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.504757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:46.514501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.515753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.516627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.517707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.519757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.520739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.538486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:46.645915 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1536846f-5fbb-4934-90c5-7ca0bc0976f2 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.247313 Oct 29 21:00:46.647267 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1674/3244] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:46.652353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f57058e-28ff-4dc5-aee8-d87ebe73298b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.720251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.732725 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e80cac17-1b6a-4fe6-99e5-4d75c3a612e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.231982 Oct 29 21:00:46.741985 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1571/3245] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:46.748249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f57058e-28ff-4dc5-aee8-d87ebe73298b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/57c5e4ce-6778-44e0-9114-69bc282259e7" status: 204 len: 0 microversion: 2.1 time: 0.099649 Oct 29 21:00:46.749522 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1675/3246] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:00:46 2022] DELETE /compute/v2.1/os-server-groups/57c5e4ce-6778-44e0-9114-69bc282259e7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:46.756501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.757760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.758412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:46.768348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.768823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.servers [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Removing options 'limit' from query {{(pid=138885) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 21:00:46.770224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:46.775383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.775772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.776430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.776868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.777439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.777866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.777970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.779211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.779566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.779850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.780202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.780802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.828285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-69ac6a5b-2f32-4236-bc46-412c372f07df tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.076743 Oct 29 21:00:46.828546 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1676/3247] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:46.839219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.839871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:46.860435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.860941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.861757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.862139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:46.862603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:46.863039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:46.958119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:46.971507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ef40b9c-cedf-4897-b367-d42055ca82b7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 200 len: 1468 microversion: 2.1 time: 0.228133 Oct 29 21:00:46.972297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1572/3248] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:46.977566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2cd961e5-20a5-4f72-95bc-f6880d5b3a3c tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:46.997024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2cd961e5-20a5-4f72-95bc-f6880d5b3a3c tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.021884 Oct 29 21:00:46.998408 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1573/3249] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:47.004221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.011723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:47.014061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1491626269', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:47.024473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.026095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.026910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.030179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.030879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.031985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.100773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:47.110124 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-122cf7e0-de9b-4f59-8aeb-bb8e2f0f1cf4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1508 microversion: 2.1 time: 0.280776 Oct 29 21:00:47.110804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1677/3250] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:47.116098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.125107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:47.126069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Searching by: {'reservation_id': 'r-wz9y74ky', 'deleted': False, 'project_id': '6506ce28d00440bb9f768ec7768a18f7'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:00:47.131728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.133036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.133036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.133734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.134191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.134620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.149921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:47.289917 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-747cc85a-c5d7-445c-8fcc-a71614f663e7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1491626269" status: 200 len: 346 microversion: 2.1 time: 0.290174 Oct 29 21:00:47.291750 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1574/3251] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 21:00:46 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1491626269 => generated 346 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:47.299312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:47.301142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4c0cbcd-bc77-42a0-9c8a-5ed06c95e4a1 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.313437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:00:47.371393 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4c0cbcd-bc77-42a0-9c8a-5ed06c95e4a1 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/94477960-cb06-43ca-aa43-99629ae13a5d" status: 204 len: 0 microversion: 2.1 time: 0.078036 Oct 29 21:00:47.371949 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1575/3252] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:00:47 2022] DELETE /compute/v2.1/os-server-groups/94477960-cb06-43ca-aa43-99629ae13a5d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:47.387391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.388634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:47.405849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.406360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.413969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.415016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.415541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.415992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.449651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:47.458475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.459024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.459403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.783477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:47.789219 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63818e9f-5cdb-41e0-a67c-668c9e20db86 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-wz9y74ky" status: 200 len: 2930 microversion: 2.1 time: 0.676628 Oct 29 21:00:47.790065 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1678/3253] 10.222.0.36 () {58 vars in 1197 bytes} [Sat Oct 29 21:00:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wz9y74ky => generated 2930 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:47.795521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb3c838e-c8ab-4d9f-8e0e-f37726501157 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:47.808243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb3c838e-c8ab-4d9f-8e0e-f37726501157 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.808551 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c936662d-43bb-414e-a2cd-9213f258e6cc tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1510 microversion: 2.1 time: 0.431020 Oct 29 21:00:47.808803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb3c838e-c8ab-4d9f-8e0e-f37726501157 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.813665 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1576/3254] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:47 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:47.817249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb3c838e-c8ab-4d9f-8e0e-f37726501157 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.818926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d34f69c7-46d6-4440-9462-4a16f972cdb0 req-7f14c174-d1f0-4d16-8adb-f6ab17bcb698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11bddee2-4a83-4178-9ba5-abc01a648538", "name": "network-vif-deleted", "tag": "c7b98d8a-b5e2-4881-a559-17dfffee387b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:47.828544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d34f69c7-46d6-4440-9462-4a16f972cdb0 req-7f14c174-d1f0-4d16-8adb-f6ab17bcb698 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.829028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d34f69c7-46d6-4440-9462-4a16f972cdb0 req-7f14c174-d1f0-4d16-8adb-f6ab17bcb698 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.829496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d34f69c7-46d6-4440-9462-4a16f972cdb0 req-7f14c174-d1f0-4d16-8adb-f6ab17bcb698 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.841167 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d34f69c7-46d6-4440-9462-4a16f972cdb0 req-7f14c174-d1f0-4d16-8adb-f6ab17bcb698 service nova] Creating event network-vif-deleted:c7b98d8a-b5e2-4881-a559-17dfffee387b for instance 11bddee2-4a83-4178-9ba5-abc01a648538 on nch2-master-1 Oct 29 21:00:47.846456 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d34f69c7-46d6-4440-9462-4a16f972cdb0 req-7f14c174-d1f0-4d16-8adb-f6ab17bcb698 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030884 Oct 29 21:00:47.848036 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1577/3255] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:47.852471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2bef728a-d624-40d0-8c02-0c79efde0788 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.863379 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2bef728a-d624-40d0-8c02-0c79efde0788 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014763 Oct 29 21:00:47.871013 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1578/3256] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:00:47 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:47.871013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.871013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:47.876874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.877377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.877868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.878620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.879045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.879473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:47.886427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb3c838e-c8ab-4d9f-8e0e-f37726501157 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Going to try to stop instance {{(pid=138885) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:00:47.936664 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb3c838e-c8ab-4d9f-8e0e-f37726501157 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "POST /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed/action" status: 202 len: 0 microversion: 2.1 time: 0.144144 Oct 29 21:00:47.938039 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1679/3257] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:00:47 2022] POST /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:00:47.945838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1787cf27-348f-46e9-9f73-71c247d8ef6f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:47.976442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.server_groups [None req-1787cf27-348f-46e9-9f73-71c247d8ef6f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Querying cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) for 2 instances {{(pid=138885) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 21:00:47.977147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1787cf27-348f-46e9-9f73-71c247d8ef6f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:47.977748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1787cf27-348f-46e9-9f73-71c247d8ef6f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:47.978215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1787cf27-348f-46e9-9f73-71c247d8ef6f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.011841 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1787cf27-348f-46e9-9f73-71c247d8ef6f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/4fc28cd3-2fe0-4f47-81c6-dd9816786b61" status: 200 len: 271 microversion: 2.1 time: 0.072480 Oct 29 21:00:48.012434 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1680/3258] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:00:47 2022] GET /compute/v2.1/os-server-groups/4fc28cd3-2fe0-4f47-81c6-dd9816786b61 => generated 271 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:48.017211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c42c2a9-9b50-440a-a664-73fa77af29d0 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Action: 'create', calling method: .version_select at 0x7fa17643f9d0>, body: {"server_group": {"name": "tempest-server-group-1853841555", "policies": ["affinity"]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:48.035598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6c42c2a9-9b50-440a-a664-73fa77af29d0 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:48.044659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6c42c2a9-9b50-440a-a664-73fa77af29d0 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:48.099185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6c42c2a9-9b50-440a-a664-73fa77af29d0 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:48.105145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6c42c2a9-9b50-440a-a664-73fa77af29d0 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:48.114471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:48.119481 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6c42c2a9-9b50-440a-a664-73fa77af29d0 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.105865 Oct 29 21:00:48.120087 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1681/3259] 10.222.0.36 () {60 vars in 1173 bytes} [Sat Oct 29 21:00:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:48.125103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.126035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:48.128792 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0b02b94-c679-4af9-b97e-712a834f3e7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.263237 Oct 29 21:00:48.130047 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1579/3260] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:47 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:48.136574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.137193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.137895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.139045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.140512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.141078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.145575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.146406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:48.161964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.163140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.163672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.165170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.165746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.166299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.448671 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dbeeb939-13b7-4c3c-ae97-51f58b7374af tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 200 len: 1619 microversion: 2.1 time: 0.317332 Oct 29 21:00:48.452230 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1580/3261] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 1619 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:48.460234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1fd5d5f4-be32-4e74-b242-f49810fbf1e8 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.461908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:48.471048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8266609b-b87e-4b70-8870-19484b72a98c tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.349573 Oct 29 21:00:48.474683 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1682/3262] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:48.489840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.490473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:48.502498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.503636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.504290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.505441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.506060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.506568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.518766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1fd5d5f4-be32-4e74-b242-f49810fbf1e8 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/ecedf980-2ffe-41b8-b44f-c1d34780b900" status: 204 len: 0 microversion: 2.1 time: 0.065372 Oct 29 21:00:48.520005 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1581/3263] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:00:48 2022] DELETE /compute/v2.1/os-server-groups/ecedf980-2ffe-41b8-b44f-c1d34780b900 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:48.528380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.530647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:48.543416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.548838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.549406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.550394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.550952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.551459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.584107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:48.606137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:48.618049 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2402caa4-e88c-4363-ab8d-0e532a13205e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 200 len: 1466 microversion: 2.1 time: 0.141906 Oct 29 21:00:48.618650 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1683/3264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 1466 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:48.623835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8a6982f-f690-4b29-82a1-5e0f6bc919ee tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.646294 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8a6982f-f690-4b29-82a1-5e0f6bc919ee tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.026441 Oct 29 21:00:48.647389 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1684/3265] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:48.679692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bda7aeb5-f4c2-4f35-9c0f-c3816ee4bc56 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Action: 'create', calling method: .version_select at 0x7fa1710919d0>, body: {"server_group": {"name": "tempest-server-group-1887633189", "policies": ["anti-affinity"]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:48.719561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-bda7aeb5-f4c2-4f35-9c0f-c3816ee4bc56 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:48.729819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-bda7aeb5-f4c2-4f35-9c0f-c3816ee4bc56 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:48.751287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:48.811019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-bda7aeb5-f4c2-4f35-9c0f-c3816ee4bc56 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:48.821241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-bda7aeb5-f4c2-4f35-9c0f-c3816ee4bc56 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_groups'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:48.834187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a58f34c6-9254-4c9c-9b64-ea5dc56c1b89 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 200 len: 1620 microversion: 2.1 time: 0.312736 Oct 29 21:00:48.849489 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1582/3266] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 1620 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:48.849699 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bda7aeb5-f4c2-4f35-9c0f-c3816ee4bc56 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.178898 Oct 29 21:00:48.849699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1685/3267] 10.222.0.36 () {60 vars in 1173 bytes} [Sat Oct 29 21:00:48 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:48.851510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.852164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:48.859490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a09d010-1a77-496f-809e-4cc592357169 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.870655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.870655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.877571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.878548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:48.878945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:48.887353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:48.894485 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a09d010-1a77-496f-809e-4cc592357169 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/68381e00-73cd-4653-89fc-8043c6157132" status: 204 len: 0 microversion: 2.1 time: 0.039539 Oct 29 21:00:48.899405 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1686/3268] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:00:48 2022] DELETE /compute/v2.1/os-server-groups/68381e00-73cd-4653-89fc-8043c6157132 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:00:48.906213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1848874-7769-4e37-9559-8580f9556f59 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:48.923103 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1848874-7769-4e37-9559-8580f9556f59 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.021322 Oct 29 21:00:48.924267 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1687/3269] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:48.999895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1052683700", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "fa45e071-bf2f-4086-9701-ddcd92357695"}]}, "os:scheduler_hints": {"group": "8246d0e1-3f81-458f-afbe-80efd49f917b"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:49.113311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] validate_networks() for [('fa45e071-bf2f-4086-9701-ddcd92357695', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:49.291207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:49.304789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c7871b6-9852-48e6-9e3b-d449bd62823e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1510 microversion: 2.1 time: 0.465226 Oct 29 21:00:49.305598 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1583/3270] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:48 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1510 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:49.311045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1528158043", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "e75e7ef5-74ec-405e-9a01-352979e69378"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:49.386785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:49.947840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:49.948275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:49.948915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:49.949351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:49.949803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:49.965757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:49.966299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:49.966753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:49.967503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:49.967971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:49.968410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.001880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:50.009129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:50.027891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:50.034315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:50.099278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a92fee1-9d74-4a91-8664-10e8693eda91 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792300 Oct 29 21:00:50.100711 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1584/3271] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:50.105838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:50.107229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:50.115254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:50.115752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:50.116190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.117138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:50.117792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:50.118379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.561865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:50.570423 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-58f745ca-9ec8-4e05-9b79-05f1a4b54a40 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.468357 Oct 29 21:00:50.580542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1585/3272] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:50 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:50.583708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:50.584657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:50.585354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:50.586086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:50.586786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:50.595747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:50.596397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:50.623214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:50.624153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:50.624757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.625768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:50.626389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:50.626572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:50.627078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:50.627337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.627521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.628263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:50.628723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:50.629156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:50.688114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:50.702988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:50.727924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:50.731150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:50.805184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=138885) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 29 21:00:50.832097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_group_members'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:50.839836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_group_members'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:50.916020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_group_members'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:50.922799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Getting quotas for user ea5d9bbcd9a0451d84912a1ae06a9e01 and project d1c48a301c994b43839fd1d41c16ba1c. Resources: {'server_group_members'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:50.972024 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-364a4eab-4321-43c4-838e-12d72d004403 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977940 Oct 29 21:00:50.974746 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1688/3273] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:50.985034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:50.987322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:50.999260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.003865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:51.027414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.030406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.034184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.035397 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a8ba1393-49e6-409b-8346-500cc634588f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.453491 Oct 29 21:00:51.036370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.037896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.038702 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1586/3274] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:50 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:51.047778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:51.064126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:51.088013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.094340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.095438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.096790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.097429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.097653 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:00:51.098245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 HTTP/1.1 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '11bddee2-4a83-4178-9ba5-abc01a648538'} Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:51.102438 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:00:51.108098 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-402d0263-d1af-44f4-b0f7-17f915d961fb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 404 len: 111 microversion: 2.1 time: 0.127301 Oct 29 21:00:51.116933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1689/3275] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:50 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:00:51.142632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:51.143381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:51.157755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.158272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.159370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.160101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.160564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.160998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.449749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:51.470586 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-38414303-c5b3-45cf-b4bc-3b53daf860ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1213 microversion: 2.1 time: 0.422735 Oct 29 21:00:51.471236 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1587/3276] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:51 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1213 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:51.492803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0b4d22a6-bdde-4c85-9377-590e35387107 req-515bfd2b-96cd-42f1-96fa-e87304e9e591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8192935b-cb3d-467f-ba5c-327b1f415b3a", "name": "network-vif-plugged", "status": "completed", "tag": "862f0b76-ffcf-4d9c-9371-e3d198eb4d22"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:51.521178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0b4d22a6-bdde-4c85-9377-590e35387107 req-515bfd2b-96cd-42f1-96fa-e87304e9e591 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.521935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0b4d22a6-bdde-4c85-9377-590e35387107 req-515bfd2b-96cd-42f1-96fa-e87304e9e591 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.525565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0b4d22a6-bdde-4c85-9377-590e35387107 req-515bfd2b-96cd-42f1-96fa-e87304e9e591 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.585609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:51.586985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0b4d22a6-bdde-4c85-9377-590e35387107 req-515bfd2b-96cd-42f1-96fa-e87304e9e591 service nova] Creating event network-vif-plugged:862f0b76-ffcf-4d9c-9371-e3d198eb4d22 for instance 8192935b-cb3d-467f-ba5c-327b1f415b3a on nch1-master-1 Oct 29 21:00:51.596907 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00437ec2-0bbd-4e46-8a1b-9ff0bae5f779 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1516 microversion: 2.1 time: 0.478153 Oct 29 21:00:51.606410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0b4d22a6-bdde-4c85-9377-590e35387107 req-515bfd2b-96cd-42f1-96fa-e87304e9e591 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115348 Oct 29 21:00:51.606831 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1690/3277] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:51 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1516 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:51.608160 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1588/3278] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:51.618330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28f8ea14-6a82-43a8-a47a-d429ef39cb30 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:51.619380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-28f8ea14-6a82-43a8-a47a-d429ef39cb30 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:51.625913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6a58ef39-5ff9-4c58-9801-aa1656d93e5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: .version_select at 0x7fa1762a75e0>, body: {"keypair": {"name": "tempest-key-1519536983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUyOX32dpz1OLc2BkeEAhbrKVC716lHSF3CgVhNN9TMCx2WV60T21UaUJ7j6ibHoVUBpA86VN8jJDYCZkOPBSpNFM0NKcJUiTnjwfiBJGS+lpAAXC7BGtL7frxh0bV9GA=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:51.684118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6a58ef39-5ff9-4c58-9801-aa1656d93e5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:51.694846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-28f8ea14-6a82-43a8-a47a-d429ef39cb30 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:51.705102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6a58ef39-5ff9-4c58-9801-aa1656d93e5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:51.709673 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-28f8ea14-6a82-43a8-a47a-d429ef39cb30 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1213 microversion: 2.1 time: 0.100052 Oct 29 21:00:51.724122 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1691/3279] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:51 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:51.735314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:51.735863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:51.745563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.746076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.746518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.747907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:51.748231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:51.748661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:51.773839 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6a58ef39-5ff9-4c58-9801-aa1656d93e5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.164379 Oct 29 21:00:51.777653 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1589/3280] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:51 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:51.790094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0aa3540-3389-4a3d-8281-8ce932e527e7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '.version_select at 0x7fa17176f0d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:51.796528 ncdv-master-1 devstack@n-api.service[138884]: WARNING oslo_db.sqlalchemy.utils [None req-d0aa3540-3389-4a3d-8281-8ce932e527e7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 21:00:51.813390 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d0aa3540-3389-4a3d-8281-8ce932e527e7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.030660 Oct 29 21:00:51.814637 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1590/3281] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 21:00:51 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:52.018634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:52.042239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d77c077a-5585-4859-aee9-d75148c34d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.315435 Oct 29 21:00:52.043579 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1692/3282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:51 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:52.065899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:52.066659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:52.095393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:52.095722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:52.096174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:52.096918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:52.097387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:52.097858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:52.152067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1693285703", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "key_name": "tempest-key-1519536983", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:52.258121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:52.583874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:52.598004 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f8d48089-7860-48d2-a6b9-7cddc0fb3054 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.536720 Oct 29 21:00:52.600439 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1591/3283] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:52 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:52.614386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:52.615419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:52.633334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:52.634546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:52.636453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:52.638634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:52.640862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:52.641623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:52.811137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:52.836840 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9be4f6ee-ff2c-427e-917a-a47813fe186c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1275 microversion: 2.1 time: 0.234380 Oct 29 21:00:52.850659 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1592/3284] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:52 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:52.863690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:52.864326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:52.873142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:52.873669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:52.874736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:52.874860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:52.875275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:52.875706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:52.995605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:53.009143 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91a362d0-e5d7-46c7-9647-756a895d68a4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1265 microversion: 2.1 time: 0.153150 Oct 29 21:00:53.010174 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1593/3285] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:52 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:53.070713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:53.071922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:53.078408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.078839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.079282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.079988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.080445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.080872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.117049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:53.118070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:53.118778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:53.119190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:53.119656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:53.133255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.134038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.134649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.135807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.136544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.137302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.156734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:53.162396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:53.176596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:53.179116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:00:53.249949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6bcb13be-d224-4bf7-a1b8-4f0394157aef tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103152 Oct 29 21:00:53.261521 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1693/3286] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:00:53.267048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2026dc3-ee00-492b-a102-19bb569cfaba tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'create', calling method: .version_select at 0x7fa17113b1f0>, body: {"keypair": {"name": "tempest-keypair-1620558044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJVthQ59qZDFBjV46vBC5te3WVFSgHRlnUGwznK6z+gJ1BKfmcqMhmZ07v9So/lTeppucDGemL6wbFAkSJTGZVmW3kcVSgyjUMSEbHmf3npJ/8yvBwBoyrXA2cSRZFUrw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:53.278234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:53.291165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c2026dc3-ee00-492b-a102-19bb569cfaba tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for project 47be3cb65cc34590a94a9a161b94a598. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:53.302316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c2026dc3-ee00-492b-a102-19bb569cfaba tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for user d3525b70b7874e7c99485cd7a1efa78d and project 47be3cb65cc34590a94a9a161b94a598. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:53.314674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:53.330520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf541327-a7a9-4754-a409-4e841176c7ad tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.261980 Oct 29 21:00:53.331634 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1594/3287] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:53 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:53.350743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5bb98c83-2622-40e4-883a-a2e7d4fac245 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:53.351836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5bb98c83-2622-40e4-883a-a2e7d4fac245 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:53.377150 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2026dc3-ee00-492b-a102-19bb569cfaba tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114455 Oct 29 21:00:53.379821 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1694/3288] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:00:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:53.476509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5bb98c83-2622-40e4-883a-a2e7d4fac245 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:53.486924 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5bb98c83-2622-40e4-883a-a2e7d4fac245 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1229 microversion: 2.1 time: 0.151578 Oct 29 21:00:53.489707 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1595/3289] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:53 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1229 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:53.628944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:53.629438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:53.639524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.640020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.640458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.641351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.641865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.642286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.863594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:53.864251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:53.875418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.876121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.876727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:53.877703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:53.878340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:53.878944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.058879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:54.071597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-156d8b3d-26fe-4850-a804-941ff663ed57 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.447675 Oct 29 21:00:54.089183 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1695/3290] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:53 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:54.104100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:54.105971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:54.122663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:54.123829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:54.124443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.125588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:54.126215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:54.128851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.398434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:54.415012 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07208c9a-c5b4-4f4c-a42c-12b15ff95ec4 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1271 microversion: 2.1 time: 0.324044 Oct 29 21:00:54.415937 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1696/3291] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:54 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:54.422156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:54.423471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:54.451279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:54.456763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:54.457321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.458704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:54.459200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:54.459639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.774364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:54.791078 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16841674-95f5-4a0c-934b-f154b6d9d017 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.931272 Oct 29 21:00:54.795815 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1596/3292] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:53 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:54.816472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:54.817147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:54.834345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:54.834849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:54.835301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.836023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:54.836486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:54.836924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:54.970764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:54.984616 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4cf197dc-5299-446d-a82b-c078d20ee9ca tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1281 microversion: 2.1 time: 0.187170 Oct 29 21:00:54.986329 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1597/3293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:54 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:54.999815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:55.015561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64712ff9-5bea-4525-b04a-6710cbbcdb60 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1520 microversion: 2.1 time: 0.597068 Oct 29 21:00:55.016598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1697/3294] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:54 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1520 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:55.099391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:55.100721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:55.115137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:55.116011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:55.116833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:55.118996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:55.119747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:55.121089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:55.443406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:55.444571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:55.452725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:55.461008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:55.462425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:55.463510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:55.464209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:55.464884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:55.811942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:55.835668 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52b1dad4-f065-4b5f-b550-dc58ae8708b9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.740777 Oct 29 21:00:55.839492 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1598/3295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:55 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:55.847357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:55.848338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:55.859027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:55.859794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:55.861123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:55.862992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:55.863688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:55.864353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.051506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:56.068362 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6236d5c-f35b-448b-b7a6-6fde3ef2988e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.628388 Oct 29 21:00:56.093225 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1698/3296] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:55 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:56.100605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:56.101237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:56.111824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.112764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.113422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.114348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.114807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.115632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.492783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:56.502510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:56.517149 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-179818a6-7ccf-418a-98b8-8e656d1e3c85 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.674100 Oct 29 21:00:56.520465 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1599/3297] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:55 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:56.524082 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-945d57a7-f5e3-45e3-8425-b69fa281c771 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1287 microversion: 2.1 time: 0.429424 Oct 29 21:00:56.541859 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1699/3298] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:56 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1287 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:56.542066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:56.542192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:56.549003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:56.551393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.552105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.552557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.553322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.553830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.554269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.768871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b93faa1e-60c3-458f-ac70-147ebec1494f req-203d0971-6efa-490e-8eee-49b6aac5f17f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1a909f-35e9-4151-a815-7c8b2d95c27a", "tag": "45d740db-d692-4e87-a757-9a604d7143e8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:56.784809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b93faa1e-60c3-458f-ac70-147ebec1494f req-203d0971-6efa-490e-8eee-49b6aac5f17f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.785294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b93faa1e-60c3-458f-ac70-147ebec1494f req-203d0971-6efa-490e-8eee-49b6aac5f17f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.785771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b93faa1e-60c3-458f-ac70-147ebec1494f req-203d0971-6efa-490e-8eee-49b6aac5f17f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.803080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b93faa1e-60c3-458f-ac70-147ebec1494f req-203d0971-6efa-490e-8eee-49b6aac5f17f service nova] Creating event network-changed:45d740db-d692-4e87-a757-9a604d7143e8 for instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a on nch2-master-1 Oct 29 21:00:56.810920 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b93faa1e-60c3-458f-ac70-147ebec1494f req-203d0971-6efa-490e-8eee-49b6aac5f17f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046192 Oct 29 21:00:56.812110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1700/3299] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:00:56.862802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:56.864016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:56.871669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.872602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.873267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.874299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.874957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.875747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.897724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:56.918762 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d83b036b-9044-4101-8342-258ab0f3e7ae tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1505 microversion: 2.1 time: 0.396888 Oct 29 21:00:56.934216 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1600/3300] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:56 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:56.942886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:56.943833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:56.951858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.952690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.953341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:56.954359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:56.955024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:56.955541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.300208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:57.309948 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5584c599-7e9d-40d1-a730-619998d2a989 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.452551 Oct 29 21:00:57.310548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1701/3301] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:56 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:57.329642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:57.338195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:57.339031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:57.343111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f83d790a-3782-4a10-929a-0650c851fe3b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 200 len: 1505 microversion: 2.1 time: 0.404173 Oct 29 21:00:57.347809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.348314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.348767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.349560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.350006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.350437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.357976 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1601/3302] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:56 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:00:57.365955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:57.366485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:57.373431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.374302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.374828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.375626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.376177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.376694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.403764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:00:57.433745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:57.491132 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3d3cdb8-6340-4188-ba59-530309144405 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 204 len: 0 microversion: 2.1 time: 0.128784 Oct 29 21:00:57.491736 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1602/3303] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:00:57 2022] DELETE /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:00:57.544408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:57.546522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:57.558142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.562091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.562972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.564000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.566125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.566587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.904120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:57.915444 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73ce978e-1e3c-4a34-9cb5-cbf388142855 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.580556 Oct 29 21:00:57.918064 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1702/3304] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:57 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:57.929227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:00:57.929868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:00:57.945670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.946565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.947748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.948748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:57.949871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:57.950991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:57.971087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:00:58.209871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:58.224101 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16fb4c56-9530-4669-b465-b497527f1acc tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.684704 Oct 29 21:00:58.225050 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1603/3305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:57 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:58.238047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1997052111", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "bad36a5b-055e-432b-a9c1-48ee70be6e17"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:58.307766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] validate_networks() for [('bad36a5b-055e-432b-a9c1-48ee70be6e17', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:58.360573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:00:58.368299 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e55a0401-9536-42df-bbec-df3a3d38d46e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.449230 Oct 29 21:00:58.368884 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1703/3306] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:00:57 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:00:58.374614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-183670664", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de04bd19-23e0-46bc-981c-3043ca16684b"}], "security_groups": [{"name": "tempest-securitygroup--1487973819"}], "key_name": "tempest-keypair-1620558044", "user_data": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:00:58.582882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] validate_networks() for [('de04bd19-23e0-46bc-981c-3043ca16684b', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:00:59.835337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:00:59.835835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:00:59.836332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:00:59.837016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:00:59.837721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:00:59.860191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:59.861046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:59.861769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:59.862734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:00:59.863368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:00:59.863972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:00:59.910094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Getting quotas for project 92ced91d5c874306ae56325583f3bb12. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:00:59.918315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Getting quotas for user 5e85d4d6aed54dae96f3a7ade33611f6 and project 92ced91d5c874306ae56325583f3bb12. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:00:59.937239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:00:59.940165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:00.009928 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48e2d0d9-1b85-46b6-a5a7-d7aa8cfd9425 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.775865 Oct 29 21:01:00.017410 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1604/3307] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:00.024368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:00.025305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:00.046008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.052927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.053762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.054767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.055408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.056593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.131561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:00.132056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:00.132643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:00.132840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:00.133252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:00.141059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=83 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:00.155761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.156255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.156696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.157425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.159440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.160111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.222784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for project 47be3cb65cc34590a94a9a161b94a598. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:00.228649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Getting quotas for user d3525b70b7874e7c99485cd7a1efa78d and project 47be3cb65cc34590a94a9a161b94a598. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:00.248412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:00.251959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:00.336710 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ba2ff6a-4d10-4376-8bf3-97d25930d5b7 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.966679 Oct 29 21:01:00.341647 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1704/3308] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:00:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:00.349487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2629bd2f-55d7-4aec-9507-ebb2dffe9fb2 req-8d76506e-bbaa-4c17-910a-0967173ab18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cd1567-01aa-4ed8-8884-2fc75b282009", "tag": "63eed9bd-e890-4791-82e3-4dbbdba0cc5d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:00.363671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2629bd2f-55d7-4aec-9507-ebb2dffe9fb2 req-8d76506e-bbaa-4c17-910a-0967173ab18d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.364421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2629bd2f-55d7-4aec-9507-ebb2dffe9fb2 req-8d76506e-bbaa-4c17-910a-0967173ab18d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.365049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2629bd2f-55d7-4aec-9507-ebb2dffe9fb2 req-8d76506e-bbaa-4c17-910a-0967173ab18d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.381624 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2629bd2f-55d7-4aec-9507-ebb2dffe9fb2 req-8d76506e-bbaa-4c17-910a-0967173ab18d service nova] Creating event network-changed:63eed9bd-e890-4791-82e3-4dbbdba0cc5d for instance 17cd1567-01aa-4ed8-8884-2fc75b282009 on nch2-master-1 Oct 29 21:01:00.393687 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2629bd2f-55d7-4aec-9507-ebb2dffe9fb2 req-8d76506e-bbaa-4c17-910a-0967173ab18d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048365 Oct 29 21:01:00.394803 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1705/3309] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:00.400387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:00.401293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:00.410584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.413024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.414283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.418220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.418953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.419785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.614171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:00.628400 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b20f5ba-9f95-4df6-9a57-5c1862223c5a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.607505 Oct 29 21:01:00.630611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1605/3310] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:00 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:00.649144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:00.652774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:00.667952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.668797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.669419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:00.671382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:00.672104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:00.673222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.045316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:01.064189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1f00491-0b62-45f3-b71f-c82e410b2036 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.667330 Oct 29 21:01:01.066815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1706/3311] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:00 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:01.080407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:01.083994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:01.090329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:01.126696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.129126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.132388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.134232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.134948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.136769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.146110 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e78b0e5c-59ee-4b68-8da7-e2dce4becfda tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.508439 Oct 29 21:01:01.170326 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1606/3312] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:00 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:01.191310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:01.193191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:01.227939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.232657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.237700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.243038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.244427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.251424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.410473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:01.424803 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3e65453-e75d-4f52-94f6-33b7e5ee9339 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1222 microversion: 2.1 time: 0.250305 Oct 29 21:01:01.428940 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1607/3313] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:01 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:01.440655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:01.441290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:01.457765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.458693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.459171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.461168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.462855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.463370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.571979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:01.583550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65733a2c-a773-4c9d-8b71-1c1759a8ca5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.511808 Oct 29 21:01:01.597611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1707/3314] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:01 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:01.613964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-db35124b-2bff-4e56-b566-04060f6f74a9 req-d81e45fb-ce3d-437b-be4b-b7cdde1f076d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367afe3d-08fb-45b3-b407-7b14ad04aeb8", "tag": "a4c2fb54-e6a8-4511-9d39-b9e59c77b46e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:01.642781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-db35124b-2bff-4e56-b566-04060f6f74a9 req-d81e45fb-ce3d-437b-be4b-b7cdde1f076d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.644168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-db35124b-2bff-4e56-b566-04060f6f74a9 req-d81e45fb-ce3d-437b-be4b-b7cdde1f076d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.645179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-db35124b-2bff-4e56-b566-04060f6f74a9 req-d81e45fb-ce3d-437b-be4b-b7cdde1f076d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.676271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-db35124b-2bff-4e56-b566-04060f6f74a9 req-d81e45fb-ce3d-437b-be4b-b7cdde1f076d service nova] Creating event network-changed:a4c2fb54-e6a8-4511-9d39-b9e59c77b46e for instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 on nch2-master-1 Oct 29 21:01:01.688514 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-db35124b-2bff-4e56-b566-04060f6f74a9 req-d81e45fb-ce3d-437b-be4b-b7cdde1f076d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089286 Oct 29 21:01:01.691754 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1708/3315] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:01.703490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:01.706774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:01.721521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.722316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.723784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.724899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:01.727127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:01.728713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:01.755668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:01.770112 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a773c7c9-8ef9-4bf5-b53c-0b41ff4b6c54 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1249 microversion: 2.1 time: 0.336462 Oct 29 21:01:01.773135 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1608/3316] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:01 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1249 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:02.071170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:02.090567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:02.091765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:02.105400 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d82cd531-bcfd-461e-b90f-1ef498ff6bd1 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.401966 Oct 29 21:01:02.109096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.109993 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1709/3317] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:01 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:02.111177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.115288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.116442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.117796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.120360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.133302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ae3b22d8-b66a-4a61-aaa9-2fee37c5bb86 req-0b6d0892-1f2c-4550-973c-46caee37bd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1a909f-35e9-4151-a815-7c8b2d95c27a", "name": "network-vif-plugged", "status": "completed", "tag": "45d740db-d692-4e87-a757-9a604d7143e8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:02.167257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ae3b22d8-b66a-4a61-aaa9-2fee37c5bb86 req-0b6d0892-1f2c-4550-973c-46caee37bd39 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.169632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ae3b22d8-b66a-4a61-aaa9-2fee37c5bb86 req-0b6d0892-1f2c-4550-973c-46caee37bd39 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.173702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ae3b22d8-b66a-4a61-aaa9-2fee37c5bb86 req-0b6d0892-1f2c-4550-973c-46caee37bd39 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.219416 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ae3b22d8-b66a-4a61-aaa9-2fee37c5bb86 req-0b6d0892-1f2c-4550-973c-46caee37bd39 service nova] Creating event network-vif-plugged:45d740db-d692-4e87-a757-9a604d7143e8 for instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a on nch2-master-1 Oct 29 21:01:02.242830 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ae3b22d8-b66a-4a61-aaa9-2fee37c5bb86 req-0b6d0892-1f2c-4550-973c-46caee37bd39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113553 Oct 29 21:01:02.246057 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1710/3318] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:02.275197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:02.275922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:02.294208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.295052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.295721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.299308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.300543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.301871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.573885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:02.594332 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-24a65247-40db-4a9b-a7a3-642dcf425f35 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.508485 Oct 29 21:01:02.597430 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1609/3319] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:02 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:02.610215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c55465ca-ed40-4d29-b166-5f89c348f68a req-f848fdad-d814-4d20-931e-edddf2454a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8192935b-cb3d-467f-ba5c-327b1f415b3a", "name": "network-vif-deleted", "tag": "862f0b76-ffcf-4d9c-9371-e3d198eb4d22"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:02.624995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:02.626193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c55465ca-ed40-4d29-b166-5f89c348f68a req-f848fdad-d814-4d20-931e-edddf2454a11 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.626915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c55465ca-ed40-4d29-b166-5f89c348f68a req-f848fdad-d814-4d20-931e-edddf2454a11 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.627754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c55465ca-ed40-4d29-b166-5f89c348f68a req-f848fdad-d814-4d20-931e-edddf2454a11 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.635228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-775df1af-48b5-4514-b063-017f5d323fd6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.383481 Oct 29 21:01:02.635959 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1711/3320] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:02 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:02.641287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:02.642387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:02.649979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.650935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.651607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.652402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.652972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.653561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.656615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c55465ca-ed40-4d29-b166-5f89c348f68a req-f848fdad-d814-4d20-931e-edddf2454a11 service nova] Creating event network-vif-deleted:862f0b76-ffcf-4d9c-9371-e3d198eb4d22 for instance 8192935b-cb3d-467f-ba5c-327b1f415b3a on nch1-master-1 Oct 29 21:01:02.663594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c55465ca-ed40-4d29-b166-5f89c348f68a req-f848fdad-d814-4d20-931e-edddf2454a11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064188 Oct 29 21:01:02.664221 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1610/3321] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:02.670398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:02.671195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:02.678072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.678858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.679371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.680310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.680848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.681362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.727300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:02.741120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9df85a4d-7ec2-4aca-94dd-7853cd81ea8a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1270 microversion: 2.1 time: 0.103707 Oct 29 21:01:02.754128 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1712/3322] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:02 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:02.795223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:02.795995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:02.803279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.803782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.804231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.804944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:02.805406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:02.805867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:02.944987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:02.949595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:02.960071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-036b6381-331c-4a85-8f76-9dda3826747f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.294093 Oct 29 21:01:02.964758 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1611/3323] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:02 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:02.967793 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f3c18860-3e22-47b0-aa09-a1a01640c05d tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1241 microversion: 2.1 time: 0.177317 Oct 29 21:01:02.968932 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1713/3324] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:02 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1241 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:03.136209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:03.136732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:03.144097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:03.145328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:03.146151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:03.148073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:03.148688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:03.149699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:03.300111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:03.308218 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ccbb639f-4a6f-4016-8d3d-5e033f2a4797 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.176192 Oct 29 21:01:03.308798 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1612/3325] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:03 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:03.619865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:03.620470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:03.627747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:03.628879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:03.630339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:03.631278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:03.632174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:03.632915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:03.666162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:03.667321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:03.677580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:03.678444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:03.679196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:03.680339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:03.681468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:03.682146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.076908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:04.090883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:04.092699 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0f0a6bef-6050-4947-af89-c8688d16e088 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.437927 Oct 29 21:01:04.093312 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1613/3326] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:03 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:04.097830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:04.098455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:04.100564 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e76cc663-fd08-4a7e-9781-8d3f8ca17d43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.484490 Oct 29 21:01:04.106840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1714/3327] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:03 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:04.111972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.112560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:04.113184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:04.114303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.114762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.115496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.115962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.116399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.132110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.132654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.133098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.134370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.136998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.138416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.783649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:04.795248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-71c22a1a-47e6-40eb-b1af-09ca42cd24d0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.700754 Oct 29 21:01:04.796391 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1614/3328] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:04 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:04.802518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:04.803360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:04.816112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.816619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.817362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.818253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.818810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.819158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.829873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:04.842921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae4295c2-da05-4654-8e44-df400438cad3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.736830 Oct 29 21:01:04.844531 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1715/3329] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:04 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:04.850562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:04.851523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:04.859620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.860883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.861601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.862592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:04.863339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:04.864009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:04.906729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:04.918412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f06f426-0707-47d8-9936-dab9b595019c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1297 microversion: 2.1 time: 0.120595 Oct 29 21:01:04.934433 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1615/3330] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:04 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1297 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:05.104898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:05.122230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:05.123183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:05.133240 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6eaf2579-6fc9-4350-85e6-9b9f59ce4201 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.287303 Oct 29 21:01:05.143466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.144298 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1716/3331] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:04 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:05.147688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.149348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.157111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.163082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.165378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:05.166371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:05.169071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.176201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.176964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.177596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.179494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.180406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.181142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.561920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:05.571921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36c7fd24-2978-4f72-a22a-ea98fa76df43 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.426107 Oct 29 21:01:05.573322 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1717/3332] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:05 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:05.589095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:05.602840 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b517a1ae-183f-4a7c-84ab-a6d8405d2356 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1317 microversion: 2.1 time: 0.486003 Oct 29 21:01:05.604220 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1616/3333] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:05 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:05.821350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:05.822142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:05.835609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.837199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.843307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.844041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.844770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.845390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.861696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1cc81140-6d6c-4d70-9101-9845eafd6c04 req-f57c9399-7213-42b1-afb4-58a8977e92d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0785aa-27c3-44da-9417-e45732a59fb1", "tag": "4d579cc4-15ee-497b-9c3d-126fd5b8c0e6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:05.893139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1cc81140-6d6c-4d70-9101-9845eafd6c04 req-f57c9399-7213-42b1-afb4-58a8977e92d4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:05.897774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1cc81140-6d6c-4d70-9101-9845eafd6c04 req-f57c9399-7213-42b1-afb4-58a8977e92d4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:05.898614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1cc81140-6d6c-4d70-9101-9845eafd6c04 req-f57c9399-7213-42b1-afb4-58a8977e92d4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:05.953072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1cc81140-6d6c-4d70-9101-9845eafd6c04 req-f57c9399-7213-42b1-afb4-58a8977e92d4 service nova] Creating event network-changed:4d579cc4-15ee-497b-9c3d-126fd5b8c0e6 for instance 8b0785aa-27c3-44da-9417-e45732a59fb1 on nch2-master-1 Oct 29 21:01:05.971583 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1cc81140-6d6c-4d70-9101-9845eafd6c04 req-f57c9399-7213-42b1-afb4-58a8977e92d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112248 Oct 29 21:01:05.972217 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1617/3334] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:06.002602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:06.003343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:06.012769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.022317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.023075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.023987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.024620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.025221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.052567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:06.067839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1d42f3d-544d-4809-a184-a5b133abdd99 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.248492 Oct 29 21:01:06.071967 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1718/3335] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:05 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:06.082641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:06.083508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:06.094957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.098021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.098870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.099823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.100450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.101051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.232543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:06.241973 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31b058b0-d762-421f-82d1-11bbf3ece11e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1315 microversion: 2.1 time: 0.168616 Oct 29 21:01:06.243384 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1719/3336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:06 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:06.249657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a751c2c0-d4e2-478b-abe3-425589e9ae1c req-7bbeb55c-1c2b-4b2d-8275-8b6ed1adeaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cd1567-01aa-4ed8-8884-2fc75b282009", "name": "network-vif-plugged", "status": "completed", "tag": "63eed9bd-e890-4791-82e3-4dbbdba0cc5d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:06.261861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a751c2c0-d4e2-478b-abe3-425589e9ae1c req-7bbeb55c-1c2b-4b2d-8275-8b6ed1adeaf8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.262657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a751c2c0-d4e2-478b-abe3-425589e9ae1c req-7bbeb55c-1c2b-4b2d-8275-8b6ed1adeaf8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.263555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a751c2c0-d4e2-478b-abe3-425589e9ae1c req-7bbeb55c-1c2b-4b2d-8275-8b6ed1adeaf8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.278617 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a751c2c0-d4e2-478b-abe3-425589e9ae1c req-7bbeb55c-1c2b-4b2d-8275-8b6ed1adeaf8 service nova] Creating event network-vif-plugged:63eed9bd-e890-4791-82e3-4dbbdba0cc5d for instance 17cd1567-01aa-4ed8-8884-2fc75b282009 on nch2-master-1 Oct 29 21:01:06.284783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a751c2c0-d4e2-478b-abe3-425589e9ae1c req-7bbeb55c-1c2b-4b2d-8275-8b6ed1adeaf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039433 Oct 29 21:01:06.286145 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1720/3337] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:06.295461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:06.297103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:06.305517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.306465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.310102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.311118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.311600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.312285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.493532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:06.503309 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bfea4dac-64f4-4b37-856d-95bcd4b0dcf3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.529882 Oct 29 21:01:06.504470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1618/3338] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:05 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:06.599491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:06.600118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:06.607044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.607786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.609039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.609966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.610596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.611196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.652725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:06.662284 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45191687-0875-4f53-9807-826f9bfad6f0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.373115 Oct 29 21:01:06.663275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1721/3339] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:06 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:06.683926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:06.685000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:06.694587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.695412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.696203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.697391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.698341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.699008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.868282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:06.877898 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae85f80a-e559-4aba-b7a4-36f8f4112cbb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.282263 Oct 29 21:01:06.879056 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1619/3340] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:06 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:06.906340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:06.914674 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2ec5f87-f2ff-4995-8d04-fc81f461e1d5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1466 microversion: 2.1 time: 0.235756 Oct 29 21:01:06.915348 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1722/3341] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:06 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:06.940544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:06.941572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:06.949856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.951244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.951838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.952562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:06.953024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:06.953480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:06.975832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:07.097972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:07.099273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:07.107934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.108705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.109603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.110544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.111416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.112854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.125048 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-24c6e1fa-77f1-49d2-8870-769440abe1d6 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1617 microversion: 2.1 time: 0.189188 Oct 29 21:01:07.125879 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1620/3342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:06 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1617 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:07.147554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:07.270341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:07.271524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:07.279704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.280462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.280942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.281929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.282398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.282838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.295876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:07.305198 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7affd170-21b7-4fcd-a916-f0534f44c476 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.211773 Oct 29 21:01:07.306313 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1723/3343] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:07 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:07.313029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-158731942", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["e75e7ef5-74ec-405e-9a01-352979e69378"]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:07.379926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:07.505359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:07.514788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e95fd197-8bf3-422c-8c22-31cfc417ba05 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.249845 Oct 29 21:01:07.518758 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1621/3344] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:07 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:07.531018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:07.531655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:07.545724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.546790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.547472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.548624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.549279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.549998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.776517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:07.777318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:07.779104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:07.780222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:07.780948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:07.795199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.796138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.796802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.799332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.800181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.800977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.816655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=25 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:07.828239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:07.831239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:07.837680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:07.841097 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-57091fe8-b3e7-4cf4-af33-34e556e6bf6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.315291 Oct 29 21:01:07.841619 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1622/3345] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:07 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:07.846648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:07.847540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:07.853942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.854822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.855496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.857007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.857732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.858426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.878537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:07.880916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:07.945707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be008f45-331a-4c53-a971-aa5608b1a173 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637972 Oct 29 21:01:07.946360 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1724/3346] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:07.951166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:07.952115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:07.958605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:07.961198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.961957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.962628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:07.963637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:07.964363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:07.964865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.098643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:08.108851 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d22b2da-942d-4891-b205-e3cf8c967c44 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.265725 Oct 29 21:01:08.115104 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1623/3347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:07 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:08.121273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62a3657d-8ffc-4251-8a95-2076608a3a5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:08.122515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62a3657d-8ffc-4251-8a95-2076608a3a5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:08.153035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:08.168275 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3f611952-4a51-46c4-a2a2-4b42183dbd87 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1313 microversion: 2.1 time: 0.220934 Oct 29 21:01:08.169800 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1725/3348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:07 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:08.190566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-62a3657d-8ffc-4251-8a95-2076608a3a5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:08.192778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=37 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:08.199430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62a3657d-8ffc-4251-8a95-2076608a3a5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1216 microversion: 2.1 time: 0.083171 Oct 29 21:01:08.200254 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1624/3349] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:08 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:08.301118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-016dd946-5d3f-4bcf-9348-ee89953e70fb req-a26d4e0a-7d3e-4c4f-be85-8160e7fa9f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367afe3d-08fb-45b3-b407-7b14ad04aeb8", "name": "network-vif-plugged", "status": "completed", "tag": "a4c2fb54-e6a8-4511-9d39-b9e59c77b46e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:08.311576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-016dd946-5d3f-4bcf-9348-ee89953e70fb req-a26d4e0a-7d3e-4c4f-be85-8160e7fa9f7b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.312663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-016dd946-5d3f-4bcf-9348-ee89953e70fb req-a26d4e0a-7d3e-4c4f-be85-8160e7fa9f7b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.313333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-016dd946-5d3f-4bcf-9348-ee89953e70fb req-a26d4e0a-7d3e-4c4f-be85-8160e7fa9f7b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.327810 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-016dd946-5d3f-4bcf-9348-ee89953e70fb req-a26d4e0a-7d3e-4c4f-be85-8160e7fa9f7b service nova] Creating event network-vif-plugged:a4c2fb54-e6a8-4511-9d39-b9e59c77b46e for instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 on nch2-master-1 Oct 29 21:01:08.330256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:08.331777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:08.333543 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-016dd946-5d3f-4bcf-9348-ee89953e70fb req-a26d4e0a-7d3e-4c4f-be85-8160e7fa9f7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037126 Oct 29 21:01:08.334571 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1726/3350] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:08.342502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.343372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.344055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.344975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.345665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.346312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.490614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:08.498546 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab19d51c-b019-4ab1-9508-5db4c79bc5de tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.173047 Oct 29 21:01:08.499150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1625/3351] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:08 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:08.541927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:08.542755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:08.549769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.550245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.550687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.551381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.551854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.552266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.728781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:08.736642 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa578cc6-7fdf-49c1-bba9-6900f0b11fe6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.198970 Oct 29 21:01:08.737228 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1727/3352] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:08 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:08.864676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:08.865304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:08.871603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.872167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.872608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:08.873310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:08.873853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:08.874281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.081688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:09.091292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b3309cfe-b610-4552-8529-bb4b49f9b6c7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.230410 Oct 29 21:01:09.092409 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1626/3353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:08 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:09.132019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.133334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.147314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.150387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.150846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.151864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.152532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.153274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.192567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.193184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.207393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.208201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.208838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.209792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.210447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.211116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.469788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:09.479731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20eaefb3-6305-4262-8009-95d826e6ed3a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1521 microversion: 2.1 time: 0.351472 Oct 29 21:01:09.488130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:09.489947 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1728/3354] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:09.498284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.498978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.499601 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ba10e7d-0394-4fe4-88c8-47819bbeb533 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1498 microversion: 2.1 time: 0.311025 Oct 29 21:01:09.507226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.507721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.508338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.508983 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1627/3355] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:09.509133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.510255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.510868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.528390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.530355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.538361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.541129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.542013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.543052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.544364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.545094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.602827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:09.612538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-35536e7b-c7f5-46f8-87c4-37c43ef31ab9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1268 microversion: 2.1 time: 0.121424 Oct 29 21:01:09.619143 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1729/3356] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:09.628681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b001eb94-2e29-42e1-b3de-ccffa6213740 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.644479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.server_groups [None req-b001eb94-2e29-42e1-b3de-ccffa6213740 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Querying cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) for 1 instances {{(pid=138885) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 21:01:09.645198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b001eb94-2e29-42e1-b3de-ccffa6213740 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.645712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b001eb94-2e29-42e1-b3de-ccffa6213740 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.646153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b001eb94-2e29-42e1-b3de-ccffa6213740 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.664000 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b001eb94-2e29-42e1-b3de-ccffa6213740 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/8246d0e1-3f81-458f-afbe-80efd49f917b" status: 200 len: 221 microversion: 2.1 time: 0.043523 Oct 29 21:01:09.664864 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1730/3357] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/os-server-groups/8246d0e1-3f81-458f-afbe-80efd49f917b => generated 221 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:09.676508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.680378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.697399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.698140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.699114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.700256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.700876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.701484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.734153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:09.828599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:09.841244 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08107e2a-646c-4c0c-8a02-e0449ea29ee2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.320256 Oct 29 21:01:09.842650 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1628/3358] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:09.848852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.849998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.860444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.861229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.861946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.862890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.863517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.864635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.876209 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-29939a83-818f-42c3-9160-576238a97307 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 204 len: 0 microversion: 2.1 time: 0.203437 Oct 29 21:01:09.877039 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1731/3359] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:09 2022] DELETE /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:09.885968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:09.887238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:09.892099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:09.893262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.893979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.895210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:09.895924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:09.896385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:09.896815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.108259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:10.110656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:10.117915 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-865af523-8105-4b1e-a787-00d6a268e784 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1504 microversion: 2.1 time: 0.236407 Oct 29 21:01:10.120762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1732/3360] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:10.126212 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e68d905-f89b-4a56-892c-e0e32ab42b2a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.282086 Oct 29 21:01:10.127045 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1629/3361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:09 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:10.136628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:10.137810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:10.146816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.147309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.147752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.148455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.149233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.149349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.309156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:10.319928 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-66df352f-9a8a-4bd6-8454-43430b866bdd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.199511 Oct 29 21:01:10.321395 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1733/3362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:10 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:10.394704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d9ebfd0f-689a-442f-be79-cbcee8233f77 req-67cc879a-b898-417d-b8a9-75aa006723df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11aa593f-4fe8-472f-9f8a-3872b461a5f4", "tag": "bf3132a9-fca7-4a6c-8fbe-cea150ab2741"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:10.407276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9ebfd0f-689a-442f-be79-cbcee8233f77 req-67cc879a-b898-417d-b8a9-75aa006723df service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.407871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9ebfd0f-689a-442f-be79-cbcee8233f77 req-67cc879a-b898-417d-b8a9-75aa006723df service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.408548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9ebfd0f-689a-442f-be79-cbcee8233f77 req-67cc879a-b898-417d-b8a9-75aa006723df service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.422472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d9ebfd0f-689a-442f-be79-cbcee8233f77 req-67cc879a-b898-417d-b8a9-75aa006723df service nova] Creating event network-changed:bf3132a9-fca7-4a6c-8fbe-cea150ab2741 for instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 on nch2-master-1 Oct 29 21:01:10.428044 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d9ebfd0f-689a-442f-be79-cbcee8233f77 req-67cc879a-b898-417d-b8a9-75aa006723df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037109 Oct 29 21:01:10.428776 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1630/3363] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:10.504688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:10.505968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:10.513286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.514101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.514745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.515754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.516442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.517090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.640060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:10.640786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:10.647822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.648670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.649359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.650323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.651011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.651684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.674374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:10.685156 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72068d4e-6e0b-4435-b61a-b8ab2cb420da tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1498 microversion: 2.1 time: 0.184164 Oct 29 21:01:10.686233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1734/3364] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:10 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:10.707744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:10.713127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:10.714258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:10.720120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.720883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.721682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.722656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.723334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.723981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.742701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:10.752194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-188dfb99-8d80-48d9-a10c-8956e9cfa435 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1268 microversion: 2.1 time: 0.116859 Oct 29 21:01:10.752842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:10.769908 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1631/3365] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:10 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1268 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:10.785605 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-233ea84a-4c27-4f4c-a2f3-9463aced56b0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.081488 Oct 29 21:01:10.793656 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1735/3366] 10.222.0.36 () {58 vars in 1154 bytes} [Sat Oct 29 21:01:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:10.798916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f6b3d144-0a4f-43c0-8010-aae3a43ac2bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:10.805669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b3d144-0a4f-43c0-8010-aae3a43ac2bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.806216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b3d144-0a4f-43c0-8010-aae3a43ac2bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.806680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b3d144-0a4f-43c0-8010-aae3a43ac2bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.832477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f6b3d144-0a4f-43c0-8010-aae3a43ac2bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Going to try to start instance {{(pid=138884) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 21:01:10.867929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:10.868760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:10.879268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.880087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.880800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.882661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.883378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.884006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.886802 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f6b3d144-0a4f-43c0-8010-aae3a43ac2bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "POST /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed/action" status: 202 len: 0 microversion: 2.1 time: 0.091567 Oct 29 21:01:10.891631 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1632/3367] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:01:10 2022] POST /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:01:10.898248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:10.899104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:10.908596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.909294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.909995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:10.912123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:10.912649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:10.913435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.161858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:11.175923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:11.183775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a9bf55d-dfe1-4cd0-9a59-746e1ff5b3f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.321852 Oct 29 21:01:11.185346 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1736/3368] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:10 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:11.186476 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d4302e4-e95b-4016-9d28-444b5cb3c999 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1507 microversion: 2.1 time: 0.293113 Oct 29 21:01:11.188375 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1633/3369] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:10 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:11.191226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:11.191854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:11.206783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:11.208237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:11.215880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.217519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.218436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.219044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.219934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.221171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.221806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.223749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.224724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.225713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.226202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.226932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.466349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:11.470629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:11.474316 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-85484872-92d6-4af5-9e6b-c155b65713b3 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1504 microversion: 2.1 time: 0.287554 Oct 29 21:01:11.475084 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1737/3370] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:11 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:11.485163 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6626c9a7-b93c-4a26-9ba6-797fdbe1d4eb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.295511 Oct 29 21:01:11.490519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:11.491415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:11.495436 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1634/3371] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:11 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:11.498370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.499065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.499705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.500602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.501291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.501822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.645392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:11.654078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bd20c8d-80ed-430d-a527-13c87bab92a3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1329 microversion: 2.1 time: 0.177670 Oct 29 21:01:11.655087 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1738/3372] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:11 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1329 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:11.776649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:11.777303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:11.785955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.786997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.787731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.788762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.789926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.790640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.859487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f07e3128-d5f4-483f-b853-6d688df7e549 req-8dcfd1cd-0f07-4e98-acd7-97521219cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0785aa-27c3-44da-9417-e45732a59fb1", "name": "network-vif-plugged", "status": "completed", "tag": "4d579cc4-15ee-497b-9c3d-126fd5b8c0e6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:11.874077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f07e3128-d5f4-483f-b853-6d688df7e549 req-8dcfd1cd-0f07-4e98-acd7-97521219cc3e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:11.874659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f07e3128-d5f4-483f-b853-6d688df7e549 req-8dcfd1cd-0f07-4e98-acd7-97521219cc3e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:11.877561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f07e3128-d5f4-483f-b853-6d688df7e549 req-8dcfd1cd-0f07-4e98-acd7-97521219cc3e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:11.894226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:11.903451 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-03ba57b6-b722-4e7c-aae1-bf6118cf4342 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1268 microversion: 2.1 time: 0.130473 Oct 29 21:01:11.904807 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1635/3373] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:11 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1268 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:11.907187 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f07e3128-d5f4-483f-b853-6d688df7e549 req-8dcfd1cd-0f07-4e98-acd7-97521219cc3e service nova] Creating event network-vif-plugged:4d579cc4-15ee-497b-9c3d-126fd5b8c0e6 for instance 8b0785aa-27c3-44da-9417-e45732a59fb1 on nch2-master-1 Oct 29 21:01:11.926246 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f07e3128-d5f4-483f-b853-6d688df7e549 req-8dcfd1cd-0f07-4e98-acd7-97521219cc3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071869 Oct 29 21:01:11.927386 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1739/3374] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:12.238527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:12.239364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:12.240426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:12.241187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:12.252632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.253584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.254196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.255079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.255725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.256160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.276440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.286145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.286639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.287404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.287887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.288323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.354269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:12.552838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:12.567804 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79e861aa-29bb-4fac-a570-b77e2bd40e2f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.350152 Oct 29 21:01:12.569237 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1636/3375] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:12 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:12.570121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:12.575485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:12.576764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:12.580353 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4bee9a6-bbd3-446a-a281-171fa9f71aad tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1507 microversion: 2.1 time: 0.355903 Oct 29 21:01:12.581165 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1740/3376] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:12 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:12.584798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.586009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.586976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.587961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.590136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.591629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.604552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:12.605493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:12.613752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.614680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.615342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.616255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.617526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.618180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.943709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:12.952334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:12.956143 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-19df2fe1-394d-4a17-9fd0-5da1e14c36c9 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1504 microversion: 2.1 time: 0.385204 Oct 29 21:01:12.971918 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1637/3377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:12 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:12.980688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:12.982393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:12.989784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:12.998022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:12.998907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:12.999885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.001558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.002959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.235360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:13.246287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96caa803-9fa4-4c8e-bd08-0b6ab66b1c08 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.663915 Oct 29 21:01:13.256548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1741/3378] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:12 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:13.262070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:13.262734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:13.269542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.270036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.270479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.271217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.271864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.272464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.333576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:13.342814 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4126b148-0eb9-4df4-889a-a4ce2bae9dfe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1511 microversion: 2.1 time: 0.369335 Oct 29 21:01:13.353552 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1638/3379] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:12 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:13.367998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:13.369031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:13.376404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:13.378854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.379516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.380237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.381351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.382387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.383069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.384244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:13.394531 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-878de020-b35b-4c45-aa74-88db287bda99 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1274 microversion: 2.1 time: 0.144257 Oct 29 21:01:13.410165 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1742/3380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:13 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:13.595952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:13.596818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:13.616331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.617203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.618952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.620322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:13.621281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:13.622465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:13.967495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:13.976460 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e05cbf2b-3ade-4e90-9559-2c973bd0871e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1511 microversion: 2.1 time: 0.612662 Oct 29 21:01:13.993109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1639/3381] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:13 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1511 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:13.999379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.000014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.006436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.007170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.007812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.008702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.009331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.009953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.111725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.123680 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d522756-8352-4439-868b-55dc6a9ccc46 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1318 microversion: 2.1 time: 0.531852 Oct 29 21:01:14.126109 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1743/3382] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:13 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:14.131429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1a298610-e595-4395-9cb1-12b299b8dc03 req-9aede35e-4644-4d72-89ba-73cb2a53acc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cd1567-01aa-4ed8-8884-2fc75b282009", "name": "network-vif-deleted", "tag": "63eed9bd-e890-4791-82e3-4dbbdba0cc5d"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:14.145736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1a298610-e595-4395-9cb1-12b299b8dc03 req-9aede35e-4644-4d72-89ba-73cb2a53acc5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.146696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1a298610-e595-4395-9cb1-12b299b8dc03 req-9aede35e-4644-4d72-89ba-73cb2a53acc5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.147340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1a298610-e595-4395-9cb1-12b299b8dc03 req-9aede35e-4644-4d72-89ba-73cb2a53acc5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.166004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1a298610-e595-4395-9cb1-12b299b8dc03 req-9aede35e-4644-4d72-89ba-73cb2a53acc5 service nova] Creating event network-vif-deleted:63eed9bd-e890-4791-82e3-4dbbdba0cc5d for instance 17cd1567-01aa-4ed8-8884-2fc75b282009 on nch2-master-1 Oct 29 21:01:14.174117 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1a298610-e595-4395-9cb1-12b299b8dc03 req-9aede35e-4644-4d72-89ba-73cb2a53acc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045571 Oct 29 21:01:14.175471 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1744/3383] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:14.184535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.185795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.194450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.201611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.201611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.201611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.210033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.210033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.255765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.259377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.267016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.267481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.267954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lazy-loading 'fault' on Instance uuid 17cd1567-01aa-4ed8-8884-2fc75b282009 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:14.270679 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51d996ce-bd4e-48b2-aa17-ab39bc3d2700 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1511 microversion: 2.1 time: 0.276305 Oct 29 21:01:14.271273 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1640/3384] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:13 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:14.288829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.289857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.314617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.315343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.316107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.317258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.317988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.318750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.355873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:14.391555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.405733 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cc30e7e-4d44-491a-9abe-f653a796de44 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1303 microversion: 2.1 time: 0.225523 Oct 29 21:01:14.407663 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1745/3385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:14 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:14.436143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.439141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.462701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.466263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.466982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.468110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.469230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.470172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.542826 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e37e486-a242-42e7-b6b0-f081718b62bf tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 204 len: 0 microversion: 2.1 time: 0.268411 Oct 29 21:01:14.545646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1641/3386] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:14 2022] DELETE /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:14.560248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.570665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.573089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.servers [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Removing options 'limit' from query {{(pid=138884) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 21:01:14.573983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:14.575957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.576518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.577213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.578290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.578458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.578945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.581346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61a51c77-1981-4dfa-8280-dadff2ea5c56 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029316 Oct 29 21:01:14.581533 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1642/3387] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 29 21:01:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:01:14.587859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.587859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.594284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.594874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.595394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.596349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.597569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.597569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.700727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.711752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.724340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b974dce8-2fe5-4674-b600-c3c00ec76789 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1274 microversion: 2.1 time: 0.141503 Oct 29 21:01:14.724825 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aad655aa-e03a-4366-9f6b-c9249958c852 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.313206 Oct 29 21:01:14.725515 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1746/3388] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:14 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:14.728523 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1643/3389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:14 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:14.733613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.734449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.741560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:14.743124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:14.750823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.754260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.754553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.755207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.755387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.755999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.756284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.756972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.757227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:14.757659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.758068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:14.758814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:14.991562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:14.995686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.006361 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9316d7e1-2b75-401e-b8cb-44bec4068adc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1517 microversion: 2.1 time: 0.279441 Oct 29 21:01:15.007334 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1747/3390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:14 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:15.009823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-015a5903-e1eb-4fd4-a229-c8c1a97fc040 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1511 microversion: 2.1 time: 0.279975 Oct 29 21:01:15.014030 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1644/3391] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:14 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:15.052371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.052992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.060483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.061272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.061932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.062821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.064829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.065939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.148518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.149263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.159380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.161934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.162855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.166985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.167958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.169218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.330168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.346563 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c094a63-cbdb-4be3-8647-92b64a8d8472 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 200 len: 1510 microversion: 2.1 time: 0.298237 Oct 29 21:01:15.347164 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1748/3392] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:15.370199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.371072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.373901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.377944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.378665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.379289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.380227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.380852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.381470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.382698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea739b87-4cfe-4af9-a794-0c15fa4ff2f2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1509 microversion: 2.1 time: 0.239016 Oct 29 21:01:15.397900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1645/3393] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:15.406899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.407735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.414256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.414887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.415456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.416317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.416880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.417407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.660498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.665074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.674366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f486d0df-9971-4075-8310-d6f71658df6c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1509 microversion: 2.1 time: 0.271970 Oct 29 21:01:15.677539 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3f40a4f-4424-45fd-b9ba-e7238934bdd7 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1511 microversion: 2.1 time: 0.311063 Oct 29 21:01:15.679053 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1749/3394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:15.692078 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1646/3395] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:15.695888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.696702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.697650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:15.700952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.705088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.706128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.706895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.708647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.710730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.712500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.717085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.717758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.718304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.719313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.719877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.720380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.776834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.777671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.778314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.778933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lazy-loading 'fault' on Instance uuid 17cd1567-01aa-4ed8-8884-2fc75b282009 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:15.815035 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25eee1bb-51a7-448d-b27a-84b029567b93 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "PUT /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1081 microversion: 2.1 time: 0.121571 Oct 29 21:01:15.826553 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1647/3396] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:01:15 2022] PUT /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1081 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:15.828552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.832068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.837259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:15.838171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:15.838301 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be1389db-8632-45d0-b059-805069d6c1c6 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1303 microversion: 2.1 time: 0.157868 Oct 29 21:01:15.839319 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1750/3397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:15.844796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:15.845913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:15.853162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.853863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.854512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.855375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.856029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.856615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.995700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.996320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:15.997408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:15.998889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:15.999526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.000010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.062019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:16.072131 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-436ee655-08dc-45ed-8294-423fc990bc65 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.230812 Oct 29 21:01:16.076616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1751/3398] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:16.081333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.081976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.101083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.102270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.103905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.105531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.106989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.108269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.135497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:16.217540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87c0b375-7895-4d8c-b824-cab7f8540d7a tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 0.385139 Oct 29 21:01:16.217540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1648/3399] 10.222.0.36 () {58 vars in 1154 bytes} [Sat Oct 29 21:01:15 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:16.227024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.227662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.242620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.243532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.245082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.245934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.247880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.248036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.277874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:16.286773 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ef1bdce-451d-4774-9510-90147aa58a88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.209035 Oct 29 21:01:16.301961 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1752/3400] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:16.314443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.314443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.327800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.328366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.328826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.331229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.331777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.332379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.508794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:16.530043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b4e673e-bced-44f0-9709-27a21bb440c0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1507 microversion: 2.1 time: 0.314751 Oct 29 21:01:16.530707 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1649/3401] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:16.538545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:16.548400 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc08a6b9-bb05-4f84-ad6d-274a742e8ae5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1517 microversion: 2.1 time: 0.245026 Oct 29 21:01:16.549204 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1753/3402] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:16.561710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.561710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.570531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.570933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.571366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.571480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.571849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.572779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.573248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.573820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.579576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.580230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.580878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.581702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.582267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.582800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.864099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:16.874909 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cb5bbac-3fc6-484d-97db-11572f547daa tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1511 microversion: 2.1 time: 0.331852 Oct 29 21:01:16.875471 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1650/3403] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:16.881766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.882405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.889747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:16.898408 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c11cdb2-c7b9-4028-ba74-d338bbd03685 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1507 microversion: 2.1 time: 0.333692 Oct 29 21:01:16.899696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1754/3404] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:16.904562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.905068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.905549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.908109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.909180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.909753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.912062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:16.912752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:16.920400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.920833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.921654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.922563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.923447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.924036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.954031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:16.954616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:16.955142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:16.955680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lazy-loading 'fault' on Instance uuid 17cd1567-01aa-4ed8-8884-2fc75b282009 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:17.010745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5d9bbcd9a0451d84912a1ae06a9e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c48a301c994b43839fd1d41c16ba1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:17.021086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a35d37ec-1d0f-42fb-b50a-2ee974d35755 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 200 len: 1303 microversion: 2.1 time: 0.144548 Oct 29 21:01:17.022113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1651/3405] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:17.028582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:17.031981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:17.039126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.039630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.040076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.041048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.041578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.042023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.074211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:17.157981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:17.167244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6375b328-ae1b-4a0a-b5e8-b67bf5142e3e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 200 len: 1510 microversion: 2.1 time: 0.266312 Oct 29 21:01:17.168402 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1755/3406] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:16 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:17.173732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:17.174724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:17.181943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.182803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.183480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.184518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.185190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.185862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.342497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:17.342930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:17.343409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:17.343831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:17.344249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:17.404765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:17.431179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:17.435631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40d6dfe0-2049-4336-b241-68cf16e2cb93 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.264724 Oct 29 21:01:17.437575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:17.453779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.455479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1756/3407] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:17 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:17.456561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.458932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.461668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.461668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.461668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.464046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e9b1e0ca-ed53-4206-b259-ca819b10011d req-4cb83819-4f24-44db-9405-6ae8984b5459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f91f395f-198b-4279-86a0-0fead4968690", "tag": "b7c0feb1-ccd8-480b-b172-8dac1d895412"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:17.478170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e9b1e0ca-ed53-4206-b259-ca819b10011d req-4cb83819-4f24-44db-9405-6ae8984b5459 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.479133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e9b1e0ca-ed53-4206-b259-ca819b10011d req-4cb83819-4f24-44db-9405-6ae8984b5459 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.479838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e9b1e0ca-ed53-4206-b259-ca819b10011d req-4cb83819-4f24-44db-9405-6ae8984b5459 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.500320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-046938d9-013c-40a3-95d5-c3f74a0f4923 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "POST /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1/action" status: 202 len: 1113 microversion: 2.1 time: 0.476699 Oct 29 21:01:17.500980 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1652/3408] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:01:17 2022] POST /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1/action => generated 1113 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 21:01:17.506047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:17.506852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:17.522015 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e9b1e0ca-ed53-4206-b259-ca819b10011d req-4cb83819-4f24-44db-9405-6ae8984b5459 service nova] Creating event network-changed:b7c0feb1-ccd8-480b-b172-8dac1d895412 for instance f91f395f-198b-4279-86a0-0fead4968690 on nch2-master-1 Oct 29 21:01:17.522759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.523267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.523717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.524442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.525084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.525550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.531717 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e9b1e0ca-ed53-4206-b259-ca819b10011d req-4cb83819-4f24-44db-9405-6ae8984b5459 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073917 Oct 29 21:01:17.532830 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1757/3409] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:17.540111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:17.541896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:17.570562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.580982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.584905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.586505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:17.589068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:17.589625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:17.863887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=11 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:17.925624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:17.933708 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b23f58f1-dc92-464f-98d4-186238cf552d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1511 microversion: 2.1 time: 0.431585 Oct 29 21:01:17.937593 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1653/3410] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:17 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:17.971736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:17.984442 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d1124c0-8b46-425e-b3f7-e61dd900ff4d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.449415 Oct 29 21:01:17.986049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1758/3411] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:17 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:17.995213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:17.996100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:18.005282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.005814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.006266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:18.006981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.007444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.008427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:18.108755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-372246260", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1dd6b363-39d8-40fb-b981-7a6a3c050919"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:18.186343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] validate_networks() for [('1dd6b363-39d8-40fb-b981-7a6a3c050919', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:18.200881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:18.290182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:18.306610 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb5a6d85-453a-4e55-b4f2-99937a0b2583 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.318708 Oct 29 21:01:18.321979 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1759/3412] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:17 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:18.327246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:18.328076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:18.335562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.336486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.337125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:18.338028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.338858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.339905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:18.676603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:18.688354 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d8c2666-1de4-4fde-abcc-94fc27a9d030 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1517 microversion: 2.1 time: 0.365203 Oct 29 21:01:18.690056 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1760/3413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:18 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:18.703952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:18.714309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:18.718659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:18.735951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.736855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.737788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:18.739752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.741426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.743115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:18.834062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:18.889170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:18.928602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:18.929408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:18.930787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.187914 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-622aa531-75ec-4518-ad36-059a56e88e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.494775 Oct 29 21:01:19.202193 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1761/3414] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 21:01:18 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:19.202193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.202193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:19.202193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.202647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.202729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.203542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.204177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.209547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.220550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 HTTP/1.1 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '17cd1567-01aa-4ed8-8884-2fc75b282009'} Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:19.222281 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a3c22d5-21b1-4b27-993f-3c2b6467e43b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 404 len: 111 microversion: 2.1 time: 0.033458 Oct 29 21:01:19.227491 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1762/3415] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:19.228875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.229605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:19.236045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.236534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.236980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.237508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:19.237965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.238173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.238427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:19.238604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.238983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:19.239406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:19.239836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:19.249791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.250282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.250723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.251455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.251915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.252345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.276437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Getting quotas for project 9a40f05c2d944feca204812cfc803454. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:19.282460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Getting quotas for user ce8fe5d6bf694d2899a4ac26fd38c66c and project 9a40f05c2d944feca204812cfc803454. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:19.296896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:19.299904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:19.351068 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffc0402d-989d-4ec0-b423-1756fa4efa7a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414484 Oct 29 21:01:19.358299 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1654/3416] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:19.363914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e4b9d548-6a61-491c-86e9-d8486f48953f req-32b23eef-5863-4cba-b91f-1997e6033ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367afe3d-08fb-45b3-b407-7b14ad04aeb8", "name": "network-vif-deleted", "tag": "a4c2fb54-e6a8-4511-9d39-b9e59c77b46e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:19.376150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4b9d548-6a61-491c-86e9-d8486f48953f req-32b23eef-5863-4cba-b91f-1997e6033ade service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.377133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4b9d548-6a61-491c-86e9-d8486f48953f req-32b23eef-5863-4cba-b91f-1997e6033ade service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.377842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4b9d548-6a61-491c-86e9-d8486f48953f req-32b23eef-5863-4cba-b91f-1997e6033ade service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.392872 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e4b9d548-6a61-491c-86e9-d8486f48953f req-32b23eef-5863-4cba-b91f-1997e6033ade service nova] Creating event network-vif-deleted:a4c2fb54-e6a8-4511-9d39-b9e59c77b46e for instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 on nch2-master-1 Oct 29 21:01:19.398519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e4b9d548-6a61-491c-86e9-d8486f48953f req-32b23eef-5863-4cba-b91f-1997e6033ade service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044721 Oct 29 21:01:19.399594 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1655/3417] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:19.400888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:19.405544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.406907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:19.412197 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4dfe055e-8490-4b85-a45b-215bc818ae60 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.185487 Oct 29 21:01:19.414719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1763/3418] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:19.415222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.415964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.416649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.417643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.418884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.419519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.419894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.425557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:19.426413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:19.551228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.553695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.554677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.555836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.556521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.557176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.621680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:19.629617 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8f55398-0658-4215-88da-7c43ebd1f75f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.228485 Oct 29 21:01:19.632552 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1656/3419] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:19.637656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14e68311-1f5a-4813-91f0-1412023fd548 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.656562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.server_groups [None req-14e68311-1f5a-4813-91f0-1412023fd548 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Querying cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) for 1 instances {{(pid=138884) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 21:01:19.657532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14e68311-1f5a-4813-91f0-1412023fd548 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.658549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14e68311-1f5a-4813-91f0-1412023fd548 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.659057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14e68311-1f5a-4813-91f0-1412023fd548 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.676520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14e68311-1f5a-4813-91f0-1412023fd548 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042767 Oct 29 21:01:19.677813 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1657/3420] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:19.690411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.691377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:19.698873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:19.699362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.700148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.700905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.701752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.702375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.703112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.781702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a94cb937-614e-4bb6-aa50-510aa69fce68 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.365836 Oct 29 21:01:19.782715 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1764/3421] 10.222.0.36 () {58 vars in 1150 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:19.793994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a212cd82-3eb5-48ff-a648-1acff1e84fed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.799363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a212cd82-3eb5-48ff-a648-1acff1e84fed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:19.903518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a212cd82-3eb5-48ff-a648-1acff1e84fed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:19.916473 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a212cd82-3eb5-48ff-a648-1acff1e84fed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1224 microversion: 2.1 time: 0.132609 Oct 29 21:01:19.917448 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1765/3422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:19.927210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdf0e249-af43-4bb7-ad65-8f1989e7030e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.944927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:19.954709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31dee002-d2f5-425f-b7ae-33c2d74b05d2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.275693 Oct 29 21:01:19.955304 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1658/3423] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:19.959793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:19.968086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.server_groups [None req-cdf0e249-af43-4bb7-ad65-8f1989e7030e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Querying cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) for 1 instances {{(pid=138885) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 21:01:19.968811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf0e249-af43-4bb7-ad65-8f1989e7030e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.969292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf0e249-af43-4bb7-ad65-8f1989e7030e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.969885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdf0e249-af43-4bb7-ad65-8f1989e7030e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.970782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:19.979923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.980425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.983565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:19.984432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:19.984968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:19.985309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.000935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdf0e249-af43-4bb7-ad65-8f1989e7030e tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/8246d0e1-3f81-458f-afbe-80efd49f917b" status: 200 len: 183 microversion: 2.1 time: 0.076483 Oct 29 21:01:20.002905 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1766/3424] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/os-server-groups/8246d0e1-3f81-458f-afbe-80efd49f917b => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:20.018019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.025839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:20.026997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:20.034650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:20.036702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.037434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.038252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.039357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.050166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.050630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.103874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:20.118698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5688117e-ccc3-41b9-87c6-51ab9e4a9a63 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1475 microversion: 2.1 time: 0.161862 Oct 29 21:01:20.121264 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1659/3425] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:19 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1475 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:20.140854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.141902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:20.152774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.154523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.155324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.156053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.156676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.157198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.194270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 HTTP/1.1 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '17cd1567-01aa-4ed8-8884-2fc75b282009'} Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:20.201082 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:20.205863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a0871a89-30c3-4998-a999-c66d0fcfaacb tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 404 len: 111 microversion: 2.1 time: 0.075343 Oct 29 21:01:20.218109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1660/3426] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:20 2022] DELETE /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:20.225766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9c263c98-3328-4b85-8873-3027dbc4cadb req-8c0e58c8-8b09-4802-9f52-74f6634074c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11aa593f-4fe8-472f-9f8a-3872b461a5f4", "name": "network-vif-plugged", "status": "completed", "tag": "bf3132a9-fca7-4a6c-8fbe-cea150ab2741"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:20.239822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9c263c98-3328-4b85-8873-3027dbc4cadb req-8c0e58c8-8b09-4802-9f52-74f6634074c3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.240444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9c263c98-3328-4b85-8873-3027dbc4cadb req-8c0e58c8-8b09-4802-9f52-74f6634074c3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.240832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9c263c98-3328-4b85-8873-3027dbc4cadb req-8c0e58c8-8b09-4802-9f52-74f6634074c3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.259208 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9c263c98-3328-4b85-8873-3027dbc4cadb req-8c0e58c8-8b09-4802-9f52-74f6634074c3 service nova] Creating event network-vif-plugged:bf3132a9-fca7-4a6c-8fbe-cea150ab2741 for instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 on nch2-master-1 Oct 29 21:01:20.266344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9c263c98-3328-4b85-8873-3027dbc4cadb req-8c0e58c8-8b09-4802-9f52-74f6634074c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045940 Oct 29 21:01:20.267385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1661/3427] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:20.275272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.276331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] [instance: 17cd1567-01aa-4ed8-8884-2fc75b282009] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:20.279918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:20.284615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.285516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.286264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.287485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.288108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.288699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.319552 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 HTTP/1.1 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '17cd1567-01aa-4ed8-8884-2fc75b282009'} Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.321233 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.326044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance 17cd1567-01aa-4ed8-8884-2fc75b282009 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:20.340658 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-803b9109-54a1-4f3f-9976-7365be91495d tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009" status: 404 len: 111 microversion: 2.1 time: 0.056309 Oct 29 21:01:20.344185 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1662/3428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:20 2022] GET /compute/v2.1/servers/17cd1567-01aa-4ed8-8884-2fc75b282009 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:20.356297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a81711d-d9db-4d37-a760-20c8af08608a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.372555 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-9a81711d-d9db-4d37-a760-20c8af08608a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance group 68381e00-73cd-4653-89fc-8043c6157132 could not be found. Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a81711d-d9db-4d37-a760-20c8af08608a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-server-groups/68381e00-73cd-4653-89fc-8043c6157132 HTTP/1.1 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance group 68381e00-73cd-4653-89fc-8043c6157132 could not be found. Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '68381e00-73cd-4653-89fc-8043c6157132'} Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 68381e00-73cd-4653-89fc-8043c6157132 could not be found. Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 68381e00-73cd-4653-89fc-8043c6157132 could not be found. Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.384149 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.388696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.388696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.388696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:20.388696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:20.388696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 68381e00-73cd-4653-89fc-8043c6157132 could not be found. Oct 29 21:01:20.388696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.394312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a81711d-d9db-4d37-a760-20c8af08608a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance group 68381e00-73cd-4653-89fc-8043c6157132 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:20.412334 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a81711d-d9db-4d37-a760-20c8af08608a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/68381e00-73cd-4653-89fc-8043c6157132" status: 404 len: 117 microversion: 2.1 time: 0.051821 Oct 29 21:01:20.414900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1663/3429] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:01:20 2022] DELETE /compute/v2.1/os-server-groups/68381e00-73cd-4653-89fc-8043c6157132 => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:20.424406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c6c916d-d7df-4f57-99ab-78efb3c57941 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.444736 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-6c6c916d-d7df-4f57-99ab-78efb3c57941 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance group ecedf980-2ffe-41b8-b44f-c1d34780b900 could not be found. Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c6c916d-d7df-4f57-99ab-78efb3c57941 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-server-groups/ecedf980-2ffe-41b8-b44f-c1d34780b900 HTTP/1.1 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance group ecedf980-2ffe-41b8-b44f-c1d34780b900 could not be found. Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ecedf980-2ffe-41b8-b44f-c1d34780b900'} Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ecedf980-2ffe-41b8-b44f-c1d34780b900 could not be found. Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ecedf980-2ffe-41b8-b44f-c1d34780b900 could not be found. Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.457865 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ecedf980-2ffe-41b8-b44f-c1d34780b900 could not be found. Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c6c916d-d7df-4f57-99ab-78efb3c57941 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance group ecedf980-2ffe-41b8-b44f-c1d34780b900 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:20.461890 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c6c916d-d7df-4f57-99ab-78efb3c57941 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/ecedf980-2ffe-41b8-b44f-c1d34780b900" status: 404 len: 117 microversion: 2.1 time: 0.041383 Oct 29 21:01:20.462411 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1664/3430] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:01:20 2022] DELETE /compute/v2.1/os-server-groups/ecedf980-2ffe-41b8-b44f-c1d34780b900 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:01:20.473165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.473848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:20.477141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-260ec8a2-c304-414a-a115-dc8e454bf872 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.462808 Oct 29 21:01:20.480545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.481666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.482290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.483166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.483639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.484376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.489299 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1767/3431] 10.222.0.36 () {58 vars in 1212 bytes} [Sat Oct 29 21:01:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:20.494412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8fa7df5-05c0-4b2a-a6c8-cee2cb77a13a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.515953 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f8fa7df5-05c0-4b2a-a6c8-cee2cb77a13a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance group 94477960-cb06-43ca-aa43-99629ae13a5d could not be found. Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8fa7df5-05c0-4b2a-a6c8-cee2cb77a13a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-server-groups/94477960-cb06-43ca-aa43-99629ae13a5d HTTP/1.1 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance group 94477960-cb06-43ca-aa43-99629ae13a5d could not be found. Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '94477960-cb06-43ca-aa43-99629ae13a5d'} Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 94477960-cb06-43ca-aa43-99629ae13a5d could not be found. Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 94477960-cb06-43ca-aa43-99629ae13a5d could not be found. Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.522935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 94477960-cb06-43ca-aa43-99629ae13a5d could not be found. Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.528308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8fa7df5-05c0-4b2a-a6c8-cee2cb77a13a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance group 94477960-cb06-43ca-aa43-99629ae13a5d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:20.534007 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8fa7df5-05c0-4b2a-a6c8-cee2cb77a13a tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/94477960-cb06-43ca-aa43-99629ae13a5d" status: 404 len: 117 microversion: 2.1 time: 0.036796 Oct 29 21:01:20.536224 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1768/3432] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:01:20 2022] DELETE /compute/v2.1/os-server-groups/94477960-cb06-43ca-aa43-99629ae13a5d => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:20.559798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.577072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:20.578176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:20.598581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.599137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.599542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.600651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.602878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.603336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.748970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:20.785945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:20.794282 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b5e90da-06c5-4d0a-b15e-24ef224180a1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.330202 Oct 29 21:01:20.801849 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1665/3433] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:20 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:20.811962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e03c1936-bdd0-428b-83e9-d7ebcb3c543b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.818266 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e03c1936-bdd0-428b-83e9-d7ebcb3c543b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] HTTP exception thrown: Instance group 57c5e4ce-6778-44e0-9114-69bc282259e7 could not be found. Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e03c1936-bdd0-428b-83e9-d7ebcb3c543b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Request method failure captured: Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-server-groups/57c5e4ce-6778-44e0-9114-69bc282259e7 HTTP/1.1 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZR8TRzJ7prB7wpTRjAlrJ5jPHAHDTnRLjoGfUX6EFGbn2Q0f6wECQ47ZwWECIA9zx6Ysqr8-7EA0okLI2BqhDEl1IzL25DfappPOa7_7ZpWJRC_8B4YmB3pO2U6_xWJeExz9aOwwdAYgRPbX1HUvhgfApI30kVDXBLanAy-G3ajHb8 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d1c48a301c994b43839fd1d41c16ba1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d1c48a301c994b43839fd1d41c16ba1c Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerGroupTestJSON-1638576104 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ea5d9bbcd9a0451d84912a1ae06a9e01 Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerGroupTestJSON-1638576104-project Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance group 57c5e4ce-6778-44e0-9114-69bc282259e7 could not be found. Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '57c5e4ce-6778-44e0-9114-69bc282259e7'} Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 57c5e4ce-6778-44e0-9114-69bc282259e7 could not be found. Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 57c5e4ce-6778-44e0-9114-69bc282259e7 could not be found. Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.819990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 57c5e4ce-6778-44e0-9114-69bc282259e7 could not be found. Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e03c1936-bdd0-428b-83e9-d7ebcb3c543b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Returning 404 to user: Instance group 57c5e4ce-6778-44e0-9114-69bc282259e7 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:20.825207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e03c1936-bdd0-428b-83e9-d7ebcb3c543b tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/57c5e4ce-6778-44e0-9114-69bc282259e7" status: 404 len: 117 microversion: 2.1 time: 0.021332 Oct 29 21:01:20.829612 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1666/3434] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:01:20 2022] DELETE /compute/v2.1/os-server-groups/57c5e4ce-6778-44e0-9114-69bc282259e7 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:20.831833 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd1fe977-773d-4cc3-8f12-e683935da1fe tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.291528 Oct 29 21:01:20.832672 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1769/3435] 10.222.0.36 () {58 vars in 1196 bytes} [Sat Oct 29 21:01:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:20.836171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.837072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:20.837752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-406d15e4-c13e-4134-8773-3d1826c9d231 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.847865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.848444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.849069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.849837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.850303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.850741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.866894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-406d15e4-c13e-4134-8773-3d1826c9d231 tempest-ServerGroupTestJSON-1638576104 tempest-ServerGroupTestJSON-1638576104-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/8246d0e1-3f81-458f-afbe-80efd49f917b" status: 204 len: 0 microversion: 2.1 time: 0.032790 Oct 29 21:01:20.867737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1770/3436] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:01:20 2022] DELETE /compute/v2.1/os-server-groups/8246d0e1-3f81-458f-afbe-80efd49f917b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:20.876410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:20.882087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:20.882858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': '1491626269', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:20.889771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.890827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.891487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.892533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:20.893362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:20.894036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:20.998738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:21.082025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-533c09f6-ef16-4f7a-986d-2707e40ba733 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?name=1491626269" status: 200 len: 346 microversion: 2.1 time: 0.208529 Oct 29 21:01:21.082955 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1771/3437] 10.222.0.36 () {58 vars in 1156 bytes} [Sat Oct 29 21:01:20 2022] GET /compute/v2.1/servers?name=1491626269 => generated 346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:21.092693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.093561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:21.108504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.110295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.111057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.112041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.112760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.113212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.118082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:21.128131 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b692289-5abb-45f2-8b5d-b1766adb1921 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.297072 Oct 29 21:01:21.129133 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1667/3438] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:20 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:21.134132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.134764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:21.147101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.147603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.148157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.148892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.149351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.149832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.257681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:21.268472 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49b66f51-7d1d-4d2c-970c-515b462e17a2 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1276 microversion: 2.1 time: 0.183900 Oct 29 21:01:21.269502 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1772/3439] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1276 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:21.274312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.285409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:21.286141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:21.292486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.293054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.293928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.294706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.295166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.295661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.346836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:21.355227 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c064a4d9-2991-4cd1-a825-7d66746b7122 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.224876 Oct 29 21:01:21.356352 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1668/3440] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:21.363068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.363925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:21.388847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.389265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.389734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.390459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.390919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.391347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.428331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:21.457379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.458426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.459149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.459854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lazy-loading 'fault' on Instance uuid 367afe3d-08fb-45b3-b407-7b14ad04aeb8 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:21.511137 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a3603559-1b49-433a-9ed1-974e3b743b8f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.240401 Oct 29 21:01:21.512509 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1773/3441] 10.222.0.36 () {58 vars in 1154 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:21.518713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:21.524115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.527936 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85519971-c8a6-4d9a-a600-a25d202bbd93 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 200 len: 1319 microversion: 2.1 time: 0.168483 Oct 29 21:01:21.530243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:21.531056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-149162626', 'deleted': False, 'project_id': '3236a32c26f94f90975d4e417177f175'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:21.541997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.542732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.543878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.544773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.545498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.546106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.546306 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1669/3442] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:21.650880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:01:21.712654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df6702d1-3e32-49b7-8a3d-d3cbb67ed61e tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-149162626" status: 200 len: 346 microversion: 2.1 time: 0.192081 Oct 29 21:01:21.713381 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1774/3443] 10.222.0.36 () {58 vars in 1228 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-149162626 => generated 346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:21.725998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.726507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:21.733687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.734486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.735159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.735937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.736620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.737146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.765141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:21.819158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.823315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:21.851322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.862240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.865069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.866015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.867009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.868051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.948491 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9a49364-4922-4b94-b7a8-9d57f07d71c4 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "DELETE /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 204 len: 0 microversion: 2.1 time: 0.225856 Oct 29 21:01:21.953193 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1670/3444] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:21 2022] DELETE /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:21.964675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:21.967920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:21.990081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.992108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.993435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:21.994235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:21.994879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:21.998022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.226607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:22.230218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:22.236934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e726978b-cf2f-4e3e-8945-2c0d3ce9600a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1371 microversion: 2.1 time: 0.421862 Oct 29 21:01:22.237884 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1775/3445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:22.242979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:22.243805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:22.251658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.261030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.265305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.266115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.270667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.271299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.295149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:22.306961 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb461609-821e-4947-a5f7-a4dc281922f6 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1517 microversion: 2.1 time: 0.351984 Oct 29 21:01:22.314228 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1671/3446] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:21 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:22.336606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:22.337472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:22.364563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.365295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.365839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.367243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.367830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.368421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.374070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:22.539013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:22.542666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:22.560837 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bca5066a-2d9f-4798-a26b-25aa6156c712 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.321805 Oct 29 21:01:22.561438 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1776/3447] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:22 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:22.577960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:22.577960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:22.577960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.578249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.578687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.583246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b8e0734-e1d6-4b02-a6db-73efc7edd9be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1282 microversion: 2.1 time: 0.251748 Oct 29 21:01:22.584449 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1672/3448] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:22 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:22.591043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:22.591944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:22.594773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:22.598759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.599436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.600014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.611292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.612758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.613499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.614592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:22.615215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:22.615804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:22.641669 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 HTTP/1.1 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '367afe3d-08fb-45b3-b407-7b14ad04aeb8'} Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:22.644157 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:22.649188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:22.649188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:22.649188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:22.649188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:22.649188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:01:22.649188 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:22.651863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:22.653858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-031b10ef-7117-47b2-af02-6e8dc6e47b50 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 404 len: 111 microversion: 2.1 time: 0.068215 Oct 29 21:01:22.654640 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1673/3449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:22 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:22.665017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-37724009-48f6-4399-af87-3c63c0dc8b6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '.version_select at 0x7fa1719b5040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:22.704653 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-37724009-48f6-4399-af87-3c63c0dc8b6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-key-1519536983" status: 202 len: 0 microversion: 2.1 time: 0.045393 Oct 29 21:01:22.709111 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1674/3450] 10.222.0.36 () {58 vars in 1209 bytes} [Sat Oct 29 21:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1519536983 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:01:22.876912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-593482751", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:22.892556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:22.903191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38f8df27-2eec-4f53-ba34-4d6bd37c6a15 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.340086 Oct 29 21:01:22.903576 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1777/3451] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:22 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:22.958048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:23.264016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:23.264770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:23.274528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.275173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.275843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.276665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.277578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.278130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.380667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:23.381183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:23.381650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:23.382289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:23.383054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:23.394232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.394927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.395314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.396085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.396556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.396994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.439944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:23.448636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:23.486637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:23.489335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:23.554349 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6504624a-9230-48f8-81c0-dba3802d8c4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689014 Oct 29 21:01:23.555622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1675/3452] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:01:23.561129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:23.562020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:23.573689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.574420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.575597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.577729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.578381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.579003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.833859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:23.848158 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97514e07-8b43-44cf-afed-31fdff137517 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1564 microversion: 2.1 time: 0.588984 Oct 29 21:01:23.848759 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1778/3453] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:23 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1564 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:23.878518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6b075db-34cf-488f-a536-60eb9686af64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:23.879593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6b075db-34cf-488f-a536-60eb9686af64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:23.890102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:23.903886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60622597-9c4f-4b3f-a785-31c33376873f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1517 microversion: 2.1 time: 0.346730 Oct 29 21:01:23.904685 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1676/3454] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:23 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:23.911182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:23.911985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:23.932619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.934827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.935294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.936127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:23.936839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:23.937436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:23.970958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6b075db-34cf-488f-a536-60eb9686af64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:23.981347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6b075db-34cf-488f-a536-60eb9686af64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1208 microversion: 2.1 time: 0.128339 Oct 29 21:01:23.997129 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1779/3455] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:23 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1208 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:24.005261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:24.006124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:24.016573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.017272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.017948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.019006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.019747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.020371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.239586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:24.249003 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3315389-2103-46e1-ad00-c747705bf811 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.342034 Oct 29 21:01:24.266885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1677/3456] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:23 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:24.284873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:24.287555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:24.288351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:24.305178 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d0a7b166-5cea-4f9a-90a4-4669c29f64d9 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.304449 Oct 29 21:01:24.317508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1780/3457] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:23 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:24.317508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:24.317508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:24.326432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.329311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.330080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.331456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.332100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.332743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.338069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.338069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.338454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.339036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.339507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.339944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.861412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-735a3982-6e84-46f6-a876-cd74c8b028f8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.593267 Oct 29 21:01:24.862343 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1678/3458] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:01:24 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-interface => generated 284 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:24.867800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1fd2b6e5-559d-4d9b-9a84-2556a71e3bfc req-635cac98-dff5-4810-823a-e20bc00e7ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f91f395f-198b-4279-86a0-0fead4968690", "name": "network-vif-plugged", "status": "completed", "tag": "b7c0feb1-ccd8-480b-b172-8dac1d895412"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:24.883606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1fd2b6e5-559d-4d9b-9a84-2556a71e3bfc req-635cac98-dff5-4810-823a-e20bc00e7ae0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.884114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1fd2b6e5-559d-4d9b-9a84-2556a71e3bfc req-635cac98-dff5-4810-823a-e20bc00e7ae0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.884565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1fd2b6e5-559d-4d9b-9a84-2556a71e3bfc req-635cac98-dff5-4810-823a-e20bc00e7ae0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.899026 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1fd2b6e5-559d-4d9b-9a84-2556a71e3bfc req-635cac98-dff5-4810-823a-e20bc00e7ae0 service nova] Creating event network-vif-plugged:b7c0feb1-ccd8-480b-b172-8dac1d895412 for instance f91f395f-198b-4279-86a0-0fead4968690 on nch2-master-1 Oct 29 21:01:24.904566 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1fd2b6e5-559d-4d9b-9a84-2556a71e3bfc req-635cac98-dff5-4810-823a-e20bc00e7ae0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040969 Oct 29 21:01:24.905191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1679/3459] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:24.935000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:24.936315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:24.953083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.953642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.954056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:24.955612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:24.956313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:24.956754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:25.142315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:25.161242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b01f6642-3b18-4608-93b6-dc532d3e1ed0 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.852849 Oct 29 21:01:25.178458 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1781/3460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:24 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:25.189901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:25.192014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:25.216503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:25.216711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:25.217157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:25.217904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:25.218358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:25.219260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:25.323993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:25.335897 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6ef5143-b6f9-42d2-a34c-a5c376964ee7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1260 microversion: 2.1 time: 0.169975 Oct 29 21:01:25.349501 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1782/3461] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:25 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:25.349501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:25.349501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:25.352254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:25.352750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:25.353192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:25.354077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:25.354821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:25.355508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:25.364886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:25.378855 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-103f60b0-13ec-45d9-8625-a2ea1863d153 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1517 microversion: 2.1 time: 0.448085 Oct 29 21:01:25.379482 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1680/3462] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:24 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:25.384170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:25.384786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:25.420638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:25.421136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:25.421793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:25.422317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:25.422773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:25.423460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.010781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:26.022056 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64ea1750-ecdf-498c-9956-0e34d0d2f55a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.684489 Oct 29 21:01:26.028566 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1783/3463] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:25 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:26.035865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7649a2ad-c326-41ca-81c9-1f132d894800 req-1369616d-fa61-46e7-8da4-3af81db73df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e2076d-c50e-4718-bbf3-53d7f7dca2af", "name": "network-vif-deleted", "tag": "7e7cb1ab-7f45-45f3-993c-cc5cb44b4ee2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:26.062876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7649a2ad-c326-41ca-81c9-1f132d894800 req-1369616d-fa61-46e7-8da4-3af81db73df7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.066029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7649a2ad-c326-41ca-81c9-1f132d894800 req-1369616d-fa61-46e7-8da4-3af81db73df7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.068776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7649a2ad-c326-41ca-81c9-1f132d894800 req-1369616d-fa61-46e7-8da4-3af81db73df7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.092236 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7649a2ad-c326-41ca-81c9-1f132d894800 req-1369616d-fa61-46e7-8da4-3af81db73df7 service nova] Creating event network-vif-deleted:7e7cb1ab-7f45-45f3-993c-cc5cb44b4ee2 for instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af on nch1-master-1 Oct 29 21:01:26.103068 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7649a2ad-c326-41ca-81c9-1f132d894800 req-1369616d-fa61-46e7-8da4-3af81db73df7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075998 Oct 29 21:01:26.104283 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1784/3464] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:26.135878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:26.155595 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f5c6832-48d4-4380-8587-6cb4c8f5159a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.774311 Oct 29 21:01:26.171661 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1681/3465] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:25 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:26.193295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:26.195027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:26.207341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.207840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.208287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.208996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.209469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.209900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.364438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:26.365333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:26.376051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.379626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.380853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.384478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.387878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.388811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.580600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:26.600858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f555f0c-0e63-4e16-8525-c20a0235049a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1266 microversion: 2.1 time: 0.240149 Oct 29 21:01:26.618114 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1682/3466] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:26 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:26.625882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:26.628167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:26.637353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.638235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.638905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.639882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.640514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.641183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.714796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:26.716072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:26.716599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:26.717144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lazy-loading 'fault' on Instance uuid 32e2076d-c50e-4718-bbf3-53d7f7dca2af {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:26.741501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:26.755667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-58178ab7-ce58-4e72-8b60-d0ff7eba7cdf tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.567044 Oct 29 21:01:26.756904 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1785/3467] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:26 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:26.844803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:26.854895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b45e484e-d19c-401e-bd6c-53f749654098 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 200 len: 1310 microversion: 2.1 time: 0.235137 Oct 29 21:01:26.856964 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1683/3468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:26 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 1310 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:27.048946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:27.051976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:27.064814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.065239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.065716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.066440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.066929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.067368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.180764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:27.181679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:27.192896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.193411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.193889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.194624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.201303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.201798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.839854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:27.851782 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a83a8552-1e23-4cf2-8aaf-e51e40c121af tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1316 microversion: 2.1 time: 0.807955 Oct 29 21:01:27.852959 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1786/3469] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:27 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:27.860233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:27.861093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:27.868965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.869713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.870429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.871449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.871920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.872356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.909652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:27.920295 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04024747-6866-441a-913c-362bdf023620 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.743820 Oct 29 21:01:27.920890 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1684/3470] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:27 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:27.926346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:27.927227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:27.933969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.936136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.936874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:27.938043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:27.938728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:27.939373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.261227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:28.281480 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-461655ad-d40b-4628-b633-790cfa8ad934 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.415125 Oct 29 21:01:28.281480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1787/3471] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:27 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:28.281480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:28.281480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 32e2076d-c50e-4718-bbf3-53d7f7dca2af] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:28.291876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.292479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.292997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.300237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.300984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.301469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.317945 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] HTTP exception thrown: Instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af could not be found. Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Request method failure captured: Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af HTTP/1.1 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRV3z8HnahXkXYXu0U1JfV6JiObN5xiVwQwr2zR3hx6MlNkcKjuVHR9LT4UYqtUbCCQGStz-NiV_3oYj0ymcWU_-F2D_84inHCmHvuocPuSM042L2cmFPvsFvwmvuRZfpvskTYaXnMSJetuG81qjB7DiZ1hR3IzyePwsao2JigrV28 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 3236a32c26f94f90975d4e417177f175 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3236a32c26f94f90975d4e417177f175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3236a32c26f94f90975d4e417177f175"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3236a32c26f94f90975d4e417177f175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3236a32c26f94f90975d4e417177f175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 3236a32c26f94f90975d4e417177f175 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ListServerFiltersTestJSON-1185071095-project Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 80d6086f20614063923d7ed5c042e195 Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ListServerFiltersTestJSON-1185071095-project Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af could not be found. Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '32e2076d-c50e-4718-bbf3-53d7f7dca2af'} Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af could not be found. Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af could not be found. Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:28.319654 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af could not be found. Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Returning 404 to user: Instance 32e2076d-c50e-4718-bbf3-53d7f7dca2af could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:28.326308 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-814f429d-f2f6-4688-b578-2a6a4a4c7835 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af" status: 404 len: 111 microversion: 2.1 time: 0.050831 Oct 29 21:01:28.327634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1788/3472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:28 2022] GET /compute/v2.1/servers/32e2076d-c50e-4718-bbf3-53d7f7dca2af => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:28.331839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae434592-c0a9-46b8-8068-a11226cf12e1", "tag": "d81b5d4c-6005-4d23-94c0-4f434539a65b"}, {"name": "network-changed", "server_uuid": "b30747e4-474b-4475-a090-b52052b0b135", "tag": "712009d1-12d1-4b45-9678-df9ce20d63e7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:28.345223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.345750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.346195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.362828 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] Creating event network-changed:d81b5d4c-6005-4d23-94c0-4f434539a65b for instance ae434592-c0a9-46b8-8068-a11226cf12e1 on nch1-master-1 Oct 29 21:01:28.363867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] Creating event network-changed:712009d1-12d1-4b45-9678-df9ce20d63e7 for instance b30747e4-474b-4475-a090-b52052b0b135 on nch1-master-1 Oct 29 21:01:28.372655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:28.374083 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-088eb1d6-4aea-4a20-b157-8fa50e17facf req-8ae35362-8b51-4b48-9c3b-7a42a5f44f98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045665 Oct 29 21:01:28.375241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1789/3473] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:28.383881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:28.384764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:28.393181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.393927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.395221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.396135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.396766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.397365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.401181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-313d58d7-1a18-4bc7-854d-e9230f2a4ea6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.477102 Oct 29 21:01:28.408708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1685/3474] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:27 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:28.417935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-adf76fcc-bf35-41c1-a526-283794cc3eb9 req-1e0580f3-26d6-46a7-b8a1-9ccefbe1c9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11aa593f-4fe8-472f-9f8a-3872b461a5f4", "tag": "bf3132a9-fca7-4a6c-8fbe-cea150ab2741"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:28.434523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-adf76fcc-bf35-41c1-a526-283794cc3eb9 req-1e0580f3-26d6-46a7-b8a1-9ccefbe1c9d0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.436003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-adf76fcc-bf35-41c1-a526-283794cc3eb9 req-1e0580f3-26d6-46a7-b8a1-9ccefbe1c9d0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.436668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-adf76fcc-bf35-41c1-a526-283794cc3eb9 req-1e0580f3-26d6-46a7-b8a1-9ccefbe1c9d0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.453387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:28.460470 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-adf76fcc-bf35-41c1-a526-283794cc3eb9 req-1e0580f3-26d6-46a7-b8a1-9ccefbe1c9d0 service nova] Creating event network-changed:bf3132a9-fca7-4a6c-8fbe-cea150ab2741 for instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 on nch2-master-1 Oct 29 21:01:28.468930 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-adf76fcc-bf35-41c1-a526-283794cc3eb9 req-1e0580f3-26d6-46a7-b8a1-9ccefbe1c9d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054709 Oct 29 21:01:28.469887 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1686/3475] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:28.578867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e27587c5-3d74-4939-869a-b0563601119f tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 204 len: 0 microversion: 2.1 time: 0.201779 Oct 29 21:01:28.579726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1790/3476] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:28 2022] DELETE /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:28.590492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:28.592107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:28.600103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.600856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.601613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.602619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.603208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.603853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.796892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:28.807014 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e6fd7eb3-c0dd-4bf7-bcca-5057527f6e79 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 200 len: 1516 microversion: 2.1 time: 0.222360 Oct 29 21:01:28.817826 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1687/3477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:28 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:28.879567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:28.880346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:28.889194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.889731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.890172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.894201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.894341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.895807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.945734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:28.946825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:28.958772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.959280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.959726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:28.960453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:28.960921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:28.961341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.161350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:29.176304 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25bf5a6c-03e6-461b-a5eb-7dda4cdb24d2 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1465 microversion: 2.1 time: 0.300966 Oct 29 21:01:29.176972 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1791/3478] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:28 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1465 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:29.217564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:29.218476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:29.233504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.234015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.237975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.238439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:29.239452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.240098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.240691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.256657 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-efe7dcea-e997-4bc6-a17e-cd300d600e0e tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.314341 Oct 29 21:01:29.257031 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1688/3479] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:28 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:29.296224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:29.297143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:29.309690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.310774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.313505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.314595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.315079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.315516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.472568 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee40d731-8f17-44f1-a60c-b82f00506360 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1616 microversion: 2.1 time: 0.269033 Oct 29 21:01:29.486312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1792/3480] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:29 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1616 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:29.486312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:29.486312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:29.497199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.497199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.497199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.497199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.497199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.497199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.634756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:29.649021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc16416e-7229-4a1d-bf6c-efbc4f7a2326 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.356884 Oct 29 21:01:29.653831 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1689/3481] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:29 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:29.705412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1219246689", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e75e7ef5-74ec-405e-9a01-352979e69378"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:29.769712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:29.778375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:29.784881 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bb556d44-4012-4a86-b2f1-74614ecf94b1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.309006 Oct 29 21:01:29.785567 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1793/3482] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:29 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:29.804994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:29.833660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:29.835522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:29.849865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.850616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.851253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:29.852138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:29.852782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:29.853465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.082312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:30.096217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-335516cf-00d4-4984-be43-0c5c9bb30d4d tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 200 len: 1516 microversion: 2.1 time: 0.269330 Oct 29 21:01:30.097231 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1794/3483] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:29 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:30.171663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:30.172616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:30.173105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:30.174169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:30.174523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:30.184007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.184483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.185227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.186283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.186908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.187525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.208772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:30.214700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Getting quotas for user bc0a8b8359414ca0af8f79a4db4b3d38 and project 6506ce28d00440bb9f768ec7768a18f7. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:30.228267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:30.231223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:30.279194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-662194c2-549c-447a-9b06-588dce7db8ef tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577884 Oct 29 21:01:30.280410 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1690/3484] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:30.291519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-988bb762-13c4-4006-b08a-7e758089669e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:30.292154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-988bb762-13c4-4006-b08a-7e758089669e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:30.306919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:30.307564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:30.352991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.354005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.354687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.359655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.360350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.361561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.419359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-988bb762-13c4-4006-b08a-7e758089669e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:30.429407 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-988bb762-13c4-4006-b08a-7e758089669e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1217 microversion: 2.1 time: 0.141982 Oct 29 21:01:30.436891 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1691/3485] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:30 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:30.677505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:30.679501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:30.688499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:30.691636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.694459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.695140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.696701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.698391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.698707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-806d9ed3-b69b-43f9-9785-ae5e21e5ff4b tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.415590 Oct 29 21:01:30.699220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.701359 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1795/3486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:30 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:30.809544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:30.810367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:30.823907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.825184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.825813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:30.826786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:30.827462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:30.828057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.066992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:31.083670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7736e71d-c485-4e72-bb35-edd893eb6cd8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.411145 Oct 29 21:01:31.093881 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1692/3487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:30 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:31.120110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:31.120734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:31.128403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.130928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.132409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.133428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.134078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.135403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.141925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:31.151810 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8aa6f69c-80e2-4848-ae5f-b95104596ba1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.347013 Oct 29 21:01:31.153127 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1796/3488] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:30 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:31.241431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:31.271594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7242deef-1b12-4ad4-b869-d9b4dbeb90e8 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 200 len: 1474 microversion: 2.1 time: 0.155233 Oct 29 21:01:31.288790 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1693/3489] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:31 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 1474 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:31.362802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5b631a84-c9bc-4cfe-bd3f-c85f64ba2b95 req-4020e12b-b475-499c-baa0-2d37d7e4175b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc1211c-d363-4842-85d7-aae9dca8ed11", "name": "network-vif-deleted", "tag": "71a1e32e-f54b-4ae4-9df4-a9283d8f8353"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:31.378279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5b631a84-c9bc-4cfe-bd3f-c85f64ba2b95 req-4020e12b-b475-499c-baa0-2d37d7e4175b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.379000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5b631a84-c9bc-4cfe-bd3f-c85f64ba2b95 req-4020e12b-b475-499c-baa0-2d37d7e4175b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.379544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5b631a84-c9bc-4cfe-bd3f-c85f64ba2b95 req-4020e12b-b475-499c-baa0-2d37d7e4175b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.392907 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5b631a84-c9bc-4cfe-bd3f-c85f64ba2b95 req-4020e12b-b475-499c-baa0-2d37d7e4175b service nova] Creating event network-vif-deleted:71a1e32e-f54b-4ae4-9df4-a9283d8f8353 for instance fbc1211c-d363-4842-85d7-aae9dca8ed11 on nch2-master-1 Oct 29 21:01:31.399003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5b631a84-c9bc-4cfe-bd3f-c85f64ba2b95 req-4020e12b-b475-499c-baa0-2d37d7e4175b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041174 Oct 29 21:01:31.400043 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1797/3490] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:31.457306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:31.458145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:31.481812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.484210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.484851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.486237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.488258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.488871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.495247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:31.601736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:31.623384 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c8fcc22-323a-4c2c-8459-b67e4cd46cc7 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1269 microversion: 2.1 time: 0.171517 Oct 29 21:01:31.635248 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1694/3491] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:31 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:31.725496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=17 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:31.730331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:31.731551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:31.740934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.741569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.742028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.742748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:31.743542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:31.743696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:31.934335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:31.944926 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ca1d9e2-1c6b-459c-8cd4-7071c2c9d673 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.220250 Oct 29 21:01:31.946040 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1798/3492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:31 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:32.106205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.107517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.116150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.116643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.117087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.118118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.118584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.119022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.178201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.179708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.186898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.187486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.188007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.188784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.189696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.190221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.426856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:32.437380 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce0e2284-bf59-48de-995b-bf7feb34730f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.335034 Oct 29 21:01:32.438259 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1695/3493] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:32 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:32.442890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.443735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: fbc1211c-d363-4842-85d7-aae9dca8ed11] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.451671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.452591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.453217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.454163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.455252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.455885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.472847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] HTTP exception thrown: Instance fbc1211c-d363-4842-85d7-aae9dca8ed11 could not be found. Oct 29 21:01:32.473694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Request method failure captured: Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 HTTP/1.1 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRV3z8HnahXkXYXu0U1JfV6JiObN5xiVwQwr2zR3hx6MlNkcKjuVHR9LT4UYqtUbCCQGStz-NiV_3oYj0ymcWU_-F2D_84inHCmHvuocPuSM042L2cmFPvsFvwmvuRZfpvskTYaXnMSJetuG81qjB7DiZ1hR3IzyePwsao2JigrV28 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 3236a32c26f94f90975d4e417177f175 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3236a32c26f94f90975d4e417177f175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3236a32c26f94f90975d4e417177f175"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3236a32c26f94f90975d4e417177f175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3236a32c26f94f90975d4e417177f175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 3236a32c26f94f90975d4e417177f175 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServerFiltersTestJSON-1185071095-project Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 80d6086f20614063923d7ed5c042e195 Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServerFiltersTestJSON-1185071095-project Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance fbc1211c-d363-4842-85d7-aae9dca8ed11 could not be found. Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'fbc1211c-d363-4842-85d7-aae9dca8ed11'} Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc1211c-d363-4842-85d7-aae9dca8ed11 could not be found. Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc1211c-d363-4842-85d7-aae9dca8ed11 could not be found. Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:32.474554 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc1211c-d363-4842-85d7-aae9dca8ed11 could not be found. Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Returning 404 to user: Instance fbc1211c-d363-4842-85d7-aae9dca8ed11 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c2b93a27-1808-4f03-b6b9-2c0e254f0316 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11" status: 404 len: 111 microversion: 2.1 time: 0.037417 Oct 29 21:01:32.479761 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1696/3494] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:32 2022] GET /compute/v2.1/servers/fbc1211c-d363-4842-85d7-aae9dca8ed11 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:32.482003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ff45dbe-caea-4db4-8206-550573ca5214 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.307723 Oct 29 21:01:32.482593 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1799/3495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:32 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:32.487399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.487911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.494789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.495308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.496602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.497343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.497838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.498426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.528320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:32.615649 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e23b33fd-cc73-406f-9dff-a2670a8d74b3 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 204 len: 0 microversion: 2.1 time: 0.130982 Oct 29 21:01:32.615896 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1697/3496] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:32 2022] DELETE /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:32.624789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.628408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.632766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.633518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.634097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.634654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.635232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.635665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.647551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.648391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.654957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.655458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.655908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.656622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.657087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.657542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.759287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:32.768948 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b571cda0-faa0-4913-9137-9f58d3fc581e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1269 microversion: 2.1 time: 0.125359 Oct 29 21:01:32.770160 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1698/3497] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:32 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1269 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:32.840578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:32.850313 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f51e4d3-9c86-4c2c-baab-1b0c48e68363 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1517 microversion: 2.1 time: 0.230011 Oct 29 21:01:32.851228 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1800/3498] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:32 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:32.971819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:32.972555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:32.979429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.980211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.981215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:32.982070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:32.982652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:32.983202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.134594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:33.143789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cda3d133-448e-469a-b6b8-9cf41854ad8f tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.176071 Oct 29 21:01:33.144387 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1699/3499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:32 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:33.462927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:33.463743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:33.472299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.473889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.474479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.475289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.475819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.476404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.505060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:33.507101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:33.519526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.520045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.520685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.521407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.521905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.522345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.747411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:33.761637 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c2d8282-8f24-4b41-85a4-1c705713df5c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.300009 Oct 29 21:01:33.774155 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1801/3500] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:33 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:33.785547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:33.794765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:33.795401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:33.795768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6083815d-a7dd-439c-9684-f0ea11ba157e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.293994 Oct 29 21:01:33.796481 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1700/3501] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:33 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:33.802140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.802644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.803097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.803818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.804283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.804727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.876729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:33.877352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:33.897092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.902254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.902980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.903963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:33.904426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:33.904856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:33.917198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:33.928600 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2eb04bbd-2b40-4c54-a911-536f14be57ba tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1269 microversion: 2.1 time: 0.137507 Oct 29 21:01:33.929762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1802/3502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:33 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1269 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:34.051774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:34.059740 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-049d2495-0d98-4436-8c0a-fdad0e532243 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1517 microversion: 2.1 time: 0.186952 Oct 29 21:01:34.060331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1701/3503] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:33 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:34.167060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:34.167681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:34.170976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:34.175093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.175595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.176076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:34.176789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.177249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.177706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:34.373160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:34.389297 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cbbf11b1-850f-4b63-830d-32a6568dbf30 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.225439 Oct 29 21:01:34.402081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1803/3504] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:34 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:34.619585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3b22ffd0-3a6e-429a-a4d7-af46ccf43d45 req-87cd9d6e-3509-49a6-8084-e93243f5c10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae434592-c0a9-46b8-8068-a11226cf12e1", "name": "network-vif-plugged", "status": "completed", "tag": "d81b5d4c-6005-4d23-94c0-4f434539a65b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:34.638244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3b22ffd0-3a6e-429a-a4d7-af46ccf43d45 req-87cd9d6e-3509-49a6-8084-e93243f5c10a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.638743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3b22ffd0-3a6e-429a-a4d7-af46ccf43d45 req-87cd9d6e-3509-49a6-8084-e93243f5c10a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.639190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3b22ffd0-3a6e-429a-a4d7-af46ccf43d45 req-87cd9d6e-3509-49a6-8084-e93243f5c10a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:34.657904 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3b22ffd0-3a6e-429a-a4d7-af46ccf43d45 req-87cd9d6e-3509-49a6-8084-e93243f5c10a service nova] Creating event network-vif-plugged:d81b5d4c-6005-4d23-94c0-4f434539a65b for instance ae434592-c0a9-46b8-8068-a11226cf12e1 on nch1-master-1 Oct 29 21:01:34.664460 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3b22ffd0-3a6e-429a-a4d7-af46ccf43d45 req-87cd9d6e-3509-49a6-8084-e93243f5c10a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054159 Oct 29 21:01:34.665723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1702/3505] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:34.791053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:34.793957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:34.806857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.807781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.808462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:34.810296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.811048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.811748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:34.837111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:34.837871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:34.841231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:34.856739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.857254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.857739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:34.858479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:34.862406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:34.862941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.498204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:35.502629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:35.506677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be7d88f8-d556-4eaa-b207-a21b2d549b64 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.723395 Oct 29 21:01:35.514464 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1804/3506] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:34 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:35.517082 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9876ef8a-17fa-4dda-a79f-750c0d98f0ff tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.683714 Oct 29 21:01:35.526079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:35.526946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:35.529932 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1703/3507] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:34 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:35.534828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:35.535658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:35.536351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.537541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:35.538265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:35.539082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.540294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:35.540924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:35.550238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:35.550743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:35.551188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.551914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:35.552373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:35.552807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.646061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:35.670694 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-326993d3-f337-48c4-b0a8-2d3ca2d17323 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1269 microversion: 2.1 time: 0.154669 Oct 29 21:01:35.671687 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1805/3508] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:35 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:35.679213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:35.679845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:35.692170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:35.692934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:35.693381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.694420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:35.694583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:35.695198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:35.822588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:35.833928 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4813ee1-296a-46a5-b502-926717b9fdd0 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1517 microversion: 2.1 time: 0.302698 Oct 29 21:01:35.835565 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1704/3509] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:35 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1517 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:35.939731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:35.951086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54af34ef-639b-4459-9b3d-594c28c0e3ac tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.278311 Oct 29 21:01:35.951688 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1806/3510] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:35 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:36.531127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:36.531808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:36.540656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:36.541076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:36.541568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:36.542300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:36.545847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:36.546335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:36.547586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:36.548802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:36.563627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:36.569057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:36.571463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:36.574897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:36.575486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:36.576033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.097983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:37.108024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-66bf6fae-0303-4d7b-9eff-c614a7f9e7c2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.581026 Oct 29 21:01:37.108780 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1705/3511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:36 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:37.117337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:37.120081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:37.130046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:37.141061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:37.142265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a017c47-5885-445d-b99e-01319dd115fa tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.599971 Oct 29 21:01:37.143194 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1807/3512] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:36 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:37.148326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:37.148949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:37.159207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:37.159724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:37.160399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.161272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:37.161964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:37.162940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.168095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:37.168966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.170156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:37.171597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:37.172284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.347980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:37.371643 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-580b9d52-a598-444e-a137-6fd9c2bc4aec tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1275 microversion: 2.1 time: 0.260772 Oct 29 21:01:37.372775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1706/3513] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:37 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:37.378883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:37.385376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:37.395200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:37.396123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:37.396812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.397830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:37.398552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:37.399647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:37.689511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:37.698317 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1ca8ea4d-82b3-4757-a9fd-5dd31835bad9 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1517 microversion: 2.1 time: 0.554093 Oct 29 21:01:37.710463 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1808/3514] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:37 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1517 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:37.793376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:37.804871 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0563061-3bda-4969-aaf6-d02c34b195f0 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.429620 Oct 29 21:01:37.822288 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1707/3515] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:37 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:38.137596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:38.138994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:38.160501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.162434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.165142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.172884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:38.174539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:38.179039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.186471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.187738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.211182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.211837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.212312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.225710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.226404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.228327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.623677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:38.641411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25062124-abfd-46a6-99f5-e06d79742383 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.508748 Oct 29 21:01:38.641895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:38.643617 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1809/3516] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:38 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:38.651932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b9403ba-0564-47fc-9bb4-245df2372b66 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.484445 Oct 29 21:01:38.665493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-027fa208-1628-4a4d-8b4f-d1393126502b req-562cdcba-8956-423a-ab90-42b7356e6210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dac4092-a0df-4b14-9e9b-7466aa2b9bed", "name": "network-vif-deleted", "tag": "113548a2-6bfd-4a9b-888f-e3ae8c805483"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:38.666387 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1708/3517] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:38 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:38.668697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:38.674018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-027fa208-1628-4a4d-8b4f-d1393126502b req-562cdcba-8956-423a-ab90-42b7356e6210 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.674642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-027fa208-1628-4a4d-8b4f-d1393126502b req-562cdcba-8956-423a-ab90-42b7356e6210 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.676309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:38.676953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-027fa208-1628-4a4d-8b4f-d1393126502b req-562cdcba-8956-423a-ab90-42b7356e6210 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.677321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:38.683853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.684985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.685756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.686946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.687723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.688549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.706573 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-027fa208-1628-4a4d-8b4f-d1393126502b req-562cdcba-8956-423a-ab90-42b7356e6210 service nova] Creating event network-vif-deleted:113548a2-6bfd-4a9b-888f-e3ae8c805483 for instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed on nch1-master-1 Oct 29 21:01:38.722830 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-027fa208-1628-4a4d-8b4f-d1393126502b req-562cdcba-8956-423a-ab90-42b7356e6210 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077363 Oct 29 21:01:38.723879 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1810/3518] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:38.738302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:38.739115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:38.753178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.753777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.754167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.770430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.771675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.772140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.833388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.834712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.835320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.835943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lazy-loading 'fault' on Instance uuid 4dac4092-a0df-4b14-9e9b-7466aa2b9bed {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:38.839765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:38.900646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80d6086f20614063923d7ed5c042e195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236a32c26f94f90975d4e417177f175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:38.915223 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-14324b11-add1-4e9a-a58f-f0572ea16226 tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 200 len: 1311 microversion: 2.1 time: 0.189865 Oct 29 21:01:38.916635 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1811/3519] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:38 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:38.935816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:38.936901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:38.951408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:38.953744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.954527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.955206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.956189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:38.956860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:38.957537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:38.963517 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c39154f4-0b84-420d-b2d6-dfa93f3ee0ac tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.294376 Oct 29 21:01:38.965443 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1709/3520] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:38 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:39.216017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:39.225784 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-679ae111-133b-4c15-81c8-ebf83e9855ed tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1324 microversion: 2.1 time: 0.307405 Oct 29 21:01:39.226890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1812/3521] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:38 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:39.238631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1469183120", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:39.314231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] validate_networks() for [('55d06ba3-22b1-486d-880f-ee24b54e949a', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:39.652131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4ef97646-885a-4bce-a361-01cc4955bdf8 req-7d034f94-c281-408a-8c17-e99d2fbb9fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30747e4-474b-4475-a090-b52052b0b135", "name": "network-vif-plugged", "status": "completed", "tag": "712009d1-12d1-4b45-9678-df9ce20d63e7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:39.661970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4ef97646-885a-4bce-a361-01cc4955bdf8 req-7d034f94-c281-408a-8c17-e99d2fbb9fa8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:39.662775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4ef97646-885a-4bce-a361-01cc4955bdf8 req-7d034f94-c281-408a-8c17-e99d2fbb9fa8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:39.663399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4ef97646-885a-4bce-a361-01cc4955bdf8 req-7d034f94-c281-408a-8c17-e99d2fbb9fa8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:39.678302 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4ef97646-885a-4bce-a361-01cc4955bdf8 req-7d034f94-c281-408a-8c17-e99d2fbb9fa8 service nova] Creating event network-vif-plugged:712009d1-12d1-4b45-9678-df9ce20d63e7 for instance b30747e4-474b-4475-a090-b52052b0b135 on nch1-master-1 Oct 29 21:01:39.684762 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4ef97646-885a-4bce-a361-01cc4955bdf8 req-7d034f94-c281-408a-8c17-e99d2fbb9fa8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035933 Oct 29 21:01:39.686077 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1813/3522] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:01:39.693040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:39.694019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:39.701052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:39.701785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:39.702465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:39.703356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:39.704102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:39.704881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:39.923102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:39.924063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:39.925267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:39.927359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:39.928065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:39.944240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:39.945052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:39.946624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:39.948100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:39.948738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:39.949511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:39.961098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=9 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:39.975446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:39.975799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Getting quotas for project 337aa2d5300843f083c33d577439db01. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:39.983430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Getting quotas for user 0c9d4094d4184f24aafcd7d4b23ee77f and project 337aa2d5300843f083c33d577439db01. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:39.984942 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-905dbd54-4b52-4a1c-b456-53f8163b2f88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.297347 Oct 29 21:01:40.000811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:40.002121 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1814/3523] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:39 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:40.004364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:40.007034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-cc871198-4ef4-4ebf-a283-96afb8d364a8 req-d8609521-a8bb-407f-824f-5ea872fe0896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e903876-9160-4477-9b54-1732ca4282ff", "tag": "0e9c0399-fe79-48bd-98c7-9eaf63e3d9d3"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:40.016926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cc871198-4ef4-4ebf-a283-96afb8d364a8 req-d8609521-a8bb-407f-824f-5ea872fe0896 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.017682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cc871198-4ef4-4ebf-a283-96afb8d364a8 req-d8609521-a8bb-407f-824f-5ea872fe0896 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.018287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cc871198-4ef4-4ebf-a283-96afb8d364a8 req-d8609521-a8bb-407f-824f-5ea872fe0896 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.030735 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-cc871198-4ef4-4ebf-a283-96afb8d364a8 req-d8609521-a8bb-407f-824f-5ea872fe0896 service nova] Creating event network-changed:0e9c0399-fe79-48bd-98c7-9eaf63e3d9d3 for instance 2e903876-9160-4477-9b54-1732ca4282ff on nch1-master-1 Oct 29 21:01:40.035785 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-cc871198-4ef4-4ebf-a283-96afb8d364a8 req-d8609521-a8bb-407f-824f-5ea872fe0896 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032417 Oct 29 21:01:40.036932 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1815/3524] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:40.042284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:40.043561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:40.050247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.050747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.051190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.051907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.052367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.052799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.064179 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91f86360-f49f-4825-9839-b53ddea94605 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082911 Oct 29 21:01:40.065524 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1710/3525] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:40.075983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:40.076769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] [instance: 4dac4092-a0df-4b14-9e9b-7466aa2b9bed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:40.086676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.088089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.088548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.089320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.091297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.091772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.097035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:40.120285 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] HTTP exception thrown: Instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed could not be found. Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Request method failure captured: Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed HTTP/1.1 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRV3z8HnahXkXYXu0U1JfV6JiObN5xiVwQwr2zR3hx6MlNkcKjuVHR9LT4UYqtUbCCQGStz-NiV_3oYj0ymcWU_-F2D_84inHCmHvuocPuSM042L2cmFPvsFvwmvuRZfpvskTYaXnMSJetuG81qjB7DiZ1hR3IzyePwsao2JigrV28 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 3236a32c26f94f90975d4e417177f175 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3236a32c26f94f90975d4e417177f175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3236a32c26f94f90975d4e417177f175"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3236a32c26f94f90975d4e417177f175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3236a32c26f94f90975d4e417177f175"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 3236a32c26f94f90975d4e417177f175 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1185071095 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ListServerFiltersTestJSON-1185071095-project Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 80d6086f20614063923d7ed5c042e195 Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ListServerFiltersTestJSON-1185071095-project Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed could not be found. Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4dac4092-a0df-4b14-9e9b-7466aa2b9bed'} Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed could not be found. Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed could not be found. Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:40.125034 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed could not be found. Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] Returning 404 to user: Instance 4dac4092-a0df-4b14-9e9b-7466aa2b9bed could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e6b66e2f-83b8-4bd3-a804-5e8c6af213bb tempest-ListServerFiltersTestJSON-1185071095 tempest-ListServerFiltersTestJSON-1185071095-project] 10.222.0.36 "GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed" status: 404 len: 111 microversion: 2.1 time: 0.059893 Oct 29 21:01:40.130002 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1711/3526] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:40 2022] GET /compute/v2.1/servers/4dac4092-a0df-4b14-9e9b-7466aa2b9bed => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:40.138526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:40.139178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:40.161705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.162219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.162674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.163398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.163862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.164298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.349936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:40.368052 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b64809e8-051d-4b3d-864e-d80002512c10 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.329687 Oct 29 21:01:40.369252 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1816/3527] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:40 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:40.375013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5cc90aa4-1b3f-4cbf-b06b-987236102109 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:40.376170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5cc90aa4-1b3f-4cbf-b06b-987236102109 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:40.797930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5cc90aa4-1b3f-4cbf-b06b-987236102109 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:40.806234 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5cc90aa4-1b3f-4cbf-b06b-987236102109 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1224 microversion: 2.1 time: 0.435664 Oct 29 21:01:40.806985 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1817/3528] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:40 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1224 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:40.812978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:40.814089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:40.820395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.821169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.821885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.822962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:40.823792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:40.824969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:40.847154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:40.860461 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-433889b9-ef5d-4c15-b405-b4aaf9a16773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.732213 Oct 29 21:01:40.866701 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1712/3529] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:40 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:41.023975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.024614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.037012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.037209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:41.037542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.037999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.044248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.044744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.045187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.047212 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b3f298a-f105-495f-b90f-d690e107fe89 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1520 microversion: 2.1 time: 0.238888 Oct 29 21:01:41.048529 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1818/3530] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:40 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:41.073231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.074074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.085997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.087002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.087719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.089325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.090555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.091928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.135181 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] HTTP exception thrown: Action 999 not found Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Request method failure captured: Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1/os-instance-actions/999 HTTP/1.1 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSdCfwZqFNIstw0dqxEydYl3tKCrjWMPrQQgdbu4MTJR1twH_dgQ_nc5MWd46zDxs-ZFMhSzNDSIEo3eptkevSgXuaaBd7yKfCn6lSbzXkvTEf6EiFhertt-wHwZSA85vvXl7oFEUMcdBfbn_bU8Ui6VGTdxbyfRJXjNHzIR_wwfyM Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 9a40f05c2d944feca204812cfc803454 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a40f05c2d944feca204812cfc803454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9a40f05c2d944feca204812cfc803454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a40f05c2d944feca204812cfc803454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9a40f05c2d944feca204812cfc803454"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 9a40f05c2d944feca204812cfc803454 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceActionsNegativeTestJSON-1627283956-project Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ce8fe5d6bf694d2899a4ac26fd38c66c Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1627283956-project Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: exception: Action 999 not found Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': 'ae434592-c0a9-46b8-8068-a11226cf12e1', 'id': '999'} Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 29 21:01:41.142326 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.147814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Returning 404 to user: Action 999 not found {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:41.148949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec93f6d9-1fd4-42ec-a088-ed9ef6dbdf7d tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.081621 Oct 29 21:01:41.155094 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1819/3531] 10.222.0.36 () {58 vars in 1308 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1/os-instance-actions/999 => generated 66 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 21:01:41.163003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b46e5dc4-94ed-4e84-8d7c-f250cb71cf9a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '.version_select at 0x7fa1716871f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.163853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b46e5dc4-94ed-4e84-8d7c-f250cb71cf9a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: e646f494-829d-4f68-b38c-74da80556576] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.172614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b46e5dc4-94ed-4e84-8d7c-f250cb71cf9a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] HTTP exception thrown: Instance e646f494-829d-4f68-b38c-74da80556576 could not be found. Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b46e5dc4-94ed-4e84-8d7c-f250cb71cf9a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Request method failure captured: Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/e646f494-829d-4f68-b38c-74da80556576/os-instance-actions HTTP/1.1 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSdCfwZqFNIstw0dqxEydYl3tKCrjWMPrQQgdbu4MTJR1twH_dgQ_nc5MWd46zDxs-ZFMhSzNDSIEo3eptkevSgXuaaBd7yKfCn6lSbzXkvTEf6EiFhertt-wHwZSA85vvXl7oFEUMcdBfbn_bU8Ui6VGTdxbyfRJXjNHzIR_wwfyM Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 9a40f05c2d944feca204812cfc803454 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a40f05c2d944feca204812cfc803454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9a40f05c2d944feca204812cfc803454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a40f05c2d944feca204812cfc803454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9a40f05c2d944feca204812cfc803454"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 9a40f05c2d944feca204812cfc803454 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-InstanceActionsNegativeTestJSON-1627283956-project Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ce8fe5d6bf694d2899a4ac26fd38c66c Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1627283956-project Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance e646f494-829d-4f68-b38c-74da80556576 could not be found. Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': 'e646f494-829d-4f68-b38c-74da80556576'} Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e646f494-829d-4f68-b38c-74da80556576 could not be found. Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:41.175354 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e646f494-829d-4f68-b38c-74da80556576 could not be found. Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e646f494-829d-4f68-b38c-74da80556576 could not be found. Oct 29 21:01:41.180115 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:01:41.182632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b46e5dc4-94ed-4e84-8d7c-f250cb71cf9a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Returning 404 to user: Instance e646f494-829d-4f68-b38c-74da80556576 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:41.184350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b46e5dc4-94ed-4e84-8d7c-f250cb71cf9a tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/e646f494-829d-4f68-b38c-74da80556576/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.027416 Oct 29 21:01:41.190649 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1820/3532] 10.222.0.36 () {58 vars in 1296 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/e646f494-829d-4f68-b38c-74da80556576/os-instance-actions => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:01:41.197994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.198743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.206812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.207548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.208167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.209048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.209755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.210428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.246636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:41.287781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:41.301611 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d3240361-025e-407a-91c3-5ef95d20f28d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.294797 Oct 29 21:01:41.303432 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1713/3533] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:41.391895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.392673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.397283 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a46811c3-8445-43c5-b8b9-509c08a837e3 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 204 len: 0 microversion: 2.1 time: 0.194074 Oct 29 21:01:41.401028 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1821/3534] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:41 2022] DELETE /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:41.410377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.410972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.412135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.412956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.413519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.414031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.415144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.416212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.425802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.426662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.427325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.428258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.428977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.429648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.724003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:41.734724 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d9f9152-4ad5-46bd-a0e8-8880210fbec5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1526 microversion: 2.1 time: 0.327087 Oct 29 21:01:41.739506 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1822/3535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1526 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:41.771481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:41.780442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-37703116-c5a4-4ec4-a44f-e6eef7b46569 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.392858 Oct 29 21:01:41.781038 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1714/3536] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:41.830918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.831557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.838249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.838751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.839198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.840555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.840982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.841829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.901690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:41.903755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:41.911565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.915040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.915717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.916691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:41.917334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:41.918826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:41.923532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:41.933331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d892893-a569-4488-83ee-d4b91add545c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1220 microversion: 2.1 time: 0.106990 Oct 29 21:01:41.934302 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1823/3537] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:42.102684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:42.112985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa007ec8-b970-432c-9e3e-1320bf3250f1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.224225 Oct 29 21:01:42.113668 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1715/3538] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:41 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:42.336623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:42.341200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:42.358380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:42.359055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:42.359612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:42.360416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:42.361006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:42.361538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:42.561104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:42.571658 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36dc6184-b2b2-4714-86d8-7a90d7a6f069 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1308 microversion: 2.1 time: 0.248897 Oct 29 21:01:42.573341 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1824/3539] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:42 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:42.766460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:42.767547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:42.774687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:42.778801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:42.779557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:42.780511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:42.781301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:42.781996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:42.804448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:42.805739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:42.813613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:42.814413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:42.815024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:42.815910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:42.816539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:42.817135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.017120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:43.025322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c56416eb-0848-4e24-9549-72e391e0c370 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1526 microversion: 2.1 time: 0.263761 Oct 29 21:01:43.033167 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1716/3540] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:42 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:43.033167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:43.033167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:43.048671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:43.049232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:43.049787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.050542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:43.051173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:43.051607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.055049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:43.066631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be0a73b5-c387-444d-8ea1-dafa63d26e73 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.262600 Oct 29 21:01:43.067242 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1825/3541] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:42 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:43.133997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:43.138221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:43.139089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:43.142532 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb25b195-2446-474e-83b6-ac4535419275 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1276 microversion: 2.1 time: 0.115611 Oct 29 21:01:43.143118 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1717/3542] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:43 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:43.146891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:43.147549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:43.148196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.148942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:43.149406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:43.149870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.294284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:43.302579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acefe98b-cf70-442c-8db7-eaf209a4ffee tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.170190 Oct 29 21:01:43.303088 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1826/3543] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:43 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:43.600452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:43.601084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:43.607440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:43.608134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:43.608750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.609690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:43.610317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:43.610921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:43.819256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:43.832239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9ca99f6d-c430-4fb6-8aa1-4264c1395728 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1489 microversion: 2.1 time: 0.235144 Oct 29 21:01:43.833071 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1718/3544] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:43 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1489 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:43.952661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-593482751", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:44.007783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:44.049843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:44.050439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:44.057612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.058118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.058570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.059289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.059755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.060193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.286441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:44.296423 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-beb1c49d-338a-42ef-b106-def3a0367665 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1526 microversion: 2.1 time: 0.251152 Oct 29 21:01:44.310274 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1719/3545] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:44 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1526 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:44.319256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:44.320137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:44.327669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.328459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.329119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.329964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.330524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.331069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.617723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:44.633028 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2df630cd-81f7-44ff-9857-eb0a05501e5e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.321157 Oct 29 21:01:44.635217 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1720/3546] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:44 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:44.653662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:44.655455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:44.661652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:44.662089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:44.662626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:44.663073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:44.663536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:44.664764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.665666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.666341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.667345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.668974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.669814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.674040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.674539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.675039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.675792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.677557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.677557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.696298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:44.702355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:44.716697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:44.719855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:44.749102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:44.759535 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b2094f6-dd29-4e4e-b17c-de1ddb0e8137 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1276 microversion: 2.1 time: 0.122846 Oct 29 21:01:44.769841 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1721/3547] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:44 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:44.779673 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-357e1e7f-aa1c-41e0-b349-e74c0ec4dff6 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831472 Oct 29 21:01:44.782112 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1827/3548] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:44.782936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:44.784329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:44.792265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8cba9706-733f-4761-a088-77ada5a3f5e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:44.793687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8cba9706-733f-4761-a088-77ada5a3f5e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:44.796775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.798078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.799034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.800053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:44.800881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:44.801555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:44.908520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8cba9706-733f-4761-a088-77ada5a3f5e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:44.919027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8cba9706-733f-4761-a088-77ada5a3f5e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1208 microversion: 2.1 time: 0.128629 Oct 29 21:01:44.919825 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1828/3549] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:44 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:45.009889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:45.022455 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a2cfda5-d91e-4f66-9186-8edaff97e636 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.251197 Oct 29 21:01:45.023365 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1722/3550] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:44 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:45.325315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:45.327153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:45.335640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.336260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.336796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.337799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.339280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.340362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.540063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:45.551880 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a63ad75-fa95-450b-88b1-2d40672b7e5c tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1526 microversion: 2.1 time: 0.231900 Oct 29 21:01:45.563499 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1829/3551] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:45 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1526 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:45.659756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:45.660380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:45.667221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.668231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.668661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.669378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.669866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.670301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.784452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:45.785751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:45.792071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.792564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.793051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.793797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.794259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.794694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.810058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:45.818913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c037a4cf-df2d-4e5c-8e1a-a8ebf4210c18 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.162809 Oct 29 21:01:45.819747 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1723/3552] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:45 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:45.877368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:45.887481 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d61c633c-4c49-4b29-9f0a-8b26ca4252d4 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1276 microversion: 2.1 time: 0.106271 Oct 29 21:01:45.888419 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1830/3553] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:45 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:45.946955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:45.947732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:45.955175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.956024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.956718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:45.957576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:45.958146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:45.958685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:46.026383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:46.035024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e22ce51-894b-41ba-894c-5ff58a06aacb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1212 microversion: 2.1 time: 0.092232 Oct 29 21:01:46.035806 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1724/3554] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:45 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1212 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:46.047753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:46.049107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:46.055506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:46.056186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:46.056698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:46.057528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:46.058088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:46.059262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:46.085222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:46.278374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:46.301088 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c1f524c-946b-4b79-81db-22354ef75e24 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.257845 Oct 29 21:01:46.304183 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1831/3555] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:46 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:46.575497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:46.576173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:46.582414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:46.583200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:46.583835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:46.584734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:46.585362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:46.585986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:46.843506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:46.844140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:46.877260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:46.877788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:46.878240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:46.878964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:46.879426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:46.879859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.096823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:47.109649 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a71673b9-9630-402b-ae91-7fa7cc090fe5 tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1526 microversion: 2.1 time: 0.537971 Oct 29 21:01:47.113845 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1725/3556] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:46 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1526 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:47.130668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:47.132750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:47.147361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.147862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.148307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.149019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.149727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.150447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.515637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:47.535755 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-440f3d13-170c-4b9e-9c4a-f2a7526abb9d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1284 microversion: 2.1 time: 0.420541 Oct 29 21:01:47.536372 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1726/3557] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:47 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1284 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:47.546939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:47.550132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:47.569677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.570660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.571218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.574579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.575202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.580423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.909038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:47.918395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9446d970-9353-4ba5-b615-4b495c985d95 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 1.079554 Oct 29 21:01:47.919238 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1832/3558] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:46 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:47.924558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:47.925405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:47.931690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.932381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.932988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.933963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.934596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.935033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:47.957901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:47.970714 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f214d95-692b-4069-816a-84b4e59854db tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1260 microversion: 2.1 time: 0.430676 Oct 29 21:01:47.971611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1727/3559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:47 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1260 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:47.977014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2c6013ed-80a9-4732-a357-823aee5c9535 req-a8563a04-51e0-4738-9987-8e6427847c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae434592-c0a9-46b8-8068-a11226cf12e1", "name": "network-vif-deleted", "tag": "d81b5d4c-6005-4d23-94c0-4f434539a65b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:47.990087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2c6013ed-80a9-4732-a357-823aee5c9535 req-a8563a04-51e0-4738-9987-8e6427847c8e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:47.990949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2c6013ed-80a9-4732-a357-823aee5c9535 req-a8563a04-51e0-4738-9987-8e6427847c8e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:47.991586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2c6013ed-80a9-4732-a357-823aee5c9535 req-a8563a04-51e0-4738-9987-8e6427847c8e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.004432 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2c6013ed-80a9-4732-a357-823aee5c9535 req-a8563a04-51e0-4738-9987-8e6427847c8e service nova] Creating event network-vif-deleted:d81b5d4c-6005-4d23-94c0-4f434539a65b for instance ae434592-c0a9-46b8-8068-a11226cf12e1 on nch1-master-1 Oct 29 21:01:48.011468 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2c6013ed-80a9-4732-a357-823aee5c9535 req-a8563a04-51e0-4738-9987-8e6427847c8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037985 Oct 29 21:01:48.012948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1728/3560] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:48.146452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:48.147958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:48.156350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.157506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.158254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.159173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.159925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.160869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.166934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:48.202382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.203337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.209001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.209626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lazy-loading 'fault' on Instance uuid ae434592-c0a9-46b8-8068-a11226cf12e1 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:01:48.319456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8fe5d6bf694d2899a4ac26fd38c66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40f05c2d944feca204812cfc803454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:48.347565 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb41590b-f816-490a-9bf4-62105fd48ecb tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 200 len: 1314 microversion: 2.1 time: 0.209181 Oct 29 21:01:48.348184 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1729/3561] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:48 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:48.564242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:48.565214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:48.576463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.577424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.578055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.578969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.579641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.580886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:48.585157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.594561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-afcb9609-4188-407d-91f2-698ef57ea773 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.672163 Oct 29 21:01:48.596417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1833/3562] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:47 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:48.944466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:48.951655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:48.960521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.961107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.963256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:48.967121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:48.967859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:48.968557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.072874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:49.082274 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f6e8c63b-f256-4855-b9dc-13afc3fcb15a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1282 microversion: 2.1 time: 0.521846 Oct 29 21:01:49.085638 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1730/3563] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:48 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1282 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:49.089366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:49.090203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:49.097655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:49.098456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:49.099126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.100439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:49.101120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:49.101794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.268719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:49.277182 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d2d67e0-ccd3-42e0-8492-93b16c7531e3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1266 microversion: 2.1 time: 0.192685 Oct 29 21:01:49.299846 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1731/3564] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:49 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:49.372130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:49.372764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] [instance: ae434592-c0a9-46b8-8068-a11226cf12e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:49.379676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:49.380650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:49.381329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.382514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:49.383293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:49.383953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.399730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:49.406604 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] HTTP exception thrown: Instance ae434592-c0a9-46b8-8068-a11226cf12e1 could not be found. Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Request method failure captured: Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 HTTP/1.1 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZSdCfwZqFNIstw0dqxEydYl3tKCrjWMPrQQgdbu4MTJR1twH_dgQ_nc5MWd46zDxs-ZFMhSzNDSIEo3eptkevSgXuaaBd7yKfCn6lSbzXkvTEf6EiFhertt-wHwZSA85vvXl7oFEUMcdBfbn_bU8Ui6VGTdxbyfRJXjNHzIR_wwfyM Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 9a40f05c2d944feca204812cfc803454 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a40f05c2d944feca204812cfc803454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9a40f05c2d944feca204812cfc803454"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9a40f05c2d944feca204812cfc803454"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9a40f05c2d944feca204812cfc803454"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 9a40f05c2d944feca204812cfc803454 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1627283956 Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-InstanceActionsNegativeTestJSON-1627283956-project Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ce8fe5d6bf694d2899a4ac26fd38c66c Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1627283956-project Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance ae434592-c0a9-46b8-8068-a11226cf12e1 could not be found. Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ae434592-c0a9-46b8-8068-a11226cf12e1'} Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae434592-c0a9-46b8-8068-a11226cf12e1 could not be found. Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae434592-c0a9-46b8-8068-a11226cf12e1 could not be found. Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:49.408515 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae434592-c0a9-46b8-8068-a11226cf12e1 could not be found. Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] Returning 404 to user: Instance ae434592-c0a9-46b8-8068-a11226cf12e1 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:01:49.413666 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4d5bd75-c705-4b2f-94c3-0189840ee0be tempest-InstanceActionsNegativeTestJSON-1627283956 tempest-InstanceActionsNegativeTestJSON-1627283956-project] 10.222.0.36 "GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1" status: 404 len: 111 microversion: 2.1 time: 0.042588 Oct 29 21:01:49.417032 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1732/3565] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:49 2022] GET /compute/v2.1/servers/ae434592-c0a9-46b8-8068-a11226cf12e1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:01:49.419202 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-719dcde2-2e3d-40ca-a9a8-5937e2adefc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1518 microversion: 2.1 time: 0.478979 Oct 29 21:01:49.420420 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1834/3566] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:48 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1518 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:49.624530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:49.625161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:49.632335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:49.632835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:49.637959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.638759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:49.639247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:49.641875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:49.972491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:49.992179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=26 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:50.107984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:50.108611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:50.122703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.123470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.124091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.124987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.125760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.126392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.156747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:50.165931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfc79bf7-bb5a-4b87-9a56-d54989e60440 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.545168 Oct 29 21:01:50.181862 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1733/3567] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:49 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:50.314157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:50.315986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:50.326609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.328375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.329283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.331207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.338237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.338963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.790704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:50.801975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53bed8f0-e2bc-443a-996a-f3196b6c827d tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.698148 Oct 29 21:01:50.803388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1835/3568] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:50 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:50.809727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8078528f-0dac-49f4-ad01-11c046c2387a req-24ab34c9-4910-4861-b22d-65e0a4ae090c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a71a556-5e58-45f9-93f3-2d20d1297c9f", "tag": "0aaff3b4-4fe2-4e38-9f9e-ade00bbd447f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:50.824598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8078528f-0dac-49f4-ad01-11c046c2387a req-24ab34c9-4910-4861-b22d-65e0a4ae090c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.825285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8078528f-0dac-49f4-ad01-11c046c2387a req-24ab34c9-4910-4861-b22d-65e0a4ae090c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.825944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8078528f-0dac-49f4-ad01-11c046c2387a req-24ab34c9-4910-4861-b22d-65e0a4ae090c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.841813 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8078528f-0dac-49f4-ad01-11c046c2387a req-24ab34c9-4910-4861-b22d-65e0a4ae090c service nova] Creating event network-changed:0aaff3b4-4fe2-4e38-9f9e-ade00bbd447f for instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f on nch1-master-1 Oct 29 21:01:50.847993 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8078528f-0dac-49f4-ad01-11c046c2387a req-24ab34c9-4910-4861-b22d-65e0a4ae090c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042514 Oct 29 21:01:50.848925 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1836/3569] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:50.854501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:50.855753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:50.863571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.864729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.865811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.867205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:50.867898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:50.868572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:50.915362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:50.924025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-298bb1fb-5258-4654-903e-9285323b0738 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.614090 Oct 29 21:01:50.924706 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1734/3570] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:50 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:51.192758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:51.193407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:51.202464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.202967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.203407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:51.204125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.204586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.205025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:51.333752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:51.344185 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93c06c45-ea86-48ad-bc97-c159733a2bd6 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1524 microversion: 2.1 time: 0.493813 Oct 29 21:01:51.344952 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1837/3571] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:50 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1524 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:51.357812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-96793871-4730-4fd7-b95e-3fbd3baec753 req-549a4d3c-15a6-4bae-8fce-702b7a2d836e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e903876-9160-4477-9b54-1732ca4282ff", "name": "network-vif-plugged", "status": "completed", "tag": "0e9c0399-fe79-48bd-98c7-9eaf63e3d9d3"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:51.360172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-96793871-4730-4fd7-b95e-3fbd3baec753 req-549a4d3c-15a6-4bae-8fce-702b7a2d836e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.360723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-96793871-4730-4fd7-b95e-3fbd3baec753 req-549a4d3c-15a6-4bae-8fce-702b7a2d836e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.361111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-96793871-4730-4fd7-b95e-3fbd3baec753 req-549a4d3c-15a6-4bae-8fce-702b7a2d836e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:51.376466 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-96793871-4730-4fd7-b95e-3fbd3baec753 req-549a4d3c-15a6-4bae-8fce-702b7a2d836e service nova] Creating event network-vif-plugged:0e9c0399-fe79-48bd-98c7-9eaf63e3d9d3 for instance 2e903876-9160-4477-9b54-1732ca4282ff on nch1-master-1 Oct 29 21:01:51.382353 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-96793871-4730-4fd7-b95e-3fbd3baec753 req-549a4d3c-15a6-4bae-8fce-702b7a2d836e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036180 Oct 29 21:01:51.383067 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1838/3572] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:51.723271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:51.731616 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-310eeade-c57c-4800-b78c-4534bb0731ae tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.543054 Oct 29 21:01:51.732191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1735/3573] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:51 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:51.826781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:51.827538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:51.834307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.834812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.835261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:51.835985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.836448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.836883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:51.950436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:51.951092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:51.957356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.957891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.958333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:51.959069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:51.959574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:51.960004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:52.560651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:52.568577 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-58aa1d5a-7e0d-41b2-acf9-400aa4709445 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.622115 Oct 29 21:01:52.569186 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1736/3574] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:51 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:52.574421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:52.575119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:52.582700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:52.583193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:52.583637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:52.584542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:52.585004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:52.585432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:52.639405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:52.647309 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a52d85b8-7542-4f33-a84d-c77d24af6d8a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.825504 Oct 29 21:01:52.647893 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1839/3575] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:51 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:52.756153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:52.756943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:52.763660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:52.764151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:52.764596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:52.765298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:52.765797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:52.766261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:53.165439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:53.175263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0de7023e-c2f8-4a11-87c8-d51f1884a021 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1524 microversion: 2.1 time: 0.605037 Oct 29 21:01:53.175895 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1737/3576] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:52 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1524 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:53.355916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:53.364424 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-789cf779-4847-4031-b880-57c77ded91be tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.612093 Oct 29 21:01:53.365155 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1840/3577] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:52 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:53.556065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-94e5fef4-9eb4-4762-b1bd-aeb66f98cdbf req-070c78f1-da7a-4f2c-993d-f9029cc8b9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0785aa-27c3-44da-9417-e45732a59fb1", "name": "network-vif-unplugged", "status": "completed", "tag": "4d579cc4-15ee-497b-9c3d-126fd5b8c0e6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:53.566483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94e5fef4-9eb4-4762-b1bd-aeb66f98cdbf req-070c78f1-da7a-4f2c-993d-f9029cc8b9ce service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:53.567105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94e5fef4-9eb4-4762-b1bd-aeb66f98cdbf req-070c78f1-da7a-4f2c-993d-f9029cc8b9ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:53.567890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94e5fef4-9eb4-4762-b1bd-aeb66f98cdbf req-070c78f1-da7a-4f2c-993d-f9029cc8b9ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:53.586415 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-94e5fef4-9eb4-4762-b1bd-aeb66f98cdbf req-070c78f1-da7a-4f2c-993d-f9029cc8b9ce service nova] Creating event network-vif-unplugged:4d579cc4-15ee-497b-9c3d-126fd5b8c0e6 for instance 8b0785aa-27c3-44da-9417-e45732a59fb1 on nch2-master-1 Oct 29 21:01:53.594936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:53.596482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:53.599369 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-94e5fef4-9eb4-4762-b1bd-aeb66f98cdbf req-070c78f1-da7a-4f2c-993d-f9029cc8b9ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047237 Oct 29 21:01:53.601206 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1738/3578] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:53.605697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:53.606982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:53.607435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:53.608829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:53.609344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:53.610057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:53.690376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:53.692303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:53.701011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:53.701812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:53.702433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:53.703320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:53.703947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:53.704537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:54.410310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:54.418132 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff186d01-f019-46f9-a6cf-45fe0e7b6195 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.829138 Oct 29 21:01:54.418724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1841/3579] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:53 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:54.430176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:54.430176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:54.430550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:54.431483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:54.432424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:54.433212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:54.434080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:54.434587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:54.531789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:54.539763 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e328370-c5ed-4c22-b883-3df100870371 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.854146 Oct 29 21:01:54.540355 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1739/3580] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:53 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:54.545377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:54.546825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:54.554216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:54.554983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:54.555518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:54.556997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:54.557623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:54.562929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:54.685634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:54.909996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:54.915193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:54.921229 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4ed8c8a-1816-4e9d-8744-ccc7c9c5b707 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1524 microversion: 2.1 time: 0.501491 Oct 29 21:01:54.934394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1842/3581] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:54 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1524 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:54.944915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8ac8d2d7-a77b-4709-987f-c265f89411c5 req-3ec190ab-efff-452a-bfd4-504201322394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d80a1a-a33d-4eda-b562-7a0a6042294a", "tag": "6dda8609-ae5c-436b-9c12-ed8141c69383"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:54.950359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:54.966286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ac8d2d7-a77b-4709-987f-c265f89411c5 req-3ec190ab-efff-452a-bfd4-504201322394 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:54.966286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ac8d2d7-a77b-4709-987f-c265f89411c5 req-3ec190ab-efff-452a-bfd4-504201322394 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:54.966286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ac8d2d7-a77b-4709-987f-c265f89411c5 req-3ec190ab-efff-452a-bfd4-504201322394 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:54.985290 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-97a52ab7-24a0-4707-b44a-85046d027379 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1317 microversion: 2.1 time: 0.443819 Oct 29 21:01:54.988435 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1740/3582] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:54 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:54.991500 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8ac8d2d7-a77b-4709-987f-c265f89411c5 req-3ec190ab-efff-452a-bfd4-504201322394 service nova] Creating event network-changed:6dda8609-ae5c-436b-9c12-ed8141c69383 for instance 24d80a1a-a33d-4eda-b562-7a0a6042294a on nch1-master-1 Oct 29 21:01:55.007366 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8ac8d2d7-a77b-4709-987f-c265f89411c5 req-3ec190ab-efff-452a-bfd4-504201322394 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071290 Oct 29 21:01:55.008132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1843/3583] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:55.364028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-831918158", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f8b66b5a-beb2-4afc-a2c9-162a415e3d52"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:55.443970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:55.444681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:55.454500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:55.454992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:55.458433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:55.462036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:55.462529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:55.466004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:55.847006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] validate_networks() for [('f8b66b5a-beb2-4afc-a2c9-162a415e3d52', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:01:56.185378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:56.202939 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9dbf21ce-e752-4d39-8634-73e07feaf96c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.763793 Oct 29 21:01:56.203955 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1844/3584] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:55 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:56.222744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:56.223514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:56.237862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:56.238675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:56.239211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:56.240296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:56.240858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:56.241364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:56.676227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:56.687650 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48bf57b9-d09f-4069-973b-0a9f838e1e79 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.480631 Oct 29 21:01:56.690366 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1845/3585] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:56 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:56.709566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:56.710207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:56.731049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:56.734710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:56.735425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:56.738686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:56.739173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:56.740389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.096149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:57.103505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:01:57.104014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:01:57.104697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:01:57.105735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:01:57.106161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:01:57.119743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.120239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.120730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.121487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.121968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48844244-4e7f-4fb0-808d-545a3913e319 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1524 microversion: 2.1 time: 0.425942 Oct 29 21:01:57.122602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1846/3586] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:56 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:57.126045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.128190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:57.128829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.132690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:57.143920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:57.146688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.153480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.153949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.154692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.155163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.155598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.184886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Getting quotas for project 23a37b9c718e465c83323970f013fe50. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:01:57.191193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Getting quotas for user 7612bf8b52db4840b9d2e7f342414429 and project 23a37b9c718e465c83323970f013fe50. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:01:57.214995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:57.238097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Going to run 2 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:01:57.240803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: bba8b302-0692-4af1-9350-ec8c975379d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:57.278420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=bba8b302-0692-4af1-9350-ec8c975379d3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:01:57.351932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a87d05ea-e145-4695-bfe6-3b9b8dc9254b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201348 Oct 29 21:01:57.353507 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1741/3587] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:01:57.359970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6a5485b7-369a-4768-9ac0-fc9613cd519e req-b2f8d8d2-3da8-4c78-85c0-716171ea16e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0785aa-27c3-44da-9417-e45732a59fb1", "name": "network-vif-plugged", "status": "completed", "tag": "4d579cc4-15ee-497b-9c3d-126fd5b8c0e6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:57.373084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6a5485b7-369a-4768-9ac0-fc9613cd519e req-b2f8d8d2-3da8-4c78-85c0-716171ea16e9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.373910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6a5485b7-369a-4768-9ac0-fc9613cd519e req-b2f8d8d2-3da8-4c78-85c0-716171ea16e9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.374534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6a5485b7-369a-4768-9ac0-fc9613cd519e req-b2f8d8d2-3da8-4c78-85c0-716171ea16e9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.391445 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6a5485b7-369a-4768-9ac0-fc9613cd519e req-b2f8d8d2-3da8-4c78-85c0-716171ea16e9 service nova] Creating event network-vif-plugged:4d579cc4-15ee-497b-9c3d-126fd5b8c0e6 for instance 8b0785aa-27c3-44da-9417-e45732a59fb1 on nch2-master-1 Oct 29 21:01:57.398185 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6a5485b7-369a-4768-9ac0-fc9613cd519e req-b2f8d8d2-3da8-4c78-85c0-716171ea16e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042055 Oct 29 21:01:57.399636 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1742/3588] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:57.408201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:57.409363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:57.417668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.418460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.419221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.420123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.420761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.421363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.427607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:57.438377 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5a276e9-f0e7-4533-9aae-2138fec44e47 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1466 microversion: 2.1 time: 0.314105 Oct 29 21:01:57.461784 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1847/3589] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:57 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1466 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:57.467953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:57.473369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:57.476709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Searching by: {'deleted': False, 'project_id': '23a37b9c718e465c83323970f013fe50'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:01:57.503698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.505100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.506004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.507051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.507798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.508453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.537429 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96e9d78c-1b5f-4926-8e43-ead85b26a553 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.074079 Oct 29 21:01:57.538732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1848/3590] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 21:01:57 2022] GET /compute/v2.1/servers => generated 675 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:57.544817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:57.551273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:57.560003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.560754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.561562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.562519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.564135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.564832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.920066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:57.931718 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-023388b6-6d43-4eb5-a852-e8d7ed1b21d0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.530300 Oct 29 21:01:57.932620 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1743/3591] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:57 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:57.938533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a9e639c-cf06-4920-8e39-989b1686b208 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:57.939169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a9e639c-cf06-4920-8e39-989b1686b208 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:57.975176 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7437c3b7-72d6-4f6c-aca6-a000257e5dd4 tempest-ServersOnMultiNodesTest-298216006 tempest-ServersOnMultiNodesTest-298216006-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1617 microversion: 2.1 time: 0.434202 Oct 29 21:01:57.976732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1849/3592] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:57 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1617 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:57.981808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:57.982709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:57.989642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.990477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.991162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:57.992442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:57.993131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:57.993860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.062910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a9e639c-cf06-4920-8e39-989b1686b208 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:58.082345 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a9e639c-cf06-4920-8e39-989b1686b208 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1219 microversion: 2.1 time: 0.147307 Oct 29 21:01:58.099121 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1744/3593] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:57 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:58.099587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:58.100112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:58.117188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.137203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.141185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.144909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.145966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.146935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.219692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:01:58.226624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:58.237176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:58.240619 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0336baec-fe66-4309-853d-12406e0775b2 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.261842 Oct 29 21:01:58.264320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1850/3594] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:57 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:58.269218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:58.272282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:58.281334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.281860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.282418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.283015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.283452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.283879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.346809 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23859e5e-2372-431a-b32d-fffeaf16cce1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 204 len: 0 microversion: 2.1 time: 0.254323 Oct 29 21:01:58.347591 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1745/3595] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:01:58 2022] DELETE /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:01:58.361011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:58.361781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:58.380547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.381268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.382662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.384592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.388196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.389642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.573096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:58.584318 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-556f257d-4b94-49da-839b-3446746f816c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1524 microversion: 2.1 time: 0.318799 Oct 29 21:01:58.584907 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1851/3596] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:58 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1524 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:58.711531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:58.724783 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96980e82-ca9a-47f0-abd5-a18d6b86ec5b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1472 microversion: 2.1 time: 0.372745 Oct 29 21:01:58.725378 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1746/3597] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:58 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:58.959620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:58.960079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:58.968739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.969497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.970105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:58.970984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:58.971868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:58.972468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.106271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:59.106903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:59.120161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.120756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.121159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.123278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.123767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.130222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.171066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:59.194218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-71eef95f-b6ec-41b0-bd44-0db8a96cd695 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.234826 Oct 29 21:01:59.195935 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1852/3598] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:58 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:59.211589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:01:59.275122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:59.278014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:59.278975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:59.285836 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-872d9e12-35e6-42ba-ba64-dd619f18793d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1271 microversion: 2.1 time: 0.183336 Oct 29 21:01:59.288708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1747/3599] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:59 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:59.308546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.321546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.327779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.334940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.335116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.336041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.514774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4b84d5bc-7ff4-4aea-a70d-dd31ee5c4cef req-97269c2f-801f-48cc-85b4-70ecacbe9e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a71a556-5e58-45f9-93f3-2d20d1297c9f", "name": "network-vif-plugged", "status": "completed", "tag": "0aaff3b4-4fe2-4e38-9f9e-ade00bbd447f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:01:59.530931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4b84d5bc-7ff4-4aea-a70d-dd31ee5c4cef req-97269c2f-801f-48cc-85b4-70ecacbe9e77 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.531427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4b84d5bc-7ff4-4aea-a70d-dd31ee5c4cef req-97269c2f-801f-48cc-85b4-70ecacbe9e77 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.531872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4b84d5bc-7ff4-4aea-a70d-dd31ee5c4cef req-97269c2f-801f-48cc-85b4-70ecacbe9e77 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.553740 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4b84d5bc-7ff4-4aea-a70d-dd31ee5c4cef req-97269c2f-801f-48cc-85b4-70ecacbe9e77 service nova] Creating event network-vif-plugged:0aaff3b4-4fe2-4e38-9f9e-ade00bbd447f for instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f on nch1-master-1 Oct 29 21:01:59.559654 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4b84d5bc-7ff4-4aea-a70d-dd31ee5c4cef req-97269c2f-801f-48cc-85b4-70ecacbe9e77 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048842 Oct 29 21:01:59.560625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1748/3600] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:01:59.608042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:59.609810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:59.610532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:59.617890 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-32824bee-6fd4-4c8e-a9f1-ad2bfb1c58fe tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.354141 Oct 29 21:01:59.619160 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1853/3601] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:59 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:01:59.626485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.626985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.627437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.629012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.629583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.630060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.751444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:59.752087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:59.760851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.761913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.762177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.763365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.763996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.764607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.790199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:59.805821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ecef3a84-98b7-4aa4-bd54-4105bd8bac1f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1509 microversion: 2.1 time: 0.196681 Oct 29 21:01:59.810442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1749/3602] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:59 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:01:59.832537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:01:59.832537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:01:59.840450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.840450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.840783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.841367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:01:59.841865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:01:59.842290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:01:59.959274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:01:59.967439 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97d4f388-e815-41d8-a428-41ff0d3e5b9f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1472 microversion: 2.1 time: 0.223100 Oct 29 21:01:59.976370 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1854/3603] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:59 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:00.051180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:00.062908 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2375fcf5-73f2-4ec6-8b77-e804437c712f tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 200 len: 1509 microversion: 2.1 time: 0.237748 Oct 29 21:02:00.064314 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1750/3604] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:01:59 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:00.086876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:00.087737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:00.098494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.100398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.102503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.105505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.107863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.111581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.165397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:00.220664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:00.221887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:00.228715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.229212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.229686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.247453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.252848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.257107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.334682 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d74ba67-16e7-4d0d-8b6c-c5f31c666587 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 204 len: 0 microversion: 2.1 time: 0.251679 Oct 29 21:02:00.337006 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1855/3605] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:00 2022] DELETE /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:00.348855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:00.349852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:00.369293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.370747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.371676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.373005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.375064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.375578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.629666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:00.642512 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0749579c-bb73-4ad8-b714-6ba8193ed64f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.424752 Oct 29 21:02:00.646727 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1751/3606] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:00 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:00.661991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-470950014", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "bad36a5b-055e-432b-a9c1-48ee70be6e17"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:00.742471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] validate_networks() for [('bad36a5b-055e-432b-a9c1-48ee70be6e17', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:02:00.866931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:00.876873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-44567084-361a-42c4-9f85-92f2acdc12bc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1277 microversion: 2.1 time: 0.537996 Oct 29 21:02:00.878236 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1856/3607] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:00 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1277 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:00.886685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:00.887624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:00.898864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.899655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.900093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:00.901017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:00.901517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:00.902496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:01.562402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:01.571455 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3c34a9a-3e62-4d67-a8ad-d2ba4ceafa89 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.691412 Oct 29 21:02:01.572048 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1857/3608] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:00 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:01.576523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:01.581182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:01.601201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:01.601954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:01.602569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:01.603923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:01.604682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:01.606425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.124460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:02.134693 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4f44a4a-66c4-4502-8337-74aa134b9a1b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1472 microversion: 2.1 time: 0.561460 Oct 29 21:02:02.158751 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1858/3609] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:01 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1472 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:02.198850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:02.199967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:02.257261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.262276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.266630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.273931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.274699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.284926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.592109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:02:02.592687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:02:02.593139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:02:02.594364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:02:02.595300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:02:02.608390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.609129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.609920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.610860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.611496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.612239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.666100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Getting quotas for project 92ced91d5c874306ae56325583f3bb12. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:02:02.679558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Getting quotas for user 5e85d4d6aed54dae96f3a7ade33611f6 and project 92ced91d5c874306ae56325583f3bb12. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:02:02.735425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:02:02.738588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:02.846841 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-006dc4ad-b4f0-45cc-9afc-568d8334e8c1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.195463 Oct 29 21:02:02.848578 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1752/3610] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:02:02.855232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:02.856074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:02.863933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.864666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.865294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.866190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.867104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.867758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.912349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:02.920679 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-459a5278-fb90-4af3-85b6-d17e627c353e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.759033 Oct 29 21:02:02.937481 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1859/3611] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:02 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:02.937481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:02.937481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:02.954724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.955336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.955857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:02.956660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:02.957205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:02.957764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:03.494873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:03.504231 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b28e60b0-2c62-4558-97ae-e1724f235495 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.577111 Oct 29 21:02:03.505245 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1860/3612] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:02 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:03.511855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:03.512885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:03.515003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:03.521361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:03.522328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:03.522939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:03.523842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:03.524475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:03.525228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:03.529890 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-83092a38-9596-4359-b1bf-1eb9c9c078a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.680021 Oct 29 21:02:03.545514 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1753/3613] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:02 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:03.561268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:03.565938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:03.580459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:03.581254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:03.582114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:03.583102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:03.584007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:03.588781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:03.733947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:03.756028 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f0af3b2-154d-406c-99f2-a6919f4fd5f8 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1221 microversion: 2.1 time: 0.246710 Oct 29 21:02:03.758844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1861/3614] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:03 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1221 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:03.819603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:03.838723 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8337358d-f26b-4d6f-93b6-8187a0b06633 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1430 microversion: 2.1 time: 0.301341 Oct 29 21:02:03.842100 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1754/3615] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:03 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1430 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:03.950290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:03.950918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:03.970243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:03.971141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:03.975538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:03.976560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:03.979421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:03.980281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.055635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a46dfcfe-8bb7-4b6f-b163-a66c53d423c9 req-f22c66a8-d2d0-42a1-863a-95e12ab09429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e903876-9160-4477-9b54-1732ca4282ff", "name": "network-vif-deleted", "tag": "0e9c0399-fe79-48bd-98c7-9eaf63e3d9d3"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:04.090312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a46dfcfe-8bb7-4b6f-b163-a66c53d423c9 req-f22c66a8-d2d0-42a1-863a-95e12ab09429 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.090991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a46dfcfe-8bb7-4b6f-b163-a66c53d423c9 req-f22c66a8-d2d0-42a1-863a-95e12ab09429 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.099112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a46dfcfe-8bb7-4b6f-b163-a66c53d423c9 req-f22c66a8-d2d0-42a1-863a-95e12ab09429 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.127693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a46dfcfe-8bb7-4b6f-b163-a66c53d423c9 req-f22c66a8-d2d0-42a1-863a-95e12ab09429 service nova] Creating event network-vif-deleted:0e9c0399-fe79-48bd-98c7-9eaf63e3d9d3 for instance 2e903876-9160-4477-9b54-1732ca4282ff on nch1-master-1 Oct 29 21:02:04.137843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a46dfcfe-8bb7-4b6f-b163-a66c53d423c9 req-f22c66a8-d2d0-42a1-863a-95e12ab09429 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086359 Oct 29 21:02:04.142129 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1755/3616] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:04.175784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "360b708f-faff-4312-b818-452b6e0d9153"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:04.178888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:04.218084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.218833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.219464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.221715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.222616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.231017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.862670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:04.881269 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a06c125-bbea-4539-9548-2d528b80441c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1308 microversion: 2.1 time: 0.936686 Oct 29 21:02:04.882409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1862/3617] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:03 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1308 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:04.888443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-cdd28c53-199b-40b2-a0f3-376832882db3 req-ec4a38ee-b906-40ab-a361-97bc8b36baf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d80a1a-a33d-4eda-b562-7a0a6042294a", "name": "network-vif-plugged", "status": "completed", "tag": "6dda8609-ae5c-436b-9c12-ed8141c69383"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:04.902152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cdd28c53-199b-40b2-a0f3-376832882db3 req-ec4a38ee-b906-40ab-a361-97bc8b36baf4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.902950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cdd28c53-199b-40b2-a0f3-376832882db3 req-ec4a38ee-b906-40ab-a361-97bc8b36baf4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.903564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cdd28c53-199b-40b2-a0f3-376832882db3 req-ec4a38ee-b906-40ab-a361-97bc8b36baf4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.915988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-28aaa598-a008-4e9e-8c02-16757fa78e62 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746451 Oct 29 21:02:04.918625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1756/3618] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:02:04 2022] POST /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:02:04.919017 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-cdd28c53-199b-40b2-a0f3-376832882db3 req-ec4a38ee-b906-40ab-a361-97bc8b36baf4 service nova] Creating event network-vif-plugged:6dda8609-ae5c-436b-9c12-ed8141c69383 for instance 24d80a1a-a33d-4eda-b562-7a0a6042294a on nch1-master-1 Oct 29 21:02:04.941492 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-cdd28c53-199b-40b2-a0f3-376832882db3 req-ec4a38ee-b906-40ab-a361-97bc8b36baf4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057308 Oct 29 21:02:04.945934 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1863/3619] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:04.946655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:04.948915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:04.954000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:04.955316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:04.963597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.964506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.965483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.966598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.967228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.967994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.983672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.987902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:04.991212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:04.994007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:04.997982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.001563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.594341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:05.602771 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ae02955-a3b7-4bd9-a84f-6ad7003b5050 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.682159 Oct 29 21:02:05.605966 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1757/3620] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:04 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:05.632398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:05.632829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:05.633605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:05.640765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.641190 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b503e12-2d00-4da9-8435-9e4bdab1e26f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.694062 Oct 29 21:02:05.641979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.643005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.643941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.644616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.645277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.658726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1864/3621] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:04 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:05.671928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:05.672477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:05.688013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.691467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.693555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.696515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.697207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.697873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.728162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:05.741093 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae7b748f-d7da-4e5e-9107-e91a0dd6a875 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1269 microversion: 2.1 time: 0.117857 Oct 29 21:02:05.743600 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1758/3622] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:05 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:05.759037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7b7386a2-5cef-4571-b7b5-209b1e51c667 req-911b56d3-f9c9-4116-aa36-800ccf0935ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790ff727-43ae-4ea8-b137-42146fa08e45", "tag": "c62f9d8a-3ce4-40c5-8c57-e94c7ebf80bf"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:05.780200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7b7386a2-5cef-4571-b7b5-209b1e51c667 req-911b56d3-f9c9-4116-aa36-800ccf0935ac service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.783394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7b7386a2-5cef-4571-b7b5-209b1e51c667 req-911b56d3-f9c9-4116-aa36-800ccf0935ac service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.784190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7b7386a2-5cef-4571-b7b5-209b1e51c667 req-911b56d3-f9c9-4116-aa36-800ccf0935ac service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.821479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7b7386a2-5cef-4571-b7b5-209b1e51c667 req-911b56d3-f9c9-4116-aa36-800ccf0935ac service nova] Creating event network-changed:c62f9d8a-3ce4-40c5-8c57-e94c7ebf80bf for instance 790ff727-43ae-4ea8-b137-42146fa08e45 on nch2-master-1 Oct 29 21:02:05.832625 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7b7386a2-5cef-4571-b7b5-209b1e51c667 req-911b56d3-f9c9-4116-aa36-800ccf0935ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087528 Oct 29 21:02:05.834302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.834859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.835128 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1759/3623] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:05.837138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.839741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 2e903876-9160-4477-9b54-1732ca4282ff {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:05.904805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:05.905746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:05.907618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:05.920639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.921816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.922459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.923732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.926247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.927874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ed07af4-d562-4a4a-82a7-470d06776ac3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1307 microversion: 2.1 time: 0.265498 Oct 29 21:02:05.928189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.951098 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1865/3624] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:05 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:05.972560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:05.973196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:05.993247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:05.994293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:05.994996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:05.997010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:06.000267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:06.001080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:06.009410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:06.051574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:06.336738 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-988cf4a4-be49-43b4-af3d-602665f51538 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 204 len: 0 microversion: 2.1 time: 0.377626 Oct 29 21:02:06.343683 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1866/3625] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:05 2022] DELETE /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:06.355786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b188a59b-ccb1-45f7-92ef-f4a362e97289 req-e532b2de-e795-453c-999b-3728d8bfc005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0785aa-27c3-44da-9417-e45732a59fb1", "name": "network-vif-deleted", "tag": "4d579cc4-15ee-497b-9c3d-126fd5b8c0e6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:06.380994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b188a59b-ccb1-45f7-92ef-f4a362e97289 req-e532b2de-e795-453c-999b-3728d8bfc005 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:06.384398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b188a59b-ccb1-45f7-92ef-f4a362e97289 req-e532b2de-e795-453c-999b-3728d8bfc005 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:06.385322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b188a59b-ccb1-45f7-92ef-f4a362e97289 req-e532b2de-e795-453c-999b-3728d8bfc005 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:06.420176 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b188a59b-ccb1-45f7-92ef-f4a362e97289 req-e532b2de-e795-453c-999b-3728d8bfc005 service nova] Creating event network-vif-deleted:4d579cc4-15ee-497b-9c3d-126fd5b8c0e6 for instance 8b0785aa-27c3-44da-9417-e45732a59fb1 on nch2-master-1 Oct 29 21:02:06.428694 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b188a59b-ccb1-45f7-92ef-f4a362e97289 req-e532b2de-e795-453c-999b-3728d8bfc005 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081623 Oct 29 21:02:06.430514 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1867/3626] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:06.442446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:06.443562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:06.462419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:06.463328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:06.464023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:06.465998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:06.466730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:06.467425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:06.518575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:06.527291 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1be172ae-cfc1-43da-9cd4-7ab85e03169d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1490 microversion: 2.1 time: 0.626053 Oct 29 21:02:06.549809 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1760/3627] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:05 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1490 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:06.559959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:06.563840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:06.575394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:06.576854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:06.581062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:06.582028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:06.582659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:06.583256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:06.928327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:06.942962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:06.949651 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b4912e09-deb9-4193-9d06-dc98d6ab05da tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1489 microversion: 2.1 time: 0.392784 Oct 29 21:02:06.971768 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-054321d7-91ba-4387-a745-ae841043a624 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1664 microversion: 2.1 time: 0.539721 Oct 29 21:02:06.972738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1868/3628] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:06 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1664 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:06.977613 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1761/3629] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:06 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1489 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:06.987628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:06.988259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:06.993135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:06.993779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:07.013371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.013890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.014333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.022134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.022636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.023076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.023786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.024240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.024660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.029424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.029991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.030437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.320639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:07.339095 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00eaac58-900c-4d4b-819d-61ad62ff86e1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.355391 Oct 29 21:02:07.354596 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1762/3630] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:06 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:07.359983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:07.360877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:07.374460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.375521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.376146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.377714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.378360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.379723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.380171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:07.393078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f48ebe88-4e1c-4af4-8a16-55e7b387242c tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.419122 Oct 29 21:02:07.393813 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1869/3631] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:06 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:07.403104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:07.411471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:07.425008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.425669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.426370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.427833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.428744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.429412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.459899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:07.471469 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c48185f-df92-4d38-b824-8a39df0322b9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1277 microversion: 2.1 time: 0.129887 Oct 29 21:02:07.477526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.478250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.478823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.479473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 2e903876-9160-4477-9b54-1732ca4282ff {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:07.482666 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1763/3632] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:07 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:07.499045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:07.499936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:07.516440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:07.519591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.521294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.522161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.523180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.523987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.524925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.545886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:07.556659 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3cf2cb23-4304-4279-a974-02b57b4a25db tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1307 microversion: 2.1 time: 0.161705 Oct 29 21:02:07.557314 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1870/3633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:07 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:07.681819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:07.692648 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d545d707-e3b3-4804-b92c-05d0e3e97ea1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1490 microversion: 2.1 time: 0.208776 Oct 29 21:02:07.693876 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1764/3634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:07 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1490 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:07.717532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:07.718356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:07.725432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.726455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.727068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.727988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.728625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.729242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.759441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:07.852177 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53a1d0eb-e056-4bee-b4a4-718bbebc4605 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 204 len: 0 microversion: 2.1 time: 0.139820 Oct 29 21:02:07.857352 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1871/3635] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:07 2022] DELETE /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:07.864487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:07.866114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:07.873963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.874362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.874809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.875916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:07.876388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:07.876955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:07.907906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:08.008294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:08.009278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:08.022888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.023640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.024311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.025344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.030225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.031772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.118505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:08.129328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d198aa1-96c2-4358-a737-b9747bad0947 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1496 microversion: 2.1 time: 0.270243 Oct 29 21:02:08.130194 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1765/3636] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:07 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1496 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:08.262462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:08.272220 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-42ccb80d-5ccf-4409-9fa6-282619d90f64 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1664 microversion: 2.1 time: 0.273707 Oct 29 21:02:08.285827 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1872/3637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:07 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1664 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:08.368843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:08.370240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:08.382738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.383324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.384481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.385740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.387157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.387834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.421216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:08.422350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:08.451851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.453177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.453787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.456209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.456993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.457711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.678339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:08.688063 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa8b26ee-ef7d-463c-a6d4-4aa0b3b98af8 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1324 microversion: 2.1 time: 0.272366 Oct 29 21:02:08.689372 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1873/3638] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:08 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:08.706053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:08.708793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f069e584-82c5-447b-b359-5a784aa925fc req-063ab9c9-e212-4f33-94a4-85255b3ed46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba8b302-0692-4af1-9350-ec8c975379d3", "tag": "88116d6b-20f2-440f-906a-193232d100a6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:08.721628 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-edfa1746-0b1a-432d-b96d-736db75bbe3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.359782 Oct 29 21:02:08.723385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1766/3639] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:08 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:08.725254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f069e584-82c5-447b-b359-5a784aa925fc req-063ab9c9-e212-4f33-94a4-85255b3ed46c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.725980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f069e584-82c5-447b-b359-5a784aa925fc req-063ab9c9-e212-4f33-94a4-85255b3ed46c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.726419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f069e584-82c5-447b-b359-5a784aa925fc req-063ab9c9-e212-4f33-94a4-85255b3ed46c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.738425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:08.740355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:08.750869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.751802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.752401 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f069e584-82c5-447b-b359-5a784aa925fc req-063ab9c9-e212-4f33-94a4-85255b3ed46c service nova] Creating event network-changed:88116d6b-20f2-440f-906a-193232d100a6 for instance bba8b302-0692-4af1-9350-ec8c975379d3 on nch2-master-1 Oct 29 21:02:08.753349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.754229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.755015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.755829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.768223 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f069e584-82c5-447b-b359-5a784aa925fc req-063ab9c9-e212-4f33-94a4-85255b3ed46c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076058 Oct 29 21:02:08.769288 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1874/3640] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:08.781958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:08.782806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:08.798237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.800896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.802352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.805092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.807213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.809120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.850335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:08.858811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:08.859469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:08.859709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-50a1284d-5690-4e13-98ac-dc89e8253bea tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1277 microversion: 2.1 time: 0.134643 Oct 29 21:02:08.860103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:08.860668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 2e903876-9160-4477-9b54-1732ca4282ff {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:08.865557 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1767/3641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:08 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:08.936986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:08.945619 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b417b7a-28ef-48e3-b847-f282a08a6614 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1307 microversion: 2.1 time: 0.174996 Oct 29 21:02:08.949570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1875/3642] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:08 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:09.156081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:09.156786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:09.168368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.168699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.169181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.169939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.170410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.170833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.300193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:09.306637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:09.322378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.326379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.327798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.328780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.329424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.330065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.622338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:09.632443 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db3eec22-900a-4a96-a241-4dda6fba5e35 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1496 microversion: 2.1 time: 0.481122 Oct 29 21:02:09.648150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1768/3643] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:09 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1496 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:09.658982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:09.661499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:09.668740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.669243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.669894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.670851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.671521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.672779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.713994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:09.724082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'flavor' on Instance uuid 11aa593f-4fe8-472f-9f8a-3872b461a5f4 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:09.725042 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64d45dca-0498-4c37-8109-0e72c2bf7703 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1664 microversion: 2.1 time: 0.429227 Oct 29 21:02:09.745168 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1876/3644] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:09 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1664 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:09.751687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:09.752657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:09.761678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.762445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.762901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.763655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.764330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.764768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.904813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06799a51-2536-4d1d-a8ba-6846737ac340 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/action" status: 200 len: 32 microversion: 2.1 time: 0.254854 Oct 29 21:02:09.905354 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1769/3645] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:02:09 2022] POST /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:02:09.912698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:09.913670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:09.921138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.921942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.922560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.923704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.924340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.924963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.940322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:09.951798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a0fa5973-c964-4d12-ad45-a9d692aac3d6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1520 microversion: 2.1 time: 0.204767 Oct 29 21:02:09.968900 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1877/3646] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:09 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:09.982834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:09.985606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:09.996266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.996893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:09.997413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:09.999083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:09.999637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.000151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.103990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:10.114478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-180eafe4-89f8-4899-8fe6-42e9eced5b3e tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1287 microversion: 2.1 time: 0.143438 Oct 29 21:02:10.126068 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1878/3647] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:09 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:10.131115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:10.131967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:10.138718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.139168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.139614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.140330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.140797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.141232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.145601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:10.153684 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-03883cf2-ae4c-4edd-b38a-c54cd9b80311 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.246728 Oct 29 21:02:10.154275 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1770/3648] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:09 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:10.159249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:10.160587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:10.168698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.169433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.170042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.171549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.172050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.172631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.213934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.214419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.214998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.215745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 2e903876-9160-4477-9b54-1732ca4282ff {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:10.273079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:10.284447 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f393cba4-77e0-4d3e-abc2-fafed550800d tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 200 len: 1307 microversion: 2.1 time: 0.128737 Oct 29 21:02:10.285157 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1771/3649] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:10 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:10.291119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e389e7b8-4158-4239-b91c-444a5b8be220 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-857530769", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e389e7b8-4158-4239-b91c-444a5b8be220 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 242 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-857530769", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-857530769', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '55d06ba3-22b1-486d-880f-ee24b54e949a'}]}}} Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:02:10.297006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e389e7b8-4158-4239-b91c-444a5b8be220 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.302857 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e389e7b8-4158-4239-b91c-444a5b8be220 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012365 Oct 29 21:02:10.309025 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1772/3650] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:10 2022] POST /compute/v2.1/servers => generated 175 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:02:10.357621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:10.366810 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-328c4e79-c8d0-4b37-b046-6976672a4236 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.239553 Oct 29 21:02:10.367404 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1879/3651] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:10 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:10.375983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d248549-0a2e-479b-a983-40a0984780e3 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:10.375983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d248549-0a2e-479b-a983-40a0984780e3 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 7dff028a-f454-405c-9a4c-98225f3f7fa2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:10.379599 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3d248549-0a2e-479b-a983-40a0984780e3 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] HTTP exception thrown: Instance 7dff028a-f454-405c-9a4c-98225f3f7fa2 could not be found. Oct 29 21:02:10.388396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-542698677", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "4da640a8-c76b-423b-9bfb-5c60a31c3aff"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d248549-0a2e-479b-a983-40a0984780e3 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/7dff028a-f454-405c-9a4c-98225f3f7fa2/metadata HTTP/1.1 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7dff028a-f454-405c-9a4c-98225f3f7fa2 could not be found. Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': '7dff028a-f454-405c-9a4c-98225f3f7fa2'} Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dff028a-f454-405c-9a4c-98225f3f7fa2 could not be found. Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dff028a-f454-405c-9a4c-98225f3f7fa2 could not be found. Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.390320 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dff028a-f454-405c-9a4c-98225f3f7fa2 could not be found. Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d248549-0a2e-479b-a983-40a0984780e3 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 404 to user: Instance 7dff028a-f454-405c-9a4c-98225f3f7fa2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d248549-0a2e-479b-a983-40a0984780e3 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/7dff028a-f454-405c-9a4c-98225f3f7fa2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.023515 Oct 29 21:02:10.395479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1880/3652] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:02:10 2022] GET /compute/v2.1/servers/7dff028a-f454-405c-9a4c-98225f3f7fa2/metadata => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:10.449877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-302fc2a7-9995-4d5d-baf6-3c7f349d2a42 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1326894970", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:10.452805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] validate_networks() for [('4da640a8-c76b-423b-9bfb-5c60a31c3aff', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-302fc2a7-9995-4d5d-baf6-3c7f349d2a42 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 499 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1326894970", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1326894970', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '55d06ba3-22b1-486d-880f-ee24b54e949a'}]}}} Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 21:02:10.454611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-302fc2a7-9995-4d5d-baf6-3c7f349d2a42 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-302fc2a7-9995-4d5d-baf6-3c7f349d2a42 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012133 Oct 29 21:02:10.459633 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1881/3653] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:10 2022] POST /compute/v2.1/servers => generated 687 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:02:10.511334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-359c0c4e-6142-4ce5-8e9a-7c36658b38cf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1240520561", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-359c0c4e-6142-4ce5-8e9a-7c36658b38cf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 500 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1240520561", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1240520561', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '55d06ba3-22b1-486d-880f-ee24b54e949a'}]}}} Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 21:02:10.517183 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-359c0c4e-6142-4ce5-8e9a-7c36658b38cf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-359c0c4e-6142-4ce5-8e9a-7c36658b38cf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016655 Oct 29 21:02:10.520895 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1882/3654] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:10 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:02:10.569421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3abc3149-72d0-43d2-b96d-4d6f196fb811 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1886305930", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3abc3149-72d0-43d2-b96d-4d6f196fb811 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 754 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1886305930", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1886305930', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '55d06ba3-22b1-486d-880f-ee24b54e949a'}]}}} Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:02:10.573867 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:02:10.576948 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:02:10.579733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.579733 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.579733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3abc3149-72d0-43d2-b96d-4d6f196fb811 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.579733 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3abc3149-72d0-43d2-b96d-4d6f196fb811 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.009981 Oct 29 21:02:10.579733 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1883/3655] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:10 2022] POST /compute/v2.1/servers => generated 1197 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 29 21:02:10.625604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b629e1d-798a-4a44-bc0b-77abbcd849bf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-806544636", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b629e1d-798a-4a44-bc0b-77abbcd849bf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 1265 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-806544636", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "55d06ba3-22b1-486d-880f-ee24b54e949a"}]}} Oct 29 21:02:10.630020 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-806544636', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '55d06ba3-22b1-486d-880f-ee24b54e949a'}]}}} Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.632571 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:02:10.634440 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:02:10.636453 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 21:02:10.636453 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.636453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b629e1d-798a-4a44-bc0b-77abbcd849bf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.636453 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b629e1d-798a-4a44-bc0b-77abbcd849bf tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010859 Oct 29 21:02:10.636453 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1884/3656] 10.222.0.36 () {60 vars in 1148 bytes} [Sat Oct 29 21:02:10 2022] POST /compute/v2.1/servers => generated 2221 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 29 21:02:10.641288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae719a2a-1255-477e-a58d-982539e17576 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:10.641820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae719a2a-1255-477e-a58d-982539e17576 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 0d5917ff-a957-4f05-bc2d-9640567f32bf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:10.647370 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ae719a2a-1255-477e-a58d-982539e17576 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] HTTP exception thrown: Instance 0d5917ff-a957-4f05-bc2d-9640567f32bf could not be found. Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae719a2a-1255-477e-a58d-982539e17576 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/0d5917ff-a957-4f05-bc2d-9640567f32bf/metadata/test2 HTTP/1.1 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 0d5917ff-a957-4f05-bc2d-9640567f32bf could not be found. Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': '0d5917ff-a957-4f05-bc2d-9640567f32bf', 'id': 'test2'} Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5917ff-a957-4f05-bc2d-9640567f32bf could not be found. Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5917ff-a957-4f05-bc2d-9640567f32bf could not be found. Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:10.648858 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5917ff-a957-4f05-bc2d-9640567f32bf could not be found. Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae719a2a-1255-477e-a58d-982539e17576 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 404 to user: Instance 0d5917ff-a957-4f05-bc2d-9640567f32bf could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae719a2a-1255-477e-a58d-982539e17576 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/0d5917ff-a957-4f05-bc2d-9640567f32bf/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.012812 Oct 29 21:02:10.654611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1885/3657] 10.222.0.36 () {58 vars in 1281 bytes} [Sat Oct 29 21:02:10 2022] GET /compute/v2.1/servers/0d5917ff-a957-4f05-bc2d-9640567f32bf/metadata/test2 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:02:10.664266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:10.665015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:10.672666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.673242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.674046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.674947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:10.675670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:10.676181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:10.692388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:11.651681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:11.672493 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1a697cc8-1b6b-4d06-abf7-beee560c3d6b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1496 microversion: 2.1 time: 1.009439 Oct 29 21:02:11.673913 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1886/3658] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:10 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1496 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:11.697089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:11.703353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:02:11.704630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:02:11.705108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:11.705518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:02:11.706055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:02:11.706636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:02:11.724010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:11.724842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:11.726171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:11.726832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:11.727775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:11.728341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:11.729021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:11.730198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:11.730849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:11.734460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:11.735222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:11.736133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:11.767165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:11.782547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Getting quotas for project ffbb1efd59ce4030b3740f0351e7df34. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:02:11.795594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Getting quotas for user 7e340341dcc94b3396bb6e53ebf1308a and project ffbb1efd59ce4030b3740f0351e7df34. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:02:11.824213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:11.833037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:02:11.836389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:11.984465 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e92f7842-70d8-44e5-ad76-3e30d75fd858 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673811 Oct 29 21:02:11.985301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1773/3659] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:02:12.003837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:12.006908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:12.022358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:12.026388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:12.027514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:12.028096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:12.029130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:12.029902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:12.030608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:12.033985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43bcbf20-fd7c-46f7-987d-a1cafd562665 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "DELETE /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 204 len: 0 microversion: 2.1 time: 0.352954 Oct 29 21:02:12.037822 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1887/3660] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:11 2022] DELETE /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:12.052237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:12.053584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:12.068281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:12.069110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:12.070507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:12.071756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:12.072723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:12.075267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:12.334178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:12.352469 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-85e3eea1-0026-4251-b052-537d0a1e7f6b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1275 microversion: 2.1 time: 0.312258 Oct 29 21:02:12.356013 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1888/3661] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:12 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1275 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:12.374856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:12.376197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:12.393538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:12.402918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:12.403590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:12.404570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:12.405271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:12.405984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:12.909145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:12.949954 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c459c4bb-39b6-418f-9648-76e0dba3f966 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1664 microversion: 2.1 time: 0.951669 Oct 29 21:02:12.956077 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1774/3662] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:11 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1664 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:12.974529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:12.975277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 2e903876-9160-4477-9b54-1732ca4282ff] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:13.014424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:13.016791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:13.017493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:13.023739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:13.025809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:13.028526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:13.078043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance 2e903876-9160-4477-9b54-1732ca4282ff could not be found. Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff HTTP/1.1 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2e903876-9160-4477-9b54-1732ca4282ff could not be found. Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2e903876-9160-4477-9b54-1732ca4282ff'} Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e903876-9160-4477-9b54-1732ca4282ff could not be found. Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e903876-9160-4477-9b54-1732ca4282ff could not be found. Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:13.084684 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e903876-9160-4477-9b54-1732ca4282ff could not be found. Oct 29 21:02:13.091806 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:13.095857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:13.097292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance 2e903876-9160-4477-9b54-1732ca4282ff could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:13.105664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5806783b-3040-4583-b948-a39b7053422f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff" status: 404 len: 111 microversion: 2.1 time: 0.142343 Oct 29 21:02:13.107109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1775/3663] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:12 2022] GET /compute/v2.1/servers/2e903876-9160-4477-9b54-1732ca4282ff => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:13.110527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5091a0ef-4910-45e4-9626-bd0aff1347da tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.743927 Oct 29 21:02:13.125535 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1889/3664] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:12 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:13.127919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:13.129891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:13.137777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:13.141317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:13.158955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:13.161118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:13.163851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:13.164148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:13.164369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:13.164829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:13.165714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:13.166473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:13.168993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:13.179960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:13.180476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:13.186721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:13.958403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:13.980720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8878c811-eb90-475d-9174-3e34f115dac8 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1268 microversion: 2.1 time: 0.863211 Oct 29 21:02:13.996364 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1890/3665] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:13 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1268 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:14.013068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:14.013996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:14.022081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:14.023675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:14.026110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:14.027830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:14.028657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:14.029421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:14.527709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:14.551620 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd413849-ecec-465c-b125-bd543a3998f1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 1.439566 Oct 29 21:02:14.552670 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1776/3666] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:13 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:14.557562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:14.558732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:14.574308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:14.574806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:14.575251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:14.575966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:14.576419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:14.576846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:14.660923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:14.671427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:14.673086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:14.674067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lazy-loading 'fault' on Instance uuid 1a71a556-5e58-45f9-93f3-2d20d1297c9f {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:15.152859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:15.169388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f2665bf-d25a-405f-b752-e181e12e511f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 200 len: 1298 microversion: 2.1 time: 0.615320 Oct 29 21:02:15.170646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1777/3667] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:14 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 1298 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:15.181100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:15.184420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:15.212937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:15.224476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.225163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.225750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.226753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.227375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.227916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.230408 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21349140-1e77-49ea-baaa-7b5cfa01e5a6 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1526 microversion: 2.1 time: 1.232090 Oct 29 21:02:15.231772 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1891/3668] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:13 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1526 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:15.236574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2b163284-dc65-453e-8e1b-8851183c355d req-811f10a9-c5bc-40f4-920d-f191c17cf200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a71a556-5e58-45f9-93f3-2d20d1297c9f", "name": "network-vif-deleted", "tag": "0aaff3b4-4fe2-4e38-9f9e-ade00bbd447f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:15.248210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2b163284-dc65-453e-8e1b-8851183c355d req-811f10a9-c5bc-40f4-920d-f191c17cf200 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.249002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2b163284-dc65-453e-8e1b-8851183c355d req-811f10a9-c5bc-40f4-920d-f191c17cf200 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.249676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2b163284-dc65-453e-8e1b-8851183c355d req-811f10a9-c5bc-40f4-920d-f191c17cf200 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.263812 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2b163284-dc65-453e-8e1b-8851183c355d req-811f10a9-c5bc-40f4-920d-f191c17cf200 service nova] Creating event network-vif-deleted:0aaff3b4-4fe2-4e38-9f9e-ade00bbd447f for instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f on nch1-master-1 Oct 29 21:02:15.269301 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2b163284-dc65-453e-8e1b-8851183c355d req-811f10a9-c5bc-40f4-920d-f191c17cf200 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036072 Oct 29 21:02:15.270314 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1892/3669] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:15.276164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:15.281024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:15.294493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.294992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.297390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.298179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.301835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.302301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.306846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:15.577132 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3c0df87-2e96-4bb4-8caf-cdfcc136e4de tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 204 len: 0 microversion: 2.1 time: 0.402112 Oct 29 21:02:15.577890 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1778/3670] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:15 2022] DELETE /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:15.601244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:15.602071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:15.628967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.629634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.632913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.633807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.637944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.639931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.744928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:15.745996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:15.757980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:15.758577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lazy-loading 'fault' on Instance uuid f747a7c1-75a9-41a9-a1b6-020088da4261 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:16.005276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041ea2e030a84da2a3e866238e7318cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709aa4b8c6024e04bd16f02cdbe1d6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:16.022563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:16.030538 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7eee82a9-e848-4def-84b4-12f10c575a60 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 200 len: 1314 microversion: 2.1 time: 0.448165 Oct 29 21:02:16.033147 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1779/3671] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:15 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:16.052286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-012ac7c2-acb7-4304-9076-d8f79aaadfd6 req-1434d2b4-6426-490b-a1d4-c55759032a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f747a7c1-75a9-41a9-a1b6-020088da4261", "name": "network-vif-deleted", "tag": "bc32e650-f1fc-4c66-911e-f6315cba5925"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:16.083985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-012ac7c2-acb7-4304-9076-d8f79aaadfd6 req-1434d2b4-6426-490b-a1d4-c55759032a5d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.086264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-012ac7c2-acb7-4304-9076-d8f79aaadfd6 req-1434d2b4-6426-490b-a1d4-c55759032a5d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.086960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-012ac7c2-acb7-4304-9076-d8f79aaadfd6 req-1434d2b4-6426-490b-a1d4-c55759032a5d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.128128 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-012ac7c2-acb7-4304-9076-d8f79aaadfd6 req-1434d2b4-6426-490b-a1d4-c55759032a5d service nova] Creating event network-vif-deleted:bc32e650-f1fc-4c66-911e-f6315cba5925 for instance f747a7c1-75a9-41a9-a1b6-020088da4261 on nch1-master-1 Oct 29 21:02:16.139896 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-012ac7c2-acb7-4304-9076-d8f79aaadfd6 req-1434d2b4-6426-490b-a1d4-c55759032a5d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103023 Oct 29 21:02:16.142057 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1780/3672] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:16.150907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.153483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.162069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.162702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.163531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.164481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.165046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.165179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:16.165701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.180057 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81ccad84-432a-4462-82ff-17420861f090 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1317 microversion: 2.1 time: 0.908157 Oct 29 21:02:16.180732 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1893/3673] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:15 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:16.210444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-300b7ac7-29ba-456e-98a6-f6eb2a5e3eef req-681ae8f7-52e4-47a6-8e06-4fcf676c0fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790ff727-43ae-4ea8-b137-42146fa08e45", "name": "network-vif-plugged", "status": "completed", "tag": "c62f9d8a-3ce4-40c5-8c57-e94c7ebf80bf"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:16.235010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-300b7ac7-29ba-456e-98a6-f6eb2a5e3eef req-681ae8f7-52e4-47a6-8e06-4fcf676c0fa1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.235754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-300b7ac7-29ba-456e-98a6-f6eb2a5e3eef req-681ae8f7-52e4-47a6-8e06-4fcf676c0fa1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.235920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-300b7ac7-29ba-456e-98a6-f6eb2a5e3eef req-681ae8f7-52e4-47a6-8e06-4fcf676c0fa1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.257930 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-300b7ac7-29ba-456e-98a6-f6eb2a5e3eef req-681ae8f7-52e4-47a6-8e06-4fcf676c0fa1 service nova] Creating event network-vif-plugged:c62f9d8a-3ce4-40c5-8c57-e94c7ebf80bf for instance 790ff727-43ae-4ea8-b137-42146fa08e45 on nch2-master-1 Oct 29 21:02:16.263956 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-300b7ac7-29ba-456e-98a6-f6eb2a5e3eef req-681ae8f7-52e4-47a6-8e06-4fcf676c0fa1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057052 Oct 29 21:02:16.265084 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1894/3674] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:16.272084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.272984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.282788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.283630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.284252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.285508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.286389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.287192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.418964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:16.430804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-469c6ce3-38e5-42b2-8747-20fbde0acf93 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1274 microversion: 2.1 time: 0.164101 Oct 29 21:02:16.433079 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1895/3675] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:16 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:16.438775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.439569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.445893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.457506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.458004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.458964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.459606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.460213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.562563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:16.570965 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9952f870-9070-4d24-bd6e-ddb71573ef46 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.425852 Oct 29 21:02:16.571796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1781/3676] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:16 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:16.577138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.577785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.584669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.585566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.586259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.587034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.587499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.587927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.811178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:16.823118 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1bd39427-1fd7-4144-b782-46b68a3a3efb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.388545 Oct 29 21:02:16.824943 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1896/3677] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:16 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:16.831011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.832032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.838783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.839632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.840350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.841312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.842067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.843071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.860765 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f HTTP/1.1 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '1a71a556-5e58-45f9-93f3-2d20d1297c9f'} Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:16.862843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:16.868260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:16.869622 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c510e31-b72b-4aa1-9ef4-e37400993bd1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 404 len: 111 microversion: 2.1 time: 0.040240 Oct 29 21:02:16.873549 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1897/3678] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:16 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:16.878250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.879026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.883455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:16.885973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.886487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.886937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.887659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.888820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.889339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.894894 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36bae6db-5e08-48f6-b7a3-bb68e051764f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1471 microversion: 2.1 time: 0.321934 Oct 29 21:02:16.905979 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1782/3679] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:16 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:16.920632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:16.921404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:16.928672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.929467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.930105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.930996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.932200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.933390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.957367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:16.957962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:16.958325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:16.961828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lazy-loading 'fault' on Instance uuid 24d80a1a-a33d-4eda-b562-7a0a6042294a {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:16.966103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:17.064070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:17.073059 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3e3e600-aa4a-47e6-87cc-ab0de987dc7a tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1314 microversion: 2.1 time: 0.198519 Oct 29 21:02:17.076005 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1898/3680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:16 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:17.081970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:17.085856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] [instance: f747a7c1-75a9-41a9-a1b6-020088da4261] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:17.099976 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e91248a7-53b1-43f0-8f3c-947ff4eb5523 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 204 len: 0 microversion: 2.1 time: 0.189231 Oct 29 21:02:17.101108 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1783/3681] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:16 2022] DELETE /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:17.103083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.105153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.108369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.109408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.112239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.112532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:17.113146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.113403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:17.121997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.122720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.123305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.124358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.124905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.127973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.140555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] HTTP exception thrown: Instance f747a7c1-75a9-41a9-a1b6-020088da4261 could not be found. Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Request method failure captured: Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 HTTP/1.1 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRS0TP-oCLS5TUksC1QJ1ldKnDvUbNz6fc5swHvP_GeCcAbqROt9n-kwN_cYQF9sK6d43BVAgVx86kkW0gWBg--LCGVEZaDcAojLcDHPZhMAK5g1FabJ33pfW-Nj_Yo31aZhZLbkq4EWTJFSO6Ts5XO88SsAA-BMKR1Mcrl5oqFwIE Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 709aa4b8c6024e04bd16f02cdbe1d6f0 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestFqdnHostnames-928695578 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/709aa4b8c6024e04bd16f02cdbe1d6f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_709aa4b8c6024e04bd16f02cdbe1d6f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/709aa4b8c6024e04bd16f02cdbe1d6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/709aa4b8c6024e04bd16f02cdbe1d6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestFqdnHostnames-928695578 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 709aa4b8c6024e04bd16f02cdbe1d6f0 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-928695578 Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestFqdnHostnames-928695578-project Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 041ea2e030a84da2a3e866238e7318cd Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestFqdnHostnames-928695578-project Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f747a7c1-75a9-41a9-a1b6-020088da4261 could not be found. Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'f747a7c1-75a9-41a9-a1b6-020088da4261'} Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f747a7c1-75a9-41a9-a1b6-020088da4261 could not be found. Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f747a7c1-75a9-41a9-a1b6-020088da4261 could not be found. Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:17.150588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f747a7c1-75a9-41a9-a1b6-020088da4261 could not be found. Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Returning 404 to user: Instance f747a7c1-75a9-41a9-a1b6-020088da4261 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:17.158285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62524593-0bf7-4363-8b44-aeb601c75b6d tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261" status: 404 len: 111 microversion: 2.1 time: 0.074795 Oct 29 21:02:17.160969 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1899/3682] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:17 2022] GET /compute/v2.1/servers/f747a7c1-75a9-41a9-a1b6-020088da4261 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:17.163591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f551998-6fe7-4f6d-8a5f-03f03ade4183 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] Calling method '.version_select at 0x7fa17643f3a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:17.203545 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f551998-6fe7-4f6d-8a5f-03f03ade4183 tempest-ServersTestFqdnHostnames-928695578 tempest-ServersTestFqdnHostnames-928695578-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87961250" status: 202 len: 0 microversion: 2.1 time: 0.043597 Oct 29 21:02:17.204156 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1900/3683] 10.222.0.36 () {58 vars in 1215 bytes} [Sat Oct 29 21:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87961250 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:02:17.212402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:17.213031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:17.234279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.234777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.235448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.237130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.237834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.239055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.501659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:17.511757 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0c44ec4-45f5-4463-8072-33fe87c7cb24 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1495 microversion: 2.1 time: 0.404787 Oct 29 21:02:17.528650 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1784/3684] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:17 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1495 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:17.537136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2473f49f-de50-43d3-a72f-3923bf8cb1d7 req-fd21eee7-ba5a-4e7b-8797-7afc1cac149d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d80a1a-a33d-4eda-b562-7a0a6042294a", "name": "network-vif-deleted", "tag": "6dda8609-ae5c-436b-9c12-ed8141c69383"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:17.543388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:17.554556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2473f49f-de50-43d3-a72f-3923bf8cb1d7 req-fd21eee7-ba5a-4e7b-8797-7afc1cac149d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.555547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2473f49f-de50-43d3-a72f-3923bf8cb1d7 req-fd21eee7-ba5a-4e7b-8797-7afc1cac149d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.555693 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5cbe4716-a7b7-45d8-be38-6982581dd9d9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1317 microversion: 2.1 time: 0.347270 Oct 29 21:02:17.556655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2473f49f-de50-43d3-a72f-3923bf8cb1d7 req-fd21eee7-ba5a-4e7b-8797-7afc1cac149d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.563740 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1901/3685] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:17 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:17.569272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:17.578029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:17.584961 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2473f49f-de50-43d3-a72f-3923bf8cb1d7 req-fd21eee7-ba5a-4e7b-8797-7afc1cac149d service nova] Creating event network-vif-deleted:6dda8609-ae5c-436b-9c12-ed8141c69383 for instance 24d80a1a-a33d-4eda-b562-7a0a6042294a on nch1-master-1 Oct 29 21:02:17.592865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2473f49f-de50-43d3-a72f-3923bf8cb1d7 req-fd21eee7-ba5a-4e7b-8797-7afc1cac149d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061720 Oct 29 21:02:17.594011 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1785/3686] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:17.594313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.597243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.597884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.598715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.599267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.599565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:17.600486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:17.600896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.610660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.611455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.612124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:17.613947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:17.614626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:17.615264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.073154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:18.096025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b012878-ba6e-4085-b3e3-19739a55a707 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1319 microversion: 2.1 time: 0.500288 Oct 29 21:02:18.104370 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1786/3687] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:17 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:18.108783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:18.109793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:18.111579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:18.122284 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e30c0adc-138f-4ada-be3c-dee032df0d9b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.556858 Oct 29 21:02:18.123180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.133493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.133493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.133493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.133493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.133493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.135359 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1902/3688] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:17 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:18.160351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:18.161267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:18.169326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.170152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.170811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.171719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.172449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.173938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.258470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.259603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.260294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.261682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid f91f395f-198b-4279-86a0-0fead4968690 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:18.372347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:18.384553 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6695d9f0-f497-4404-9693-6d0d01d3e175 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 200 len: 1306 microversion: 2.1 time: 0.241106 Oct 29 21:02:18.385155 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1903/3689] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:18 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 1306 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:18.399637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:18.400270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:18.414711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.415249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.415898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.416817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.419121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.419569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.432067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:18.494485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.495682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.496243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.496895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lazy-loading 'fault' on Instance uuid 24d80a1a-a33d-4eda-b562-7a0a6042294a {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:18.585047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:18.593306 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0f259ca-e776-4f7f-96bb-82a9a10ce947 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1314 microversion: 2.1 time: 0.205611 Oct 29 21:02:18.594034 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1904/3690] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:18 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:18.610098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200f98eb-4037-47be-b68c-938c8089e90e", "tag": "db961a28-c65f-42bc-810c-fed9166ec2d0"}, {"server_uuid": "f91f395f-198b-4279-86a0-0fead4968690", "name": "network-vif-deleted", "tag": "b7c0feb1-ccd8-480b-b172-8dac1d895412"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:18.624533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.625336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.626037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.640219 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] Creating event network-changed:db961a28-c65f-42bc-810c-fed9166ec2d0 for instance 200f98eb-4037-47be-b68c-938c8089e90e on nch1-master-1 Oct 29 21:02:18.640900 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] Creating event network-vif-deleted:b7c0feb1-ccd8-480b-b172-8dac1d895412 for instance f91f395f-198b-4279-86a0-0fead4968690 on nch2-master-1 Oct 29 21:02:18.653697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-10e8902f-3201-46d4-90ac-f2045c25fe9a req-ab701339-97f6-4c47-bf6e-c560c35071ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048142 Oct 29 21:02:18.654673 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1905/3691] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:18.661220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3bb5c178-78da-4461-8a18-cdc2034a015c req-810f644a-b59a-4085-97c6-33fdfe06de06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba8b302-0692-4af1-9350-ec8c975379d3", "name": "network-vif-plugged", "status": "completed", "tag": "88116d6b-20f2-440f-906a-193232d100a6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:18.671401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3bb5c178-78da-4461-8a18-cdc2034a015c req-810f644a-b59a-4085-97c6-33fdfe06de06 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.671884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3bb5c178-78da-4461-8a18-cdc2034a015c req-810f644a-b59a-4085-97c6-33fdfe06de06 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.672378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3bb5c178-78da-4461-8a18-cdc2034a015c req-810f644a-b59a-4085-97c6-33fdfe06de06 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.683677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3bb5c178-78da-4461-8a18-cdc2034a015c req-810f644a-b59a-4085-97c6-33fdfe06de06 service nova] Creating event network-vif-plugged:88116d6b-20f2-440f-906a-193232d100a6 for instance bba8b302-0692-4af1-9350-ec8c975379d3 on nch2-master-1 Oct 29 21:02:18.684257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:18.688957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3bb5c178-78da-4461-8a18-cdc2034a015c req-810f644a-b59a-4085-97c6-33fdfe06de06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Oct 29 21:02:18.689226 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1906/3692] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:18.695086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-148f3c97-65af-4b39-894a-98e02519a469 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.595071 Oct 29 21:02:18.695621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:18.696565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:18.697594 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1787/3693] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:18 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:18.702958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:18.703661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:18.704278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.704931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.705571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.706437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.707064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.707662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.710760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.711504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.712171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:18.713109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:18.714481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:18.715180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.091692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.100259 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9b2a21a-8823-4cc7-9256-06d601195a85 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1495 microversion: 2.1 time: 0.409607 Oct 29 21:02:19.100936 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1907/3694] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:18 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1495 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:19.119654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.127351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.128114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.128853 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9e3ae0b7-8d8c-4613-8300-8ed495d722a9 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1317 microversion: 2.1 time: 0.429591 Oct 29 21:02:19.129521 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1788/3695] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:18 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:19.135878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.136715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.137263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.138367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.138945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.139527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.152052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.152708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.161495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.162156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.162594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.163664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.164292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.164883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.470147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.474413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.478641 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e0198428-e31a-4166-b4ed-f23ccd579a74 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 200 len: 1506 microversion: 2.1 time: 0.355574 Oct 29 21:02:19.479347 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1908/3696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:19.484797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.485549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: f91f395f-198b-4279-86a0-0fead4968690] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.489727 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aa3ce502-9a15-4da0-a0cb-30ac6b682859 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.342104 Oct 29 21:02:19.505297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1789/3697] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:19.505690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.505690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.505690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.505964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.506051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.506051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.506203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: bba8b302-0692-4af1-9350-ec8c975379d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.506295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.509911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.510411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.510890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.511617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.512108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.512544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.518901 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance f91f395f-198b-4279-86a0-0fead4968690 could not be found. Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 HTTP/1.1 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f91f395f-198b-4279-86a0-0fead4968690 could not be found. Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'f91f395f-198b-4279-86a0-0fead4968690'} Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f91f395f-198b-4279-86a0-0fead4968690 could not be found. Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f91f395f-198b-4279-86a0-0fead4968690 could not be found. Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:19.520586 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f91f395f-198b-4279-86a0-0fead4968690 could not be found. Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance f91f395f-198b-4279-86a0-0fead4968690 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8fee644b-77c3-4a33-b832-04209a728b50 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690" status: 404 len: 111 microversion: 2.1 time: 0.040950 Oct 29 21:02:19.527432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1909/3698] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/f91f395f-198b-4279-86a0-0fead4968690 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:19.531853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.532434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.538506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.539081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.539600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.540695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.540909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.541405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.568691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:19.673156 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-693ce443-3a69-445e-930c-448bc6cffd0f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 204 len: 0 microversion: 2.1 time: 0.145106 Oct 29 21:02:19.675340 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1910/3699] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:19 2022] DELETE /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:02:19.677155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.682319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.683361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.686119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a762ab0-5349-4778-9b9b-b7fa09146f4f tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3" status: 200 len: 1319 microversion: 2.1 time: 0.187103 Oct 29 21:02:19.686715 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1790/3700] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:19.691050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.691201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6b27091d-aea7-406a-a05e-c37cd6fd86a0 req-e74a540c-a2ab-4f1b-9ca8-0ef61dea3cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba", "tag": "648f4c68-6640-4b37-b998-b6eefe868be1"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:19.691925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.692590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.693493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.694779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.695564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.701031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6b27091d-aea7-406a-a05e-c37cd6fd86a0 req-e74a540c-a2ab-4f1b-9ca8-0ef61dea3cf8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.701540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6b27091d-aea7-406a-a05e-c37cd6fd86a0 req-e74a540c-a2ab-4f1b-9ca8-0ef61dea3cf8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.701987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6b27091d-aea7-406a-a05e-c37cd6fd86a0 req-e74a540c-a2ab-4f1b-9ca8-0ef61dea3cf8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.713395 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6b27091d-aea7-406a-a05e-c37cd6fd86a0 req-e74a540c-a2ab-4f1b-9ca8-0ef61dea3cf8 service nova] Creating event network-changed:648f4c68-6640-4b37-b998-b6eefe868be1 for instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba on nch2-master-1 Oct 29 21:02:19.720059 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6b27091d-aea7-406a-a05e-c37cd6fd86a0 req-e74a540c-a2ab-4f1b-9ca8-0ef61dea3cf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032134 Oct 29 21:02:19.720674 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1791/3701] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:19.726781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.727492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.734443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.734939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.735384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.736091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.736544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.736971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.737797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.738293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.738735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.739490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lazy-loading 'fault' on Instance uuid 24d80a1a-a33d-4eda-b562-7a0a6042294a {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:19.784929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c9d4094d4184f24aafcd7d4b23ee77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337aa2d5300843f083c33d577439db01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.793714 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca4d692d-46f2-4ba4-9e0d-90fc57f5c5ea tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 200 len: 1314 microversion: 2.1 time: 0.116935 Oct 29 21:02:19.794305 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1911/3702] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 1314 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:19.804097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:19.805056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:19.813944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.814445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.815021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.817102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:19.817102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:19.817102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:19.962919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:19.971347 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8e6552f-2c77-4686-a19c-7e22fec6f5ab tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1472 microversion: 2.1 time: 0.249278 Oct 29 21:02:19.972083 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1792/3703] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:20.010736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:20.019168 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-faf46c3c-119f-4367-bdae-056d7e799cf0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.223698 Oct 29 21:02:20.019824 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1912/3704] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:19 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:20.124866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:20.126908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:20.133621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.134396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.135043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.135832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.136480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.137106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.154350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:20.155069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:20.161399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.162426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.162647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.163330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.164184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.165077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.435733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:20.443645 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdbea52d-a06a-43a6-b5ab-4c47660222e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1317 microversion: 2.1 time: 0.293242 Oct 29 21:02:20.452793 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1913/3705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:20 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:20.497014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:20.506615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d777efdf-7ddc-4dda-8253-2dcee3956353 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1495 microversion: 2.1 time: 0.385262 Oct 29 21:02:20.514516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1793/3706] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:20 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1495 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:20.516047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:20.516713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:20.524174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.524660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.527499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.528228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.528694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.529128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.709712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:20.710973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: bba8b302-0692-4af1-9350-ec8c975379d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:20.713501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:20.720222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.721066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.721724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.722761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.723395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.723989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.726508 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5628881d-9b25-4eb6-a810-762149b5b8c9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.217815 Oct 29 21:02:20.727307 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1914/3707] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:20 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:20.820708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:20.821338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] [instance: 24d80a1a-a33d-4eda-b562-7a0a6042294a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:20.829488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.831002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.831656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.832565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:20.833203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:20.834763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:20.856619 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] HTTP exception thrown: Instance 24d80a1a-a33d-4eda-b562-7a0a6042294a could not be found. Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Request method failure captured: Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a HTTP/1.1 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZSyjtb88j4ABz1KurMs9PDOSMvKAHQZwJXEwW7KtsyrAPIVYOID7e4T5cP8H0rJDTTdWjI_5-H4o93ZKjDQghVt8XgNCFTodR4tAGZwaDs1hlo1eOVuvd1h1TMhycNhkKHCAPXSLafJrfRD2O0WKHYXufKOiC92B0AshFcivq6ZqEc Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_337aa2d5300843f083c33d577439db01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/337aa2d5300843f083c33d577439db01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/337aa2d5300843f083c33d577439db01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 337aa2d5300843f083c33d577439db01 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-882728983 Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 0c9d4094d4184f24aafcd7d4b23ee77f Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-882728983-project Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 24d80a1a-a33d-4eda-b562-7a0a6042294a could not be found. Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '24d80a1a-a33d-4eda-b562-7a0a6042294a'} Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d80a1a-a33d-4eda-b562-7a0a6042294a could not be found. Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d80a1a-a33d-4eda-b562-7a0a6042294a could not be found. Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:20.859125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d80a1a-a33d-4eda-b562-7a0a6042294a could not be found. Oct 29 21:02:20.865127 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:20.867213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] Returning 404 to user: Instance 24d80a1a-a33d-4eda-b562-7a0a6042294a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:20.868298 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db0cc49e-3cb1-4c83-bc98-53bc6fac4d57 tempest-ServerMetadataNegativeTestJSON-882728983 tempest-ServerMetadataNegativeTestJSON-882728983-project] 10.222.0.36 "GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a" status: 404 len: 111 microversion: 2.1 time: 0.054918 Oct 29 21:02:20.869937 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1915/3708] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:20 2022] GET /compute/v2.1/servers/24d80a1a-a33d-4eda-b562-7a0a6042294a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:02:20.994809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:20.996373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:21.011551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:21.012362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:21.013006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:21.015182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:21.015823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:21.017707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:21.218932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:21.230173 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b841cb5c-baee-46be-94dc-112a644a7192 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3" status: 200 len: 1319 microversion: 2.1 time: 0.524328 Oct 29 21:02:21.233522 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1794/3709] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:20 2022] GET /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:21.239580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:21.240443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:21.261861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:21.262852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:21.263529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:21.270157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:21.270595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:21.271052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:21.757155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:21.825525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=20 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:21.920922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:21.942353 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49e9825e-c435-4696-b818-01661b146578 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1472 microversion: 2.1 time: 0.951175 Oct 29 21:02:21.961915 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1916/3710] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:20 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1472 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:21.971187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:21.972245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:21.982829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:21.983649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:21.984604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:21.987344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:21.988060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:21.988850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.062175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:22.074499 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce019b76-a026-4cac-b295-fe558f5492e6 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.839410 Oct 29 21:02:22.075894 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1795/3711] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:21 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:22.082154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:22.083302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:22.091100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.091982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.092680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.093831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.094526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.095279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.384323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:22.402885 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1eff16c-66c1-4ede-8e5f-37aa5a717355 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1317 microversion: 2.1 time: 0.439429 Oct 29 21:02:22.403786 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1917/3712] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:21 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:22.408728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:22.409703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:22.430023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.430851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.431546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.432530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.433164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.433795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.639626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:22.678327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:22.699838 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a88a721d-d779-40c6-81bc-3eb5008e60aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1495 microversion: 2.1 time: 0.618476 Oct 29 21:02:22.702437 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1796/3713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:22 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1495 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:22.733735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:22.734676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: bba8b302-0692-4af1-9350-ec8c975379d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:22.747652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.748353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.748965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.749896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.750587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.751202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.764892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:22.785760 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4fe28209-564d-4688-8c00-d1cc7be054ee tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.378060 Oct 29 21:02:22.786700 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1918/3714] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:22 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:22.796870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-84b57d02-0be5-43d2-98e7-790e23636019 req-52d66e2b-37a9-4353-bf8e-b01122804026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200f98eb-4037-47be-b68c-938c8089e90e", "name": "network-vif-plugged", "status": "completed", "tag": "db961a28-c65f-42bc-810c-fed9166ec2d0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:22.811037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-84b57d02-0be5-43d2-98e7-790e23636019 req-52d66e2b-37a9-4353-bf8e-b01122804026 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.811816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-84b57d02-0be5-43d2-98e7-790e23636019 req-52d66e2b-37a9-4353-bf8e-b01122804026 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.812482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-84b57d02-0be5-43d2-98e7-790e23636019 req-52d66e2b-37a9-4353-bf8e-b01122804026 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.827345 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-84b57d02-0be5-43d2-98e7-790e23636019 req-52d66e2b-37a9-4353-bf8e-b01122804026 service nova] Creating event network-vif-plugged:db961a28-c65f-42bc-810c-fed9166ec2d0 for instance 200f98eb-4037-47be-b68c-938c8089e90e on nch1-master-1 Oct 29 21:02:22.836339 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-84b57d02-0be5-43d2-98e7-790e23636019 req-52d66e2b-37a9-4353-bf8e-b01122804026 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047525 Oct 29 21:02:22.838041 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1919/3715] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:22.846516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4df6fd0f-30dd-4731-a37b-eee9bdfede2f req-ee3a3d25-5b78-46e1-99bb-8484cf083a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30747e4-474b-4475-a090-b52052b0b135", "name": "network-vif-deleted", "tag": "712009d1-12d1-4b45-9678-df9ce20d63e7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:22.859482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4df6fd0f-30dd-4731-a37b-eee9bdfede2f req-ee3a3d25-5b78-46e1-99bb-8484cf083a30 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.860389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4df6fd0f-30dd-4731-a37b-eee9bdfede2f req-ee3a3d25-5b78-46e1-99bb-8484cf083a30 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.861271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4df6fd0f-30dd-4731-a37b-eee9bdfede2f req-ee3a3d25-5b78-46e1-99bb-8484cf083a30 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.874974 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4df6fd0f-30dd-4731-a37b-eee9bdfede2f req-ee3a3d25-5b78-46e1-99bb-8484cf083a30 service nova] Creating event network-vif-deleted:712009d1-12d1-4b45-9678-df9ce20d63e7 for instance b30747e4-474b-4475-a090-b52052b0b135 on nch1-master-1 Oct 29 21:02:22.881829 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4df6fd0f-30dd-4731-a37b-eee9bdfede2f req-ee3a3d25-5b78-46e1-99bb-8484cf083a30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041518 Oct 29 21:02:22.882864 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1920/3716] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:22.975245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:22.977295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:22.987161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.987876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.988494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:22.989752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:22.990397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:22.991088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.090432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:23.109076 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e7aa934a-2baf-486e-9feb-bb3964c11c3c tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3" status: 200 len: 1506 microversion: 2.1 time: 0.400517 Oct 29 21:02:23.124963 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1797/3717] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:22 2022] GET /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:23.137448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:23.138095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:23.145967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.146468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.146904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.147989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.149502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.150121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.220002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:23.228278 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ea63518-1fba-4d3d-bc58-5255fc00e19e tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1472 microversion: 2.1 time: 0.260488 Oct 29 21:02:23.229531 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1921/3718] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:22 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:23.254497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:23.254951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: bba8b302-0692-4af1-9350-ec8c975379d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:23.262653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.263170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.263625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.264347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.264958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.265236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.289108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:23.296961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: bba8b302-0692-4af1-9350-ec8c975379d3] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:23.339629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:23.349226 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-adfea664-668b-4e1d-bdf1-6040879b6db3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.217814 Oct 29 21:02:23.353855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1798/3719] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:23 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:23.434883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:23.435402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:23.442376 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bcc9e5b-1539-48b6-9a47-48f44b462ab1 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3" status: 204 len: 0 microversion: 2.1 time: 0.195229 Oct 29 21:02:23.443237 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1922/3720] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:23 2022] DELETE /compute/v2.1/servers/bba8b302-0692-4af1-9350-ec8c975379d3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:23.446868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.447383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.447845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.449156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.449660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.450103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.456320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:23.456927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:23.467401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.467901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.468351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.469068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.469562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.470302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.498350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 790ff727-43ae-4ea8-b137-42146fa08e45] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:23.642769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=96,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:23.655310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:23.670822 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-98fafc52-2bdf-487a-8609-0a8db4bec441 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45" status: 204 len: 0 microversion: 2.1 time: 0.217145 Oct 29 21:02:23.671941 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a70fd40c-a4ac-4376-a463-411648cedea2 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1317 microversion: 2.1 time: 0.244259 Oct 29 21:02:23.672885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1799/3722] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:23 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:23.685129 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1923/3722] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:23 2022] DELETE /compute/v2.1/servers/790ff727-43ae-4ea8-b137-42146fa08e45 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:23.692141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-624fb6a1-69c7-47bf-b1ff-9c935a02f27c req-b1cdb1d7-4d8a-484e-bc08-ba415be69d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1a909f-35e9-4151-a815-7c8b2d95c27a", "name": "network-vif-deleted", "tag": "45d740db-d692-4e87-a757-9a604d7143e8"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:23.703127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-624fb6a1-69c7-47bf-b1ff-9c935a02f27c req-b1cdb1d7-4d8a-484e-bc08-ba415be69d32 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.703949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-624fb6a1-69c7-47bf-b1ff-9c935a02f27c req-b1cdb1d7-4d8a-484e-bc08-ba415be69d32 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.704626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-624fb6a1-69c7-47bf-b1ff-9c935a02f27c req-b1cdb1d7-4d8a-484e-bc08-ba415be69d32 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.723259 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-624fb6a1-69c7-47bf-b1ff-9c935a02f27c req-b1cdb1d7-4d8a-484e-bc08-ba415be69d32 service nova] Creating event network-vif-deleted:45d740db-d692-4e87-a757-9a604d7143e8 for instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a on nch2-master-1 Oct 29 21:02:23.732896 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-624fb6a1-69c7-47bf-b1ff-9c935a02f27c req-b1cdb1d7-4d8a-484e-bc08-ba415be69d32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057592 Oct 29 21:02:23.733862 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1800/3723] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:23.739445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:23.740286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:23.760360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.760906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.761349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.762379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.763106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.763715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.810974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:23.811956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:23.813256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.813962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.814570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.815199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lazy-loading 'fault' on Instance uuid b30747e4-474b-4475-a090-b52052b0b135 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:23.826433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.827082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.828157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.830910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:23.831573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:23.833745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:23.886936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:23.895682 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0e9c14b-11fb-44d5-92e5-9cf1cf431ddd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 200 len: 1298 microversion: 2.1 time: 0.170985 Oct 29 21:02:23.910750 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1924/3724] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:23 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:23.921941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1626252635", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f8b66b5a-beb2-4afc-a2c9-162a415e3d52"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:24.007032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] validate_networks() for [('f8b66b5a-beb2-4afc-a2c9-162a415e3d52', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:02:24.072533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:24.081680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-569f4a24-6227-4994-aa45-df8a1f64ecb2 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.275664 Oct 29 21:02:24.094162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1801/3725] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:23 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:24.256188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:24.256817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:24.275496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.277747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.278480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.279670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.281325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.282120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.483114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:24.491901 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-327a9e0f-ebdb-4389-89d8-6200f3f17c66 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1430 microversion: 2.1 time: 0.239557 Oct 29 21:02:24.493261 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1802/3726] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:24 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1430 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:24.499989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:24.500975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:24.508229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.508991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.509644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.510775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.511610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.512333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.678389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:02:24.678833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:02:24.679379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:02:24.680931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:02:24.681441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:02:24.697207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.697732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.698232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.698980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.699444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.699883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.742940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Getting quotas for project 23a37b9c718e465c83323970f013fe50. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:02:24.757643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Getting quotas for user 7612bf8b52db4840b9d2e7f342414429 and project 23a37b9c718e465c83323970f013fe50. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:02:24.774006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Going to run 2 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:02:24.781806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:24.835787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=f6f6d76e-94cf-4dbd-88b0-9670121a6b61,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:24.889085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:24.899761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-46e96cc8-1727-4841-9ae3-6b068184cc1a tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.404946 Oct 29 21:02:24.904732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1803/3727] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:24 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:24.922534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:24.924413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:24.940379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.941339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.945033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.946024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:24.946777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:24.947391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:24.972165 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fee2854f-67bf-4610-aa8b-73e31a8bcfa2 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.046561 Oct 29 21:02:24.977042 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1925/3728] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 21:02:24.992948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:24.993886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:25.003926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.004512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.004969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.005793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.006965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.007603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.040285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 HTTP/1.1 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b30747e4-474b-4475-a090-b52052b0b135'} Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:25.042713 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:25.048209 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:25.048209 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:25.048209 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:25.048209 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:25.048209 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:02:25.048209 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:25.051398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:25.052514 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-306612af-d089-4fa2-a7ad-4dd03a4199aa tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 404 len: 111 microversion: 2.1 time: 0.074414 Oct 29 21:02:25.057012 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1926/3729] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:24 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:25.075415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:25.097092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:25.097875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Searching by: {'deleted': False, 'project_id': '23a37b9c718e465c83323970f013fe50'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:02:25.135102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.135870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.136498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.137636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.138265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.138885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.190540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:02:25.264770 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb39673d-9e87-4801-b23e-75b6595020b8 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.205882 Oct 29 21:02:25.265501 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1927/3730] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 21:02:25 2022] GET /compute/v2.1/servers => generated 1335 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:25.274938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:25.275540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:25.290664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.291166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.291616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.292890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.293348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.293805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.331995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:25.345080 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-66ce7b72-7906-42a1-ac69-96d449df4712 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1507 microversion: 2.1 time: 0.436710 Oct 29 21:02:25.346885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1804/3731] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:24 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:25.359038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e23b35ed-cb04-48eb-8076-c4c3922d6c40 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:25.360007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e23b35ed-cb04-48eb-8076-c4c3922d6c40 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:25.494960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e23b35ed-cb04-48eb-8076-c4c3922d6c40 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:25.508574 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e23b35ed-cb04-48eb-8076-c4c3922d6c40 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1218 microversion: 2.1 time: 0.159608 Oct 29 21:02:25.509470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1805/3732] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:25 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:25.527742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:25.529661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:25.544127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.547893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.548354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.549391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:25.549906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:25.550344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:25.712431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:25.723691 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-790e6e38-549f-4fe1-871f-66278fbf0866 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.457191 Oct 29 21:02:25.730089 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1928/3733] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:25 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:25.737898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-757764065", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:25.860865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:02:26.379446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:26.391127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0770b282-1f57-4a43-bca4-59daa9028137 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1507 microversion: 2.1 time: 0.877759 Oct 29 21:02:26.392063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1806/3734] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:25 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1507 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:26.397928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:26.398890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:26.407648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:26.408567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:26.409420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:26.410589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:26.412092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:26.412947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:26.462817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:26.463618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:26.464316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:26.466149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 1b1a909f-35e9-4151-a815-7c8b2d95c27a {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:26.634920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:26.657801 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-391fcf05-82c9-48bb-9075-d9889a95498a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1307 microversion: 2.1 time: 0.257125 Oct 29 21:02:26.659316 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1807/3735] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:26 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:26.664337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:26.665438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:26.689819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:26.692340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:26.693008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:26.693804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:26.695939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:26.697078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:26.697783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.149086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:27.163738 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-861c9a12-d35d-446e-a8e3-e9940736165c tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1735 microversion: 2.1 time: 0.502507 Oct 29 21:02:27.180263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1808/3736] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:26 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1735 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:27.180263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:27.180263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:27.249700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.252821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.253341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.259194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.259194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.259477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.390698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-44295da5-f408-4c6c-91e4-c1ee5a3fcc6d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "PUT /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1079 microversion: 2.1 time: 0.224807 Oct 29 21:02:27.392265 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1809/3737] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:02:27 2022] PUT /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1079 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:27.411722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:27.412701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:27.425204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.427014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.427695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.428812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.429635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.433114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.590612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:27.603515 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-19576cf4-db55-4938-8d81-3f1c44f06ba3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1214 microversion: 2.1 time: 0.196030 Oct 29 21:02:27.607512 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1810/3738] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:27 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:27.629792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:02:27.630769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:02:27.631290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:02:27.634899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:02:27.637312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:02:27.653645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:27.656373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:27.675501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.679090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.679932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.682917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.684048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.685886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.686936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.687486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.687949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.688764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:27.689233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:27.702007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:27.772045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:02:27.777907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:02:27.808523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:02:27.812478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:27.925347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b064089-3690-49ce-a89d-d2c9c515bbc8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.193774 Oct 29 21:02:27.928679 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1929/3739] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:02:27.946848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:27.950067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:28.031011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:28.035298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:28.039963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:28.042430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:28.044430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:28.048793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:28.822671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:28.836117 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1769ddcb-ba74-450d-bdc6-96beca068360 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1505 microversion: 2.1 time: 0.906045 Oct 29 21:02:28.837115 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1930/3740] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:27 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1505 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:28.848530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:28.860187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:28.886690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:28.887386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:28.887861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:28.888819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:28.889378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:28.891783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:28.979912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:28.980136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:28.981873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:28.985754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 1b1a909f-35e9-4151-a815-7c8b2d95c27a {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:29.084456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:29.094621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7d422484-d640-455e-8fef-c6c2e9821d88 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 200 len: 1307 microversion: 2.1 time: 0.252613 Oct 29 21:02:29.095160 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1931/3741] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:28 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:29.110131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:29.111173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:29.126761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.127624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.128389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.129360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.130100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.130764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.252899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:29.271787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2c7a6e0-c168-4115-8bc6-fa9a37c92111 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1212 microversion: 2.1 time: 0.173203 Oct 29 21:02:29.273305 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1932/3742] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:29 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1212 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:29.285689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:29.289864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:29.295329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:29.308699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.311400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.311841 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c8a68a2-3dcd-4a3f-a155-9fcb33eff4bc tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 1.701576 Oct 29 21:02:29.313178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.313482 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1811/3743] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:27 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:29.315115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.318631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.321667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.533312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c10943f6-3445-4a5e-8199-8b500f94fd52 req-3371be65-9ab9-449b-8e71-64e9a4a535f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba", "name": "network-vif-plugged", "status": "completed", "tag": "648f4c68-6640-4b37-b998-b6eefe868be1"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:29.575181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c10943f6-3445-4a5e-8199-8b500f94fd52 req-3371be65-9ab9-449b-8e71-64e9a4a535f9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.575914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c10943f6-3445-4a5e-8199-8b500f94fd52 req-3371be65-9ab9-449b-8e71-64e9a4a535f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.578072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c10943f6-3445-4a5e-8199-8b500f94fd52 req-3371be65-9ab9-449b-8e71-64e9a4a535f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.618401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c10943f6-3445-4a5e-8199-8b500f94fd52 req-3371be65-9ab9-449b-8e71-64e9a4a535f9 service nova] Creating event network-vif-plugged:648f4c68-6640-4b37-b998-b6eefe868be1 for instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba on nch2-master-1 Oct 29 21:02:29.649994 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c10943f6-3445-4a5e-8199-8b500f94fd52 req-3371be65-9ab9-449b-8e71-64e9a4a535f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.325051 Oct 29 21:02:29.652812 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1812/3744] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:29.681210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:29.683094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:29.695015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.695874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.696515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.697445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:29.698219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:29.698997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:29.899064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:29.928701 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-480f8c16-424a-4123-a2ca-4f4f17e06750 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1276 microversion: 2.1 time: 0.268388 Oct 29 21:02:29.933092 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1813/3745] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:29 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:30.014650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:30.024311 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cef4b4e1-f3cb-4bc1-85d6-5e8afc48e127 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1715 microversion: 2.1 time: 0.749728 Oct 29 21:02:30.035152 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1933/3746] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:29 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1715 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:30.040874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:30.042356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.061015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.061558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.062014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.062747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.069815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.070355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.139981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-81a1c7d4-d845-4f23-80d7-41d38140e36a req-60039e5a-8e55-4a9d-b1c1-8551624a73f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790ff727-43ae-4ea8-b137-42146fa08e45", "name": "network-vif-deleted", "tag": "c62f9d8a-3ce4-40c5-8c57-e94c7ebf80bf"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:30.157129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-81a1c7d4-d845-4f23-80d7-41d38140e36a req-60039e5a-8e55-4a9d-b1c1-8551624a73f7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.158104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-81a1c7d4-d845-4f23-80d7-41d38140e36a req-60039e5a-8e55-4a9d-b1c1-8551624a73f7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.162043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-81a1c7d4-d845-4f23-80d7-41d38140e36a req-60039e5a-8e55-4a9d-b1c1-8551624a73f7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.192838 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-81a1c7d4-d845-4f23-80d7-41d38140e36a req-60039e5a-8e55-4a9d-b1c1-8551624a73f7 service nova] Creating event network-vif-deleted:c62f9d8a-3ce4-40c5-8c57-e94c7ebf80bf for instance 790ff727-43ae-4ea8-b137-42146fa08e45 on nch2-master-1 Oct 29 21:02:30.234748 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-81a1c7d4-d845-4f23-80d7-41d38140e36a req-60039e5a-8e55-4a9d-b1c1-8551624a73f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294550 Oct 29 21:02:30.235661 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1814/3747] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:30.241087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:30.242543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 1b1a909f-35e9-4151-a815-7c8b2d95c27a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.255998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.257659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.258338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.261113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.262548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.262992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.286195 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a could not be found. Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a HTTP/1.1 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a could not be found. Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1b1a909f-35e9-4151-a815-7c8b2d95c27a'} Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a could not be found. Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a could not be found. Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:30.289053 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a could not be found. Oct 29 21:02:30.297696 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.301764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance 1b1a909f-35e9-4151-a815-7c8b2d95c27a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:30.301764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3fb07afb-b122-435a-a34a-5225fbcedfa0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a" status: 404 len: 111 microversion: 2.1 time: 0.063802 Oct 29 21:02:30.302564 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1815/3748] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:30 2022] GET /compute/v2.1/servers/1b1a909f-35e9-4151-a815-7c8b2d95c27a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:30.310981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:30.312310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.327875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.329910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.330776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.331900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.333004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.335776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.344669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:30.484656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:30.496729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:30.506390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d709758-94ce-48f5-a68f-2ee2d50ca2e5 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1505 microversion: 2.1 time: 0.469855 Oct 29 21:02:30.508554 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1934/3749] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:30 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:30.512514 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa11b989-c5c7-46d0-b284-f544a562d44f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1260 microversion: 2.1 time: 0.208612 Oct 29 21:02:30.529483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1816/3750] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:30 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:30.533437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:30.534477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.535908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:30.536458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.551203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.552103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.553076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.553619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.554070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.554599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.554785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.555433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.556062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.557830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.558737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.570801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.660177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:30.757949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Cannot 'detach_volume' instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 while it is in vm_state rescued Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments/360b708f-faff-4312-b818-452b6e0d9153 HTTP/1.1 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'detach_volume' instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 while it is in vm_state rescued Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': '11aa593f-4fe8-472f-9f8a-3872b461a5f4', 'id': '360b708f-faff-4312-b818-452b6e0d9153'} Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 while it is in vm_state rescued Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.764769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 while it is in vm_state rescued Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 409 to user: Cannot 'detach_volume' instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 while it is in vm_state rescued {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:30.769110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90f72ae8-edd9-4e51-b7ae-5d633dac86d2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments/360b708f-faff-4312-b818-452b6e0d9153" status: 409 len: 152 microversion: 2.1 time: 0.256557 Oct 29 21:02:30.774420 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1935/3751] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:02:30 2022] DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments/360b708f-faff-4312-b818-452b6e0d9153 => generated 152 bytes in 265 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:02:30.781548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-94095c77-47f8-4f4a-a6fe-85da60435e0d req-4dae9ff8-da43-4a0f-a789-1d4db671fbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba8b302-0692-4af1-9350-ec8c975379d3", "name": "network-vif-deleted", "tag": "88116d6b-20f2-440f-906a-193232d100a6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:30.804488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-94095c77-47f8-4f4a-a6fe-85da60435e0d req-4dae9ff8-da43-4a0f-a789-1d4db671fbcd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.805244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-94095c77-47f8-4f4a-a6fe-85da60435e0d req-4dae9ff8-da43-4a0f-a789-1d4db671fbcd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.805934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-94095c77-47f8-4f4a-a6fe-85da60435e0d req-4dae9ff8-da43-4a0f-a789-1d4db671fbcd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.820952 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-94095c77-47f8-4f4a-a6fe-85da60435e0d req-4dae9ff8-da43-4a0f-a789-1d4db671fbcd service nova] Creating event network-vif-deleted:88116d6b-20f2-440f-906a-193232d100a6 for instance bba8b302-0692-4af1-9350-ec8c975379d3 on nch2-master-1 Oct 29 21:02:30.828007 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-94095c77-47f8-4f4a-a6fe-85da60435e0d req-4dae9ff8-da43-4a0f-a789-1d4db671fbcd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052202 Oct 29 21:02:30.829337 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1936/3752] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:30.837833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:30.838851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.862846 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b73f14c-5ce8-4140-adf3-8965591eb11b tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 204 len: 0 microversion: 2.1 time: 0.344713 Oct 29 21:02:30.863947 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1817/3753] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:30 2022] DELETE /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:30.870870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:30.876566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.877082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.878315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.879253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.879895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.880535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.881281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:30.896542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.897126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.897755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.901506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:30.902116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:30.904663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:30.925504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:31.077751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd094edb-f7de-4f7c-a295-495558351cf3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "PUT /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1081 microversion: 2.1 time: 0.211982 Oct 29 21:02:31.078929 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1818/3754] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:02:30 2022] PUT /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1081 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:31.086083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:31.086899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:31.102591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.107118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.107691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.109891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.110632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.115098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.228888 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d0b3646-a1c4-4df7-be98-452ca0bb9759 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/action" status: 202 len: 0 microversion: 2.1 time: 0.148454 Oct 29 21:02:31.230712 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1819/3755] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:02:31 2022] POST /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:02:31.238123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:31.238720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:31.245906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.246401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.246843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.248772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.249235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.250121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.280818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:31.392300 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1dda44b7-7012-4af9-8b27-0dcb2244ddc9 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 204 len: 0 microversion: 2.1 time: 0.159518 Oct 29 21:02:31.396976 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1820/3756] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:31 2022] DELETE /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:31.404157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:31.405019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:31.411807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.412047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.412474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.413850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.415020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.415020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.438985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:31.454764 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e23c408b-f65c-49f3-9802-33047166264e tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1316 microversion: 2.1 time: 0.623946 Oct 29 21:02:31.455366 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1937/3757] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:30 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:31.475006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:31.475919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:31.482974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.483731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.484362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.485254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.485917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.486557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.939139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:31.947015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:31.955689 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9d3d166-d108-4c9b-807b-deb23614f43c tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1507 microversion: 2.1 time: 0.484499 Oct 29 21:02:31.957007 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1938/3758] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:31 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:31.965473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:31.966697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a7b74ff-77b0-429a-889a-fd60a8d2175d tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.568378 Oct 29 21:02:31.968961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:31.978304 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1821/3759] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:31 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:31.979321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.980797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.982232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:31.983198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:31.983828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:31.984979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:31.985479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:31.987316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.001643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.002247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.002818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.003794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.004442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.004885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.576916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:32.607579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e07fddb-7218-4856-86b6-0abe0842d2fa tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1723 microversion: 2.1 time: 0.646967 Oct 29 21:02:32.611263 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1939/3760] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:31 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1723 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:32.624992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:32.625653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:32.654943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.655271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.655716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.656434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.656890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.657325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.672433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:32.688029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb258694-c438-4810-b790-2e35f9d63ba1 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 200 len: 1474 microversion: 2.1 time: 0.707750 Oct 29 21:02:32.691575 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1822/3761] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:31 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 1474 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:32.725814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-aa6ee9a6-bd9f-4e29-a20a-8a57b14039dc req-69001e02-1293-44f3-bfba-3b1ad7af7bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba8b302-0692-4af1-9350-ec8c975379d3", "name": "network-vif-unplugged", "status": "completed", "tag": "88116d6b-20f2-440f-906a-193232d100a6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:32.768550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aa6ee9a6-bd9f-4e29-a20a-8a57b14039dc req-69001e02-1293-44f3-bfba-3b1ad7af7bfc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.769667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aa6ee9a6-bd9f-4e29-a20a-8a57b14039dc req-69001e02-1293-44f3-bfba-3b1ad7af7bfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.770123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aa6ee9a6-bd9f-4e29-a20a-8a57b14039dc req-69001e02-1293-44f3-bfba-3b1ad7af7bfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.794290 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-aa6ee9a6-bd9f-4e29-a20a-8a57b14039dc req-69001e02-1293-44f3-bfba-3b1ad7af7bfc service nova] Creating event network-vif-unplugged:88116d6b-20f2-440f-906a-193232d100a6 for instance bba8b302-0692-4af1-9350-ec8c975379d3 on nch2-master-1 Oct 29 21:02:32.808630 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-aa6ee9a6-bd9f-4e29-a20a-8a57b14039dc req-69001e02-1293-44f3-bfba-3b1ad7af7bfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098943 Oct 29 21:02:32.811505 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1823/3762] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:32.818559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:32.819273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:32.830975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.831407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.831915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:32.832686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:32.833418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:32.834061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:33.379915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:33.394093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7cbe9fc6-afb6-4416-bfa8-3cb00d84eafe tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1266 microversion: 2.1 time: 0.779301 Oct 29 21:02:33.396357 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1940/3763] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:32 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1266 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:33.412910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:33.419560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:33.427552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:33.428994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:33.429737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:33.430476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:33.430944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:33.431442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.014160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:34.036725 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b45e74c8-1e41-4676-8647-0c42492f8fc7 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1507 microversion: 2.1 time: 1.222856 Oct 29 21:02:34.038792 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1824/3764] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:32 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1507 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:34.048241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:34.050536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:34.058583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.059586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.060448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.061681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.063563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.064919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.073940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:34.084004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bf72f3f-e0f0-477d-a737-ec3a98b1f6a9 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1505 microversion: 2.1 time: 0.676133 Oct 29 21:02:34.109868 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1941/3765] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:33 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:34.118774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:34.119685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:34.137938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.138767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.139222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.139960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.140427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.140866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.837327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:34.846272 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13b9892f-dedf-4938-a1fa-e097dcb687f3 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.805776 Oct 29 21:02:34.856616 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1825/3766] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:34 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:34.862012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:34.862969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:34.875896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.876805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.879710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.880722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.881153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:34.881577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.882869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.907475 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-467416cd-dc52-4ef4-9768-73e80c33bb7e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1723 microversion: 2.1 time: 0.796104 Oct 29 21:02:34.920543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1942/3767] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:34 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1723 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:34.923327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:34.927130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:34.943215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.944477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.945119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:34.946083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:34.946723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:34.947328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.004110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:35.208952 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d34f4867-b87f-4a9d-a1c0-e3639efed7c3 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "DELETE /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 204 len: 0 microversion: 2.1 time: 0.298608 Oct 29 21:02:35.209648 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1943/3768] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:34 2022] DELETE /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:35.216827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:35.218068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:35.236067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.236571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.237017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.237774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.238235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.238666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.288330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e95a973d-6fd3-4d54-8563-697db33aae98 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba/ips" status: 200 len: 109 microversion: 2.1 time: 0.077486 Oct 29 21:02:35.289312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1944/3769] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:02:35 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba/ips => generated 109 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:35.301382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:35.302120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:35.309190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.309668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.310186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.310963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.311433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.311869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.500962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:35.580254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:35.606833 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cd23a4f-dd62-47a3-b954-8265aa16ef5c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 200 len: 1474 microversion: 2.1 time: 0.748622 Oct 29 21:02:35.610753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1826/3770] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:34 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 1474 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:35.616001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1ffcc657-05f5-4d03-8cef-0273d1cf71f2 req-9704efdc-3ff9-49dc-b31c-c033089c9b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956a4b60-0c22-4798-bde6-00ece91c4d3c", "tag": "7b716bd1-6cfd-403c-ae0c-7737bea7d764"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:35.645051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1ffcc657-05f5-4d03-8cef-0273d1cf71f2 req-9704efdc-3ff9-49dc-b31c-c033089c9b8a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.654665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1ffcc657-05f5-4d03-8cef-0273d1cf71f2 req-9704efdc-3ff9-49dc-b31c-c033089c9b8a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.655355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1ffcc657-05f5-4d03-8cef-0273d1cf71f2 req-9704efdc-3ff9-49dc-b31c-c033089c9b8a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.678737 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1ffcc657-05f5-4d03-8cef-0273d1cf71f2 req-9704efdc-3ff9-49dc-b31c-c033089c9b8a service nova] Creating event network-changed:7b716bd1-6cfd-403c-ae0c-7737bea7d764 for instance 956a4b60-0c22-4798-bde6-00ece91c4d3c on nch1-master-1 Oct 29 21:02:35.685103 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1ffcc657-05f5-4d03-8cef-0273d1cf71f2 req-9704efdc-3ff9-49dc-b31c-c033089c9b8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072767 Oct 29 21:02:35.688300 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1827/3771] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:35.698620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:35.702458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:35.715809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.723122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.723857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.724842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.725575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.726259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.774225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:35.800661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:35.875827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:35.883974 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.api [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Instance is already in deleting state, ignoring this request Oct 29 21:02:35.885123 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb69dd8c-3a8e-4293-ace5-bcb1fc2f8b72 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "DELETE /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 204 len: 0 microversion: 2.1 time: 0.195176 Oct 29 21:02:35.886303 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1828/3772] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:35 2022] DELETE /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:35.892057 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e791552f-7b53-43ee-aa80-b8e759c5fbe4 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.597908 Oct 29 21:02:35.893329 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1945/3773] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:35 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:35.908596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d1d77194-1e91-4723-9a7b-af90fe9d2775 req-81fad858-0d6c-4b4c-99dd-f5d56896e511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f58caf-98ff-43b0-ac4e-a9521e2b81ea", "name": "network-vif-deleted", "tag": "d63ecde2-aa99-4ec3-9ef5-6df5a600ae85"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:35.913076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:35.913762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:35.923847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.924366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.924813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.925597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.931964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.933244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.945955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d1d77194-1e91-4723-9a7b-af90fe9d2775 req-81fad858-0d6c-4b4c-99dd-f5d56896e511 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:35.947529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d1d77194-1e91-4723-9a7b-af90fe9d2775 req-81fad858-0d6c-4b4c-99dd-f5d56896e511 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:35.949684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d1d77194-1e91-4723-9a7b-af90fe9d2775 req-81fad858-0d6c-4b4c-99dd-f5d56896e511 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:35.985314 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d1d77194-1e91-4723-9a7b-af90fe9d2775 req-81fad858-0d6c-4b4c-99dd-f5d56896e511 service nova] Creating event network-vif-deleted:d63ecde2-aa99-4ec3-9ef5-6df5a600ae85 for instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea on nch2-master-1 Oct 29 21:02:35.987972 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f55317c3-8088-4bdf-907d-1ca8a7aade5a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba/ips" status: 200 len: 109 microversion: 2.1 time: 0.100416 Oct 29 21:02:35.992389 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d1d77194-1e91-4723-9a7b-af90fe9d2775 req-81fad858-0d6c-4b4c-99dd-f5d56896e511 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097534 Oct 29 21:02:35.993410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1946/3774] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:36.003207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.004488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.004721 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1829/3775] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:02:35 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba/ips => generated 109 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:36.009883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.010995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.017611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.018698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.019537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.021045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.021647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.022495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.023112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.023726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.028045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.029128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.029857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.030513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.409954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:36.420641 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22d9c32e-275c-4a83-983f-37d8d4bcfb47 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1513 microversion: 2.1 time: 0.414588 Oct 29 21:02:36.425128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:36.438197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1830/3776] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:36 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1513 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:36.469431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.469775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fdb1ecb2-94e9-43a8-a628-790f7a593d9b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.474162 Oct 29 21:02:36.474364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.478402 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1947/3777] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:35 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:36.488434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.488942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.496428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.497376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.498035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.498940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.501562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.502686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.510508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.511369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.512169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.513664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.518128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.518732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.577293 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e23dac1-273c-4833-ab1b-86a8f9be647c tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba/ips/tempest-ServerAddressesTestJSON-1072361795-network" status: 200 len: 94 microversion: 2.1 time: 0.097952 Oct 29 21:02:36.577939 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1948/3778] 10.222.0.36 () {58 vars in 1401 bytes} [Sat Oct 29 21:02:36 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba/ips/tempest-ServerAddressesTestJSON-1072361795-network => generated 94 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:02:36.591425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.591954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.599470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.599807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.600839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.601609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.602078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.602519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.651645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:36.807221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:36.817287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16a061a7-e498-4eed-a6f8-b6e668988be6 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 204 len: 0 microversion: 2.1 time: 0.231675 Oct 29 21:02:36.819044 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1949/3779] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:36 2022] DELETE /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:02:36.839084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.841351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.855201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.855648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.856149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.856888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.857407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.858020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.863295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:36.871860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-063f6055-00fc-4f05-9637-5d66181e3be1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1723 microversion: 2.1 time: 0.417671 Oct 29 21:02:36.872455 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1831/3780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:36 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1723 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:36.879335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:36.887925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:36.900574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.902942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.904768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.905674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.906875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.909349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:36.909596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.910276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:36.910880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:36.911503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 77f58caf-98ff-43b0-ac4e-a9521e2b81ea {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:36.992768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:37.021995 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-603c442c-bb9a-4774-abf2-6005d9a1f74a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 200 len: 1309 microversion: 2.1 time: 0.191431 Oct 29 21:02:37.024024 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1950/3781] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:36 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:37.040642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:37.044757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:37.067355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:37.069259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:37.070011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:37.071022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:37.071720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:37.072416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:37.735380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:37.789672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=12 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:37.882970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:37.895638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:37.899089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:37.901148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab6ddb17-dacf-4e3e-b089-30da400d4641 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1511 microversion: 2.1 time: 1.027419 Oct 29 21:02:37.902900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1832/3782] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:36 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1511 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:37.908550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:37.909299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:37.917335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:37.918090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:37.918612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:37.928656 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1ac8b0bf-9b49-4618-934a-135ce0a22e23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.903220 Oct 29 21:02:37.929274 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1951/3783] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:37 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:37.958339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:37.958558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:37.959463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:37.960245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:37.966696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:37.967308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:37.968107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:37.978153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:37.986462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:37.986978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:37.987414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.375075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:38.383980 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-18ebc46b-7745-4231-9fb5-0a4f0178a082 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.441303 Oct 29 21:02:38.385280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:38.402469 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1952/3784] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:37 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:38.414533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a2afee99-f577-492a-9918-b206173e30cb req-b813f3e7-18b1-422f-9b8e-ef3e5f54e25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3", "name": "network-vif-deleted", "tag": "76fe2d78-74ce-4cb2-9cdc-37877fafce37"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:38.427373 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-abfe6bec-b262-435a-a3d4-9498f4fb108a tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1513 microversion: 2.1 time: 0.522403 Oct 29 21:02:38.431334 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1833/3785] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:37 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:38.449485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a2afee99-f577-492a-9918-b206173e30cb req-b813f3e7-18b1-422f-9b8e-ef3e5f54e25a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.449988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a2afee99-f577-492a-9918-b206173e30cb req-b813f3e7-18b1-422f-9b8e-ef3e5f54e25a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.450429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a2afee99-f577-492a-9918-b206173e30cb req-b813f3e7-18b1-422f-9b8e-ef3e5f54e25a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.464689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:38.467238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:38.482011 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a2afee99-f577-492a-9918-b206173e30cb req-b813f3e7-18b1-422f-9b8e-ef3e5f54e25a service nova] Creating event network-vif-deleted:76fe2d78-74ce-4cb2-9cdc-37877fafce37 for instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 on nch1-master-1 Oct 29 21:02:38.487936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.488928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.489627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.490972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.491610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.492334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.492470 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a2afee99-f577-492a-9918-b206173e30cb req-b813f3e7-18b1-422f-9b8e-ef3e5f54e25a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088335 Oct 29 21:02:38.493323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1953/3786] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:38.506429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:38.507143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:38.530290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.531031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.531597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.532585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.533778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.536025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.613880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.614484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.615021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.615560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 77f58caf-98ff-43b0-ac4e-a9521e2b81ea {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:38.684146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:38.693421 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-47025761-4872-4768-8794-210b664adbbd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 200 len: 1309 microversion: 2.1 time: 0.198718 Oct 29 21:02:38.694530 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1954/3787] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:38 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:38.700603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f6d76e-94cf-4dbd-88b0-9670121a6b61", "tag": "94617b61-0b04-44a0-b768-e77c62a243d7"}, {"name": "network-changed", "server_uuid": "2cf79198-dbfe-4f1a-adf4-f6bb1eab8262", "tag": "fe61547e-472d-4f71-98b6-e5c76acc611a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:38.720655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.721592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.722106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.738214 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] Creating event network-changed:94617b61-0b04-44a0-b768-e77c62a243d7 for instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 on nch1-master-1 Oct 29 21:02:38.739335 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] Creating event network-changed:fe61547e-472d-4f71-98b6-e5c76acc611a for instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 on nch1-master-1 Oct 29 21:02:38.747587 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-892bc7f3-503e-4e3a-b3a4-92bdd039e03e req-70bb54d7-be5e-4ab3-8444-01425390a407 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050613 Oct 29 21:02:38.748981 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1955/3788] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:38.793992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:38.804220 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b430ddee-d072-41f9-be84-84556ea11df3 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1729 microversion: 2.1 time: 0.368966 Oct 29 21:02:38.808995 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1834/3789] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:38 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1729 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:38.829288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:38.829925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:38.836708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.837205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.837990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.839360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.839855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.840295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.924579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:38.925262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:38.935334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.936412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.938110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.942168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.942713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.943356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.960371 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b7141c51-e01a-4ee4-b04c-44b77e92792b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135496 Oct 29 21:02:38.961911 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1956/3790] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:02:38 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:38.969181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:38.970987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:38.981297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.982506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.983522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:38.984474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:38.985170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:38.986130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.347730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:39.357405 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f74718a7-9d74-47d0-8650-6135269e15fd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1511 microversion: 2.1 time: 0.436945 Oct 29 21:02:39.358741 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1835/3791] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:38 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:39.419779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:39.420409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:39.432989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.434258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.434960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.435912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.436617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.436742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:39.438344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.462595 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37733bf2-b328-41da-94e6-add085e0a237 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.494646 Oct 29 21:02:39.463941 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1957/3792] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:38 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:39.468849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:39.469754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:39.476068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.476882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.477589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.478522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.479774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.480432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.603851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:39.616965 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-02ecc6a1-4e7a-4ba9-855e-89ea7341dd12 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1471 microversion: 2.1 time: 0.151456 Oct 29 21:02:39.621224 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1958/3793] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:39 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:39.719669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:39.720377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 77f58caf-98ff-43b0-ac4e-a9521e2b81ea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:39.731966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.733234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.733855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.734689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.737917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.739487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.767637 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea could not be found. Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea HTTP/1.1 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea could not be found. Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '77f58caf-98ff-43b0-ac4e-a9521e2b81ea'} Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea could not be found. Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea could not be found. Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:39.770577 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea could not be found. Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.775723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance 77f58caf-98ff-43b0-ac4e-a9521e2b81ea could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:39.780094 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d9102df-9529-4767-b9cb-7d06acdb8505 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea" status: 404 len: 111 microversion: 2.1 time: 0.065367 Oct 29 21:02:39.780829 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1959/3794] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:39 2022] GET /compute/v2.1/servers/77f58caf-98ff-43b0-ac4e-a9521e2b81ea => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:02:39.791416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:39.793579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:39.807650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.809018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.810236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.811091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.811671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.812281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.831943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 could not be found. Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 HTTP/1.1 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 could not be found. Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3'} Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 could not be found. Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 could not be found. Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:39.834973 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 could not be found. Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:39.840723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:39.842674 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa9d241c-c6f4-45bb-bd7b-ec15b9e5a8dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3" status: 404 len: 111 microversion: 2.1 time: 0.057407 Oct 29 21:02:39.843688 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1960/3795] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:39 2022] GET /compute/v2.1/servers/be7a26ec-4c4b-4d69-b1cc-752ab6abe7a3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:39.851557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41ac0ba6-83ce-445b-acd4-238a9ca2bb9a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:39.877513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:39.898916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-50616f8b-a346-47f0-8f50-c496b6d155bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.482026 Oct 29 21:02:39.901359 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41ac0ba6-83ce-445b-acd4-238a9ca2bb9a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/4fc28cd3-2fe0-4f47-81c6-dd9816786b61" status: 204 len: 0 microversion: 2.1 time: 0.052569 Oct 29 21:02:39.901565 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1836/3796] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:39 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:39.906986 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1961/3797] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:02:39 2022] DELETE /compute/v2.1/os-server-groups/4fc28cd3-2fe0-4f47-81c6-dd9816786b61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:39.915468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:39.919461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:39.932561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.935270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.936309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.937778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:39.938477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:39.939348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:39.980427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:40.147860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1c998d23-4c65-4b67-bf55-41f887641fe4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 204 len: 0 microversion: 2.1 time: 0.238887 Oct 29 21:02:40.160814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:40.161638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:40.166587 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1837/3798] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:39 2022] DELETE /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:40.176359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.177081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.177629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.178421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.178998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.179848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.233049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:40.358141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-609195a7-f505-496d-afae-4e7cfdf2e8f3 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 204 len: 0 microversion: 2.1 time: 0.201299 Oct 29 21:02:40.359432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1962/3799] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:40 2022] DELETE /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:40.368918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:40.369842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:40.376225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.376740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.377188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.379371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.379371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.379371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.385126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:40.386632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:40.397737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.398235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.398676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.399388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.399844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.400274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.607563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:40.626920 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-895d3ada-0e0b-483b-997e-ce41832ce72b tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1469 microversion: 2.1 time: 0.245897 Oct 29 21:02:40.645394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1963/3800] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:40 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:40.659083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:40.660112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:40.679291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.679954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.680492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.681312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.681925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.683009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.913740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:40.925177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ccb9845c-69c9-458a-9d50-67af5a6829e8 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1475 microversion: 2.1 time: 0.561185 Oct 29 21:02:40.946771 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1838/3801] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:40 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:40.957497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:40.960158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:40.967202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.967944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.968571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:40.969502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:40.970126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:40.970720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.038575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.039065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.039541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.040012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lazy-loading 'fault' on Instance uuid 200f98eb-4037-47be-b68c-938c8089e90e {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:41.114680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:41.126674 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-514e7077-ecda-4338-812c-08f7c78d91e9 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.479243 Oct 29 21:02:41.128197 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1964/3802] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:40 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:41.134712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-432fe9f2-db5e-4bd5-9d1f-b460deebbf81 req-7798f086-4fa8-47b2-92dc-65fe53b9aa66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba", "name": "network-vif-deleted", "tag": "648f4c68-6640-4b37-b998-b6eefe868be1"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:41.202892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85d4d6aed54dae96f3a7ade33611f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ced91d5c874306ae56325583f3bb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:41.221673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-432fe9f2-db5e-4bd5-9d1f-b460deebbf81 req-7798f086-4fa8-47b2-92dc-65fe53b9aa66 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.223345 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-398c7ca1-abe9-41b9-a072-b8fb564115a1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 200 len: 1307 microversion: 2.1 time: 0.275360 Oct 29 21:02:41.241484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-432fe9f2-db5e-4bd5-9d1f-b460deebbf81 req-7798f086-4fa8-47b2-92dc-65fe53b9aa66 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.241484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-432fe9f2-db5e-4bd5-9d1f-b460deebbf81 req-7798f086-4fa8-47b2-92dc-65fe53b9aa66 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.246219 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1839/3803] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:40 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:41.257951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6ca88963-d8a7-4937-badc-c5989dbcf219 req-089ec059-042d-4b76-a985-d7a43d6faec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200f98eb-4037-47be-b68c-938c8089e90e", "name": "network-vif-deleted", "tag": "db961a28-c65f-42bc-810c-fed9166ec2d0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:41.277909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6ca88963-d8a7-4937-badc-c5989dbcf219 req-089ec059-042d-4b76-a985-d7a43d6faec5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.278764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6ca88963-d8a7-4937-badc-c5989dbcf219 req-089ec059-042d-4b76-a985-d7a43d6faec5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.280140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6ca88963-d8a7-4937-badc-c5989dbcf219 req-089ec059-042d-4b76-a985-d7a43d6faec5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.282504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-432fe9f2-db5e-4bd5-9d1f-b460deebbf81 req-7798f086-4fa8-47b2-92dc-65fe53b9aa66 service nova] Creating event network-vif-deleted:648f4c68-6640-4b37-b998-b6eefe868be1 for instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba on nch2-master-1 Oct 29 21:02:41.297649 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-432fe9f2-db5e-4bd5-9d1f-b460deebbf81 req-7798f086-4fa8-47b2-92dc-65fe53b9aa66 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167119 Oct 29 21:02:41.298593 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1965/3804] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:41.304401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:41.305374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6ca88963-d8a7-4937-badc-c5989dbcf219 req-089ec059-042d-4b76-a985-d7a43d6faec5 service nova] Creating event network-vif-deleted:db961a28-c65f-42bc-810c-fed9166ec2d0 for instance 200f98eb-4037-47be-b68c-938c8089e90e on nch1-master-1 Oct 29 21:02:41.309928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:41.311658 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6ca88963-d8a7-4937-badc-c5989dbcf219 req-089ec059-042d-4b76-a985-d7a43d6faec5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063923 Oct 29 21:02:41.314200 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1840/3805] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:41.330004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.330514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.330957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.333150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.333734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.334389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.660381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:41.661102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:41.680714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.687369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.687964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.688819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:41.689842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:41.698409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:41.966005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:41.976316 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f39c3b4b-7fcf-4b6e-9919-be9597a47544 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.676032 Oct 29 21:02:41.980265 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1966/3806] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:41 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:41.987064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:41.997114 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78eef587-8e15-47b1-b9d2-e7056110e542 tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1469 microversion: 2.1 time: 0.342837 Oct 29 21:02:42.001148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:42.006632 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1841/3807] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:41 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1469 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:42.007614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:42.016981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.017493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.029127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.030160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.030966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.031562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.153998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:42.154619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:42.167310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.168073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.168682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.169626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.170248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.170865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.763531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:42.778215 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2be96d70-bacd-4386-9911-1bb1d3413005 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1475 microversion: 2.1 time: 0.796427 Oct 29 21:02:42.780866 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1967/3808] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:41 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1475 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:42.792727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:42.796617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 200f98eb-4037-47be-b68c-938c8089e90e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:42.814781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.818986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.819809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.821231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.822193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.823153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.866331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] HTTP exception thrown: Instance 200f98eb-4037-47be-b68c-938c8089e90e could not be found. Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Request method failure captured: Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e HTTP/1.1 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQ2jubHA3ETn9En-Z-5xh1_jTAxzGwaZpto_gP5BBouOLyzw86aCQaKq72x7cmUw35z3HeQ44-PSK3YMoJPm3OWV5dCJaam28h75DU8r4yy7Mfm151SoU9Q_Y2wSmO2rAJqGaF_96W4mrEQV5mKjLa_D1WFdYakBncL-1oSKm0UkyU Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_92ced91d5c874306ae56325583f3bb12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 5e85d4d6aed54dae96f3a7ade33611f6 Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 200f98eb-4037-47be-b68c-938c8089e90e could not be found. Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '200f98eb-4037-47be-b68c-938c8089e90e'} Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200f98eb-4037-47be-b68c-938c8089e90e could not be found. Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200f98eb-4037-47be-b68c-938c8089e90e could not be found. Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:42.868076 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200f98eb-4037-47be-b68c-938c8089e90e could not be found. Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Returning 404 to user: Instance 200f98eb-4037-47be-b68c-938c8089e90e could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:42.872673 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-858a9416-7274-42ad-81c6-66a510d95c7d tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e" status: 404 len: 111 microversion: 2.1 time: 0.086776 Oct 29 21:02:42.877737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1968/3809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:42 2022] GET /compute/v2.1/servers/200f98eb-4037-47be-b68c-938c8089e90e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:42.895552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:42.908863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:42.924752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.925725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.926990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.949495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:42.950404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:42.951084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:42.970522 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] HTTP exception thrown: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Request method failure captured: Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 HTTP/1.1 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQ2jubHA3ETn9En-Z-5xh1_jTAxzGwaZpto_gP5BBouOLyzw86aCQaKq72x7cmUw35z3HeQ44-PSK3YMoJPm3OWV5dCJaam28h75DU8r4yy7Mfm151SoU9Q_Y2wSmO2rAJqGaF_96W4mrEQV5mKjLa_D1WFdYakBncL-1oSKm0UkyU Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_92ced91d5c874306ae56325583f3bb12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 5e85d4d6aed54dae96f3a7ade33611f6 Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8b0785aa-27c3-44da-9417-e45732a59fb1'} Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:42.972295 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:42.977529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Returning 404 to user: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:42.980940 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01ad6d5c-d64d-4236-ae0c-c1420afe6f41 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 404 len: 111 microversion: 2.1 time: 0.097231 Oct 29 21:02:42.982357 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1969/3810] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:42 2022] DELETE /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:42.992564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:42.993907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8b0785aa-27c3-44da-9417-e45732a59fb1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:43.029435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.032540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.033057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.033848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.034357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.039981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.083347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] HTTP exception thrown: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Request method failure captured: Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 HTTP/1.1 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQ2jubHA3ETn9En-Z-5xh1_jTAxzGwaZpto_gP5BBouOLyzw86aCQaKq72x7cmUw35z3HeQ44-PSK3YMoJPm3OWV5dCJaam28h75DU8r4yy7Mfm151SoU9Q_Y2wSmO2rAJqGaF_96W4mrEQV5mKjLa_D1WFdYakBncL-1oSKm0UkyU Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_92ced91d5c874306ae56325583f3bb12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 5e85d4d6aed54dae96f3a7ade33611f6 Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8b0785aa-27c3-44da-9417-e45732a59fb1'} Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:43.086859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. Oct 29 21:02:43.092432 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.094578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Returning 404 to user: Instance 8b0785aa-27c3-44da-9417-e45732a59fb1 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:43.095616 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-325d288d-f436-4da3-a0d9-a8ce50e41902 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1" status: 404 len: 111 microversion: 2.1 time: 0.108175 Oct 29 21:02:43.096793 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1970/3811] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:42 2022] GET /compute/v2.1/servers/8b0785aa-27c3-44da-9417-e45732a59fb1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:43.104966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:43.106416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:43.106775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:43.117204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.117947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.118876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.119838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.120494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.121152 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1e775b18-47b0-4369-8097-2346d945cf45 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.971257 Oct 29 21:02:43.121365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.135669 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1842/3812] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:42 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:43.147557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:43.148598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:43.187092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.187608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.190029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.190974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.191223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.191661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.242276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:43.254847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.258243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.259013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.259720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lazy-loading 'fault' on Instance uuid 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:43.780516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e340341dcc94b3396bb6e53ebf1308a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbb1efd59ce4030b3740f0351e7df34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:43.806422 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2028608-735d-423b-a8e0-6782a12ba66a tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 200 len: 1306 microversion: 2.1 time: 0.663223 Oct 29 21:02:43.821037 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1843/3813] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:43 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 1306 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:43.837182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:43.842845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:43.858076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.858846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.859554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.861414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.862426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.863045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.888730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] HTTP exception thrown: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Request method failure captured: Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a HTTP/1.1 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQ2jubHA3ETn9En-Z-5xh1_jTAxzGwaZpto_gP5BBouOLyzw86aCQaKq72x7cmUw35z3HeQ44-PSK3YMoJPm3OWV5dCJaam28h75DU8r4yy7Mfm151SoU9Q_Y2wSmO2rAJqGaF_96W4mrEQV5mKjLa_D1WFdYakBncL-1oSKm0UkyU Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_92ced91d5c874306ae56325583f3bb12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 5e85d4d6aed54dae96f3a7ade33611f6 Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '8192935b-cb3d-467f-ba5c-327b1f415b3a'} Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:43.890403 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Returning 404 to user: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e68c8b5e-b5e1-46d1-acd2-c719fa00c94b tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 404 len: 111 microversion: 2.1 time: 0.069071 Oct 29 21:02:43.894683 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1844/3814] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:43 2022] DELETE /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:43.902901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11aa593f-4fe8-472f-9f8a-3872b461a5f4", "tag": "bf3132a9-fca7-4a6c-8fbe-cea150ab2741"}, {"name": "network-changed", "server_uuid": "11aa593f-4fe8-472f-9f8a-3872b461a5f4", "tag": "bf3132a9-fca7-4a6c-8fbe-cea150ab2741"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:43.923264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.927334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:43.928475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.928956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.946308 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1eeadcd4-f17c-491f-9df7-1cb0836289f4 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.848294 Oct 29 21:02:43.947223 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1971/3815] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:43 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:43.952311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:43.953129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:43.974311 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] Creating event network-changed:bf3132a9-fca7-4a6c-8fbe-cea150ab2741 for instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 on nch2-master-1 Oct 29 21:02:43.978145 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] Creating event network-changed:bf3132a9-fca7-4a6c-8fbe-cea150ab2741 for instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 on nch2-master-1 Oct 29 21:02:43.984812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.985319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.985811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.986534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:43.987001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:43.987435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:43.996142 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-93138786-e6fa-4e42-b9dc-7c9bee69aeec req-3085ec23-28a9-4f8e-852b-e430431e9444 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099324 Oct 29 21:02:43.998171 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1845/3816] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:44.025357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:44.026455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] [instance: 8192935b-cb3d-467f-ba5c-327b1f415b3a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:44.035935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.038391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.045448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.046502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.047140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.047796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.083649 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] HTTP exception thrown: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Request method failure captured: Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a HTTP/1.1 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQ2jubHA3ETn9En-Z-5xh1_jTAxzGwaZpto_gP5BBouOLyzw86aCQaKq72x7cmUw35z3HeQ44-PSK3YMoJPm3OWV5dCJaam28h75DU8r4yy7Mfm151SoU9Q_Y2wSmO2rAJqGaF_96W4mrEQV5mKjLa_D1WFdYakBncL-1oSKm0UkyU Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_92ced91d5c874306ae56325583f3bb12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/92ced91d5c874306ae56325583f3bb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 92ced91d5c874306ae56325583f3bb12 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-413772277 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 5e85d4d6aed54dae96f3a7ade33611f6 Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerDiskConfigTestJSON-413772277-project Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '8192935b-cb3d-467f-ba5c-327b1f415b3a'} Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:44.088289 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] Returning 404 to user: Instance 8192935b-cb3d-467f-ba5c-327b1f415b3a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f14ab095-2bfd-44ea-aa6b-45f12379efe1 tempest-ServerDiskConfigTestJSON-413772277 tempest-ServerDiskConfigTestJSON-413772277-project] 10.222.0.36 "GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a" status: 404 len: 111 microversion: 2.1 time: 0.090244 Oct 29 21:02:44.094988 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1846/3817] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:43 2022] GET /compute/v2.1/servers/8192935b-cb3d-467f-ba5c-327b1f415b3a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:44.146799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:44.147410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:44.152481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:44.165906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.167263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.170913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.171915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.174276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.177400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.507456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:44.516093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0729060b-9a8e-49f7-9b11-425f2cccc5aa tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1475 microversion: 2.1 time: 0.567442 Oct 29 21:02:44.539150 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1972/3818] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:43 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1475 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:44.646614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:44.657092 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-676a3b1d-0dc3-4b4e-8f38-6778b34c0c06 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.513988 Oct 29 21:02:44.659853 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1847/3819] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:44 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:44.814741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1280100317", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:44.835988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:44.836667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] [instance: 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:44.848439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.853276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.854164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.857547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.858311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.858920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.892886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] HTTP exception thrown: Instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba could not be found. Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Request method failure captured: Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba HTTP/1.1 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZTRN6NJorGSJjT3gNjnOSLfP6WQ0JjImOTJiJbrGpe-__nEEhneAxTe6PC50Wj9eIk-XXrvS-yWMbfRwVCnASF764vqjO4cNFEPu2oSMz5MzGwkuOpU-lPSlBIMQ_jryRFRBOo4ab_UZr-W6DnGnA3e1Ta09ykEsfEQyaOUAv24quI Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: ffbb1efd59ce4030b3740f0351e7df34 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerAddressesTestJSON-1546933478 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ffbb1efd59ce4030b3740f0351e7df34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ffbb1efd59ce4030b3740f0351e7df34"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ffbb1efd59ce4030b3740f0351e7df34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ffbb1efd59ce4030b3740f0351e7df34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerAddressesTestJSON-1546933478 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: ffbb1efd59ce4030b3740f0351e7df34 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1546933478 Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerAddressesTestJSON-1546933478-project Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7e340341dcc94b3396bb6e53ebf1308a Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerAddressesTestJSON-1546933478-project Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba could not be found. Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba'} Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba could not be found. Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba could not be found. Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:44.894492 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba could not be found. Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] Returning 404 to user: Instance 6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:44.899870 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f4fedfc-18b2-461a-91b3-0631fd7739cd tempest-ServerAddressesTestJSON-1546933478 tempest-ServerAddressesTestJSON-1546933478-project] 10.222.0.36 "GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba" status: 404 len: 111 microversion: 2.1 time: 0.064866 Oct 29 21:02:44.905662 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1848/3820] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:44 2022] GET /compute/v2.1/servers/6a3701d3-3bf3-4a6a-b5aa-b8154734c6ba => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:02:44.914664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-08fd33e8-ad03-43a4-a329-a8a770159e1a req-403481cb-b0df-4a69-8459-ccc609c8341e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956a4b60-0c22-4798-bde6-00ece91c4d3c", "name": "network-vif-plugged", "status": "completed", "tag": "7b716bd1-6cfd-403c-ae0c-7737bea7d764"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:44.919586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:02:44.938135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08fd33e8-ad03-43a4-a329-a8a770159e1a req-403481cb-b0df-4a69-8459-ccc609c8341e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:44.938620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08fd33e8-ad03-43a4-a329-a8a770159e1a req-403481cb-b0df-4a69-8459-ccc609c8341e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:44.939058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-08fd33e8-ad03-43a4-a329-a8a770159e1a req-403481cb-b0df-4a69-8459-ccc609c8341e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:44.970542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-08fd33e8-ad03-43a4-a329-a8a770159e1a req-403481cb-b0df-4a69-8459-ccc609c8341e service nova] Creating event network-vif-plugged:7b716bd1-6cfd-403c-ae0c-7737bea7d764 for instance 956a4b60-0c22-4798-bde6-00ece91c4d3c on nch1-master-1 Oct 29 21:02:44.976041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-08fd33e8-ad03-43a4-a329-a8a770159e1a req-403481cb-b0df-4a69-8459-ccc609c8341e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066229 Oct 29 21:02:44.976999 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1849/3821] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:02:44.990038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:44.994168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:45.008263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:45.009815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:45.010850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:45.011601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:45.012076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:45.012518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:45.513171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:45.530540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4905600b-5e12-41eb-b544-548a117eb207 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 0.548165 Oct 29 21:02:45.547508 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1850/3822] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:44 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:45.565310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:45.567961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:45.590159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:45.592457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:45.593127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:45.594112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:45.595757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:45.597119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:46.228112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:46.237171 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55362cf8-0b44-4fb6-b0bd-049f0367038f tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1475 microversion: 2.1 time: 0.688290 Oct 29 21:02:46.243813 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1851/3823] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:45 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1475 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:46.258201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:46.259097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:46.268415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:46.270629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:46.273581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:46.274780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:46.275538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:46.276871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:46.949901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:02:46.950843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:02:46.951503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:02:46.952119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:02:46.952840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:46.953536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:02:46.967594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67440edd-f9b4-4a70-a229-8e8aded4aa6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.718289 Oct 29 21:02:46.971216 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1852/3824] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:46 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:46.990502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.010520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.011282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.013879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.014547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.015371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.026249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b5182a58-a37b-4a4e-ae8e-2437bdb117c1 req-b0758160-4876-40f0-b69d-d04eb3c4657c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1", "name": "network-vif-deleted", "tag": "495b6acb-43c2-4148-8c3a-5278c7a0b20e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:47.034573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:47.041707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b5182a58-a37b-4a4e-ae8e-2437bdb117c1 req-b0758160-4876-40f0-b69d-d04eb3c4657c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.042750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b5182a58-a37b-4a4e-ae8e-2437bdb117c1 req-b0758160-4876-40f0-b69d-d04eb3c4657c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.043238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b5182a58-a37b-4a4e-ae8e-2437bdb117c1 req-b0758160-4876-40f0-b69d-d04eb3c4657c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.054563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:02:47.068821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b5182a58-a37b-4a4e-ae8e-2437bdb117c1 req-b0758160-4876-40f0-b69d-d04eb3c4657c service nova] Creating event network-vif-deleted:495b6acb-43c2-4148-8c3a-5278c7a0b20e for instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 on nch2-master-1 Oct 29 21:02:47.071742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:02:47.086141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b5182a58-a37b-4a4e-ae8e-2437bdb117c1 req-b0758160-4876-40f0-b69d-d04eb3c4657c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087483 Oct 29 21:02:47.090477 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1853/3825] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:47.113495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:02:47.114126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3b657cb3-c8a3-45ad-befd-d776120d5bd1 req-0d490ad2-5cfb-4924-8597-f7f48a169b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9", "name": "network-vif-deleted", "tag": "5505ab66-82a6-4c92-9ae0-fd1973d0b4d0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:47.118006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:47.155109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3b657cb3-c8a3-45ad-befd-d776120d5bd1 req-0d490ad2-5cfb-4924-8597-f7f48a169b94 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.155595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3b657cb3-c8a3-45ad-befd-d776120d5bd1 req-0d490ad2-5cfb-4924-8597-f7f48a169b94 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.156080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3b657cb3-c8a3-45ad-befd-d776120d5bd1 req-0d490ad2-5cfb-4924-8597-f7f48a169b94 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.170134 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3b657cb3-c8a3-45ad-befd-d776120d5bd1 req-0d490ad2-5cfb-4924-8597-f7f48a169b94 service nova] Creating event network-vif-deleted:5505ab66-82a6-4c92-9ae0-fd1973d0b4d0 for instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 on nch2-master-1 Oct 29 21:02:47.176882 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3b657cb3-c8a3-45ad-befd-d776120d5bd1 req-0d490ad2-5cfb-4924-8597-f7f48a169b94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083167 Oct 29 21:02:47.178051 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1854/3826] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:47.191149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:47.194313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:47.202879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.204271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.204884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.205818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.206639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.207995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.229663 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-70a4935d-f82a-485c-8bef-defe0b695ebc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.688872 Oct 29 21:02:47.230633 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1973/3827] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:02:47.242399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c758b36e-fff5-47e6-b28d-ab652af8c6d6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:47.245165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c758b36e-fff5-47e6-b28d-ab652af8c6d6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:47.504177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c758b36e-fff5-47e6-b28d-ab652af8c6d6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:47.520070 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c758b36e-fff5-47e6-b28d-ab652af8c6d6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1215 microversion: 2.1 time: 0.281799 Oct 29 21:02:47.522210 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1974/3828] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:47 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1215 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:47.530848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:47.541147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:47.570656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.571299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.573862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.578709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.581099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.582869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.675641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:47.676616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:47.682816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:47.684333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lazy-loading 'fault' on Instance uuid 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:02:47.790586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:47.806651 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d68a5fa-a192-4b2b-9861-176fa734f0c4 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 200 len: 1309 microversion: 2.1 time: 0.282222 Oct 29 21:02:47.826388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1975/3829] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:47 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 1309 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:48.004167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:48.005050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:48.037605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:48.038310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:48.038872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:48.039735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:48.040521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:48.041073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:48.668735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:48.680096 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d786c32-e83c-4866-adb2-e3ee2477d7a5 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1318 microversion: 2.1 time: 1.500207 Oct 29 21:02:48.686109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1855/3830] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:47 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1318 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:48.695156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:48.695798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:48.714079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:48.714679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:48.721733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:48.723261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:48.724565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:48.725245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:48.821492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:48.840172 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55ce0a44-d94a-4019-897a-d888a7183891 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1211 microversion: 2.1 time: 0.150136 Oct 29 21:02:48.857070 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1856/3831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:48 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1211 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:48.868504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:48.869557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:48.889200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:48.895311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:48.898470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:48.899819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:48.902251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:48.904137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:48.957051 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 could not be found. Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 HTTP/1.1 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 could not be found. Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9'} Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 could not be found. Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 could not be found. Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:48.961293 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 could not be found. Oct 29 21:02:48.973540 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:48.978449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance 7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:48.985211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-892cb08a-3b85-4faf-b2b4-63f1a175902c tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9" status: 404 len: 111 microversion: 2.1 time: 0.122669 Oct 29 21:02:48.986132 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1857/3832] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:48 2022] GET /compute/v2.1/servers/7fa9ca8c-2bbc-4f9f-8ed6-a8735edbfdb9 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:49.001872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:49.003222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:49.013488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.014280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.014944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.015965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.017693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.018606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.033499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:49.042916 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39b8640a-7fb4-428b-b297-c6267cc183dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 1.045484 Oct 29 21:02:49.043430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 could not be found. Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 HTTP/1.1 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 could not be found. Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1'} Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 could not be found. Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 could not be found. Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:49.045847 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 could not be found. Oct 29 21:02:49.050677 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:02:49.051186 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1976/3833] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:47 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:49.053515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:49.054715 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a1b53c99-cb60-4c1c-9d28-3648c981d9dd tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1" status: 404 len: 111 microversion: 2.1 time: 0.061084 Oct 29 21:02:49.055835 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1858/3834] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:48 2022] GET /compute/v2.1/servers/ad251df5-e5cf-4f1b-bc8b-a3365c27d6f1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:49.068704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1cb3b792-749c-402b-9bb5-7351ee02d3a6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:49.136874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1cb3b792-749c-402b-9bb5-7351ee02d3a6 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/45241e72-7724-4fad-946e-ef919852e232" status: 204 len: 0 microversion: 2.1 time: 0.076096 Oct 29 21:02:49.139416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1977/3835] 10.222.0.36 () {58 vars in 1266 bytes} [Sat Oct 29 21:02:49 2022] DELETE /compute/v2.1/os-server-groups/45241e72-7724-4fad-946e-ef919852e232 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:49.148451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:49.151529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:49.162600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.163463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.164135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.165065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.165792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.167700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.243980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:49.381190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5bffdbbb-9585-4734-9204-3bd43788f6ac req-24f70950-b947-427e-b77d-3122eaee6283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f6d76e-94cf-4dbd-88b0-9670121a6b61", "name": "network-vif-plugged", "status": "completed", "tag": "94617b61-0b04-44a0-b768-e77c62a243d7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:49.393758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:49.406551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5bffdbbb-9585-4734-9204-3bd43788f6ac req-24f70950-b947-427e-b77d-3122eaee6283 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.407724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5bffdbbb-9585-4734-9204-3bd43788f6ac req-24f70950-b947-427e-b77d-3122eaee6283 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.408374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5bffdbbb-9585-4734-9204-3bd43788f6ac req-24f70950-b947-427e-b77d-3122eaee6283 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.411284 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-38dfd23a-0ef8-4c5f-b8f8-9d034c903f32 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 204 len: 0 microversion: 2.1 time: 0.267732 Oct 29 21:02:49.415012 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1859/3836] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:49 2022] DELETE /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:49.430079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:49.430810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:49.441038 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5bffdbbb-9585-4734-9204-3bd43788f6ac req-24f70950-b947-427e-b77d-3122eaee6283 service nova] Creating event network-vif-plugged:94617b61-0b04-44a0-b768-e77c62a243d7 for instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 on nch1-master-1 Oct 29 21:02:49.448675 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5bffdbbb-9585-4734-9204-3bd43788f6ac req-24f70950-b947-427e-b77d-3122eaee6283 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071127 Oct 29 21:02:49.450362 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1978/3837] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:02:49.450671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.451750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.453231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.454606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.456413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.456866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.743135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:49.744204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:49.764845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.767632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.768312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.769183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.771838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.773074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.895440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:49.906592 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6fcb3a8b-6c3f-45eb-9faf-94787a8528c5 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1471 microversion: 2.1 time: 0.489752 Oct 29 21:02:49.921882 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1860/3838] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:49 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1471 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:49.926341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:49.927264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:49.939152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.940193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.941130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:49.942656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:49.943590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:49.951109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:50.182660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:50.196572 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cf15d865-3014-441b-a0b7-dac392f622ff tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1273 microversion: 2.1 time: 0.284520 Oct 29 21:02:50.197280 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1861/3839] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:49 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:50.204832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:50.211181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:50.232517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:50.238861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:50.239456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:50.246136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:50.246783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:50.247247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:50.737544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:50.750322 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-986442bb-fec5-4958-b2ca-c4a287b39681 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1506 microversion: 2.1 time: 1.032659 Oct 29 21:02:50.753144 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1979/3840] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:49 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1506 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:50.777538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:50.778457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:50.788414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:50.790098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:50.801165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:50.802187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:50.802689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:50.803626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:51.097946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:51.120440 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8583c9a-5730-4742-873a-e6fd933fcca5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.921201 Oct 29 21:02:51.124323 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1862/3841] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:50 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:51.140017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:51.140944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:51.159902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:51.160752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:51.161406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:51.162372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:51.171375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:51.172085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:51.586667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:51.598650 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-088a9c08-349e-4765-b0a8-a015161bc7bb tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1318 microversion: 2.1 time: 0.826177 Oct 29 21:02:51.599879 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1980/3842] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:50 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:51.606211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:51.607201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:51.614149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:51.641379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:51.642256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:51.643458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:51.644116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:51.645372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:51.780041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:51.797630 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d9c2329-59b7-443f-b1d9-3dd9ffdc0589 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1273 microversion: 2.1 time: 0.194635 Oct 29 21:02:51.799983 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1981/3843] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:51 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:51.905609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0a8b8359414ca0af8f79a4db4b3d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6506ce28d00440bb9f768ec7768a18f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:51.944186 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1bac1433-d6d1-45af-9942-ab19542b24b0 tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 200 len: 1471 microversion: 2.1 time: 0.814906 Oct 29 21:02:51.946753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1863/3844] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:51 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 1471 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:52.152327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:52.155316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:52.164307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:52.165414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:52.167014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:52.168990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:52.169970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:52.172628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:52.679553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1364453699", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "249c06de-7362-4934-9368-245c7efe0876"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:52.814650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:52.830717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] validate_networks() for [('249c06de-7362-4934-9368-245c7efe0876', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:02:52.835512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa85a8ac-fa3e-44c3-ac2e-425929264ebc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.687818 Oct 29 21:02:52.836737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1982/3845] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:52 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:52.842049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:52.846926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:52.880560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:52.890587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:52.891282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:52.892247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:52.892878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:52.893499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:54.439045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:54.452323 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-366a33e2-7b28-4b6d-9481-186b9e0f986b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1318 microversion: 2.1 time: 1.614330 Oct 29 21:02:54.457249 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1983/3846] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:52 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1318 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:54.468340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:54.475305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:54.498130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:54.498949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:54.499571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:54.502333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:54.502809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:54.503253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.192283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:55.204156 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df61b5bb-9a0d-4f80-b63c-b6c274799dd7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.745668 Oct 29 21:02:55.205681 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1984/3847] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:54 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:55.211152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:55.212079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] [instance: e75e7ef5-74ec-405e-9a01-352979e69378] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:55.225247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.225876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.226384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.227231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.227756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.228250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.247004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] HTTP exception thrown: Instance e75e7ef5-74ec-405e-9a01-352979e69378 could not be found. Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Request method failure captured: Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 HTTP/1.1 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQQJ7KFP_5kbbej_K-erc1S_zJg0Yyf7agdp5I5MnLY3P6UjQtB0XZ3cO6OM_Os2xi1ro4Q0On7IE_3vV8BlhY6hvwnY9LbeoOaHnSOpQAeNBsyOaDsk21V2uckVzapPzacQA9NLsOhDa6EI5RzINqmnnI7VAa1mGtQkNttpZPtBSg Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6506ce28d00440bb9f768ec7768a18f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6506ce28d00440bb9f768ec7768a18f7 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1833486613 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: bc0a8b8359414ca0af8f79a4db4b3d38 Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersOnMultiNodesTest-1833486613-project Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance e75e7ef5-74ec-405e-9a01-352979e69378 could not be found. Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'e75e7ef5-74ec-405e-9a01-352979e69378'} Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75e7ef5-74ec-405e-9a01-352979e69378 could not be found. Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75e7ef5-74ec-405e-9a01-352979e69378 could not be found. Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:02:55.250034 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75e7ef5-74ec-405e-9a01-352979e69378 could not be found. Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:02:55.255976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] Returning 404 to user: Instance e75e7ef5-74ec-405e-9a01-352979e69378 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:02:55.258212 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68019b9e-b06a-47ad-a18c-5678208a2a1a tempest-ServersOnMultiNodesTest-1833486613 tempest-ServersOnMultiNodesTest-1833486613-project] 10.222.0.36 "GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378" status: 404 len: 111 microversion: 2.1 time: 0.050426 Oct 29 21:02:55.262189 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1985/3848] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:55 2022] GET /compute/v2.1/servers/e75e7ef5-74ec-405e-9a01-352979e69378 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:02:55.363285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3216b1e0-a083-4667-9680-76d57e927ba1 req-9efe6ae1-0d34-4586-9b45-6fdca1ee1343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75e7ef5-74ec-405e-9a01-352979e69378", "name": "network-vif-deleted", "tag": "97e61f37-85b0-4b26-8bd1-bf179735f626"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:55.415732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3216b1e0-a083-4667-9680-76d57e927ba1 req-9efe6ae1-0d34-4586-9b45-6fdca1ee1343 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.434225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3216b1e0-a083-4667-9680-76d57e927ba1 req-9efe6ae1-0d34-4586-9b45-6fdca1ee1343 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.434772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3216b1e0-a083-4667-9680-76d57e927ba1 req-9efe6ae1-0d34-4586-9b45-6fdca1ee1343 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.467290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:02:55.467770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:02:55.468194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:02:55.468613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:02:55.469082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:02:55.492893 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3216b1e0-a083-4667-9680-76d57e927ba1 req-9efe6ae1-0d34-4586-9b45-6fdca1ee1343 service nova] Creating event network-vif-deleted:97e61f37-85b0-4b26-8bd1-bf179735f626 for instance e75e7ef5-74ec-405e-9a01-352979e69378 on nch1-master-1 Oct 29 21:02:55.495626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.496517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.497818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.498581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.500801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.501252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.515941 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3216b1e0-a083-4667-9680-76d57e927ba1 req-9efe6ae1-0d34-4586-9b45-6fdca1ee1343 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250418 Oct 29 21:02:55.518452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1986/3849] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:55.535973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:55.542005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:55.547399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:55.560582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.564468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.566899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.567936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.569885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.571791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.575789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Getting quotas for project 7392e793031e40e2b67155a93af93ecb. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:02:55.592064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Getting quotas for user 2d6288cab8f247d3835b882fca1c0054 and project 7392e793031e40e2b67155a93af93ecb. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:02:55.637579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:02:55.640287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:02:55.727565 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1267a821-94ca-4ab0-bafe-5d00b694b357 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.162113 Oct 29 21:02:55.729287 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1864/3850] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:02:55.739965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5426b1d3-93fc-4b2f-841d-05d21dee0086 req-a74c4734-7e05-420b-a0e2-2ce44ba6eac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf79198-dbfe-4f1a-adf4-f6bb1eab8262", "name": "network-vif-plugged", "status": "completed", "tag": "fe61547e-472d-4f71-98b6-e5c76acc611a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:55.765837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5426b1d3-93fc-4b2f-841d-05d21dee0086 req-a74c4734-7e05-420b-a0e2-2ce44ba6eac2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.768702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5426b1d3-93fc-4b2f-841d-05d21dee0086 req-a74c4734-7e05-420b-a0e2-2ce44ba6eac2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.769831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5426b1d3-93fc-4b2f-841d-05d21dee0086 req-a74c4734-7e05-420b-a0e2-2ce44ba6eac2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.799239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5426b1d3-93fc-4b2f-841d-05d21dee0086 req-a74c4734-7e05-420b-a0e2-2ce44ba6eac2 service nova] Creating event network-vif-plugged:fe61547e-472d-4f71-98b6-e5c76acc611a for instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 on nch1-master-1 Oct 29 21:02:55.820912 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5426b1d3-93fc-4b2f-841d-05d21dee0086 req-a74c4734-7e05-420b-a0e2-2ce44ba6eac2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081818 Oct 29 21:02:55.822124 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1865/3851] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:55.842177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4d434109-49d1-477c-a0da-671c360a6319 req-c2647928-3c9c-4b92-a1f3-fdc63d029323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c44b4c-753e-4d71-b652-2ac9e04befcb", "tag": "25e02b45-6c9a-42f1-8b30-3faab040a237"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:55.889542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4d434109-49d1-477c-a0da-671c360a6319 req-c2647928-3c9c-4b92-a1f3-fdc63d029323 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:55.894941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4d434109-49d1-477c-a0da-671c360a6319 req-c2647928-3c9c-4b92-a1f3-fdc63d029323 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:55.898213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4d434109-49d1-477c-a0da-671c360a6319 req-c2647928-3c9c-4b92-a1f3-fdc63d029323 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:55.960605 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4d434109-49d1-477c-a0da-671c360a6319 req-c2647928-3c9c-4b92-a1f3-fdc63d029323 service nova] Creating event network-changed:25e02b45-6c9a-42f1-8b30-3faab040a237 for instance 90c44b4c-753e-4d71-b652-2ac9e04befcb on nch2-master-1 Oct 29 21:02:55.970366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4d434109-49d1-477c-a0da-671c360a6319 req-c2647928-3c9c-4b92-a1f3-fdc63d029323 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146002 Oct 29 21:02:55.974742 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1866/3852] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:02:55.996600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:55.999851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:56.013593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:56.015230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:56.016257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:56.018284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:56.019848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:56.022578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:56.461941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:56.479305 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f4d6619-d387-4d1b-a98c-30938b9ae628 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.957638 Oct 29 21:02:56.480714 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1987/3853] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:55 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:56.501006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-becdbbc5-37bb-4225-9149-e0bbb733c614 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:56.503416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-becdbbc5-37bb-4225-9149-e0bbb733c614 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:56.607283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:56.615712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8311b6d2-cd14-42da-8aa7-4c351554ce91 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1505 microversion: 2.1 time: 0.632525 Oct 29 21:02:56.640947 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1867/3854] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:55 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:56.685656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:56.685656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:56.691543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:56.692967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:56.693446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:56.694487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:56.694973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:56.695415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:56.774539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-becdbbc5-37bb-4225-9149-e0bbb733c614 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:56.793385 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-becdbbc5-37bb-4225-9149-e0bbb733c614 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1216 microversion: 2.1 time: 0.305511 Oct 29 21:02:56.794383 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1988/3855] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:56 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1216 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:56.812704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:56.813199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:56.843439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:56.844114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:56.844567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:56.845278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:56.846009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:56.850126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:56.914558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:57.035027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:57.037721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:57.044312 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a20c7f0-d786-479c-9f1a-6a29c1a496bf tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 204 len: 0 microversion: 2.1 time: 0.247837 Oct 29 21:02:57.044775 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e582564-3c62-40d4-a707-be9588375d61 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.402603 Oct 29 21:02:57.045537 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1989/3856] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:56 2022] DELETE /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:57.056024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:57.057019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:57.067792 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1868/3857] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:56 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:57.077857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.089181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.091520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.094170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.094752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.096553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.153689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:02:57.423318 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5484498e-de85-4fdf-8a72-80a969df3b63 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "DELETE /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 204 len: 0 microversion: 2.1 time: 0.372236 Oct 29 21:02:57.424320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1990/3858] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:02:57 2022] DELETE /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:02:57.432696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:57.433329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:57.449168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.450794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.451839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.452946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.453616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.454392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.506720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:57.508140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:57.524318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.527036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.527721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.531863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.532995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.534034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.923580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:57.939487 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25581f7f-f649-40ae-b4b0-6301fc1424fc tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1511 microversion: 2.1 time: 0.509037 Oct 29 21:02:57.941801 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1869/3859] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:57 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:57.953259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:57.954142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:57.967954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.971730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.974098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:57.976298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:57.977027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:57.980215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:58.014555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:58.021128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:02:58.023612 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db5d2ec0-bcb9-4d92-8d4a-fd3695e15a71 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1308 microversion: 2.1 time: 0.523559 Oct 29 21:02:58.034681 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1991/3860] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:57 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:58.077351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:58.078058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:58.088124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:58.088622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:58.089066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:58.089810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:58.090271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:58.090704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:58.177563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:58.208504 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0d5ba1f-6a43-4951-b111-b55a65bd9654 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1268 microversion: 2.1 time: 0.265432 Oct 29 21:02:58.210168 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1870/3861] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:57 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1268 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:58.313298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:58.322724 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4ce48e3-926b-4fd4-981b-7083ae742e0a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.250901 Oct 29 21:02:58.323704 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1992/3862] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:58 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:58.966964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:58.967659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:58.978931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:58.979444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:58.981963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:58.982516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:58.983007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:58.983466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.048364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:59.050300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:59.062026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.064047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.064749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.069111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.070115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.070925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.315783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:59.327995 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f7e9306-fb8f-4a8d-9175-ad6f0d5264d0 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1511 microversion: 2.1 time: 0.362590 Oct 29 21:02:59.331772 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1871/3863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:58 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:59.338435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:59.339505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:59.347965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.348735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.349957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.350920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.351610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.353215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.426790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:59.440562 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2f45a79-08dd-463e-ac76-94fbf36ec54d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1489 microversion: 2.1 time: 0.396966 Oct 29 21:02:59.441718 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1993/3864] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:59 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1489 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:02:59.444355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:59.463602 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce3bc093-65fc-4d4a-8acf-e96ab4fbe699 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1274 microversion: 2.1 time: 0.129932 Oct 29 21:02:59.466302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1872/3865] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:59 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:59.467579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:59.470227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:59.473542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:02:59.476162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:59.481790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.482291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.482734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.486027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.490951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.491407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.495548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.498767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.501955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.505251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.507003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.508420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.662179 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d81582d-aad0-42f8-9958-90cb582e6b7d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "PUT /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1084 microversion: 2.1 time: 0.194537 Oct 29 21:02:59.663228 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1873/3866] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:02:59 2022] PUT /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1084 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:59.687035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:59.687761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:59.698512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.699343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.700166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.701165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.701889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.702742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.731984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:59.742994 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6084794-ec12-45d3-9154-550d3c88598c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.299164 Oct 29 21:02:59.743514 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1994/3867] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:59 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:59.876391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:02:59.887018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-652f3877-4117-4db5-ad5e-544d8b1dfe73 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1510 microversion: 2.1 time: 0.207692 Oct 29 21:02:59.887518 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1874/3868] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:59 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:02:59.911712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:02:59.913281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:02:59.923323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.924915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.925799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:02:59.926851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:02:59.927521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:02:59.928406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:00.151998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:00.162117 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c4db375-642c-40f5-8dd8-fa9aa42c4c6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1510 microversion: 2.1 time: 0.253987 Oct 29 21:03:00.162782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1995/3869] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:02:59 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:00.187176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:00.187679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:00.200319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:00.200831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:00.206337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:00.207467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:00.208130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:00.208875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:00.247942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:00.360359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:00.361331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:00.383147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:00.388910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:00.389809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:00.391918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:00.395437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:00.396344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:00.461103 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4547489-be36-4723-bdaf-ff7747e9b3b8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 204 len: 0 microversion: 2.1 time: 0.279282 Oct 29 21:03:00.462301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1875/3870] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:00 2022] DELETE /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:00.471797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:00.474541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:00.490644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:00.491604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:00.492982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:00.499687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:00.500715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:00.501379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.222610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:01.232998 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2290bcf9-9188-40e7-9e25-f77a3068e1a7 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1511 microversion: 2.1 time: 0.877627 Oct 29 21:03:01.233600 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1996/3871] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:00 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1511 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:01.238831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:01.239726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:01.247015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.247631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.248166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.248967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.249673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.250641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.288851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:01.300246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef21c97c-65a9-48fb-80f3-794eebaa8526 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1516 microversion: 2.1 time: 0.833580 Oct 29 21:03:01.300897 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1876/3872] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:00 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1516 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:01.306378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:01.307241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:01.313419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.314163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.314762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.315654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.316281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.316873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.571204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:01.581375 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6800ff8a-4e07-453e-8a2f-be90290e4e2c tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.346339 Oct 29 21:03:01.583132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1997/3873] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:01 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:01.605954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:01.615536 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-739b3f2c-a65e-4973-af4a-3439fc8bd1ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.313348 Oct 29 21:03:01.620316 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1877/3874] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:01 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:01.627547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d5225bba-4b07-405f-9d46-586477f4faf1 req-c71c85d4-c7ed-4c67-b52e-bf8c7f3a9eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9", "tag": "0227e57d-6aca-4a5d-a176-055e7f2e1d9d"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:01.644695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5225bba-4b07-405f-9d46-586477f4faf1 req-c71c85d4-c7ed-4c67-b52e-bf8c7f3a9eae service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.645487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5225bba-4b07-405f-9d46-586477f4faf1 req-c71c85d4-c7ed-4c67-b52e-bf8c7f3a9eae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.646097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5225bba-4b07-405f-9d46-586477f4faf1 req-c71c85d4-c7ed-4c67-b52e-bf8c7f3a9eae service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.658021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d5225bba-4b07-405f-9d46-586477f4faf1 req-c71c85d4-c7ed-4c67-b52e-bf8c7f3a9eae service nova] Creating event network-changed:0227e57d-6aca-4a5d-a176-055e7f2e1d9d for instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 on nch2-master-1 Oct 29 21:03:01.663449 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d5225bba-4b07-405f-9d46-586477f4faf1 req-c71c85d4-c7ed-4c67-b52e-bf8c7f3a9eae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041496 Oct 29 21:03:01.664050 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1878/3875] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:01.766950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:01.780474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.781267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.783288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.786483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.787894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.788699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.835478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ebc277a-2d1d-4e71-a257-432a9a378119 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.250946 Oct 29 21:03:01.836473 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1998/3876] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 21:03:01 2022] GET /compute/v2.1/os-services => generated 947 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:01.851083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:01.855430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.855985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.859938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.860845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.861389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.861872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.923176 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-edc8cdfd-1613-41c8-9391-9e7aff0827fe tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.076545 Oct 29 21:03:01.924667 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1879/3877] 10.222.0.36 () {58 vars in 1174 bytes} [Sat Oct 29 21:03:01 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:01.937144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:01.942189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.942965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.946638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:01.948172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:01.949288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:01.952531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.023062 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed991032-0ca6-4ac4-bb11-28225c308852 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.089489 Oct 29 21:03:02.028190 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 1999/3878] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 21:03:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:02.037509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:02.042943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.044128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.045770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.048342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.049293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.052148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.107268 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d2d39d29-aae3-473f-a137-78197c3ba1b5 tempest-ServicesAdminTestJSON-165373833 tempest-ServicesAdminTestJSON-165373833-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.073879 Oct 29 21:03:02.108619 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1880/3879] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 21:03:02 2022] GET /compute/v2.1/os-services => generated 947 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:02.168660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f57043da-9ce3-4010-a7ab-8261ebf54788 req-069aa8ed-707f-4634-86e7-819c67f6464e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f6d76e-94cf-4dbd-88b0-9670121a6b61", "name": "network-vif-deleted", "tag": "94617b61-0b04-44a0-b768-e77c62a243d7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:02.187830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f57043da-9ce3-4010-a7ab-8261ebf54788 req-069aa8ed-707f-4634-86e7-819c67f6464e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.188344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f57043da-9ce3-4010-a7ab-8261ebf54788 req-069aa8ed-707f-4634-86e7-819c67f6464e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.188791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f57043da-9ce3-4010-a7ab-8261ebf54788 req-069aa8ed-707f-4634-86e7-819c67f6464e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.230916 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f57043da-9ce3-4010-a7ab-8261ebf54788 req-069aa8ed-707f-4634-86e7-819c67f6464e service nova] Creating event network-vif-deleted:94617b61-0b04-44a0-b768-e77c62a243d7 for instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 on nch1-master-1 Oct 29 21:03:02.239970 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f57043da-9ce3-4010-a7ab-8261ebf54788 req-069aa8ed-707f-4634-86e7-819c67f6464e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073693 Oct 29 21:03:02.242081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2000/3880] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:02.256060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:02.257773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:02.270740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.275031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.277428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.280204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.281752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.282445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.329684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:02.330403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:02.342977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.344336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.344807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.345582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.346061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.346500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.496441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:02.511889 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4a95502-5985-4e60-81a0-8abb6902ef2b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 200 len: 1303 microversion: 2.1 time: 0.259452 Oct 29 21:03:02.513963 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1881/3881] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:02 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 1303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:02.610760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:02.611578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:02.615597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:02.632259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.634199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.634744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.636395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:02.638989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:02.640300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:02.712658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:02.955854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:02.974597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54def071-5736-4d35-8e72-2dd2b7c6b8c8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1516 microversion: 2.1 time: 0.649426 Oct 29 21:03:02.978152 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2001/3882] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:02 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1516 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:02.997727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:02.998670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:03.006193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.006988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.007779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.008742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.009393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.011066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.185738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:03.199129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85b4a1bb-40b9-4e68-a87e-d87db1debfb5 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.592830 Oct 29 21:03:03.200123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1882/3883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:02 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:03.208673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-af1fc3b3-3ab9-4427-916d-d1fdb164ae8e req-cda39e5b-5349-4592-8b0c-a0d81bad2752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956a4b60-0c22-4798-bde6-00ece91c4d3c", "name": "network-vif-unplugged", "status": "completed", "tag": "7b716bd1-6cfd-403c-ae0c-7737bea7d764"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:03.240266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-af1fc3b3-3ab9-4427-916d-d1fdb164ae8e req-cda39e5b-5349-4592-8b0c-a0d81bad2752 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.241326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-af1fc3b3-3ab9-4427-916d-d1fdb164ae8e req-cda39e5b-5349-4592-8b0c-a0d81bad2752 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.242026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-af1fc3b3-3ab9-4427-916d-d1fdb164ae8e req-cda39e5b-5349-4592-8b0c-a0d81bad2752 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.265642 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-af1fc3b3-3ab9-4427-916d-d1fdb164ae8e req-cda39e5b-5349-4592-8b0c-a0d81bad2752 service nova] Creating event network-vif-unplugged:7b716bd1-6cfd-403c-ae0c-7737bea7d764 for instance 956a4b60-0c22-4798-bde6-00ece91c4d3c on nch1-master-1 Oct 29 21:03:03.277499 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-af1fc3b3-3ab9-4427-916d-d1fdb164ae8e req-cda39e5b-5349-4592-8b0c-a0d81bad2752 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070124 Oct 29 21:03:03.281511 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1883/3884] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:03.542912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:03.545047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: f6f6d76e-94cf-4dbd-88b0-9670121a6b61] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:03.555638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.558006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.558703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.561027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.563216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.563954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.586303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:03.595800 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9c064ba9-01fb-4ded-9534-a67ee573a6f8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.616302 Oct 29 21:03:03.597862 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] HTTP exception thrown: Instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 could not be found. Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Request method failure captured: Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 HTTP/1.1 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZTD6PmNbUejU30BBz_WpYOgsxSw6FkZoX8_0oYnR8vGR2ep1_erAvDIJifW5_kbXc7x8Pzu0S-USF2pUaY2Dahcez9qe9ZTJgGgktpuI-oHc5Tq3SpIUubnU2hecDvR6aY2K8-9jD-UwFGaLWvQmzsQ73czh5iUJ7dvI1WcRvUY1is Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 23a37b9c718e465c83323970f013fe50 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-MultipleCreateTestJSON-736640677 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/23a37b9c718e465c83323970f013fe50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_23a37b9c718e465c83323970f013fe50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/23a37b9c718e465c83323970f013fe50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/23a37b9c718e465c83323970f013fe50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-MultipleCreateTestJSON-736640677 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 23a37b9c718e465c83323970f013fe50 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-MultipleCreateTestJSON-736640677 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-MultipleCreateTestJSON-736640677-project Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7612bf8b52db4840b9d2e7f342414429 Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-MultipleCreateTestJSON-736640677-project Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 could not be found. Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f6f6d76e-94cf-4dbd-88b0-9670121a6b61'} Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 could not be found. Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 could not be found. Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:03.602461 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 could not be found. Oct 29 21:03:03.613324 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:03.615404 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2002/3885] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:02 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:03.617955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Returning 404 to user: Instance f6f6d76e-94cf-4dbd-88b0-9670121a6b61 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:03.621133 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c5d91c5-fdb6-457f-9463-62be91ae6c35 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61" status: 404 len: 111 microversion: 2.1 time: 0.088225 Oct 29 21:03:03.631458 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1884/3886] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:03 2022] GET /compute/v2.1/servers/f6f6d76e-94cf-4dbd-88b0-9670121a6b61 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:03:03.634219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:03.634993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:03.641044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.641583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.642055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.642773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:03.643204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:03.643638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:03.776039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:03.796824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd791803-78ed-48ec-bc37-b05c9074ee20 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1470 microversion: 2.1 time: 0.165715 Oct 29 21:03:03.811553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2003/3887] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:03 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:04.004193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:04.004991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:04.026726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.035969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.036706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.038449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.039218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.039953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.222460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:04.223090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:04.233170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.237982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.238455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.239205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.239676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.240106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.334928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:04.347301 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a13f6c4a-9e5c-4868-8d3d-4ca99e75dc5e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1474 microversion: 2.1 time: 0.349613 Oct 29 21:03:04.364014 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1885/3888] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:03 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:04.406311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d46ab7fb-7224-41df-9129-6f81b620b32b req-782eb311-d4d3-46e9-9611-04fb5b7f6157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956a4b60-0c22-4798-bde6-00ece91c4d3c", "name": "network-vif-deleted", "tag": "7b716bd1-6cfd-403c-ae0c-7737bea7d764"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:04.418398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d46ab7fb-7224-41df-9129-6f81b620b32b req-782eb311-d4d3-46e9-9611-04fb5b7f6157 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.418917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d46ab7fb-7224-41df-9129-6f81b620b32b req-782eb311-d4d3-46e9-9611-04fb5b7f6157 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.419321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d46ab7fb-7224-41df-9129-6f81b620b32b req-782eb311-d4d3-46e9-9611-04fb5b7f6157 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.452162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d46ab7fb-7224-41df-9129-6f81b620b32b req-782eb311-d4d3-46e9-9611-04fb5b7f6157 service nova] Creating event network-vif-deleted:7b716bd1-6cfd-403c-ae0c-7737bea7d764 for instance 956a4b60-0c22-4798-bde6-00ece91c4d3c on nch1-master-1 Oct 29 21:03:04.467335 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d46ab7fb-7224-41df-9129-6f81b620b32b req-782eb311-d4d3-46e9-9611-04fb5b7f6157 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065409 Oct 29 21:03:04.468988 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1886/3889] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:03:04.629248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:04.630855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:04.638971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.639907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.640610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.641609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.642317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.642989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.661811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:04.676165 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e6b5dfa-9c54-44f4-ba2b-f74976f6f22d tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.457695 Oct 29 21:03:04.704801 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2004/3890] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:04 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:04.828810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:04.829853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:04.844560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.845379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.846123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.847129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.849907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.850471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.894595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:04.906743 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a19e0991-02d0-4613-8c6c-c8bd82b5fadf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.281245 Oct 29 21:03:04.908848 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1887/3891] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:04 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:04.942400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:04.947034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:04.954030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:04.954861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lazy-loading 'fault' on Instance uuid 956a4b60-0c22-4798-bde6-00ece91c4d3c {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:05.094812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7612bf8b52db4840b9d2e7f342414429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a37b9c718e465c83323970f013fe50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:05.105367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0edf2c20-631d-4db1-8484-cfdb94c3e341 tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 200 len: 1308 microversion: 2.1 time: 0.281423 Oct 29 21:03:05.123560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2005/3892] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:04 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:05.309982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-71e92b5d-5617-4c69-9382-1bc637ddf0ef req-6547c71a-f214-43ed-bd19-420405b33c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c44b4c-753e-4d71-b652-2ac9e04befcb", "name": "network-vif-plugged", "status": "completed", "tag": "25e02b45-6c9a-42f1-8b30-3faab040a237"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:05.322661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-71e92b5d-5617-4c69-9382-1bc637ddf0ef req-6547c71a-f214-43ed-bd19-420405b33c23 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.323586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-71e92b5d-5617-4c69-9382-1bc637ddf0ef req-6547c71a-f214-43ed-bd19-420405b33c23 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.324336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-71e92b5d-5617-4c69-9382-1bc637ddf0ef req-6547c71a-f214-43ed-bd19-420405b33c23 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.349270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-71e92b5d-5617-4c69-9382-1bc637ddf0ef req-6547c71a-f214-43ed-bd19-420405b33c23 service nova] Creating event network-vif-plugged:25e02b45-6c9a-42f1-8b30-3faab040a237 for instance 90c44b4c-753e-4d71-b652-2ac9e04befcb on nch2-master-1 Oct 29 21:03:05.387788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-71e92b5d-5617-4c69-9382-1bc637ddf0ef req-6547c71a-f214-43ed-bd19-420405b33c23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081364 Oct 29 21:03:05.399104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:05.400159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:05.409900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.410873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.411471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.412355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.412985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.413419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.414276 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1888/3893] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:05.517281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.518018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.518623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.519250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lazy-loading 'fault' on Instance uuid 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:05.606888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:05.615372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ffcbc3ba-6b77-4cec-9896-809dc0579a23 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 200 len: 1319 microversion: 2.1 time: 0.229205 Oct 29 21:03:05.616383 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2006/3894] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:05 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:05.723991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:05.729987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:05.730723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:05.744287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.745156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.745943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.746850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.747489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.748113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.932136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:05.932770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:05.945599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.946535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.947766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.948582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:05.949003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:05.952092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:05.952892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:05.968830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f167704d-c68a-4b69-90bd-c8f531508746 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.245862 Oct 29 21:03:05.969798 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1889/3895] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:05 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:06.138856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:06.139589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] [instance: 956a4b60-0c22-4798-bde6-00ece91c4d3c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:06.151855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:06.153791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:06.154364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:06.155505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:06.158647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:06.159114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:06.181977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:06.191042 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] HTTP exception thrown: Instance 956a4b60-0c22-4798-bde6-00ece91c4d3c could not be found. Oct 29 21:03:06.195320 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9063d77c-2c2d-4a84-adfa-9af6dfdf6956 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1315 microversion: 2.1 time: 0.267055 Oct 29 21:03:06.196318 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2007/3896] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:05 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Request method failure captured: Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c HTTP/1.1 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZTD6PmNbUejU30BBz_WpYOgsxSw6FkZoX8_0oYnR8vGR2ep1_erAvDIJifW5_kbXc7x8Pzu0S-USF2pUaY2Dahcez9qe9ZTJgGgktpuI-oHc5Tq3SpIUubnU2hecDvR6aY2K8-9jD-UwFGaLWvQmzsQ73czh5iUJ7dvI1WcRvUY1is Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 23a37b9c718e465c83323970f013fe50 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-MultipleCreateTestJSON-736640677 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/23a37b9c718e465c83323970f013fe50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_23a37b9c718e465c83323970f013fe50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/23a37b9c718e465c83323970f013fe50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/23a37b9c718e465c83323970f013fe50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-MultipleCreateTestJSON-736640677 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 23a37b9c718e465c83323970f013fe50 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-MultipleCreateTestJSON-736640677 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-MultipleCreateTestJSON-736640677-project Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7612bf8b52db4840b9d2e7f342414429 Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-MultipleCreateTestJSON-736640677-project Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 956a4b60-0c22-4798-bde6-00ece91c4d3c could not be found. Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '956a4b60-0c22-4798-bde6-00ece91c4d3c'} Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 956a4b60-0c22-4798-bde6-00ece91c4d3c could not be found. Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 956a4b60-0c22-4798-bde6-00ece91c4d3c could not be found. Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:06.200895 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 956a4b60-0c22-4798-bde6-00ece91c4d3c could not be found. Oct 29 21:03:06.206579 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.210548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] Returning 404 to user: Instance 956a4b60-0c22-4798-bde6-00ece91c4d3c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:06.213941 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bff2b59-958e-45e8-b50b-acf1af01d59b tempest-MultipleCreateTestJSON-736640677 tempest-MultipleCreateTestJSON-736640677-project] 10.222.0.36 "GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c" status: 404 len: 111 microversion: 2.1 time: 0.080473 Oct 29 21:03:06.227153 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1890/3897] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:06 2022] GET /compute/v2.1/servers/956a4b60-0c22-4798-bde6-00ece91c4d3c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:03:06.571216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-64fb6444-b85d-406b-a157-23624567a85e req-34a9b38e-14b6-49f9-a7e6-bc2794fd94a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf79198-dbfe-4f1a-adf4-f6bb1eab8262", "name": "network-vif-deleted", "tag": "fe61547e-472d-4f71-98b6-e5c76acc611a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:06.599601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-64fb6444-b85d-406b-a157-23624567a85e req-34a9b38e-14b6-49f9-a7e6-bc2794fd94a5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:06.600095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-64fb6444-b85d-406b-a157-23624567a85e req-34a9b38e-14b6-49f9-a7e6-bc2794fd94a5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:06.600538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-64fb6444-b85d-406b-a157-23624567a85e req-34a9b38e-14b6-49f9-a7e6-bc2794fd94a5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:06.642523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:06.643172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:06.649812 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-64fb6444-b85d-406b-a157-23624567a85e req-34a9b38e-14b6-49f9-a7e6-bc2794fd94a5 service nova] Creating event network-vif-deleted:fe61547e-472d-4f71-98b6-e5c76acc611a for instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 on nch1-master-1 Oct 29 21:03:06.652423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:06.652912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:06.653364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:06.654114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:06.654579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:06.655022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:06.658343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-64fb6444-b85d-406b-a157-23624567a85e req-34a9b38e-14b6-49f9-a7e6-bc2794fd94a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090893 Oct 29 21:03:06.659909 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2008/3898] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:06.719649 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 HTTP/1.1 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2cf79198-dbfe-4f1a-adf4-f6bb1eab8262'} Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.742089 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:06.749550 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:06.749550 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:06.749550 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:06.749550 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:06.749550 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:03:06.749550 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:06.752489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:06.752489 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-422873f8-5b33-4174-8d0e-4c55cef6983a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 404 len: 111 microversion: 2.1 time: 0.113869 Oct 29 21:03:06.756262 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1891/3899] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:06 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:03:06.992707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:06.998441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-106613218", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "952a0058-a373-4626-8a93-42fe347eca16"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:07.004767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:07.009765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:07.044414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:07.046168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:07.046806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:07.048182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:07.052924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:07.053650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:07.076099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] validate_networks() for [('952a0058-a373-4626-8a93-42fe347eca16', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:03:07.564577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:07.574739 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e145916f-3e60-4892-aa16-304ed16985d6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.586706 Oct 29 21:03:07.587781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2009/3900] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:06 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:07.593387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:07.594364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:07.612813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:07.613634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:07.614318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:07.615273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:07.616317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:07.617003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:07.670119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:08.527107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:08.536454 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b9e3c940-4071-4568-ae69-1c10847cbfdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1502 microversion: 2.1 time: 0.947238 Oct 29 21:03:08.545617 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2010/3901] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:07 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1502 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:08.560286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:08.561401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:08.568153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.568652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.569097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.569844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.570307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.570735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.599941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:08.622697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:08.624124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:08.625077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:08.626283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:08.628160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:08.646501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.647543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.648215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.649206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.650771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.652954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.678587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:08.685586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Getting quotas for user 23d0ccab778b46aa9894f047db04b6b7 and project 26372e44d6654191b8a30f4a1af2d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:08.701507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:08.704640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:08.707455 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-99bd3c3f-b234-4a33-88cc-2d544d78fc9d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 204 len: 0 microversion: 2.1 time: 0.145696 Oct 29 21:03:08.708938 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2011/3902] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:08 2022] DELETE /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:03:08.725986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:08.727446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:08.739766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.740279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.740895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.741871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.742348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.742841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.761124 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bd4e8ee0-3bd3-4e40-811a-86c0f56054d5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770686 Oct 29 21:03:08.768533 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1892/3903] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:03:08.775198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:08.776849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:08.786232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.787271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.788219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:08.789343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:08.790371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:08.791124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:09.153073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:09.164247 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-42842ac1-5b0b-4f34-bb5e-ac902caa42aa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1508 microversion: 2.1 time: 0.394000 Oct 29 21:03:09.165883 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1893/3904] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:08 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:09.172917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-46193e73-13f4-4d58-b93e-589ee51b5f1d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:09.174164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-46193e73-13f4-4d58-b93e-589ee51b5f1d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:09.216244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:09.227599 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65c306a1-16bb-4049-826a-69fcb3ca7caa tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.515857 Oct 29 21:03:09.241940 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2012/3905] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:08 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:09.325737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-46193e73-13f4-4d58-b93e-589ee51b5f1d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:09.336085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-46193e73-13f4-4d58-b93e-589ee51b5f1d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1208 microversion: 2.1 time: 0.167500 Oct 29 21:03:09.336993 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1894/3906] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:09 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1208 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:10.192168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:10.192839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:10.215054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:10.215693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:10.216157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:10.216910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:10.217367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:10.227879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:10.251129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:10.252013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:10.269687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:10.272152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:10.272721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:10.277044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:10.278502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:10.280130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:10.675608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:10.692889 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7e4df562-cb44-4316-84b4-f0bb389de3af tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1508 microversion: 2.1 time: 0.504986 Oct 29 21:03:10.708594 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2013/3907] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:10 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:10.730981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:10.731624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:10.740822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:10.753622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:10.754889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:10.756253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:10.760831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:10.761326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:10.762724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:10.765767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:10.774083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9f0ab2a-ddf6-40e8-bebe-893e68e669ea tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.527118 Oct 29 21:03:10.777789 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1895/3908] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:10 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:10.949373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:10.969253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92343563-3572-4f07-9fe4-f6721d5bfa65 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1266 microversion: 2.1 time: 0.252846 Oct 29 21:03:10.972823 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2014/3909] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:10 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:11.012735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c55c4fa7-e147-4b76-939a-9041d335af2c req-a1e050b0-3e5e-4cba-8b1d-4b87a2594a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9", "name": "network-vif-plugged", "status": "completed", "tag": "0227e57d-6aca-4a5d-a176-055e7f2e1d9d"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:11.035957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c55c4fa7-e147-4b76-939a-9041d335af2c req-a1e050b0-3e5e-4cba-8b1d-4b87a2594a74 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:11.037756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c55c4fa7-e147-4b76-939a-9041d335af2c req-a1e050b0-3e5e-4cba-8b1d-4b87a2594a74 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:11.039929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c55c4fa7-e147-4b76-939a-9041d335af2c req-a1e050b0-3e5e-4cba-8b1d-4b87a2594a74 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:11.077661 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c55c4fa7-e147-4b76-939a-9041d335af2c req-a1e050b0-3e5e-4cba-8b1d-4b87a2594a74 service nova] Creating event network-vif-plugged:0227e57d-6aca-4a5d-a176-055e7f2e1d9d for instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 on nch2-master-1 Oct 29 21:03:11.090612 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c55c4fa7-e147-4b76-939a-9041d335af2c req-a1e050b0-3e5e-4cba-8b1d-4b87a2594a74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083055 Oct 29 21:03:11.093010 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1896/3910] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:11.727840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:11.729220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:11.748599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:11.749983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:11.750861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:11.752379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:11.753244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:11.753769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:11.822984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:11.824332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:11.835098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:11.836000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:11.843959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:11.844758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:11.847260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:11.847967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:11.983749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:12.226632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:12.242492 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee3df598-5f50-4857-82de-7e5e6007ddb4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1508 microversion: 2.1 time: 0.523597 Oct 29 21:03:12.243759 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2015/3911] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:11 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:12.257561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:12.258511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:12.268271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:12.268984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:12.269652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:12.270563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:12.271205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:12.271835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:12.446432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:12.458033 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6a535e5f-3a63-4c44-8c40-ce09604b5399 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1316 microversion: 2.1 time: 0.662242 Oct 29 21:03:12.462453 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1897/3912] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:11 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:12.495500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:12.505300 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-27c0216a-fc84-4d37-9219-d2b772c5c657 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1266 microversion: 2.1 time: 0.259350 Oct 29 21:03:12.510351 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2016/3913] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:12 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:13.271189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:13.272481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:13.288576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.289199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.289548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.292810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.293519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.294156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.491970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:13.494858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:13.511426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.520829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.522479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.523568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.524765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.525981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.606006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:13.618121 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-477c6fa5-cd87-4094-b9f7-5bb07477ef70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1508 microversion: 2.1 time: 0.350746 Oct 29 21:03:13.618723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1898/3914] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:13 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:13.651730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:13.652592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:13.671255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.671754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.678247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.678938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.687595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.688576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.889108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:13.901050 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b966f6b1-93bd-430f-ab4e-21d6a38e95cd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1266 microversion: 2.1 time: 0.280282 Oct 29 21:03:13.906076 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1899/3915] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:13 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:13.913135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:13.915185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:13.932574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.933328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.934030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:13.934953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:13.935787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:13.936391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.121730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:14.131288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db01b3fd-6811-4d62-a6ce-80c0b686a9a7 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1502 microversion: 2.1 time: 0.646988 Oct 29 21:03:14.159957 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2017/3916] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:13 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1502 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:14.167270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:14.167687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:14.191781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.194518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.195153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.196050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.197953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'services' on Instance uuid 11aa593f-4fe8-472f-9f8a-3872b461a5f4 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:14.198157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.198456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.360891 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2bce38cf-9292-493a-be3d-d376abb1629a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.199323 Oct 29 21:03:14.361570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2018/3917] 10.222.0.36 () {58 vars in 1296 bytes} [Sat Oct 29 21:03:14 2022] DELETE /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9/os-server-password => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:14.375581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:14.376291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:14.389169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.389929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.392970 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c2e33df-40e6-41d2-8e81-8e3522551f75 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments/360b708f-faff-4312-b818-452b6e0d9153" status: 202 len: 0 microversion: 2.1 time: 0.485176 Oct 29 21:03:14.394125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.394884 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1900/3918] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:03:13 2022] DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments/360b708f-faff-4312-b818-452b6e0d9153 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:03:14.398458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.399038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.399504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.406995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:14.414789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:14.440195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.440806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.441491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.442263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.443311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.443834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.462175 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff17b9bd-764a-43b4-b5f7-5fcc19c124c6 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.090403 Oct 29 21:03:14.465991 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2019/3919] 10.222.0.36 () {58 vars in 1293 bytes} [Sat Oct 29 21:03:14 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9/os-server-password => generated 16 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 21:03:14.476128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:14.484386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:14.494503 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13dd64fd-85b3-4a4a-ba7d-d87e81d1edf2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093920 Oct 29 21:03:14.496101 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1901/3920] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:03:14 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:03:14.530330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.533071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.537134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.538812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.542610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.547001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.652363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:14.654017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:14.665873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.674511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.675913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:14.678396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.680134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.684027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.693628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.935220 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3358e6ca-a4d6-4c0f-8024-bdaf9226536e tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 204 len: 0 microversion: 2.1 time: 0.462823 Oct 29 21:03:14.939620 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2020/3921] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:14 2022] DELETE /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:03:14.953349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:14.954733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:14.981907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.983624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.984415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:14.985588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:14.986359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:14.987244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:15.418702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:15.434533 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5f67a59f-d402-4b38-9915-e0fd00dc3386 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1508 microversion: 2.1 time: 0.788951 Oct 29 21:03:15.435763 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1902/3922] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:14 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1508 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:15.444604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:15.447607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:15.467320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:15.472261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:15.472994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:15.474589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:15.478998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:15.479659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:15.552097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:15.577847 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-84acd4be-b793-422c-9828-f9ba36a48186 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 0.632785 Oct 29 21:03:15.579219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2021/3923] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:14 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:15.583698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:15.586006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:15.593298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:15.593932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:15.594379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:15.595098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:15.595558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:15.595991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:15.652136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:15.658548 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9faffcfa-0858-4f97-83fc-756a68a37aae tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078625 Oct 29 21:03:15.659142 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2022/3924] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:03:15 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:15.755967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:15.769356 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db7ff0eb-2359-4b7b-9b79-4d806a2c118a tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1508 microversion: 2.1 time: 0.329755 Oct 29 21:03:15.769968 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1903/3925] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:15 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:16.098684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7737d22a-51ad-4f77-9488-16bc893b9b71 req-7822261a-13ea-4f30-a602-dc6cd787294c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c44b4c-753e-4d71-b652-2ac9e04befcb", "name": "network-vif-deleted", "tag": "25e02b45-6c9a-42f1-8b30-3faab040a237"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:16.124485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7737d22a-51ad-4f77-9488-16bc893b9b71 req-7822261a-13ea-4f30-a602-dc6cd787294c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.126535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7737d22a-51ad-4f77-9488-16bc893b9b71 req-7822261a-13ea-4f30-a602-dc6cd787294c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.127446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7737d22a-51ad-4f77-9488-16bc893b9b71 req-7822261a-13ea-4f30-a602-dc6cd787294c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.157285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7737d22a-51ad-4f77-9488-16bc893b9b71 req-7822261a-13ea-4f30-a602-dc6cd787294c service nova] Creating event network-vif-deleted:25e02b45-6c9a-42f1-8b30-3faab040a237 for instance 90c44b4c-753e-4d71-b652-2ac9e04befcb on nch2-master-1 Oct 29 21:03:16.190279 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7737d22a-51ad-4f77-9488-16bc893b9b71 req-7822261a-13ea-4f30-a602-dc6cd787294c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095577 Oct 29 21:03:16.201495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2023/3926] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:16.458611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:16.459555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:16.489926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.490491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.491635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.499447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.501367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.502613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.612414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:16.615216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:16.627561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.629400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.631513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.631970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.632435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'fault' on Instance uuid 90c44b4c-753e-4d71-b652-2ac9e04befcb {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:16.644925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:16.648228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.649236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.654814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.655826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.656601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.784146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:16.793810 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87d0b396-fc6d-451a-8140-a407571cb1d7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 200 len: 1305 microversion: 2.1 time: 0.339082 Oct 29 21:03:16.794720 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1904/3927] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:16 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 1305 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:16.799646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:16.803116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:16.809890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.810645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.811253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.812171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.812863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.813638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.878765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec63ac72-ff45-446c-84f7-60ff3b76d788 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082881 Oct 29 21:03:16.879361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1905/3928] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:03:16 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:03:16.892156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:16.896751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:16.906923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.909598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.912019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:16.914266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:16.915113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:16.917167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.100424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:17.108804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-223a7aa8-99f6-4e65-9bd6-6778b6775c5b tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 0.506356 Oct 29 21:03:17.133070 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2024/3929] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:16 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:17.139621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:17.143417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:17.151465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.152444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.153152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.154149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.155103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.155765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.227140 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Cannot 'reboot' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action HTTP/1.1 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 28 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: {"reboot": {"type": "HARD"}} Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'reboot' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '30bafcee-4865-4929-842f-d5de12eed8cb', 'body': {'reboot': {'type': 'HARD'}}} Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30bafcee-4865-4929-842f-d5de12eed8cb in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:03:17.228961 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 409 to user: Cannot 'reboot' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:17.233953 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94dc50ad-12f8-499e-8bcf-b1a5b8e148f0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action" status: 409 len: 145 microversion: 2.1 time: 0.095884 Oct 29 21:03:17.242636 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2025/3930] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:03:17 2022] POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action => generated 145 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:03:17.249900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:17.252696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:17.270764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.271180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.271623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.278804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.279579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.280212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.314685 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Cannot 'rebuild' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action HTTP/1.1 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 65 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'rebuild' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '30bafcee-4865-4929-842f-d5de12eed8cb', 'body': {'rebuild': {'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7'}}} Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30bafcee-4865-4929-842f-d5de12eed8cb in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:03:17.316651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued Oct 29 21:03:17.321366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.333398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 409 to user: Cannot 'rebuild' instance 30bafcee-4865-4929-842f-d5de12eed8cb while it is in vm_state rescued {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:17.333398 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b37813e9-0ce8-4ff0-be9f-c513d2c188e2 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action" status: 409 len: 146 microversion: 2.1 time: 0.083385 Oct 29 21:03:17.334115 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2026/3931] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:03:17 2022] POST /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb/action => generated 146 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:03:17.345791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:17.346705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:17.355229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.356830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.357564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.358765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.359513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.361027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.397890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:17.514355 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8bb5d93-da7d-40a9-b74a-465fd0d146ab tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 204 len: 0 microversion: 2.1 time: 0.178405 Oct 29 21:03:17.515607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2027/3932] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:17 2022] DELETE /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:17.529693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:17.531368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:17.539840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.541330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.542077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.543098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.544720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.545435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.581923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:17.593511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ac65adb-3de9-4734-97a7-c9f4adffcf32 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1508 microversion: 2.1 time: 0.709727 Oct 29 21:03:17.594123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1906/3933] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:16 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1508 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:17.821310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:17.822036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:17.828681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.829648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.830310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.831507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:17.834101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:17.837250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:17.839481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:17.849715 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9c10cca9-fb1e-48de-aecd-7baabfd5dd68 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1689 microversion: 2.1 time: 0.327343 Oct 29 21:03:17.850315 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2028/3934] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:17 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1689 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:17.858510 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb HTTP/1.1 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '90c44b4c-753e-4d71-b652-2ac9e04befcb'} Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:17.860442 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:03:17.865248 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:17.872044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:17.872928 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca01e729-97e2-4f96-82ec-defbbe36da80 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 404 len: 111 microversion: 2.1 time: 0.055859 Oct 29 21:03:17.873528 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1907/3935] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:17 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:03:18.034301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1232289465", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:18.097671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:03:18.141492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:18.142683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:18.151549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:18.152767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:18.154163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:18.155156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:18.155946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:18.156594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:18.457715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:18.495309 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a0a86323-bcbe-4731-8f94-3c9c234bac6d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 0.358615 Oct 29 21:03:18.506593 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1908/3936] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:18 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:18.623369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:18.624974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:18.645499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:18.648125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:18.648802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:18.651001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:18.654203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:18.654668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:18.711135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:19.174128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:19.192886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8bb70dc6-6670-4146-8df1-c3b9bfb6888b tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1508 microversion: 2.1 time: 0.572429 Oct 29 21:03:19.196074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1909/3937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:18 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1508 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:19.201653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:19.204896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:19.220481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.224718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.225343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.227669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.231048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.231605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.333269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:19.430001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:19.431147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:19.432024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:19.433399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:19.434125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:19.449616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.451015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.451641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.452677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.453504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.454739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.491600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:19.496954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:19.503544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-086d26bb-2eb8-4c1b-bdfe-7bb23473e777 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1689 microversion: 2.1 time: 0.305594 Oct 29 21:03:19.507573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1910/3938] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:19 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1689 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:19.509043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:19.527310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cb1fc595-11c5-4357-87df-b838e1bd0108 req-5af4e3ca-fde7-465b-baa2-8f28b2801179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9", "name": "network-vif-deleted", "tag": "0227e57d-6aca-4a5d-a176-055e7f2e1d9d"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:19.529100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:19.532572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:19.543599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cb1fc595-11c5-4357-87df-b838e1bd0108 req-5af4e3ca-fde7-465b-baa2-8f28b2801179 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.545220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cb1fc595-11c5-4357-87df-b838e1bd0108 req-5af4e3ca-fde7-465b-baa2-8f28b2801179 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.545792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cb1fc595-11c5-4357-87df-b838e1bd0108 req-5af4e3ca-fde7-465b-baa2-8f28b2801179 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.576055 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cb1fc595-11c5-4357-87df-b838e1bd0108 req-5af4e3ca-fde7-465b-baa2-8f28b2801179 service nova] Creating event network-vif-deleted:0227e57d-6aca-4a5d-a176-055e7f2e1d9d for instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 on nch2-master-1 Oct 29 21:03:19.587828 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cb1fc595-11c5-4357-87df-b838e1bd0108 req-5af4e3ca-fde7-465b-baa2-8f28b2801179 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078570 Oct 29 21:03:19.589010 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1911/3939] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:19.608331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:19.609063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:19.630139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.631420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06911853-a3e7-46d7-b865-bd7218be592e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601876 Oct 29 21:03:19.631927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.632402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.634035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2029/3940] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:03:19.635120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:19.635612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:19.636116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:19.649812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-745a3dae-b917-40ae-b75f-10d20065e798 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:19.651634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-745a3dae-b917-40ae-b75f-10d20065e798 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:19.873291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-745a3dae-b917-40ae-b75f-10d20065e798 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:19.885923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-745a3dae-b917-40ae-b75f-10d20065e798 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1215 microversion: 2.1 time: 0.244016 Oct 29 21:03:19.887402 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2030/3941] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:19 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:20.017853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:20.027209 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4a4b098b-75fe-4a6f-a58c-3faa30736620 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 0.430039 Oct 29 21:03:20.041663 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1912/3942] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:19 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:20.223990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:20.224772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:20.247748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:20.248378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:20.252537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:20.255434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:20.256828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:20.258709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:20.438414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6288cab8f247d3835b882fca1c0054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7392e793031e40e2b67155a93af93ecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:20.465755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0d63f33-fc2b-4a85-acdb-f5a49e8e85ee tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 200 len: 1466 microversion: 2.1 time: 0.243737 Oct 29 21:03:20.467338 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2031/3943] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:20 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 1466 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:20.533677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:20.534538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:20.546028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:20.548183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:20.548809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:20.551697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:20.552356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:20.554884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:20.722007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96959df4-20cf-4b20-b26c-558e0522807b tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Action: 'create', calling method: .version_select at 0x7fa1762804c0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:20.757406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96959df4-20cf-4b20-b26c-558e0522807b tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Getting quotas for project 1aae66faf0914cd895527e7de0b135b5. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:20.769689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96959df4-20cf-4b20-b26c-558e0522807b tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Getting quotas for user 34d57d3b668c4cc182d86bd40ba5856c and project 1aae66faf0914cd895527e7de0b135b5. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:20.913321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:20.931261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96959df4-20cf-4b20-b26c-558e0522807b tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Getting quotas for project 1aae66faf0914cd895527e7de0b135b5. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:20.944946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-96959df4-20cf-4b20-b26c-558e0522807b tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Getting quotas for user 34d57d3b668c4cc182d86bd40ba5856c and project 1aae66faf0914cd895527e7de0b135b5. Resources: {'server_groups'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:20.955069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:20.973411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7370ac6b-bbe4-4282-b9f0-eeef561b0a36 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1689 microversion: 2.1 time: 0.444577 Oct 29 21:03:20.992883 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2032/3944] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:20 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1689 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:21.002387 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96959df4-20cf-4b20-b26c-558e0522807b tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.544242 Oct 29 21:03:21.008156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:21.009294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:21.010067 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1913/3945] 10.222.0.36 () {62 vars in 1214 bytes} [Sat Oct 29 21:03:20 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:03:21.018878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:21.020670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:21.021220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db8ff397-4d58-4dd3-a7f6-ec71d9a29156 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:21.021600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:21.022963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:21.038079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:21.041139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:21.078127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db8ff397-4d58-4dd3-a7f6-ec71d9a29156 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.066771 Oct 29 21:03:21.078720 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1914/3946] 10.222.0.36 () {60 vars in 1193 bytes} [Sat Oct 29 21:03:21 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:03:21.090479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:21.104915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:21.117934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:21.122970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:21.123594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:21.129325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:21.129994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:21.130537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:22.186035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:22.206307 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fbc11a4b-e736-4978-86ca-d9ac88922c99 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1211 microversion: 2.1 time: 1.210175 Oct 29 21:03:22.209290 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2033/3947] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:20 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1211 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:22.217250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ce41173-e112-4ff1-8e1c-4ff6500383f5 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:22.258217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ce41173-e112-4ff1-8e1c-4ff6500383f5 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda" status: 200 len: 235 microversion: 2.64 time: 0.047693 Oct 29 21:03:22.258804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2034/3948] 10.222.0.36 () {60 vars in 1304 bytes} [Sat Oct 29 21:03:22 2022] GET /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda => generated 235 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:03:22.269915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:22.270760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] [instance: 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:22.286722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:22.288640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:22.289517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:22.293912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:22.295038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:22.297399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:22.316997 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] HTTP exception thrown: Instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 could not be found. Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Request method failure captured: Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 HTTP/1.1 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT8alpe8pDmINvfqxVhqg_1lLtv5myngeMXxbFpAe3vzAldYk8y27UrdFYLS0vQk2OSXWerCrpO09u3Gnd4NIkG2VlJMPELHvkl09oKLvmiie_q-l2NIrSK9h3r27pMBasnQyVvjEXlMw7nTt1Y-KVmInb8ARgmhP7QlItsGYZYiOQ Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 7392e793031e40e2b67155a93af93ecb Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerPasswordTestJSON-1110110899 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7392e793031e40e2b67155a93af93ecb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7392e793031e40e2b67155a93af93ecb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7392e793031e40e2b67155a93af93ecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7392e793031e40e2b67155a93af93ecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerPasswordTestJSON-1110110899 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 7392e793031e40e2b67155a93af93ecb Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1110110899 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerPasswordTestJSON-1110110899-project Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 2d6288cab8f247d3835b882fca1c0054 Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerPasswordTestJSON-1110110899-project Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 could not be found. Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9'} Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 could not be found. Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 could not be found. Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:22.320321 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 could not be found. Oct 29 21:03:22.327723 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.335758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] Returning 404 to user: Instance 00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:22.337529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-544149aa-d18d-4d7e-a7ba-c3cfe5db19d1 tempest-ServerPasswordTestJSON-1110110899 tempest-ServerPasswordTestJSON-1110110899-project] 10.222.0.36 "GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9" status: 404 len: 111 microversion: 2.1 time: 0.072539 Oct 29 21:03:22.338441 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2035/3949] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:22 2022] GET /compute/v2.1/servers/00dfe92c-a1fb-40fe-ae89-9b4e047c9cd9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:03:22.344532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3c8f392f-462f-4ff9-a3f4-9905dbf5255e req-770f03ca-20cc-47c3-85ba-56a4bc205972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0de1b1b-a7f2-4a5b-af3a-70a50512b706", "tag": "6f51a070-8cbe-46df-a715-a482955b9319"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:22.375588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8f392f-462f-4ff9-a3f4-9905dbf5255e req-770f03ca-20cc-47c3-85ba-56a4bc205972 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:22.379909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8f392f-462f-4ff9-a3f4-9905dbf5255e req-770f03ca-20cc-47c3-85ba-56a4bc205972 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:22.380612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8f392f-462f-4ff9-a3f4-9905dbf5255e req-770f03ca-20cc-47c3-85ba-56a4bc205972 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:22.406655 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3c8f392f-462f-4ff9-a3f4-9905dbf5255e req-770f03ca-20cc-47c3-85ba-56a4bc205972 service nova] Creating event network-changed:6f51a070-8cbe-46df-a715-a482955b9319 for instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 on nch1-master-1 Oct 29 21:03:22.418237 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3c8f392f-462f-4ff9-a3f4-9905dbf5255e req-770f03ca-20cc-47c3-85ba-56a4bc205972 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078244 Oct 29 21:03:22.419420 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2036/3950] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:22.426939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:22.427897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:22.435743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:22.436625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:22.437275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:22.438202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:22.439315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:22.439927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:22.735549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:22.762697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-887d1a87-3161-4d21-bdab-22159e2359b0 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1689 microversion: 2.1 time: 0.341826 Oct 29 21:03:22.766084 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2037/3951] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:22 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1689 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:22.784010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72f4c003-7f5f-40a8-afc0-2cc48f5b6222 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:22.828687 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72f4c003-7f5f-40a8-afc0-2cc48f5b6222 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda" status: 204 len: 0 microversion: 2.64 time: 0.058360 Oct 29 21:03:22.829844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2038/3952] 10.222.0.36 () {60 vars in 1307 bytes} [Sat Oct 29 21:03:22 2022] DELETE /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:03:22.840798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-963b083f-e971-4773-ace4-480d3a68f243 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:22.880105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-963b083f-e971-4773-ace4-480d3a68f243 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] HTTP exception thrown: Instance group c2af284c-bc23-48fa-afc3-784381bebdda could not be found. Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-963b083f-e971-4773-ace4-480d3a68f243 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Request method failure captured: Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda HTTP/1.1 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUYRNK-uAD8GKMmSpiiMGNNe-74UvI6HgR3dAakjl8yUePaO85aE3msbEVP1iN-dBm8g3Rpq4WZ2cllI6mqg-CyxS08ofxzHB6UP2m9pmj_HPKhP5Qtc-v2u8pixVO8KQiL3gk0acz5GoJJFFxg4n2GCOuQuUl6GGux-hvf-wMGS8Y Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.64 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 1aae66faf0914cd895527e7de0b135b5 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerGroup264TestJSON-1639423517 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1aae66faf0914cd895527e7de0b135b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1aae66faf0914cd895527e7de0b135b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1aae66faf0914cd895527e7de0b135b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1aae66faf0914cd895527e7de0b135b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerGroup264TestJSON-1639423517 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 1aae66faf0914cd895527e7de0b135b5 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1639423517 Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerGroup264TestJSON-1639423517-project Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 34d57d3b668c4cc182d86bd40ba5856c Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerGroup264TestJSON-1639423517-project Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance group c2af284c-bc23-48fa-afc3-784381bebdda could not be found. Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c2af284c-bc23-48fa-afc3-784381bebdda'} Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c2af284c-bc23-48fa-afc3-784381bebdda could not be found. Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c2af284c-bc23-48fa-afc3-784381bebdda could not be found. Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.882998 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:22.890520 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:22.890520 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:22.890520 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:22.890520 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:22.890520 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c2af284c-bc23-48fa-afc3-784381bebdda could not be found. Oct 29 21:03:22.890520 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:22.892483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-963b083f-e971-4773-ace4-480d3a68f243 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] Returning 404 to user: Instance group c2af284c-bc23-48fa-afc3-784381bebdda could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:22.901116 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-963b083f-e971-4773-ace4-480d3a68f243 tempest-ServerGroup264TestJSON-1639423517 tempest-ServerGroup264TestJSON-1639423517-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda" status: 404 len: 117 microversion: 2.64 time: 0.057838 Oct 29 21:03:22.903904 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2039/3953] 10.222.0.36 () {60 vars in 1307 bytes} [Sat Oct 29 21:03:22 2022] DELETE /compute/v2.1/os-server-groups/c2af284c-bc23-48fa-afc3-784381bebdda => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:03:23.297737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:23.311381 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff66135c-81ba-4a8c-8fe7-d1cc70a658e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 2.224658 Oct 29 21:03:23.314445 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1915/3954] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:21 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:23.318982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1163384325", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "98c33bc7-a28d-4b72-9f57-0704218c3e2e"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:23.333963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:23.334590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:23.356176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:23.356608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:23.357256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:23.358009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:23.358470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:23.358906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:23.408904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] validate_networks() for [('98c33bc7-a28d-4b72-9f57-0704218c3e2e', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:03:23.540225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:23.551235 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b4ae07c2-4a31-4bac-92f1-d172c0d4f910 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1273 microversion: 2.1 time: 0.234257 Oct 29 21:03:23.552449 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1916/3955] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:23 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:23.790101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:23.791513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:23.807702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:23.808374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:23.808968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:23.809852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:23.810435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:23.810981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:25.004172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:25.025900 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb401545-40a7-4945-b75a-fdf7f1a56677 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1689 microversion: 2.1 time: 1.231656 Oct 29 21:03:25.027730 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1917/3956] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:23 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1689 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:25.032625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:25.045900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:25.064507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:25.065154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:25.065907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:25.075230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:25.076646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:25.078931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:26.354196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:26.365692 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a034cce-31c9-42e0-811f-2e18b2e31aa1 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 1.336698 Oct 29 21:03:26.386464 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1918/3957] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:25 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:26.392808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:26.401608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:26.419193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:26.420025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:26.420656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:26.421645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:26.422123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:26.422571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:26.766249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:26.766872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:26.768183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:26.769991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:26.777736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:26.830625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:26.839234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:26.842110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:26.843063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:26.843786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:26.844464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:26.900637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Getting quotas for project a132bbc7ac614352935b11096f132071. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:26.921356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Getting quotas for user c02182ffa1ec4555b0055cfc38dc3827 and project a132bbc7ac614352935b11096f132071. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:26.959020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:26.969809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:27.052566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:27.108475 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1853a6f5-e095-4d60-a34d-aca3271ef09a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.929601 Oct 29 21:03:27.115276 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2040/3958] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:03:27.116945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:27.117601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:27.139599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:27.140114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:27.140567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:27.141290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:27.150995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:27.151848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:27.243130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:27.244187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:27.244835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:27.245532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'fault' on Instance uuid 11aa593f-4fe8-472f-9f8a-3872b461a5f4 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:27.394752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:27.410498 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6537143-e527-4e17-9474-e3dbd6eea1c1 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 200 len: 1335 microversion: 2.1 time: 0.299898 Oct 29 21:03:27.411963 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2041/3959] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:27 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 1335 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:27.417531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5a7aab09-b5e6-4d0c-a618-98513ff144e6 req-f17df3a0-cb18-4018-84a0-c3122577c276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11aa593f-4fe8-472f-9f8a-3872b461a5f4", "name": "network-vif-deleted", "tag": "bf3132a9-fca7-4a6c-8fbe-cea150ab2741"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:27.457371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5a7aab09-b5e6-4d0c-a618-98513ff144e6 req-f17df3a0-cb18-4018-84a0-c3122577c276 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:27.458174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5a7aab09-b5e6-4d0c-a618-98513ff144e6 req-f17df3a0-cb18-4018-84a0-c3122577c276 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:27.458796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5a7aab09-b5e6-4d0c-a618-98513ff144e6 req-f17df3a0-cb18-4018-84a0-c3122577c276 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:27.507866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5a7aab09-b5e6-4d0c-a618-98513ff144e6 req-f17df3a0-cb18-4018-84a0-c3122577c276 service nova] Creating event network-vif-deleted:bf3132a9-fca7-4a6c-8fbe-cea150ab2741 for instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 on nch2-master-1 Oct 29 21:03:27.513182 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5a7aab09-b5e6-4d0c-a618-98513ff144e6 req-f17df3a0-cb18-4018-84a0-c3122577c276 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099744 Oct 29 21:03:27.514059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2042/3960] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:27.530167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8480534-c876-4c18-8aea-ce8979efd91f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:27.530861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8480534-c876-4c18-8aea-ce8979efd91f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:27.761799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8480534-c876-4c18-8aea-ce8979efd91f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:27.771335 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8480534-c876-4c18-8aea-ce8979efd91f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1225 microversion: 2.1 time: 0.255627 Oct 29 21:03:27.775648 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2043/3961] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:27 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1225 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:27.782497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:27.784029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:27.795129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:27.795975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:27.797519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:27.798515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:27.799503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:27.801056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:27.926013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:27.939859 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d41150c-4af0-48ce-9dd1-0f4086c23575 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 1.549332 Oct 29 21:03:27.940814 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1919/3962] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:26 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:28.443776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:28.444769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 11aa593f-4fe8-472f-9f8a-3872b461a5f4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:28.462284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:28.473559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:28.474485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:28.477628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:28.485591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:28.486931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:28.550593 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 could not be found. Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 HTTP/1.1 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 could not be found. Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '11aa593f-4fe8-472f-9f8a-3872b461a5f4'} Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 could not be found. Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 could not be found. Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:28.553133 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 could not be found. Oct 29 21:03:28.559990 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:28.576581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 404 to user: Instance 11aa593f-4fe8-472f-9f8a-3872b461a5f4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:28.580154 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2b1a976-ff94-44da-a4e5-7455658e45d5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4" status: 404 len: 111 microversion: 2.1 time: 0.143627 Oct 29 21:03:28.583603 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1920/3963] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:28 2022] GET /compute/v2.1/servers/11aa593f-4fe8-472f-9f8a-3872b461a5f4 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:03:28.594406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea4c8d33-e1f5-4706-810e-58cf1c2ddebd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '.version_select at 0x7fa170f3f790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:28.649771 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea4c8d33-e1f5-4706-810e-58cf1c2ddebd tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620558044" status: 202 len: 0 microversion: 2.1 time: 0.061352 Oct 29 21:03:28.652784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1921/3964] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620558044 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:03:28.798235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:28.799567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:28.815470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:28.819569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:28.820317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:28.821364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:28.824278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:28.824984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:28.859287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:28.871555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-864418aa-4634-4502-9c69-4d0912b92088 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 1.093996 Oct 29 21:03:28.874942 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2044/3965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:27 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:28.969132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:28.970168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:28.983376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:28.984221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:28.984910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:28.986033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:28.987401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:28.990507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:29.390963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:29.406700 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-70e2b791-4b3d-488d-9685-541b555e58dd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1221 microversion: 2.1 time: 0.613915 Oct 29 21:03:29.407622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1922/3966] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:28 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1221 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:29.896551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:29.897939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:29.911574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:29.920623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:29.921663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:29.925147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:29.929395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:29.930374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:30.255140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:30.276423 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62141956-9e06-4e17-8829-713501e3431a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 1.312495 Oct 29 21:03:30.280731 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2045/3967] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:28 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:30.432871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:30.433490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:30.445946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:30.446447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:30.447436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:30.448144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:30.448601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:30.449034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:30.976212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:31.179980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:31.201156 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26ebf545-b5f1-4d1e-a12a-297523bbcfac tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1283 microversion: 2.1 time: 0.772283 Oct 29 21:03:31.203597 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2046/3968] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:30 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1283 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:31.309272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:31.309945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:31.318814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:31.319311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:31.319761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:31.320484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:31.320945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:31.321380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:31.337359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:31.748831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:31.759876 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-089eb178-f594-4343-a4e9-122d09e50e96 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 1.867387 Oct 29 21:03:31.760480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1923/3969] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:29 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:31.778668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f0150a9b-ae75-4997-9b7a-d41605da1c96 req-0d276ef4-d51a-4c12-8ddd-c230fb6f8068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9675b6-7c57-4107-987d-c6f581c3d43a", "tag": "b3a610ed-fd90-4265-a0db-34cd10af6516"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:31.792327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f0150a9b-ae75-4997-9b7a-d41605da1c96 req-0d276ef4-d51a-4c12-8ddd-c230fb6f8068 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:31.792923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f0150a9b-ae75-4997-9b7a-d41605da1c96 req-0d276ef4-d51a-4c12-8ddd-c230fb6f8068 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:31.793590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f0150a9b-ae75-4997-9b7a-d41605da1c96 req-0d276ef4-d51a-4c12-8ddd-c230fb6f8068 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:31.822409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f0150a9b-ae75-4997-9b7a-d41605da1c96 req-0d276ef4-d51a-4c12-8ddd-c230fb6f8068 service nova] Creating event network-changed:b3a610ed-fd90-4265-a0db-34cd10af6516 for instance ca9675b6-7c57-4107-987d-c6f581c3d43a on nch2-master-1 Oct 29 21:03:31.832329 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f0150a9b-ae75-4997-9b7a-d41605da1c96 req-0d276ef4-d51a-4c12-8ddd-c230fb6f8068 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057966 Oct 29 21:03:31.832954 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1924/3970] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:32.025863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a8d24644-e89b-4090-b79b-856f0240e8a6 req-2d3c802d-f5c3-4e03-97e7-097fd7b43116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0de1b1b-a7f2-4a5b-af3a-70a50512b706", "name": "network-vif-plugged", "status": "completed", "tag": "6f51a070-8cbe-46df-a715-a482955b9319"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:32.037740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a8d24644-e89b-4090-b79b-856f0240e8a6 req-2d3c802d-f5c3-4e03-97e7-097fd7b43116 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:32.038883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a8d24644-e89b-4090-b79b-856f0240e8a6 req-2d3c802d-f5c3-4e03-97e7-097fd7b43116 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:32.039904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a8d24644-e89b-4090-b79b-856f0240e8a6 req-2d3c802d-f5c3-4e03-97e7-097fd7b43116 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:32.052760 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a8d24644-e89b-4090-b79b-856f0240e8a6 req-2d3c802d-f5c3-4e03-97e7-097fd7b43116 service nova] Creating event network-vif-plugged:6f51a070-8cbe-46df-a715-a482955b9319 for instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 on nch1-master-1 Oct 29 21:03:32.058376 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a8d24644-e89b-4090-b79b-856f0240e8a6 req-2d3c802d-f5c3-4e03-97e7-097fd7b43116 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038101 Oct 29 21:03:32.059347 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1925/3971] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:03:32.228519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:32.229232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:32.236782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:32.237288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:32.237751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:32.242372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:32.242857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:32.246573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:32.289937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:32.303387 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59eaf776-bacb-4b07-9c03-f23bf70f7f7c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 0.998899 Oct 29 21:03:32.317906 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2047/3972] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:31 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:32.771657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:32.789856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:32.791531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:32.804902 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ba5d634b-059b-48b2-bc5a-392490fc109e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.577321 Oct 29 21:03:32.805636 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1926/3973] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:32 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:32.831112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:32.834688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:32.835393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:32.837797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:32.838514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:32.842358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:33.327893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:33.328547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:33.342557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:33.343067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:33.343519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:33.344245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:33.344707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:33.345142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:33.416009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:33.862323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:33.886782 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00242f9f-70de-4edb-828b-c4e9f5d89051 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1308 microversion: 2.1 time: 1.104419 Oct 29 21:03:33.888321 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2048/3974] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:32 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1308 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:33.893680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:33.894587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:33.916651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:33.917556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:33.918012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:33.919972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:33.920461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:33.938382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:34.538213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:34.551321 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-818c7c37-969a-4e9a-a850-22090a56d7b2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 1.227152 Oct 29 21:03:34.552623 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1927/3975] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:33 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:34.917436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:34.920540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:34.932594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:34.933443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:34.936671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:34.937583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:34.938166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:34.939157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:34.963162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:35.008034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3bbf5d60-30e0-46eb-87b5-35e892be0fff tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 1.116615 Oct 29 21:03:35.021745 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2049/3976] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:33 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:35.361707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a863c9a4-b338-4f03-aeeb-eb8571a7ead0 req-11ef58a1-bbac-4f20-9884-11c36153da6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80bf941-937a-44d7-a246-a10c9fa24efa", "tag": "5750ec1d-cf82-4eb8-bec4-03cd56b9fa49"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:35.405000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a863c9a4-b338-4f03-aeeb-eb8571a7ead0 req-11ef58a1-bbac-4f20-9884-11c36153da6e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.407739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a863c9a4-b338-4f03-aeeb-eb8571a7ead0 req-11ef58a1-bbac-4f20-9884-11c36153da6e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.409768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a863c9a4-b338-4f03-aeeb-eb8571a7ead0 req-11ef58a1-bbac-4f20-9884-11c36153da6e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:35.478666 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a863c9a4-b338-4f03-aeeb-eb8571a7ead0 req-11ef58a1-bbac-4f20-9884-11c36153da6e service nova] Creating event network-changed:5750ec1d-cf82-4eb8-bec4-03cd56b9fa49 for instance a80bf941-937a-44d7-a246-a10c9fa24efa on nch2-master-1 Oct 29 21:03:35.500326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a863c9a4-b338-4f03-aeeb-eb8571a7ead0 req-11ef58a1-bbac-4f20-9884-11c36153da6e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144778 Oct 29 21:03:35.510738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2050/3977] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:35.577588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:35.578745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:35.597036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.597821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.598590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:35.600046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.600884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.602013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:35.602378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:35.614819 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f187cb6e-3018-4ce3-915e-3f06345f0dd0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1490 microversion: 2.1 time: 0.706018 Oct 29 21:03:35.631227 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1928/3978] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:34 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1490 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:35.643401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1991807335"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:35.646373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:35.659736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.660752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.661737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:35.662822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.663513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.664173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:35.794606 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c90b4751-f12e-432d-af6f-02d1787cd230 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "PUT /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1076 microversion: 2.1 time: 0.156930 Oct 29 21:03:35.810711 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1929/3979] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:03:35 2022] PUT /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1076 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:35.839797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:35.844454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:35.860717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.861621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.864694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:35.865773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:35.866489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:35.867165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:36.535202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:36.571364 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6911331-e4e5-4b16-8ef0-5fddc44247e3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 0.994118 Oct 29 21:03:36.572320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2051/3980] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:35 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:36.606701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:36.625260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:36.659049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:36.663638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:36.664380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:36.666059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:36.666563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:36.667005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:36.879246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:37.072151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:37.083347 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d5cfc606-b760-40b4-8e30-eadfa32f10d7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1502 microversion: 2.1 time: 1.264615 Oct 29 21:03:37.086262 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1930/3981] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:35 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1502 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:37.204830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:37.224901 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87706df5-f312-43e8-8936-73d909a265b9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.623175 Oct 29 21:03:37.226188 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2052/3982] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:36 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:37.231789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:37.232650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:37.241373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.242179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.243290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:37.245019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.245850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.246495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:37.499871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:37.510515 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c44665a-b7bb-4019-9894-b884c8e3cded tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1502 microversion: 2.1 time: 0.282851 Oct 29 21:03:37.511104 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2053/3983] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:37 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1502 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:37.520946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:37.521474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:37.534583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.540193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.542444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:37.543631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.544659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.554863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:37.606332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:37.726736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5214ffba-6837-4f60-a4cd-d97cec9dca38 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'create', calling method: .version_select at 0x7fa170c2b5e0>, body: {"keypair": {"name": "tempest-keypair-552241776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZJ9QExl+ynBoqednHT6uuPsPZAtEBxBEJdMBcd6hcVwsUdBj4B1+ctgnFgXkVVnLmI4QJmDJf+uFSXDL+BlSqzmed+GT9NoK5i8dN/fqp4MTK2iUxZC3xB37A4m7uHAw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:37.758636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-5214ffba-6837-4f60-a4cd-d97cec9dca38 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:37.768163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-5214ffba-6837-4f60-a4cd-d97cec9dca38 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for user c35b0dd86eb14cbbab1732cc96ab2573 and project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:37.775223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=16 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:37.826018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5214ffba-6837-4f60-a4cd-d97cec9dca38 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.717676 Oct 29 21:03:37.827126 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1931/3984] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:03:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:37.842524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b510948-4f2f-4aeb-ae98-6eb639d858e5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:37.847040 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1f9e5aa5-ed6c-4d89-a061-536fe26c1822 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "DELETE /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 204 len: 0 microversion: 2.1 time: 0.332262 Oct 29 21:03:37.849864 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2054/3985] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:37 2022] DELETE /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:37.853275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b510948-4f2f-4aeb-ae98-6eb639d858e5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.854058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b510948-4f2f-4aeb-ae98-6eb639d858e5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.854669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b510948-4f2f-4aeb-ae98-6eb639d858e5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:37.873392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:37.874215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:37.895386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b510948-4f2f-4aeb-ae98-6eb639d858e5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Going to try to stop instance {{(pid=138884) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:03:37.903856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.904369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.904818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:37.905586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:37.924327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:37.925399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:38.018174 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b510948-4f2f-4aeb-ae98-6eb639d858e5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "POST /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706/action" status: 202 len: 0 microversion: 2.1 time: 0.174746 Oct 29 21:03:38.020661 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1932/3986] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:03:37 2022] POST /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:03:38.039222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:38.039934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:38.060001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:38.064519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:38.064519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:38.064519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:38.064519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:38.064519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:38.707419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:38.726185 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-47798cfd-d265-465f-b247-7f1eb0d0cc5e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1507 microversion: 2.1 time: 0.702205 Oct 29 21:03:38.728088 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1933/3987] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:38 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:38.743619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:38.745088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:38.747546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:38.756171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acb1e424-9935-419f-8465-a707aaffb0c8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 0.903168 Oct 29 21:03:38.762190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:38.763011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:38.763728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:38.770259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:38.770953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:38.771250 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2055/3988] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:37 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:38.773549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:38.781261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:38.782319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:38.788951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:38.789785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:38.790434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:38.791545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:38.792178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:38.792779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:39.085159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:39.099874 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87163dd3-71f3-4fb7-8803-60ad9a55f955 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.370601 Oct 29 21:03:39.101317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1934/3989] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:38 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:39.265130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:39.276499 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ac893ec-1446-4691-9d91-30a31adb7a8e tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.503986 Oct 29 21:03:39.280340 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2056/3990] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:38 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:39.654957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-242870d4-8de5-4966-9598-45079b85ccfe req-0817ea0d-df8b-4f8d-a050-13a444bf8547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9675b6-7c57-4107-987d-c6f581c3d43a", "name": "network-vif-plugged", "status": "completed", "tag": "b3a610ed-fd90-4265-a0db-34cd10af6516"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:39.688911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-242870d4-8de5-4966-9598-45079b85ccfe req-0817ea0d-df8b-4f8d-a050-13a444bf8547 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:39.691377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-242870d4-8de5-4966-9598-45079b85ccfe req-0817ea0d-df8b-4f8d-a050-13a444bf8547 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:39.692698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-242870d4-8de5-4966-9598-45079b85ccfe req-0817ea0d-df8b-4f8d-a050-13a444bf8547 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:39.734082 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-242870d4-8de5-4966-9598-45079b85ccfe req-0817ea0d-df8b-4f8d-a050-13a444bf8547 service nova] Creating event network-vif-plugged:b3a610ed-fd90-4265-a0db-34cd10af6516 for instance ca9675b6-7c57-4107-987d-c6f581c3d43a on nch2-master-1 Oct 29 21:03:39.749302 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-242870d4-8de5-4966-9598-45079b85ccfe req-0817ea0d-df8b-4f8d-a050-13a444bf8547 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099033 Oct 29 21:03:39.753415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:39.754163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:39.754820 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1935/3991] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:39.791490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:39.793248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:39.797230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:39.800212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:39.802238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:39.810615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:39.811127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:39.817143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:39.830246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:39.831231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:39.834828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:39.837996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:39.838788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:39.840703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:40.729640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:40.738812 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb80838c-21d2-4a78-97ae-642cc16fc664 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1507 microversion: 2.1 time: 0.990182 Oct 29 21:03:40.742765 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2057/3992] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:39 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1507 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:40.760427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:40.761807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:40.770632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:40.777801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:40.779794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:40.780669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:40.788637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:40.789338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:40.820753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:40.831220 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-71fe55b9-9f69-42b4-b5ad-c2237514dd96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 1.049750 Oct 29 21:03:40.842658 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1936/3993] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:39 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:40.859892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:40.860679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:40.884097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:40.894359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:40.894978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:40.896099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:40.896712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:40.897243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:41.490094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:41.499006 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-33f9bbe9-5df5-4ab6-876c-302d29ce80b5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.753881 Oct 29 21:03:41.522376 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2058/3994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:40 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:41.531916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:41.546422 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9caa2dcb-c28b-4a79-bc31-8c0b7849f24b tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.702079 Oct 29 21:03:41.546865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1937/3995] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:40 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:41.771403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:41.772097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:41.806110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:41.807295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:41.809415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:41.811316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:41.812929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:41.813753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:41.875759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:41.876576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:41.896406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:41.899193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:41.900470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:41.901327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:41.910952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:41.914270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:42.448530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:42.459186 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8acddf47-fef5-4c4d-9232-9d83c13e9394 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1507 microversion: 2.1 time: 0.694003 Oct 29 21:03:42.465673 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2059/3996] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:41 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1507 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:42.532294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:42.533371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:42.546845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:42.549976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:42.552573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:42.562697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:42.570255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:42.571135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:42.750584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:42.779364 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e993a07-a2c0-4c39-914a-8433dc440343 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1315 microversion: 2.1 time: 0.908152 Oct 29 21:03:42.785681 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1938/3997] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:41 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:42.806248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:42.814450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:42.827202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:42.830064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:42.834109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:42.838570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:42.839399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:42.840095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:43.044364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:43.055900 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4ed0214-62c8-4441-b997-7cc02d2cf658 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.531018 Oct 29 21:03:43.056513 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2060/3998] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:42 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:43.088228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e28efb58-6f47-4bb0-97c2-36d0fe8b4466 req-e92c743d-5d0b-4f65-84cd-a2da371243a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bafcee-4865-4929-842f-d5de12eed8cb", "name": "network-vif-deleted", "tag": "c43c74eb-a41f-4f9c-8123-f6fa9262b1b9"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:43.139750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e28efb58-6f47-4bb0-97c2-36d0fe8b4466 req-e92c743d-5d0b-4f65-84cd-a2da371243a6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:43.142530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e28efb58-6f47-4bb0-97c2-36d0fe8b4466 req-e92c743d-5d0b-4f65-84cd-a2da371243a6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:43.145907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e28efb58-6f47-4bb0-97c2-36d0fe8b4466 req-e92c743d-5d0b-4f65-84cd-a2da371243a6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:43.209326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e28efb58-6f47-4bb0-97c2-36d0fe8b4466 req-e92c743d-5d0b-4f65-84cd-a2da371243a6 service nova] Creating event network-vif-deleted:c43c74eb-a41f-4f9c-8123-f6fa9262b1b9 for instance 30bafcee-4865-4929-842f-d5de12eed8cb on nch1-master-1 Oct 29 21:03:43.221297 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e28efb58-6f47-4bb0-97c2-36d0fe8b4466 req-e92c743d-5d0b-4f65-84cd-a2da371243a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139447 Oct 29 21:03:43.231189 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2061/3999] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:43.484067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:43.485255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:43.512942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:43.513468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:43.513935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:43.518349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:43.518847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:43.519294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:43.622475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:43.626338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:43.626816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:43.627300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'fault' on Instance uuid 30bafcee-4865-4929-842f-d5de12eed8cb {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:43.762637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:43.773428 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9e7fcc6-9fa7-45d2-944d-e271b21c8ebb tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 200 len: 1312 microversion: 2.1 time: 0.293361 Oct 29 21:03:43.775204 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2062/4000] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:43 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:43.794494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:43.809966 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ef4b2b8-64b6-4f4e-ae74-2c86aad5618a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 1.021233 Oct 29 21:03:43.812732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1939/4001] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:42 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:43.821550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1189095715", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1afe3e15-ddc2-4d60-825a-7983ed3bd0c7"}], "security_groups": [{"name": "tempest-securitygroup--1042464997"}], "key_name": "tempest-keypair-552241776", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:44.014019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-334296533", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:44.101625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] validate_networks() for [('1afe3e15-ddc2-4d60-825a-7983ed3bd0c7', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:03:44.118122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:44.119313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:44.120872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:44.121561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:44.124912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:44.153158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:44.154324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:44.157328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:44.159191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:44.162100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:44.162891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:44.178790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:44.191219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Getting quotas for project a1430cb8bece48f0bb8fec9960625325. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:44.198947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Getting quotas for user 412a928bf8354ed797e1887ca4e7f3b4 and project a1430cb8bece48f0bb8fec9960625325. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:44.218167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:44.222215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:44.290612 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0a5d43a-f6b1-465f-b5d7-1ae32056db58 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.514044 Oct 29 21:03:44.291899 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2063/4002] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 21:03:44.309499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:44.310176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:44.329305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:44.329974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:44.331514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:44.332633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:44.334245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:44.334736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:45.247093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:45.261083 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fef6b633-fee5-44aa-b4d5-fcd4811aea2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1502 microversion: 2.1 time: 0.967792 Oct 29 21:03:45.264432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2064/4003] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:44 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1502 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:45.296890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:45.297797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:45.314579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:45.316236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:45.317160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:45.318586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:45.320379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:45.322463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.104851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:46.128125 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4cde39c8-7971-4fb8-96af-77e5dbcc4a0e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.861500 Oct 29 21:03:46.129309 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2065/4004] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:45 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:46.137289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9cdaebc4-44fa-474d-941d-8dd9afb9978e req-4cbb6782-4e6b-4abe-9bde-eb7910feec81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80bf941-937a-44d7-a246-a10c9fa24efa", "name": "network-vif-plugged", "status": "completed", "tag": "5750ec1d-cf82-4eb8-bec4-03cd56b9fa49"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:46.188695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9cdaebc4-44fa-474d-941d-8dd9afb9978e req-4cbb6782-4e6b-4abe-9bde-eb7910feec81 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.190606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9cdaebc4-44fa-474d-941d-8dd9afb9978e req-4cbb6782-4e6b-4abe-9bde-eb7910feec81 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.192545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9cdaebc4-44fa-474d-941d-8dd9afb9978e req-4cbb6782-4e6b-4abe-9bde-eb7910feec81 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.232084 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9cdaebc4-44fa-474d-941d-8dd9afb9978e req-4cbb6782-4e6b-4abe-9bde-eb7910feec81 service nova] Creating event network-vif-plugged:5750ec1d-cf82-4eb8-bec4-03cd56b9fa49 for instance a80bf941-937a-44d7-a246-a10c9fa24efa on nch2-master-1 Oct 29 21:03:46.257330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:46.258408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:46.259897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:46.260629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:46.261571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:46.270851 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9cdaebc4-44fa-474d-941d-8dd9afb9978e req-4cbb6782-4e6b-4abe-9bde-eb7910feec81 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114647 Oct 29 21:03:46.275307 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2066/4005] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:46.290420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.291262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.292509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:46.294569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:46.295081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.296104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.296733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.297185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.307142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.308311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.309071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.310476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.312021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.313719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.357372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:46.371540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for user c35b0dd86eb14cbbab1732cc96ab2573 and project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:46.404478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:46.411109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:46.487142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:46.507747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:46.509837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:46.511222 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61c4c18c-d5c0-494c-8efb-b3ecdfb277a6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 200 len: 1347 microversion: 2.47 time: 0.234017 Oct 29 21:03:46.526750 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20f620d3-fafa-4bca-82ec-05204c951d62 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.711746 Oct 29 21:03:46.529762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2067/4006] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:46 2022] GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 1347 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:46.537338 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1940/4007] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:03:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:03:46.543993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:46.544441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 30bafcee-4865-4929-842f-d5de12eed8cb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:46.546790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:46.547279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:46.554858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.558749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.560292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.561310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.562753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.563144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.563288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.563683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.564393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.565000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.565320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.565987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.608771 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Instance 30bafcee-4865-4929-842f-d5de12eed8cb could not be found. Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb HTTP/1.1 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 30bafcee-4865-4929-842f-d5de12eed8cb could not be found. Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '30bafcee-4865-4929-842f-d5de12eed8cb'} Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bafcee-4865-4929-842f-d5de12eed8cb could not be found. Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bafcee-4865-4929-842f-d5de12eed8cb could not be found. Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:46.610407 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bafcee-4865-4929-842f-d5de12eed8cb could not be found. Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 404 to user: Instance 30bafcee-4865-4929-842f-d5de12eed8cb could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da1f6bf9-1054-4106-857e-93f19d3e6de5 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb" status: 404 len: 111 microversion: 2.1 time: 0.080716 Oct 29 21:03:46.615366 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2068/4008] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:46 2022] GET /compute/v2.1/servers/30bafcee-4865-4929-842f-d5de12eed8cb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:03:46.619985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-27d9abc2-5c94-439c-a5af-c8230992f480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:46.625581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-27d9abc2-5c94-439c-a5af-c8230992f480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:46.755384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-27d9abc2-5c94-439c-a5af-c8230992f480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:46.766140 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-27d9abc2-5c94-439c-a5af-c8230992f480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1238 microversion: 2.1 time: 0.152257 Oct 29 21:03:46.766999 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2069/4009] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:46 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1238 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:46.812271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2038689979", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:46.885969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:46.906158 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64f54efe-6ff0-4ea6-855c-e4342e967b6f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.360000 Oct 29 21:03:46.908806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:46.923781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1941/4010] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:46 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:46.930014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:46.933948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:46.934485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:46.935847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:46.940717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:46.949579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:46.971739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.972537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.972829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.973579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.974563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.975308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.975974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.983395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.983983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:46.987445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:46.990330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:46.993061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:47.015245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Getting quotas for project a1430cb8bece48f0bb8fec9960625325. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:47.028783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Getting quotas for user 412a928bf8354ed797e1887ca4e7f3b4 and project a1430cb8bece48f0bb8fec9960625325. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:47.056551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:47.063865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:47.073497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:47.093216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:47.169146 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-956a83b7-7d8a-4100-8713-c4f233597369 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.369492 Oct 29 21:03:47.175133 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2070/4011] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 21:03:47.180449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0a58bc7-10e3-494c-b645-6c64967586b9"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:47.190824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:47.225975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:47.226822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:47.227542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:47.228571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:47.242025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:47.242839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:47.365578 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4afc1298-2d80-40c4-84ac-813b6ce0ba3e tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 204 len: 0 microversion: 2.1 time: 0.439493 Oct 29 21:03:47.366548 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1942/4012] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:46 2022] DELETE /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:47.376917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:47.378258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:47.396550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:47.400453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:47.402055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:47.403857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:47.404825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:47.405298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:47.405926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:47.423425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:47.688422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:47.702865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f9adc10b-1de2-4a46-b6d8-a518261901cb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.335015 Oct 29 21:03:47.703461 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1943/4013] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:47 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:47.714542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ae1a0eb-5f4a-4d1b-959f-60cfc61c8fb8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:47.730819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ae1a0eb-5f4a-4d1b-959f-60cfc61c8fb8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:47.787445 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ae1a0eb-5f4a-4d1b-959f-60cfc61c8fb8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "PUT /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 992 microversion: 2.47 time: 0.076710 Oct 29 21:03:47.803428 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1944/4014] 10.222.0.36 () {62 vars in 1297 bytes} [Sat Oct 29 21:03:47 2022] PUT /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 992 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:03:47.808968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:47.810131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:47.817559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:47.818340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:47.819090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:47.819989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:47.820610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:47.821278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.030169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:48.039318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-800ef04b-d03a-4da4-b95e-be011572f79f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.234651 Oct 29 21:03:48.040545 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1945/4015] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:47 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:48.203248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb9cdcf6-1fac-48b3-b5d2-d9b1f116df64 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Action: 'create', calling method: .version_select at 0x7fa176280160>, body: {"keypair": {"name": "tempest-keypair-1519502543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqBb+zKWTHZcguRCckZxaAYGr1nf/2Je/iIZ1Iq0tZlTX2QMFV7lM4D6eBkLr57IxawZRTRunztW+Dn+1DLieQmWen6TKuC3HQHMLnu4cyKPxsoi5W/b+VG6WZ5V2RzKg=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:48.242124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-cb9cdcf6-1fac-48b3-b5d2-d9b1f116df64 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Getting quotas for project c4e54075f50e468dbd398cc3df0d30a6. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:48.249327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-cb9cdcf6-1fac-48b3-b5d2-d9b1f116df64 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Getting quotas for user 317c7fc1b0be4187bb3b719ac5c8fde3 and project c4e54075f50e468dbd398cc3df0d30a6. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:48.310507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb9cdcf6-1fac-48b3-b5d2-d9b1f116df64 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.268034 Oct 29 21:03:48.321262 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1946/4016] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:03:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:48.327337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:48.328484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:48.337938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:48.338756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:48.339655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.340927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:48.341599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:48.342201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.439840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:48.449871 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b173fca6-9e01-42d2-beff-3fc9b17dbfeb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1242 microversion: 2.1 time: 0.126162 Oct 29 21:03:48.464147 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1947/4017] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:48 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:48.473980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:48.475123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:48.483790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:48.484873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:48.485763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.486542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:48.487206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:48.487903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.622231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:48.663285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:48.672239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:48.681354 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e1610176-1c59-4823-837b-7d5f4a887680 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1282 microversion: 2.47 time: 0.207875 Oct 29 21:03:48.684919 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1948/4018] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:48 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:48.704581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:48.705147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:48.715501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:48.716012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:48.717735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.721994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:48.722803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:48.723817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:48.989085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:49.005278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9147aa0e-4067-4bfe-a2c0-a6d5af90c6e6 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.317621 Oct 29 21:03:49.006704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1949/4019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:48 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:49.014161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:49.014784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:49.035233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.035989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.037347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.038294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.039069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.040868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.401665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:49.411406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89523d91-a54d-49c3-8430-61a62c5d6e6a tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.400902 Oct 29 21:03:49.418513 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1950/4020] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:49 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:49.448810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:49.450359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:49.466782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.469742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.470652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.474763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.475505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.476710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.710183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:49.719569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f1162ce-4b44-47b2-bf33-333db34ee780 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.282156 Oct 29 21:03:49.720516 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1951/4021] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:49 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:49.725667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:49.726694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:49.734690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.735491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.736148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.736885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.737368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.737820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.881378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:49.894995 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b9af232-3c6a-4b32-823d-633a65f6ac46 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1242 microversion: 2.1 time: 0.172963 Oct 29 21:03:49.895868 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1952/4022] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1242 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:49.910543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:49.914210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:49.920719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.921219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.921758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:49.922475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:49.923127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:49.923736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:50.005309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:50.015321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:50.022305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:50.026230 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b490fe09-2c26-4d67-95b5-169d8775d4d8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1282 microversion: 2.47 time: 0.129118 Oct 29 21:03:50.030143 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1953/4023] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:49 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:50.035741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:50.037804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:50.057389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:50.059266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:50.059909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:50.060857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:50.061513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:50.062124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:50.325167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:50.334434 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84a976c8-883f-41af-8e28-6d3c56aead73 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1325 microversion: 2.1 time: 0.302880 Oct 29 21:03:50.335460 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1954/4024] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:50 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:50.462007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-324163820", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:50.517797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] validate_networks() for [('0afc686e-aecb-4fab-be22-b120e882e5e7', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:03:50.926319 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef095c61-9924-4363-bbc3-b8c922afbfb7 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.743182 Oct 29 21:03:50.929632 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2071/4025] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:03:47 2022] POST /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a/os-volume_attachments => generated 194 bytes in 3754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:50.939877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:50.940619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:50.958098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:50.958700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:50.961618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:50.962721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:50.966571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:50.967268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:51.656584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:51.657105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:51.657569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:51.657988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:51.658402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:51.663021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:51.673560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:51.674367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:51.674878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:51.675039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5151ddd9-629a-48d8-a1f1-c0d67d896803 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.742725 Oct 29 21:03:51.675612 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2072/4026] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:50 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:51.675741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:51.676073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:51.676505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:51.701701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Getting quotas for project a47c15d746e94571b66736d37e9c92b4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:51.703768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:51.708336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:51.708499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Getting quotas for user bf5d75d7cdde44639d2f5ca9475c85b5 and project a47c15d746e94571b66736d37e9c92b4. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:51.722059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:51.722441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:51.723099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:51.723760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:51.724741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:51.724948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:51.744859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:51.746337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:51.801717 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc8d558f-1e35-43b2-9910-eee67418a275 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.395576 Oct 29 21:03:51.802738 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1955/4027] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:03:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:03:51.830834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-268272093", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1f0bf1b8-b500-4b43-b33b-d9e1c3ff1ffe"}], "security_groups": [{"name": "tempest-securitygroup--909091631"}], "key_name": "tempest-keypair-1519502543", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:52.148013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:52.176816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] validate_networks() for [('1f0bf1b8-b500-4b43-b33b-d9e1c3ff1ffe', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:03:52.177266 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a3456b6-eddc-442f-acfc-f7740a4e4cb8 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1522 microversion: 2.1 time: 0.485244 Oct 29 21:03:52.178852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2073/4028] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:51 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:52.208291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:52.210671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:52.265450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:52.265993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:52.266439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:52.267918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:52.268384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:52.268813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:52.372357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:52.389111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1a18e4e-c769-4035-b33d-d9a56877a9c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1290 microversion: 2.1 time: 0.200105 Oct 29 21:03:52.408126 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2074/4029] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:52 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1290 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:52.408126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:52.408126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:52.433061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:52.433857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:52.434399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:52.436185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:52.436839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:52.438291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:52.731595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:52.745348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:52.751770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:52.755937 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d0185679-02a2-40cf-a6bd-48858e222ee9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1336 microversion: 2.47 time: 0.362240 Oct 29 21:03:52.757294 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2075/4030] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:52 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:52.776833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:52.779608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:52.806342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:52.813323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:52.814158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:52.815145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:52.815705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:52.816235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.122036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:53.133020 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87229fa0-d0f6-4fac-8f56-7701f413b593 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1522 microversion: 2.1 time: 0.367569 Oct 29 21:03:53.134548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2076/4031] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:52 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:53.142446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.145340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:53.166737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.167501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.167675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.172836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.174448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.174810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.185736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:53.187532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:53.188208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:53.189590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:53.190226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:53.229415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.230326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.230937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.232149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.233113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.234139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.259616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Getting quotas for project c4e54075f50e468dbd398cc3df0d30a6. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:03:53.267114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Getting quotas for user 317c7fc1b0be4187bb3b719ac5c8fde3 and project c4e54075f50e468dbd398cc3df0d30a6. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:03:53.297905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:03:53.301127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:03:53.346268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:53.357187 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d34a9c2a-29e2-4411-b45d-8cbff55753f7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1209 microversion: 2.1 time: 0.221273 Oct 29 21:03:53.358186 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2077/4032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1209 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:53.362967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b6b94f6a-2d7a-4fd1-8ee1-345ba3e725ae req-ad768944-2889-4046-98af-8985bc7971cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9", "name": "network-vif-deleted", "tag": "754992b9-b168-405b-9747-f1e7c4cf318b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:53.379703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6b94f6a-2d7a-4fd1-8ee1-345ba3e725ae req-ad768944-2889-4046-98af-8985bc7971cf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.380482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6b94f6a-2d7a-4fd1-8ee1-345ba3e725ae req-ad768944-2889-4046-98af-8985bc7971cf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.380608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b6b94f6a-2d7a-4fd1-8ee1-345ba3e725ae req-ad768944-2889-4046-98af-8985bc7971cf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.398500 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b6b94f6a-2d7a-4fd1-8ee1-345ba3e725ae req-ad768944-2889-4046-98af-8985bc7971cf service nova] Creating event network-vif-deleted:754992b9-b168-405b-9747-f1e7c4cf318b for instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 on nch2-master-1 Oct 29 21:03:53.406708 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b6b94f6a-2d7a-4fd1-8ee1-345ba3e725ae req-ad768944-2889-4046-98af-8985bc7971cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046355 Oct 29 21:03:53.407551 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2078/4033] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:53.417418 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-691e9b49-4be9-44b6-b658-09158aef2993 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.612546 Oct 29 21:03:53.418843 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1956/4034] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:03:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:03:53.419160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.419936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:53.424879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.425665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:53.428077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.428578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.429675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.430627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.431255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.431853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.433135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.433970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.434619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.435571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.436231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.437915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.482383 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] HTTP exception thrown: Instance is not a member of specified network Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Request method failure captured: Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa/ips/invalid HTTP/1.1 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUaKXBBs87Mm-wDoSxvrnwSvA_WtwOQ1jmajyBejIO0foFJp2QYXE7TqQkZBUm4P25ginUeSGlij9EexMpZV8D-L7W1Guo-udc2XK_QV6JOA5WisVZheKuYfl0jOQvyGZWWmQ253EeAGuTXkb4DxF59QvOiC19B32zfMFWb2FJhJDM Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a132bbc7ac614352935b11096f132071 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a132bbc7ac614352935b11096f132071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a132bbc7ac614352935b11096f132071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a132bbc7ac614352935b11096f132071"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a132bbc7ac614352935b11096f132071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a132bbc7ac614352935b11096f132071 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerAddressesNegativeTestJSON-1131282004-project Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c02182ffa1ec4555b0055cfc38dc3827 Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1131282004-project Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance is not a member of specified network Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'server_id': 'a80bf941-937a-44d7-a246-a10c9fa24efa', 'id': 'invalid'} Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 29 21:03:53.491004 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.511019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Returning 404 to user: Instance is not a member of specified network {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:53.514930 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-055fbb73-d6e8-4ee5-8456-25a08e274b2f tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.093314 Oct 29 21:03:53.521722 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1957/4035] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa/ips/invalid => generated 91 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:03:53.539159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.540854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:53.554417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.558455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.560545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.563132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.563678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.564396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.664053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:53.673740 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0fa1df1f-d5b7-4b5d-acf9-a1d22468a240 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.264880 Oct 29 21:03:53.681067 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2079/4036] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:53.694901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.705983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:53.714881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.715691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.716356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.717260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:53.721237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:53.722090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:53.827403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:53.840712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60479a3e-6cf5-45b3-95ff-5afaeee14106 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1480 microversion: 2.1 time: 0.316998 Oct 29 21:03:53.841611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1958/4037] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1480 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:53.858484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45d04c69-fa88-41ae-8a0e-00056879a2a1 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.860814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45d04c69-fa88-41ae-8a0e-00056879a2a1 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:53.970731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:53.985278 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9fd45539-c444-4fe1-8429-f8863daa18c8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1298 microversion: 2.1 time: 0.302960 Oct 29 21:03:53.988680 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2080/4038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1298 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:53.992342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-45d04c69-fa88-41ae-8a0e-00056879a2a1 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:53.995738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba7b153f-67a5-4c2c-943c-2583e26b91fd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:53.996747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba7b153f-67a5-4c2c-943c-2583e26b91fd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Failed to fetch instance by id 999 {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 21:03:53.997573 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ba7b153f-67a5-4c2c-943c-2583e26b91fd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] HTTP exception thrown: Instance 999 could not be found. Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba7b153f-67a5-4c2c-943c-2583e26b91fd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Request method failure captured: Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUaKXBBs87Mm-wDoSxvrnwSvA_WtwOQ1jmajyBejIO0foFJp2QYXE7TqQkZBUm4P25ginUeSGlij9EexMpZV8D-L7W1Guo-udc2XK_QV6JOA5WisVZheKuYfl0jOQvyGZWWmQ253EeAGuTXkb4DxF59QvOiC19B32zfMFWb2FJhJDM Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a132bbc7ac614352935b11096f132071 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a132bbc7ac614352935b11096f132071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a132bbc7ac614352935b11096f132071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a132bbc7ac614352935b11096f132071"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a132bbc7ac614352935b11096f132071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a132bbc7ac614352935b11096f132071 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerAddressesNegativeTestJSON-1131282004-project Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c02182ffa1ec4555b0055cfc38dc3827 Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1131282004-project Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 999 could not be found. Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': '999'} Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 21:03:53.999651 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:54.007242 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45d04c69-fa88-41ae-8a0e-00056879a2a1 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1241 microversion: 2.1 time: 0.162085 Oct 29 21:03:54.010630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba7b153f-67a5-4c2c-943c-2583e26b91fd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Returning 404 to user: Instance 999 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:54.011278 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1959/4039] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:54.021865 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba7b153f-67a5-4c2c-943c-2583e26b91fd tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.029945 Oct 29 21:03:54.023657 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2081/4040] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 21:03:53 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:03:54.033030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:54.036312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:54.037881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:54.038123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:54.053662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.054592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.056617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.057159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.057823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.058689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.066439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.067080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.067550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.068306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.068773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.075616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.109386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:54.209167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:54.242785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:54.256272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:54.265433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:54.268257 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5210d648-8a63-4ae0-bc4a-25499621341a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1336 microversion: 2.47 time: 0.254758 Oct 29 21:03:54.271795 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1960/4041] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:54 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1336 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:54.378503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e1c2a026-9b3a-4c98-a509-0686c365e8b2 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 204 len: 0 microversion: 2.1 time: 0.349089 Oct 29 21:03:54.379108 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2082/4042] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:54 2022] DELETE /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:54.381141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:54.382365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:54.387506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:54.388225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:54.397388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.398067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.398603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.399984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.400537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.401061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.402860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.403518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.403979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.404708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.405174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.405657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.514434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:54.534169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee4bc455-4ee6-4203-8b5b-7a99feb04013 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1273 microversion: 2.1 time: 0.157584 Oct 29 21:03:54.534792 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1961/4043] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:54 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:54.687396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:54.699251 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07e0fc55-8796-4301-bba4-399ec14c02e9 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1528 microversion: 2.1 time: 0.314811 Oct 29 21:03:54.702134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:54.703064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:54.703833 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2083/4044] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:54 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1528 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:54.715527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.716854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.719050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.719814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.720291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.722281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.868981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:54.869645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:54.881789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.885371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.885981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.887116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.888455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.889771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.906023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:54.917233 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c721f4bf-6c8d-40a7-9b1a-3481db1c6ba3 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.220313 Oct 29 21:03:54.930656 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1962/4045] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:54 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:54.965670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:54.973569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:54.974423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:54.975152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'fault' on Instance uuid 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:55.010864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:55.011612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:55.031171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.036432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.046375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.047447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.048105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.048733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.049415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.059786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-04ee0d7b-d563-459e-be1c-9aadc196867f tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1312 microversion: 2.1 time: 0.195941 Oct 29 21:03:55.060697 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2084/4046] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:54 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:55.065743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:55.066609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:55.074276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.085757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.087851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.090283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.091351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.095065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.131171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.141274 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-548f6fd0-07a1-4538-ae2c-421db6cdee79 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1296 microversion: 2.1 time: 0.134780 Oct 29 21:03:55.156066 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1963/4047] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:55 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1296 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:55.218684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.226928 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6a92377-9860-4be7-8bdb-8e1b35795a27 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1293 microversion: 2.1 time: 0.164795 Oct 29 21:03:55.227918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2085/4048] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:55 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:55.302585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:55.303985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:55.324247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.324813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.325723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.326463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.326934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.327377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.353251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:55.406992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.416286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.418704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.420068 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-596e60a2-5f3e-4887-bd30-878c2be52713 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1336 microversion: 2.47 time: 0.122344 Oct 29 21:03:55.420624 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1964/4049] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:55 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:55.558368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:55.559297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:55.565860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.566602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.567105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.567917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.568495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.569156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.724321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:55.725316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:55.733819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.734638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.735555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.736858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.737541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.738164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.835222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:55.845170 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5dcb83b5-f086-4352-9794-bdfd541fbc32 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.289898 Oct 29 21:03:55.849374 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2086/4050] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:55 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:55.942577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:55.943205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:55.955344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.959332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.960573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:55.961600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:55.962248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:55.963349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.135370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:56.144869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75954fcd-dd2f-4c52-ab7d-b7eef1cb89e3 tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1528 microversion: 2.1 time: 0.424453 Oct 29 21:03:56.166028 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1965/4051] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:55 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1528 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:56.171870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:56.172463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:56.179427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.180040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.181131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.181884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.182643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.183118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.308302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.308890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.309476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.310061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lazy-loading 'fault' on Instance uuid 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:03:56.423926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:56.435077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-393eae0c-c0a3-4b14-85ef-cadc94ac36ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.496326 Oct 29 21:03:56.440925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3525b70b7874e7c99485cd7a1efa78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47be3cb65cc34590a94a9a161b94a598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:56.453761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bee60cc8-98e1-45b5-9e82-5b3e0b16fc3b tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 200 len: 1312 microversion: 2.1 time: 0.286455 Oct 29 21:03:56.456971 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1966/4052] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:56 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:56.461446 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2087/4053] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:55 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:03:56.464061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:56.465687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:56.468634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:56.469251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:56.477241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.478317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.478873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.479603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.480064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.480497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.482006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.482713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.483327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.484266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.484891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.485516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.748942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:56.752252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:56.777586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36580e49-9445-466a-a62a-bfe663721892 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1299 microversion: 2.1 time: 0.314254 Oct 29 21:03:56.778168 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-299d63ad-c317-46f0-b166-a978de5cbb8f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1296 microversion: 2.1 time: 0.311328 Oct 29 21:03:56.778956 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1967/4054] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:56 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1296 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:56.795643 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2088/4055] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:56 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1299 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:56.803390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:56.809646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:56.810513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:56.810688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:56.818744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:56.827561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.828930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.830465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.831106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.831792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.832715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.833367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.834037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.835143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:56.835578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.836472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:56.842185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:56.890738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:03:57.001724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:57.022483 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4aea84fc-3912-4783-b53e-ce9655f0c513 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 204 len: 0 microversion: 2.1 time: 0.225543 Oct 29 21:03:57.023080 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2089/4056] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:03:56 2022] DELETE /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:03:57.027073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:57.028995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:57.035994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:57.043320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.044102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.045083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.046027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.046658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.047282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.047448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:57.049050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:57.053552 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-158ecb3f-d558-419d-8e1c-9b11087fc7ce tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1357 microversion: 2.47 time: 0.256068 Oct 29 21:03:57.083396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1968/4057] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:56 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:57.099629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:57.102803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:57.119728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.121966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.122632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.126109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.126850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.127472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.132338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=14 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:03:57.450951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:57.468790 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54085945-c83d-4a77-8e4a-15bf330386ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1554 microversion: 2.1 time: 0.383601 Oct 29 21:03:57.470494 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1969/4058] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:57 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1554 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:57.496252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:57.500232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:57.508216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.509476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.510376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.511293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.511973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.512604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.620420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:03:57.620853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:03:57.621337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:03:57.621835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:03:57.622250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:03:57.726459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:57.753445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:57.758373 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a65d6970-303c-4193-b572-96631789fd29 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.733103 Oct 29 21:03:57.760504 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2090/4059] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:57 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:57.764528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.765396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.766124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.768797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.772883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.773344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.785323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:57.790656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:57.802708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.806243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.811370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.813979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.817066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.817766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.850637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d4ec814-4d29-429b-b0a0-af49e58ee88c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "POST /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4/action" status: 202 len: 1079 microversion: 2.47 time: 0.365942 Oct 29 21:03:57.851811 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1970/4060] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 21:03:57 2022] POST /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4/action => generated 1079 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 21:03:57.858448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:57.859309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:57.867520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.868438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.869791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:57.870713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:57.871672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:57.872273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.300941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:58.311873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f4d3d60-7712-4256-ad88-c3259533402d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1528 microversion: 2.1 time: 0.547328 Oct 29 21:03:58.313601 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2091/4061] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:57 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:58.320643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:58.323853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] [instance: 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:58.335610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.336109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.337309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.338240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.338877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.339481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.348977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:58.358003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] HTTP exception thrown: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 could not be found. Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Request method failure captured: Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 HTTP/1.1 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZQZOqO6JY6IbfUxBABYUY7Xnz9THaoqtL0u24hf67ylabytEWmVpkFF01vecPHPK9rkrUUCT2DYZYt9kj4IAkm7V7fEO2Vo1F--DB1CURcJNx5a9fGo9RJTg_egnm_yTqLq9CckPR6FoZDQjq0M9k8YzSyNdBcCPN-a9etWot_X9Jk Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/47be3cb65cc34590a94a9a161b94a598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 47be3cb65cc34590a94a9a161b94a598 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961218988 Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3525b70b7874e7c99485cd7a1efa78d Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961218988-project Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 could not be found. Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9'} Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 could not be found. Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 could not be found. Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:58.360006 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 could not be found. Oct 29 21:03:58.367009 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:03:58.370946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] Returning 404 to user: Instance 2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:03:58.372099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f1441117-1f3b-45ed-8518-46da22603345 tempest-ServerRescueNegativeTestJSON-961218988 tempest-ServerRescueNegativeTestJSON-961218988-project] 10.222.0.36 "GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9" status: 404 len: 111 microversion: 2.1 time: 0.057146 Oct 29 21:03:58.373723 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2092/4062] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:58 2022] GET /compute/v2.1/servers/2781a36e-5b8d-44ff-8c72-e4e61ce7bfd9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:03:58.380968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7dd0705c-56d0-4784-afdf-045f2ea28623 req-19adc2ad-0a9d-44e5-a6b2-21b2bcf8abef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a12a156-5f53-400d-bd24-6dc2d98cb50e", "tag": "d0ae7a24-ca93-4e95-8078-518a813e7127"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:03:58.381976 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-21d61f2e-4b13-4833-b096-ce7d1fc11198 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.528187 Oct 29 21:03:58.387103 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1971/4063] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:57 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:58.402035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7dd0705c-56d0-4784-afdf-045f2ea28623 req-19adc2ad-0a9d-44e5-a6b2-21b2bcf8abef service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.402879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7dd0705c-56d0-4784-afdf-045f2ea28623 req-19adc2ad-0a9d-44e5-a6b2-21b2bcf8abef service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.403909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7dd0705c-56d0-4784-afdf-045f2ea28623 req-19adc2ad-0a9d-44e5-a6b2-21b2bcf8abef service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.419891 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7dd0705c-56d0-4784-afdf-045f2ea28623 req-19adc2ad-0a9d-44e5-a6b2-21b2bcf8abef service nova] Creating event network-changed:d0ae7a24-ca93-4e95-8078-518a813e7127 for instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e on nch1-master-1 Oct 29 21:03:58.428246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:58.429109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:58.430227 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7dd0705c-56d0-4784-afdf-045f2ea28623 req-19adc2ad-0a9d-44e5-a6b2-21b2bcf8abef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054866 Oct 29 21:03:58.431417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2093/4064] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:03:58.441480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:58.443173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:58.456329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.459560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.459722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.460866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.462587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.464040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.464492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.464909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.465281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.471296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.472241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.474139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.916895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:58.931217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ce7c690-84e4-4f2c-a4d4-935935ce4fa2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.497309 Oct 29 21:03:58.933074 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2094/4065] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:58 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:58.949654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:58.950556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:58.957352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.958111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.958553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:58.960066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:58.960536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:58.960971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.044391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:59.053391 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b95cd222-6ed6-4d63-a4d1-c2ee670590c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.663123 Oct 29 21:03:59.057852 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1972/4066] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:58 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:59.063653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:59.067297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:59.079751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.080586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.081256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.082504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.083953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.087788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.182712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:59.195348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:59.198804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:59.202538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e95d180-b490-47a3-bbd1-87c860b1a73a tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.268138 Oct 29 21:03:59.204083 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2095/4067] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:03:58 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:03:59.225419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:59.230425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:59.311661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.311661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.311661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.311661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.311661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.311661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.777237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:59.785260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:03:59.788086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1af62fa3-a46f-484b-875f-e6cbfc9ee107 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.571993 Oct 29 21:03:59.799992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c53c54b-8b78-4f1a-8284-55df995d0cac tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1554 microversion: 2.1 time: 0.740591 Oct 29 21:03:59.804035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2096/4068] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:59 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:59.809392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:59.809941 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1973/4069] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:59 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1554 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:03:59.816365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:59.822019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.822652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.823210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.823574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:03:59.824133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.824494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:03:59.824812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.825515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.831010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.831669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.832272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.833511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.834127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.834692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.868245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:03:59.868904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:03:59.869481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:03:59.870048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lazy-loading 'fault' on Instance uuid a80bf941-937a-44d7-a246-a10c9fa24efa {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:00.047915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02182ffa1ec4555b0055cfc38dc3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a132bbc7ac614352935b11096f132071', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:00.052778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:00.060546 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a683d67f-0c80-4a38-b52e-234e48919f2d tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 200 len: 1315 microversion: 2.1 time: 0.254985 Oct 29 21:04:00.062437 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2097/4070] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:59 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:00.071818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:00.073520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:00.085093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.087071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.087695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.088732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.089700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.090280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.354333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:00.363276 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c382b1e6-a401-49dd-a7fe-51abaf2946bb tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.544932 Oct 29 21:04:00.375307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1974/4071] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:03:59 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:00.375307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:00.376931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:00.385849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.387324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.387987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.390286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.390991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.391646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.443753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:00.454235 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-096f3cca-9894-4bdf-93a4-1efef1f0a6b9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.389918 Oct 29 21:04:00.454895 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2098/4072] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:00 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:00.460314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:00.460946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:00.470829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.471522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.472448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.473327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.474001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.474441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.843447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:00.853718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:00.855499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:00.856776 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-083ed33f-147e-41b8-96ab-dd2cddc9b67d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.400678 Oct 29 21:04:00.869547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2099/4073] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:00 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:00.884746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:00.885793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:00.894985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.895852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.896392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:00.898019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:00.898123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:00.898680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.126977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:01.160245 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89e3e821-3282-4f23-9e9a-8a302bb29bad tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.794168 Oct 29 21:04:01.161839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1975/4074] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:00 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:01.171612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:01.174008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:01.192280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.193834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.194492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.195464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.196679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.197331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.270995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:01.286706 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aacd555e-8c5a-46a0-af18-ab09c782e1fb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.421618 Oct 29 21:04:01.309891 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2100/4075] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:00 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:01.323221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80bf941-937a-44d7-a246-a10c9fa24efa", "name": "network-vif-deleted", "tag": "5750ec1d-cf82-4eb8-bec4-03cd56b9fa49"}, {"name": "network-changed", "server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:01.347751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.348236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.348670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.364097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] Creating event network-vif-deleted:5750ec1d-cf82-4eb8-bec4-03cd56b9fa49 for instance a80bf941-937a-44d7-a246-a10c9fa24efa on nch2-master-1 Oct 29 21:04:01.364595 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] Creating event network-changed:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:04:01.400098 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e5adbbb4-2870-4852-ac38-ad13f042519f req-96c132ef-7814-498b-bd0d-d8b3438bfe28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087984 Oct 29 21:04:01.401027 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2101/4076] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:01.406507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-aae945fc-c565-4dcf-b281-65e8f90432ff req-7e8e3fe3-09c1-425a-97a5-cd7bf9433bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9675b6-7c57-4107-987d-c6f581c3d43a", "name": "network-vif-deleted", "tag": "b3a610ed-fd90-4265-a0db-34cd10af6516"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:01.420030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aae945fc-c565-4dcf-b281-65e8f90432ff req-7e8e3fe3-09c1-425a-97a5-cd7bf9433bc3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.420884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aae945fc-c565-4dcf-b281-65e8f90432ff req-7e8e3fe3-09c1-425a-97a5-cd7bf9433bc3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.421486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-aae945fc-c565-4dcf-b281-65e8f90432ff req-7e8e3fe3-09c1-425a-97a5-cd7bf9433bc3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.436077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-aae945fc-c565-4dcf-b281-65e8f90432ff req-7e8e3fe3-09c1-425a-97a5-cd7bf9433bc3 service nova] Creating event network-vif-deleted:b3a610ed-fd90-4265-a0db-34cd10af6516 for instance ca9675b6-7c57-4107-987d-c6f581c3d43a on nch2-master-1 Oct 29 21:04:01.441948 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-aae945fc-c565-4dcf-b281-65e8f90432ff req-7e8e3fe3-09c1-425a-97a5-cd7bf9433bc3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039312 Oct 29 21:04:01.443563 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2102/4077] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:01.449832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:01.450906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] [instance: a80bf941-937a-44d7-a246-a10c9fa24efa] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:01.458233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.459108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.459899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.460920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.462346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.462959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.480530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:01.481146 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] HTTP exception thrown: Instance a80bf941-937a-44d7-a246-a10c9fa24efa could not be found. Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Request method failure captured: Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa HTTP/1.1 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUaKXBBs87Mm-wDoSxvrnwSvA_WtwOQ1jmajyBejIO0foFJp2QYXE7TqQkZBUm4P25ginUeSGlij9EexMpZV8D-L7W1Guo-udc2XK_QV6JOA5WisVZheKuYfl0jOQvyGZWWmQ253EeAGuTXkb4DxF59QvOiC19B32zfMFWb2FJhJDM Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a132bbc7ac614352935b11096f132071 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a132bbc7ac614352935b11096f132071"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a132bbc7ac614352935b11096f132071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a132bbc7ac614352935b11096f132071"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a132bbc7ac614352935b11096f132071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a132bbc7ac614352935b11096f132071 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1131282004 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerAddressesNegativeTestJSON-1131282004-project Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c02182ffa1ec4555b0055cfc38dc3827 Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1131282004-project Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a80bf941-937a-44d7-a246-a10c9fa24efa could not be found. Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a80bf941-937a-44d7-a246-a10c9fa24efa'} Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80bf941-937a-44d7-a246-a10c9fa24efa could not be found. Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80bf941-937a-44d7-a246-a10c9fa24efa could not be found. Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:01.482869 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80bf941-937a-44d7-a246-a10c9fa24efa could not be found. Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] Returning 404 to user: Instance a80bf941-937a-44d7-a246-a10c9fa24efa could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:01.485876 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16ac5f3e-e768-4afe-9dcc-12d43ea8c78a tempest-ServerAddressesNegativeTestJSON-1131282004 tempest-ServerAddressesNegativeTestJSON-1131282004-project] 10.222.0.36 "GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa" status: 404 len: 111 microversion: 2.1 time: 0.039484 Oct 29 21:04:01.488812 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2103/4078] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:01 2022] GET /compute/v2.1/servers/a80bf941-937a-44d7-a246-a10c9fa24efa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:01.494740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:01.495526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:01.501542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62775372-546a-48e5-9e87-7b09b7dbadb3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1346 microversion: 2.1 time: 0.336931 Oct 29 21:04:01.502170 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1976/4079] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:01 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1346 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:01.502814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.503585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.504274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.505167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.505789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.506355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.533483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:01.537105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:01.546952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.547449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.547897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.548610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.549070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.558204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.763576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:01.776631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3029fa00-529a-4c67-b92f-e4eb1e3e00f5 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.286345 Oct 29 21:04:01.778018 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2104/4080] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:01 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:01.801977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:01.812000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2174f1e9-6f3e-456e-beec-51e4278149f9 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.298637 Oct 29 21:04:01.813020 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1977/4081] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:01 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:01.884410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:01.885493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:01.896825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.898732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.900994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:01.902371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:01.904270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:01.904923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.023793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:02.035265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:02.036985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:02.039394 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25eb6437-02d9-420e-ac0c-84c41d3ea79b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.159235 Oct 29 21:04:02.041867 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2105/4082] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:01 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:02.184046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:02.185808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:02.195519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.196824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.197429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.198498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.199091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.200235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.322811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:02.323454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:02.330266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.331030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.331620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.332494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.333180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.333835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.500617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:02.507206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:02.521819 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d59349a5-01f7-4121-9dd6-ea37aa05dbed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.339427 Oct 29 21:04:02.524932 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1978/4083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:02 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:02.531674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:02.532529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:02.544115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.544963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.546593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.548377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.550064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.550878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.595182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.595679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.603065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.603556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'fault' on Instance uuid ca9675b6-7c57-4107-987d-c6f581c3d43a {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:02.680816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:02.700141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2fa17633-8943-489e-a491-467b6c343849 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 200 len: 1351 microversion: 2.1 time: 0.172470 Oct 29 21:04:02.701288 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1979/4084] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:02 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 1351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:02.708685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:02.717754 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-070947ee-09a0-4d40-8f2d-dc8ad7d8c6fa tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.399995 Oct 29 21:04:02.726079 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2106/4085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:02 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:02.807083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:02.808317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:02.815834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.816425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.816937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.818819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.819328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.820819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.838085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:02.839399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:02.854289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.855229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.856136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:02.859737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:02.862524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:02.863228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.173181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:03.181849 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4051bd6a-df86-4c31-9e01-42f3a78bb405 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.349562 Oct 29 21:04:03.187865 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2107/4086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:02 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:03.206123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:03.206936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:03.217049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.218469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.219154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.220019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.222025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.222689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.247313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:03.271427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:03.280934 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a520ec65-22f4-4e2f-adc9-4c3a5f2f7a4c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.479949 Oct 29 21:04:03.284769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1980/4087] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:02 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:03.347561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:03.373035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:03.375918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:03.377430 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b7fd100-27f9-47cc-811a-85a2b156cfdd tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.188345 Oct 29 21:04:03.389490 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2108/4088] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:03 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:03.475257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-12bcac62-0be4-436c-b5a3-eb6ee2f8c36e req-751c4bc0-cfdf-4ab4-8d36-51ed2095d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b266901d-80f5-4033-91e9-4198d82cc551", "tag": "d097fa95-f63b-4a03-b4eb-d20a2483c344"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:03.492439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-12bcac62-0be4-436c-b5a3-eb6ee2f8c36e req-751c4bc0-cfdf-4ab4-8d36-51ed2095d8f4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.494603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-12bcac62-0be4-436c-b5a3-eb6ee2f8c36e req-751c4bc0-cfdf-4ab4-8d36-51ed2095d8f4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.495050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-12bcac62-0be4-436c-b5a3-eb6ee2f8c36e req-751c4bc0-cfdf-4ab4-8d36-51ed2095d8f4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.513170 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-12bcac62-0be4-436c-b5a3-eb6ee2f8c36e req-751c4bc0-cfdf-4ab4-8d36-51ed2095d8f4 service nova] Creating event network-changed:d097fa95-f63b-4a03-b4eb-d20a2483c344 for instance b266901d-80f5-4033-91e9-4198d82cc551 on nch1-master-1 Oct 29 21:04:03.519309 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-12bcac62-0be4-436c-b5a3-eb6ee2f8c36e req-751c4bc0-cfdf-4ab4-8d36-51ed2095d8f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047806 Oct 29 21:04:03.520490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1981/4089] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:03.550220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:03.550854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:03.559461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.560158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.560771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.561665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.562260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.562829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.728730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:03.729584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:03.742358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.743480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.744011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.745562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.746244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.746941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.762298 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a HTTP/1.1 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ca9675b6-7c57-4107-987d-c6f581c3d43a'} Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:03.764194 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.767272 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.769575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:03.770934 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36af6634-3771-427d-94a7-9fa600aa9691 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 404 len: 111 microversion: 2.1 time: 0.046300 Oct 29 21:04:03.775244 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1982/4090] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:03 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:04:03.782603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:03.783490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:03.790966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.791740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.793753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.794757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.795460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.796152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.809971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:03.826268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-842ceb7d-33b2-490d-b93f-bc560e70c3dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.280163 Oct 29 21:04:03.831177 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2109/4091] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:03 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:03.946675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:03.950140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:03.957680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.958524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.959169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.960187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:03.961065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:03.967567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:03.982889 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a/os-volume_attachments HTTP/1.1 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': 'ca9675b6-7c57-4107-987d-c6f581c3d43a'} Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:03.984829 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:04:03.987704 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:03.989983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:03.991127 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f12cc6c4-5755-4769-81b9-e993ab1eba08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050542 Oct 29 21:04:03.995774 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2110/4092] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:04:03 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:04:04.003937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=28 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:04.113688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:04.128622 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-803802c7-ff56-49f8-92b9-9c158bb435d0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.351554 Oct 29 21:04:04.129906 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1983/4093] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:03 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:04.207861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-58587636", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:04.216532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:04.217251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:04.248592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:04.249194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:04.249644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:04.250416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:04.251405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:04.251900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:04.337625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:04:04.675211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:04.691980 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da50b911-e8d8-42fd-bb09-8359f7f490a2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.479659 Oct 29 21:04:04.706103 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1984/4094] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:04 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:04.717073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:04.718159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:04.724732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:04.728074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:04.728813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:04.729799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:04.730474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:04.731140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.095571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:05.112711 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db06dcd6-915b-4e4b-a571-63f231bdaa8f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.399343 Oct 29 21:04:05.113323 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1985/4095] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:04 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:05.126810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:05.131327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:05.148477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.149656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.150111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.152722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.153198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.156744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.304559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:05.314415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:05.321549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:05.324597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a5c165a0-bf04-49da-83a6-e538cf4df3e1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.210275 Oct 29 21:04:05.351261 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1986/4096] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:05 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:05.360903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:05.364216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:05.380747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.381446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.382085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.382968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.385267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.385889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.531958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:05.533118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:05.533770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:05.534352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:05.534952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:05.546930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:05.576252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.577177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.581559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.583282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.583909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.584516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.647113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:05.660810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:05.695636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:05.702619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:05.854512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-69d47100-2abd-4007-9af4-76b31f0bb548 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650591 Oct 29 21:04:05.862138 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2111/4097] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:04:05.891510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:05.892736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:05.903708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.904537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.904649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:05.906007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:05.906615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:05.907224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:06.120393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:06.133128 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8b8e109-9ded-4d24-8fff-a941e613ab83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.778451 Oct 29 21:04:06.137638 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1987/4098] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:05 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:06.147050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-607c36e0-98f4-4abf-8996-c6c08716c9f5 req-efee340d-5d22-4cdd-ac3b-c47107ab2c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a12a156-5f53-400d-bd24-6dc2d98cb50e", "name": "network-vif-plugged", "status": "completed", "tag": "d0ae7a24-ca93-4e95-8078-518a813e7127"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:06.161056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-607c36e0-98f4-4abf-8996-c6c08716c9f5 req-efee340d-5d22-4cdd-ac3b-c47107ab2c05 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:06.162052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-607c36e0-98f4-4abf-8996-c6c08716c9f5 req-efee340d-5d22-4cdd-ac3b-c47107ab2c05 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:06.162700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-607c36e0-98f4-4abf-8996-c6c08716c9f5 req-efee340d-5d22-4cdd-ac3b-c47107ab2c05 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:06.181361 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-607c36e0-98f4-4abf-8996-c6c08716c9f5 req-efee340d-5d22-4cdd-ac3b-c47107ab2c05 service nova] Creating event network-vif-plugged:d0ae7a24-ca93-4e95-8078-518a813e7127 for instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e on nch1-master-1 Oct 29 21:04:06.195799 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-607c36e0-98f4-4abf-8996-c6c08716c9f5 req-efee340d-5d22-4cdd-ac3b-c47107ab2c05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056148 Oct 29 21:04:06.196593 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1988/4099] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:06.205505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:06.209410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:06.225204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:06.225950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:06.226586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:06.228333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:06.229006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:06.234903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.308642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:07.318723 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea0ba3b6-feb8-4b9d-8571-24e31601a93a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 1.119982 Oct 29 21:04:07.321579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1989/4100] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:06 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:07.327318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:07.333208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:07.334134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:07.337942 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93106972-354a-4436-8ccb-d55529c4cedc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 1.474286 Oct 29 21:04:07.342533 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2112/4101] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:05 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:07.348682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.349199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.349696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.350296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:07.352533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:07.361751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.362662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.363322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.364291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.364968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.365969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.369830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.370515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.370979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.615098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:07.630164 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3993e25b-9312-4ad9-aaea-a47894d29954 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1265 microversion: 2.1 time: 0.303623 Oct 29 21:04:07.630723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1990/4102] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:07 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:07.676848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:07.678065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:07.692553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.694703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.696734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.697955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.698575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.699675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.882170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:07.891764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:07.893423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:07.894935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8919361d-2c2e-40fa-874c-6b3a19c181d2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.237125 Oct 29 21:04:07.896233 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1991/4103] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:07 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:07.902100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:07.903667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:07.910649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.911217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.911729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.912508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:07.913039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:07.913578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:07.997543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:08.006121 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cea50b94-6688-4be3-9d31-5da1d24a8ced tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.662218 Oct 29 21:04:08.006892 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2113/4104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:07 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:08.012816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:08.030082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:08.038902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.039555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.040257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.041200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.042063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.042939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.071311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:08.171783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b61a6603-29cb-41ff-9cf2-543ace407c24 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 204 len: 0 microversion: 2.1 time: 0.162765 Oct 29 21:04:08.172633 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2114/4105] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:08 2022] DELETE /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:04:08.182985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:08.184636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:08.194278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.196336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.197362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.198726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.199405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.200061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.236689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:08.251140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1b26468-daac-43bd-955e-7ee2fa6c33f3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.353641 Oct 29 21:04:08.269023 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1992/4106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:07 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:08.300001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5da4537e-f8c5-4b5c-a870-ee9fb06e0bcf req-2d718c64-90d7-4b27-8ebd-8bd6b3e1a650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-plugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:08.318378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5da4537e-f8c5-4b5c-a870-ee9fb06e0bcf req-2d718c64-90d7-4b27-8ebd-8bd6b3e1a650 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.321331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5da4537e-f8c5-4b5c-a870-ee9fb06e0bcf req-2d718c64-90d7-4b27-8ebd-8bd6b3e1a650 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.322084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5da4537e-f8c5-4b5c-a870-ee9fb06e0bcf req-2d718c64-90d7-4b27-8ebd-8bd6b3e1a650 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.343277 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5da4537e-f8c5-4b5c-a870-ee9fb06e0bcf req-2d718c64-90d7-4b27-8ebd-8bd6b3e1a650 service nova] Creating event network-vif-plugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:04:08.364243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5da4537e-f8c5-4b5c-a870-ee9fb06e0bcf req-2d718c64-90d7-4b27-8ebd-8bd6b3e1a650 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060472 Oct 29 21:04:08.365631 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1993/4107] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:08.381299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:08.382416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:08.395287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:08.408848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.409353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.409864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.410152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-384b5f81-e451-4de1-bd14-3858559e90a4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1271 microversion: 2.1 time: 0.232095 Oct 29 21:04:08.410596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.422671 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2115/4108] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:08 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:08.422957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.422957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.423115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:08.423115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:08.435493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.435995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.436444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.437326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.437966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.438544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.446401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:08.935020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:08.952246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cff34e47-cd36-4d49-a9e5-82d26ab80fbe tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.584145 Oct 29 21:04:08.968229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:08.969578 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1994/4109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:08 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:08.974694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:08.975502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:08.979974 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f05bea9-9d69-4495-9b84-6fa1ff8997e4 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1313 microversion: 2.1 time: 0.566539 Oct 29 21:04:08.984109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.984780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.985375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:08.986808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:08.987422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:08.988148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.001179 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2116/4110] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:08 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:09.036175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:09.037631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:09.056579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:09.058951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:09.058951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.059419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:09.059882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:09.060422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.103334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:09.111918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:09.113383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:09.114799 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8bd9ee4f-e426-43ba-8c9f-eb546a02dc22 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.143975 Oct 29 21:04:09.115369 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1995/4111] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:08 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:09.280570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:09.281365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:09.298097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:09.300869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:09.302237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.309578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:09.312033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:09.317244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:09.317244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.330506 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1bcfa59a-add0-4fc2-837f-2b6ffbb802e0 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.300085 Oct 29 21:04:09.349678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2117/4112] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:09 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:09.434824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:09.435462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:09.442826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:09.443597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:09.444365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.445105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:09.446844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:09.448195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:09.604016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:09.620926 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0a4cd8dd-c681-4c75-afbe-e4566064aa8e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1364 microversion: 2.1 time: 0.344843 Oct 29 21:04:09.621877 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1996/4113] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:09 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:09.706366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:09.716268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea00363c-004f-424a-8626-d1265bf75d52 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 0.286196 Oct 29 21:04:09.719183 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2118/4114] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:09 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:09.981122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:09.982812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:09.999417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.000073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.000572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.001505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.004066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.005277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.008974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:10.009720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:10.018677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.019205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.023547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.024453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.024932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.025373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.253741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:10.259496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:10.271855 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9345772d-1d7d-4497-8029-5ce2197e6f3a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.299049 Oct 29 21:04:10.275474 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1997/4115] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:09 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:10.283587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:10.285496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:10.290806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:10.303685 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-05ccf5b9-bc52-42ce-b6e9-f3dbf21b0958 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1499 microversion: 2.1 time: 0.298346 Oct 29 21:04:10.303833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.304378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.304607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2119/4116] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:10 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1499 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:10.304838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.306277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.306745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.307226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.330037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:10.334169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:10.357498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.360693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.361285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.364044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.364762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.366188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.440208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lazy-loading 'flavor' on Instance uuid 7a12a156-5f53-400d-bd24-6dc2d98cb50e {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:10.540020 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2814897e-6217-4322-bccc-420f19595bd3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "POST /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e/action" status: 200 len: 32 microversion: 2.1 time: 0.215704 Oct 29 21:04:10.544382 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2120/4117] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:04:10 2022] POST /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 21:04:10.554054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d98f4e56-607b-42f3-a640-6624475a42e3 req-e67bce12-102e-4171-8e61-4709ba7fdc09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93143995-41eb-46b6-881a-d9c9c353df71", "tag": "b4fc31a9-ec17-4b68-8c69-4b56982cbd29"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:10.581971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d98f4e56-607b-42f3-a640-6624475a42e3 req-e67bce12-102e-4171-8e61-4709ba7fdc09 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.582730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d98f4e56-607b-42f3-a640-6624475a42e3 req-e67bce12-102e-4171-8e61-4709ba7fdc09 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.583918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d98f4e56-607b-42f3-a640-6624475a42e3 req-e67bce12-102e-4171-8e61-4709ba7fdc09 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.614188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d98f4e56-607b-42f3-a640-6624475a42e3 req-e67bce12-102e-4171-8e61-4709ba7fdc09 service nova] Creating event network-changed:b4fc31a9-ec17-4b68-8c69-4b56982cbd29 for instance 93143995-41eb-46b6-881a-d9c9c353df71 on nch2-master-1 Oct 29 21:04:10.623694 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d98f4e56-607b-42f3-a640-6624475a42e3 req-e67bce12-102e-4171-8e61-4709ba7fdc09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077431 Oct 29 21:04:10.630461 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2121/4118] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:10.637043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:10.640922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:10.657311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.658151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.658831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.659715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.660317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.660891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.760161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:10.769843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:10.779833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:10.782312 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bfd7be6e-9a0e-44bd-8b36-364bb910856f tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.504424 Oct 29 21:04:10.785075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1998/4119] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:10 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:10.795906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-dcab0fed-0581-4543-8f24-0324f846d5e9 req-5c8db0e4-965a-479b-a052-9ebefca3bf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b266901d-80f5-4033-91e9-4198d82cc551", "name": "network-vif-plugged", "status": "completed", "tag": "d097fa95-f63b-4a03-b4eb-d20a2483c344"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:10.818866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dcab0fed-0581-4543-8f24-0324f846d5e9 req-5c8db0e4-965a-479b-a052-9ebefca3bf1f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.819434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dcab0fed-0581-4543-8f24-0324f846d5e9 req-5c8db0e4-965a-479b-a052-9ebefca3bf1f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.819774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dcab0fed-0581-4543-8f24-0324f846d5e9 req-5c8db0e4-965a-479b-a052-9ebefca3bf1f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.846303 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-dcab0fed-0581-4543-8f24-0324f846d5e9 req-5c8db0e4-965a-479b-a052-9ebefca3bf1f service nova] Creating event network-vif-plugged:d097fa95-f63b-4a03-b4eb-d20a2483c344 for instance b266901d-80f5-4033-91e9-4198d82cc551 on nch1-master-1 Oct 29 21:04:10.860718 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-dcab0fed-0581-4543-8f24-0324f846d5e9 req-5c8db0e4-965a-479b-a052-9ebefca3bf1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073145 Oct 29 21:04:10.865068 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 1999/4120] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:10.876508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:10.878434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:10.890625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.891521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.892632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.894243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:10.896395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:10.897168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:10.977851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:10.994668 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c9de85b-3695-48ea-8a22-bf8416419bf2 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.362741 Oct 29 21:04:10.995270 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2122/4121] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:10 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:11.000723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:11.004929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:11.026255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.026962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.027556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.028542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.029143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.029803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.345393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.356175 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-47ae9df5-5752-4631-bc11-87be9516f7a3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.486758 Oct 29 21:04:11.356766 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2000/4122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:10 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:11.372374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:11.373145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:11.388681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.389196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.389688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.390414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.390885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.391324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.438114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.447898 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e7724f7-bef1-40b3-8a68-c92d8ff5a132 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1550 microversion: 2.1 time: 0.451327 Oct 29 21:04:11.448778 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2123/4123] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:10 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1550 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:11.454948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:11.455979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:11.465152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.465991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.466912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.467828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.468389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.468914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.644725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.663455 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ade32043-7604-42ef-a9bb-0fb44eac3f7d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 0.299129 Oct 29 21:04:11.677570 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2001/4124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:11 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:11.677570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:11.677570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:11.682176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.682819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.683271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.684010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.684914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.686002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.690825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.702936 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e8641d6-58ca-4a8b-8f04-88eec340eb8c tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1366 microversion: 2.1 time: 0.252702 Oct 29 21:04:11.703506 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2124/4125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:11 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:11.812865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:11.813919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:11.822541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.823876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.824760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.825734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:11.826372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:11.827057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:11.839374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4fdcefbb-9ced-4ecd-95f9-a1508776b2ab tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173019 Oct 29 21:04:11.840572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2002/4126] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:04:11 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:11.924932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.941230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.942754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:11.944130 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-926844dd-296c-4bae-b00e-31d92960eef6 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.138892 Oct 29 21:04:11.950977 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2125/4127] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:11 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:12.021197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:12.022439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:12.029448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:12.029970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:12.030413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:12.031113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:12.031917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:12.032350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:12.186391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:12.194915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-70007bf9-68da-4fb4-b192-8829cf19f3ab tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1512 microversion: 2.1 time: 0.179712 Oct 29 21:04:12.207642 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2003/4128] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:12 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:12.391924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:12.394066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:12.408336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:12.411543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:12.414072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:12.416864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:12.417581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:12.421373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:12.689136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:12.689832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:12.697564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:12.698329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:12.698920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:12.699795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:12.700405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:12.700985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.508287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:13.511061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:13.521071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-33863a9f-6eac-490e-8b80-e634aa17424a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 0.835761 Oct 29 21:04:13.524730 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9591c337-acb2-426f-9668-ad9ce890f9e8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 1.142160 Oct 29 21:04:13.526570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2126/4129] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:12 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:13.532453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:13.533591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:13.539007 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2004/4130] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:12 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:13.544758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.549594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:13.550215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:13.550390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.551318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.552324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.553014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.556976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.561211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.565910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.566621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.567521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.568292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.568876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.731467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:13.750301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:13.753819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:13.756680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84ba6f81-bfe2-4d10-bed5-3244051bc8eb tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.216027 Oct 29 21:04:13.757385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2005/4131] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:13 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:13.783068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:13.783690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:13.791311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.792100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.792538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.793241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.793715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.794279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.927932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:13.941896 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a06a3f97-1df5-4468-aea5-21db2bea0e3b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1556 microversion: 2.1 time: 0.413937 Oct 29 21:04:13.943390 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2127/4132] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:13 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1556 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:13.969657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:13.970171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:13.976583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.977531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.978284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:13.979155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:13.979930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:13.980507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.100591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:14.116254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-011e1caf-634f-4aea-ab1c-974dbb933889 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1489 microversion: 2.1 time: 0.347916 Oct 29 21:04:14.117568 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2006/4133] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:13 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1489 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:14.123329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-edb9b4fc-6e27-4e2e-bfea-0661a203088a req-9d964365-0b55-412e-8ef9-9c04e6c4c3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:14.131585 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c5b8f559-d954-42ca-be3e-c6191f271358 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164822 Oct 29 21:04:14.139839 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2128/4134] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:04:13 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:14.140002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-edb9b4fc-6e27-4e2e-bfea-0661a203088a req-9d964365-0b55-412e-8ef9-9c04e6c4c3ce service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.140002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-edb9b4fc-6e27-4e2e-bfea-0661a203088a req-9d964365-0b55-412e-8ef9-9c04e6c4c3ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.140002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-edb9b4fc-6e27-4e2e-bfea-0661a203088a req-9d964365-0b55-412e-8ef9-9c04e6c4c3ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.155024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1174932629"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:14.160084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:14.163361 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-edb9b4fc-6e27-4e2e-bfea-0661a203088a req-9d964365-0b55-412e-8ef9-9c04e6c4c3ce service nova] Creating event network-changed:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:04:14.168628 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-edb9b4fc-6e27-4e2e-bfea-0661a203088a req-9d964365-0b55-412e-8ef9-9c04e6c4c3ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049713 Oct 29 21:04:14.169490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2007/4135] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:14.201706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.202652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.203313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.204211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.204812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.205386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.312516 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fc2fde26-35e8-4a18-9af1-9ab467747720 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "PUT /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1062 microversion: 2.1 time: 0.172272 Oct 29 21:04:14.327182 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2129/4136] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:04:14 2022] PUT /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1062 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:14.337691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:14.338427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:14.351762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.352290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.353690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.354438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.354904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.358118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.546285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:14.548016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:14.564323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.564992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.566366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.567287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.571951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.573082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.810421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:14.826809 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f3aedd8-64a4-45d9-98f5-9d0f4151874c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1489 microversion: 2.1 time: 0.494018 Oct 29 21:04:14.828058 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2008/4137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:14 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1489 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:14.834108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:14.835310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:14.844107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.845213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.846102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.847310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.848798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.849636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.919273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:14.929535 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3df6239-84ac-4e36-affa-8ba160110a3c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 0.388796 Oct 29 21:04:14.931753 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2130/4138] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:14 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:14.946518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:14.947772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:14.955377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.957698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.959761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.960777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:14.961527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:14.962168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:14.969384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:15.094064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:15.113635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:15.115642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:15.117985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-28181bae-a70f-4533-b3cb-be5e0e477362 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.184243 Oct 29 21:04:15.130142 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2131/4139] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:14 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:15.144234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:15.146712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:15.155188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.156501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.157732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.158689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.159350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.159983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.224463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:15.238800 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-783419d4-9def-4a1d-a02d-2d6805d466c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.409300 Oct 29 21:04:15.239622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2009/4140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:14 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:15.562878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:15.573340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-498788ae-1c22-4dfb-8f43-9dc2665256bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1489 microversion: 2.1 time: 0.441993 Oct 29 21:04:15.599929 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2132/4141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:15 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1489 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:15.606156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:15.607186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:15.616655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.617202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.617665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.618577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.619041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.619473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.673890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:15.824325 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-058b7ce6-28f8-4ff7-b05b-45c27475df8e tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 204 len: 0 microversion: 2.1 time: 0.224018 Oct 29 21:04:15.825005 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2010/4142] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:15 2022] DELETE /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:04:15.833498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:15.834193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:15.841302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:15.843776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:15.848050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.850849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.851654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.854749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.857518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.858120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.962125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:15.963289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:15.988721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.990751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.994300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:15.996117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:15.996938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:15.997554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:16.358714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:16.374221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf1bc134-a6b1-4e5d-97b5-fbdccb5d0d22 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1495 microversion: 2.1 time: 0.543059 Oct 29 21:04:16.378091 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2133/4143] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:15 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1495 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:16.395354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:16.395994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:16.416462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:16.419851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:16.420173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:16.420656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:16.422081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:16.422387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:16.426423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:16.433128 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43885ccd-e8b8-40a8-95a1-0959a924725e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 0.478703 Oct 29 21:04:16.448640 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2011/4144] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:15 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:16.448640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:16.448640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:16.448640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:16.462831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:16.463346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:16.463802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:16.464531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:16.464996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:16.465433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:16.556801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:16.567968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:16.573835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:16.576571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72d32306-456c-4af5-9a63-346ab9fa5ff5 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.196590 Oct 29 21:04:16.578616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2134/4145] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:16 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:16.599551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-bdc80677-d0d0-441d-90fc-5b4e59502347 req-4869cd75-6b96-47df-b3a4-d3ba29900bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b266901d-80f5-4033-91e9-4198d82cc551", "tag": "d097fa95-f63b-4a03-b4eb-d20a2483c344"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:16.625737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bdc80677-d0d0-441d-90fc-5b4e59502347 req-4869cd75-6b96-47df-b3a4-d3ba29900bfc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:16.626242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bdc80677-d0d0-441d-90fc-5b4e59502347 req-4869cd75-6b96-47df-b3a4-d3ba29900bfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:16.626686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bdc80677-d0d0-441d-90fc-5b4e59502347 req-4869cd75-6b96-47df-b3a4-d3ba29900bfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:16.659304 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-bdc80677-d0d0-441d-90fc-5b4e59502347 req-4869cd75-6b96-47df-b3a4-d3ba29900bfc service nova] Creating event network-changed:d097fa95-f63b-4a03-b4eb-d20a2483c344 for instance b266901d-80f5-4033-91e9-4198d82cc551 on nch1-master-1 Oct 29 21:04:16.671368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-bdc80677-d0d0-441d-90fc-5b4e59502347 req-4869cd75-6b96-47df-b3a4-d3ba29900bfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086357 Oct 29 21:04:16.672023 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2135/4146] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:16.794946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:16.805577 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-785444f6-6e53-4053-a685-cee5d03f86dd tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.370620 Oct 29 21:04:16.806392 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2012/4147] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:16 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:17.407097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:17.407820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:17.428150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:17.428656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:17.429229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:17.430375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:17.430838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:17.431455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:17.456099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:17.457384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:17.473335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:17.474147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:17.475930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:17.476957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:17.479760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:17.480447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:18.424920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:18.445064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-643e3bfb-c474-415d-8fa0-2ccf82eeb98f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1495 microversion: 2.1 time: 1.042662 Oct 29 21:04:18.447052 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2136/4148] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:17 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1495 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:18.467811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-990156d9-15e6-45d8-800e-95d290f8afe5 req-83af245b-dbe3-4afb-8673-6e0fb4825e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93143995-41eb-46b6-881a-d9c9c353df71", "name": "network-vif-plugged", "status": "completed", "tag": "b4fc31a9-ec17-4b68-8c69-4b56982cbd29"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:18.507777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-990156d9-15e6-45d8-800e-95d290f8afe5 req-83af245b-dbe3-4afb-8673-6e0fb4825e71 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:18.508837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-990156d9-15e6-45d8-800e-95d290f8afe5 req-83af245b-dbe3-4afb-8673-6e0fb4825e71 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:18.509283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-990156d9-15e6-45d8-800e-95d290f8afe5 req-83af245b-dbe3-4afb-8673-6e0fb4825e71 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:18.544523 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-990156d9-15e6-45d8-800e-95d290f8afe5 req-83af245b-dbe3-4afb-8673-6e0fb4825e71 service nova] Creating event network-vif-plugged:b4fc31a9-ec17-4b68-8c69-4b56982cbd29 for instance 93143995-41eb-46b6-881a-d9c9c353df71 on nch2-master-1 Oct 29 21:04:18.557764 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-990156d9-15e6-45d8-800e-95d290f8afe5 req-83af245b-dbe3-4afb-8673-6e0fb4825e71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108922 Oct 29 21:04:18.558383 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2137/4149] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:18.581910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:18.582627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:18.614752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:18.615240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:18.615694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:18.616405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:18.616864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:18.617324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:18.835827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:18.849709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:18.856104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:18.858692 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9c39270-a0a9-4b60-848e-9c9c8204e0ba tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.298522 Oct 29 21:04:18.859828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2138/4150] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:18 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:18.875321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:18.876191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:18.887004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:18.892623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:18.894459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:18.895276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:18.896628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:18.900241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:18.916094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:18.934550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-059abb68-bf37-4e74-aadb-9b06ab1a2129 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 1.476871 Oct 29 21:04:18.935646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2013/4151] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:17 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:19.474710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:19.475505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:19.494000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.495124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.498414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:19.501090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.502462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.504384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:19.544099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:19.562925 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40eaaabe-6d2c-4b93-8443-5d5a8e95358e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.701817 Oct 29 21:04:19.563790 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2139/4152] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:18 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:19.575903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ace64c93-c75b-46fa-829e-03c70c4e8aaf req-defdcaa8-c41f-478d-8d3c-7dec228b646f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0de1b1b-a7f2-4a5b-af3a-70a50512b706", "name": "network-vif-deleted", "tag": "6f51a070-8cbe-46df-a715-a482955b9319"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:19.593627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:19.614703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ace64c93-c75b-46fa-829e-03c70c4e8aaf req-defdcaa8-c41f-478d-8d3c-7dec228b646f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.616680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ace64c93-c75b-46fa-829e-03c70c4e8aaf req-defdcaa8-c41f-478d-8d3c-7dec228b646f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.619545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ace64c93-c75b-46fa-829e-03c70c4e8aaf req-defdcaa8-c41f-478d-8d3c-7dec228b646f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:19.655893 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ace64c93-c75b-46fa-829e-03c70c4e8aaf req-defdcaa8-c41f-478d-8d3c-7dec228b646f service nova] Creating event network-vif-deleted:6f51a070-8cbe-46df-a715-a482955b9319 for instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 on nch1-master-1 Oct 29 21:04:19.676295 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ace64c93-c75b-46fa-829e-03c70c4e8aaf req-defdcaa8-c41f-478d-8d3c-7dec228b646f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108098 Oct 29 21:04:19.677192 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2140/4153] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:19.716680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:19.730597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d0dc47c7-5d1e-4d23-8985-d79ed3ab2a88 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 200 len: 1292 microversion: 2.1 time: 0.258984 Oct 29 21:04:19.733333 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2014/4154] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:19 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 1292 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:19.887690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:19.888405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:19.898190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.899339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.899781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:19.900489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.900947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.901373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:19.962932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:19.963644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:19.974423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.974924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.975370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:19.976100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:19.976544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:19.977036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.058892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:20.069836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:20.078743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:20.089422 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-03009370-76bb-453f-9c0a-b05fef18995d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.206641 Oct 29 21:04:20.090406 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2141/4155] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:19 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:20.225199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:20.236407 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a309846-ff83-45b2-bbcc-67a287960b1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1313 microversion: 2.1 time: 0.279830 Oct 29 21:04:20.237048 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2015/4156] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:19 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:20.593214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:20.594035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:20.603591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.604089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.604661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.605557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.606569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.607056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.789639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-498319895", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:20.796887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:20.810995 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7aba854-dbd1-41f2-aa2e-5083a8d4d349 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.222776 Oct 29 21:04:20.811840 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2016/4157] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:20 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:20.833700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:20.834737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:20.841818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.842536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.843646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.844834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.845544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.846310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.902751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 HTTP/1.1 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f0de1b1b-a7f2-4a5b-af3a-70a50512b706'} Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:20.904946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:20.908969 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:20.908969 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:20.908969 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:20.908969 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:20.908969 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:20.908969 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:20.909573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] validate_networks() for [('3b68060f-ecb8-4b22-879b-438ab171c21d', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:04:20.910519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:20.911572 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26a02ff0-7496-4a7a-8ebe-edf7d8ccccd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 404 len: 111 microversion: 2.1 time: 0.098666 Oct 29 21:04:20.912686 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2017/4158] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:20 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:20.928428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e4ad351e-d997-4f79-8663-c4ba621b508c req-7babd728-220a-4f48-bcb9-1aa92ce08e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93143995-41eb-46b6-881a-d9c9c353df71", "name": "network-vif-deleted", "tag": "b4fc31a9-ec17-4b68-8c69-4b56982cbd29"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:20.940054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4ad351e-d997-4f79-8663-c4ba621b508c req-7babd728-220a-4f48-bcb9-1aa92ce08e23 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.940777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4ad351e-d997-4f79-8663-c4ba621b508c req-7babd728-220a-4f48-bcb9-1aa92ce08e23 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.942476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e4ad351e-d997-4f79-8663-c4ba621b508c req-7babd728-220a-4f48-bcb9-1aa92ce08e23 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.957058 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e4ad351e-d997-4f79-8663-c4ba621b508c req-7babd728-220a-4f48-bcb9-1aa92ce08e23 service nova] Creating event network-vif-deleted:b4fc31a9-ec17-4b68-8c69-4b56982cbd29 for instance 93143995-41eb-46b6-881a-d9c9c353df71 on nch2-master-1 Oct 29 21:04:20.964398 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e4ad351e-d997-4f79-8663-c4ba621b508c req-7babd728-220a-4f48-bcb9-1aa92ce08e23 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049526 Oct 29 21:04:20.965311 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2018/4159] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:20.981833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:20.982765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:20.993306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.994074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.995021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:20.995950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:20.996731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:20.997418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.020500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 HTTP/1.1 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f0de1b1b-a7f2-4a5b-af3a-70a50512b706'} Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.023090 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.027080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.029062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.030167 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e59480a4-b92f-49f7-a13a-fd199a61b74d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 404 len: 111 microversion: 2.1 time: 0.063103 Oct 29 21:04:21.030898 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2019/4160] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:20 2022] DELETE /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.044803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.046796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: f0de1b1b-a7f2-4a5b-af3a-70a50512b706] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.085742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.089210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.091381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.092885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.096217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.097977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.127085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 HTTP/1.1 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f0de1b1b-a7f2-4a5b-af3a-70a50512b706'} Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.135258 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.138783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.138783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.138783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.138783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.138783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. Oct 29 21:04:21.138783 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.140447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance f0de1b1b-a7f2-4a5b-af3a-70a50512b706 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.141531 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b1c2e95d-a594-4155-8be1-b2718eff218c tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706" status: 404 len: 111 microversion: 2.1 time: 0.106502 Oct 29 21:04:21.142700 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2020/4161] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/f0de1b1b-a7f2-4a5b-af3a-70a50512b706 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:04:21.156152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.156799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.164002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.165338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.167229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.168123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.169484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.170083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.292673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:21.313618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:21.318193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:21.319665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-527079b4-d92c-4363-b493-aa2d558ea864 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.175648 Oct 29 21:04:21.323897 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2021/4162] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:21.335890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.338234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.352619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.354962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.357706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.358605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.359235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.359813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.378119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 HTTP/1.1 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2cf79198-dbfe-4f1a-adf4-f6bb1eab8262'} Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.380271 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.384098 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.386055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.387110 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75a189c9-ed81-4f62-ab8a-465084d36dd7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 404 len: 111 microversion: 2.1 time: 0.062098 Oct 29 21:04:21.387859 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2022/4163] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:21 2022] DELETE /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.393307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.394184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.401535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.402294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.403156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.404275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.404973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.406233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.557138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:21.568574 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-deeb3440-486b-4988-a425-fb1d3ce65879 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1292 microversion: 2.1 time: 0.179363 Oct 29 21:04:21.569303 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2023/4164] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1292 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:21.590469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.591597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.598869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.599850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.600528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.601885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.602630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.603280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.620540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 HTTP/1.1 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2cf79198-dbfe-4f1a-adf4-f6bb1eab8262'} Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.622467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.625648 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.625648 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.625648 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.625648 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.625648 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. Oct 29 21:04:21.625648 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.627388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.628492 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a5bc659-99f0-4767-a05a-56ab5ab1f6bd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262" status: 404 len: 111 microversion: 2.1 time: 0.042889 Oct 29 21:04:21.629573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2024/4165] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/2cf79198-dbfe-4f1a-adf4-f6bb1eab8262 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.638332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.639126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.647810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.649074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.649782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.650592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.651119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.651685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.667946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f HTTP/1.1 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1a71a556-5e58-45f9-93f3-2d20d1297c9f'} Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.670044 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.673114 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.673719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:21.673719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:21.673719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:21.674117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:21.674945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:21.675602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.676537 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d72c9f1b-ebd3-4680-8730-79e2620b4c1f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 404 len: 111 microversion: 2.1 time: 0.042423 Oct 29 21:04:21.677881 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2025/4166] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:21 2022] DELETE /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.686895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.688315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 1a71a556-5e58-45f9-93f3-2d20d1297c9f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.691491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.691993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.692432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.693167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.693819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.694400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.696800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.697293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.697948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.698811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.699280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.699827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.717430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.718337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Getting quotas for project 6173752e65384e85a2bcc8c3e542931a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f HTTP/1.1 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1a71a556-5e58-45f9-93f3-2d20d1297c9f'} Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.720032 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 1a71a556-5e58-45f9-93f3-2d20d1297c9f could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b2ecac9-edb4-4aa6-a970-85dad5a6a9dc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f" status: 404 len: 111 microversion: 2.1 time: 0.040245 Oct 29 21:04:21.727502 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2026/4167] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/1a71a556-5e58-45f9-93f3-2d20d1297c9f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:04:21.732747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Getting quotas for user 7c7c243e53fb4f3a895b665028a14373 and project 6173752e65384e85a2bcc8c3e542931a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:21.733149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.733961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.744120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.744918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.745378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.746123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.746582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.747009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.750061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:21.752544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:21.763248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 HTTP/1.1 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b30747e4-474b-4475-a090-b52052b0b135'} Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.764932 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-832bb343-389f-4b7e-a904-1b09780a57f7 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 404 len: 111 microversion: 2.1 time: 0.039012 Oct 29 21:04:21.768569 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2027/4168] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:21 2022] DELETE /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.775584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.776197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: b30747e4-474b-4475-a090-b52052b0b135] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.783777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.784277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.784883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.785813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.786281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.786767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.803479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 HTTP/1.1 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b30747e4-474b-4475-a090-b52052b0b135'} Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.805760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance b30747e4-474b-4475-a090-b52052b0b135 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-929eb307-5598-4286-89bd-712e343904bc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135" status: 404 len: 111 microversion: 2.1 time: 0.035817 Oct 29 21:04:21.809331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2028/4169] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/b30747e4-474b-4475-a090-b52052b0b135 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.818543 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc2195c3-37f5-4aa6-8f0a-a658897a8554 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240967 Oct 29 21:04:21.819084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.819597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.826268 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2142/4170] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:04:21.827842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.828653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.829201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.830091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.830658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.831382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c8c1754-2227-407c-8ce8-a81d93b06254 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.832026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4c8c1754-2227-407c-8ce8-a81d93b06254 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.832981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.850184 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 HTTP/1.1 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '367afe3d-08fb-45b3-b407-7b14ad04aeb8'} Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:21.852009 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:21.856002 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:21.856946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:21.857971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f80be0e5-cd9c-4513-94a7-02590f1bde4f tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 404 len: 111 microversion: 2.1 time: 0.043401 Oct 29 21:04:21.858701 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2029/4171] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:21 2022] DELETE /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:21.868213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.869001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.877050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.877719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.878368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.879282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.879904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.880496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.938739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4c8c1754-2227-407c-8ce8-a81d93b06254 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:21.951176 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c8c1754-2227-407c-8ce8-a81d93b06254 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1216 microversion: 2.1 time: 0.123346 Oct 29 21:04:21.951956 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2143/4172] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:21.969516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:21.970779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 367afe3d-08fb-45b3-b407-7b14ad04aeb8] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:21.977040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:21.978952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.979756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.980431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:21.981587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:21.982250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:21.982856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.011483 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 HTTP/1.1 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '367afe3d-08fb-45b3-b407-7b14ad04aeb8'} Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.015936 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 367afe3d-08fb-45b3-b407-7b14ad04aeb8 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53693b6f-c4a2-45eb-bd31-5caa44218466 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8" status: 404 len: 111 microversion: 2.1 time: 0.063704 Oct 29 21:04:22.022859 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2144/4173] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/367afe3d-08fb-45b3-b407-7b14ad04aeb8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:22.037009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.037547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.044057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.044553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.044990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.045721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.046176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.046602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.062685 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 HTTP/1.1 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '11bddee2-4a83-4178-9ba5-abc01a648538'} Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:22.064984 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.068074 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.070009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:22.071669 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-714ba2d4-2251-44fe-917d-a8e0f3cef8d8 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 404 len: 111 microversion: 2.1 time: 0.043917 Oct 29 21:04:22.072761 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2145/4174] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:22 2022] DELETE /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:22.090133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.090897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 11bddee2-4a83-4178-9ba5-abc01a648538] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.097625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.098731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.099084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.100185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.100896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.102102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.121840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 HTTP/1.1 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '11bddee2-4a83-4178-9ba5-abc01a648538'} Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.123604 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 11bddee2-4a83-4178-9ba5-abc01a648538 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de149263-851a-4c4a-8148-d5d56c3fc631 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538" status: 404 len: 111 microversion: 2.1 time: 0.048257 Oct 29 21:04:22.127047 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2146/4175] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:22 2022] GET /compute/v2.1/servers/11bddee2-4a83-4178-9ba5-abc01a648538 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:22.134827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.135533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 554bb8c9-aed0-4928-bea2-6b8b93e1feb5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.140477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:22.143130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.143745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.144955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.145797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.146497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.147251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.149766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ed0b9438-86d2-4563-aa31-d21345c372bb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.285988 Oct 29 21:04:22.151385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2030/4176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:21 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:22.172478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 HTTP/1.1 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '554bb8c9-aed0-4928-bea2-6b8b93e1feb5'} Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:22.174068 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.177567 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.180848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:22.182025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fe0b9d69-fd92-4eab-a70f-7ad429702524 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5" status: 404 len: 111 microversion: 2.1 time: 0.051908 Oct 29 21:04:22.182774 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2147/4177] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:22 2022] DELETE /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:22.190917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.191485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 554bb8c9-aed0-4928-bea2-6b8b93e1feb5] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.198359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.199095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.199778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.200573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.201116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.201647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.224531 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 HTTP/1.1 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '554bb8c9-aed0-4928-bea2-6b8b93e1feb5'} Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.226116 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 554bb8c9-aed0-4928-bea2-6b8b93e1feb5 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2d917eb7-ba4e-4ed6-b813-21bdd4dc22dd tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5" status: 404 len: 111 microversion: 2.1 time: 0.041316 Oct 29 21:04:22.230337 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2031/4178] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:22 2022] GET /compute/v2.1/servers/554bb8c9-aed0-4928-bea2-6b8b93e1feb5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:22.236758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.237319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.246082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.246594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.247323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.248638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.249247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.249880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.281942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:22.354677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.357407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.381205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.381752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.382205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.382979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.383444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.383869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.408178 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-356ce3bc-8de1-4398-a48b-baa054bd619d tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 204 len: 0 microversion: 2.1 time: 0.174286 Oct 29 21:04:22.410355 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2148/4179] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:22 2022] DELETE /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:04:22.432234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.433168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.447468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.448417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.449015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.449959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.450615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.451253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.521432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:22.535697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:22.539890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:22.541653 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef8adc57-0d93-4810-baea-a4629cec88b9 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.193697 Oct 29 21:04:22.544029 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2032/4180] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:22 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:22.594902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.595631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:22.620603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.621295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.621815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.622734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:22.624851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:22.627245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:22.647674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:22.665651 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e29dcdc6-af5a-4d8c-a6a8-9613c667c4ff tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1480 microversion: 2.1 time: 0.248967 Oct 29 21:04:22.666421 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2149/4181] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:22 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1480 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:22.738243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:22.749655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7523b071-65ff-41c0-99e2-0a0e1fde596c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1292 microversion: 2.1 time: 0.160768 Oct 29 21:04:22.753775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2033/4182] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:22 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:22.978742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:22.979384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:23.005347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.005915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.007729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.008842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.013265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.013939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.136254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:23.145935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97687ddb-d033-40e8-837b-211a6a44f348 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1212 microversion: 2.1 time: 0.176540 Oct 29 21:04:23.161815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2150/4183] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:22 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1212 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:23.173788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:23.174781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:23.184133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.184835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.185281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.186020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.186626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.188637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.405699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:23.416284 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a5e006a-89bc-46ec-a7b0-27618930c05a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.246737 Oct 29 21:04:23.416952 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2034/4184] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:23 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:23.571060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:23.571756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:23.578626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.579119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.579655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.580373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.580825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.581254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.654292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:23.676692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:23.678200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:23.681004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-32c1458e-8524-4411-8884-6eb61c2538f2 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.113291 Oct 29 21:04:23.682449 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2151/4185] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:23 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:23.691984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:23.692856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:23.707565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.709581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.710282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.711764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.712230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.712822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.774830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:23.775471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:23.783854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.784358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.784799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.785535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.785998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.786425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.825624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:23.870540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:23.871052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:23.871505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:23.875548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'fault' on Instance uuid 93143995-41eb-46b6-881a-d9c9c353df71 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:23.973851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:23.989301 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-630ac605-05a2-493e-943e-314e3cfad417 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 200 len: 1303 microversion: 2.1 time: 0.219602 Oct 29 21:04:23.992839 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2152/4186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:23 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 1303 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:24.001982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:24.018340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2bb07db6-8138-4d74-92c8-6bf151bd5fdc tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1480 microversion: 2.1 time: 0.331014 Oct 29 21:04:24.019335 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2035/4187] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:23 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1480 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:24.170781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:24.171845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:24.179510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:24.180232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:24.180678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:24.181390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:24.181890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:24.182350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:24.254505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:24.262598 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-149b68b5-6177-43f7-a69b-635d54c3a41d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1274 microversion: 2.1 time: 0.095982 Oct 29 21:04:24.263189 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2153/4188] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:24 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:24.455742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:24.456993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:24.492849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:24.495742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:24.500736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:24.505815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:24.506886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:24.508741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:24.715904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:24.716813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:24.727706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:24.729422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:24.730686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:24.732189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:24.733109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:24.733825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:24.796022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:24.817756 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4eb1d733-c4b5-4a8a-94a0-c3c6c36116a8 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.381065 Oct 29 21:04:24.821383 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2036/4189] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:24 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:24.838698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:24.853393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:24.856698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:24.860234 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6da5925-c8ca-40c7-a300-da2e237bde3c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.154691 Oct 29 21:04:24.862186 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2154/4190] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:24 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:04:25.017713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:25.018357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:25.024834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.025338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.030320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.031426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.032465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.033661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.053506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:25.054199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:25.073695 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 HTTP/1.1 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '93143995-41eb-46b6-881a-d9c9c353df71'} Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:25.075775 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:04:25.079080 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:25.082604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.083130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.083588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.084318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.084788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.085230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.088077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:25.089029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25e43ae9-9e11-4742-b15c-290da261a2fb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 404 len: 111 microversion: 2.1 time: 0.076534 Oct 29 21:04:25.089600 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2037/4191] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:25 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:25.127647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b11248dd-1f0b-4a85-874b-4babba45e735 req-b82d5d6e-62d3-4fca-b584-e11413d0cdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6ba4b7-b2b8-4a27-8b72-071029f7e3db", "name": "network-vif-deleted", "tag": "a092463f-6017-47bf-8c5c-1eca16d4b176"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:25.169545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b11248dd-1f0b-4a85-874b-4babba45e735 req-b82d5d6e-62d3-4fca-b584-e11413d0cdec service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.171260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b11248dd-1f0b-4a85-874b-4babba45e735 req-b82d5d6e-62d3-4fca-b584-e11413d0cdec service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.176241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b11248dd-1f0b-4a85-874b-4babba45e735 req-b82d5d6e-62d3-4fca-b584-e11413d0cdec service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.221047 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b11248dd-1f0b-4a85-874b-4babba45e735 req-b82d5d6e-62d3-4fca-b584-e11413d0cdec service nova] Creating event network-vif-deleted:a092463f-6017-47bf-8c5c-1eca16d4b176 for instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db on nch1-master-1 Oct 29 21:04:25.235241 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b11248dd-1f0b-4a85-874b-4babba45e735 req-b82d5d6e-62d3-4fca-b584-e11413d0cdec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126807 Oct 29 21:04:25.235940 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2038/4192] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:25.254189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d0ccab778b46aa9894f047db04b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26372e44d6654191b8a30f4a1af2d77e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:25.265053 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d32d8336-bddd-47fd-b1d7-9a40364f0369 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 200 len: 1438 microversion: 2.1 time: 0.223457 Oct 29 21:04:25.266385 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2155/4193] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:25 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 1438 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:25.300732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:25.301485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:25.332011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.334257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.349666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.361430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1676576762", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:25.376917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.378166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.379932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.517776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:04:25.792362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:25.809868 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7cafef11-dff0-4acb-b918-db21b4db5f26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.526903 Oct 29 21:04:25.810777 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2039/4194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:25 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:25.846046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:25.846692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:25.853342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.853967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.854429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.855126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:25.855590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:25.856077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:25.876996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:26.183175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:26.192463 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75d40fc0-155b-41fa-b648-3438e9274938 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.350509 Oct 29 21:04:26.193062 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2040/4195] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:25 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:26.219188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:26.220158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:26.226967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.227571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.228033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.229037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.229543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.229988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.265430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:26.265920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:26.266414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:26.266835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:26.267248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:26.280895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.281486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.283456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.284243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.284716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.285164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.306727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:26.312271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:26.313252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:26.328895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:26.330840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:26.332040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0a12a45e-d08b-4ecd-8176-d7db680c7fde tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.123888 Oct 29 21:04:26.332593 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2041/4196] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:26 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:26.334429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:26.336937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:26.337817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:26.338633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] [instance: 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:26.344937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.345698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.346339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.347258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.347914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.348542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.370484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] HTTP exception thrown: Instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db could not be found. Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Request method failure captured: Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db HTTP/1.1 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZRFM8DrTYq7VhOZd-6OtJFRBY8zGb65eHL1eXeEkifY9RR5WP1p6SvCDCBjNuv1x6a_Qh5lQUy4kdzDSZuV0GtkkvaIg0BYci8kcylhYbEp369YB52o70CyDNzVQlLh_ZV_ClyNgHtJGwYshHISUyI_XBKXYNOGT9g0VJ2K8rcaoco Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/26372e44d6654191b8a30f4a1af2d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersTestJSON-273767695 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 26372e44d6654191b8a30f4a1af2d77e Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersTestJSON-273767695 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersTestJSON-273767695-project Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 23d0ccab778b46aa9894f047db04b6b7 Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersTestJSON-273767695-project Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db could not be found. Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2f6ba4b7-b2b8-4a27-8b72-071029f7e3db'} Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db could not be found. Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db could not be found. Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:26.372592 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db could not be found. Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] Returning 404 to user: Instance 2f6ba4b7-b2b8-4a27-8b72-071029f7e3db could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e603b500-f0df-4d05-a372-1853470d1f32 tempest-ServersTestJSON-273767695 tempest-ServersTestJSON-273767695-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db" status: 404 len: 111 microversion: 2.1 time: 0.040342 Oct 29 21:04:26.376204 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2042/4197] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:26 2022] GET /compute/v2.1/servers/2f6ba4b7-b2b8-4a27-8b72-071029f7e3db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:26.395856 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-44ffecd8-b163-4158-b6e1-f65e477160a5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039497 Oct 29 21:04:26.396930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2156/4198] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:04:26.408339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c68bc481-04a4-497e-983d-285e8750e165 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:26.409265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c68bc481-04a4-497e-983d-285e8750e165 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:26.489222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c68bc481-04a4-497e-983d-285e8750e165 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:26.499378 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c68bc481-04a4-497e-983d-285e8750e165 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1215 microversion: 2.1 time: 0.095339 Oct 29 21:04:26.500791 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2043/4199] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:26 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:26.534020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-04a4ef59-819b-444c-b8d4-d8e2d09a9fce req-0a8a78a5-97d6-4ac6-8caa-189d45304a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:26.561776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-04a4ef59-819b-444c-b8d4-d8e2d09a9fce req-0a8a78a5-97d6-4ac6-8caa-189d45304a1e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.562357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-04a4ef59-819b-444c-b8d4-d8e2d09a9fce req-0a8a78a5-97d6-4ac6-8caa-189d45304a1e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.562917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-04a4ef59-819b-444c-b8d4-d8e2d09a9fce req-0a8a78a5-97d6-4ac6-8caa-189d45304a1e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.575168 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-04a4ef59-819b-444c-b8d4-d8e2d09a9fce req-0a8a78a5-97d6-4ac6-8caa-189d45304a1e service nova] Creating event network-changed:51d03947-ece9-475c-b20e-71c5f2dcc21b for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee on nch2-master-1 Oct 29 21:04:26.580087 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-04a4ef59-819b-444c-b8d4-d8e2d09a9fce req-0a8a78a5-97d6-4ac6-8caa-189d45304a1e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050403 Oct 29 21:04:26.580864 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2157/4200] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:26.834297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:26.835233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:26.846312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.846988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.847677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:26.848568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:26.849806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:26.850424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.147737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:27.158631 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6fe38b1d-2115-45ba-8fe8-d84a2bfc96c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.330255 Oct 29 21:04:27.159202 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2044/4201] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:26 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:27.221407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:27.222486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:27.242909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:27.243416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:27.250132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.251018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:27.251419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:27.251880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.359383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:27.360273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:27.367110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:27.367817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:27.368443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.369370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:27.370000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:27.370581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.518112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:27.530577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:27.532326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:27.534333 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff6560bb-e856-4ec0-9a21-259656ec9d0e tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.178911 Oct 29 21:04:27.535857 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2045/4202] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:27 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:27.541376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:27.542143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:27.548279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:27.548854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:27.549866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.550994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:27.551919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:27.552575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:27.632438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:27.642344 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca12ed22-62b5-484b-a664-01c52899ff1f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.426986 Oct 29 21:04:27.643360 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2158/4203] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:27 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:27.655041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:27.663567 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a64377f-ee37-4572-b630-590e9b8d7ae5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1267 microversion: 2.1 time: 0.126187 Oct 29 21:04:27.664191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2046/4204] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:27 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:28.186765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:28.187583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:28.200368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.200594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.201045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.202089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.203065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.203666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.563947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:28.564627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:28.574416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.576320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.579107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.580224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.581140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.582720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.816970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:28.826912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:28.828851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:28.830618 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ea871a2-1851-494e-bad3-7e7c205aaea1 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.270609 Oct 29 21:04:28.854826 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2047/4205] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:28 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:28.861836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:28.862574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:28.869629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.870476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.871127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.872050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.872715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.873345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.887967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:28.904937 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a3133f1-5c84-49c3-aed0-e9cbbb5a9aa7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.725203 Oct 29 21:04:28.905577 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2159/4206] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:28 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:28.910410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:28.911024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:28.922217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.922959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.923585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:28.924560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:28.925182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:28.925646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:29.049877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:29.060875 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b5f36f0e-4788-4437-9765-4b874d110231 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1273 microversion: 2.1 time: 0.153927 Oct 29 21:04:29.064275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2160/4207] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:28 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:29.245855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:29.264479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a17037c-798e-43cc-a850-6917ad1efad3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.405076 Oct 29 21:04:29.269241 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2048/4208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:28 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:29.867071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:29.867823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:29.875251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:29.876176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:29.876701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:29.877873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:29.878409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:29.879101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:29.929546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:29.930722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:29.938499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:29.938993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:29.939434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:29.940145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:29.940905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:29.941509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:30.092774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:30.107255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:30.111726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:30.113510 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2f5d28aa-67be-455f-be31-a996d5b98681 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1366 microversion: 2.47 time: 0.250671 Oct 29 21:04:30.115886 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2161/4209] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:29 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:30.124599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:30.125627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:30.154054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:30.154599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:30.155123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:30.158116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:30.160888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:30.161576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:30.434218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:30.447203 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e9b4188-8012-4ee5-86c6-f44e51b813dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.522148 Oct 29 21:04:30.449150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2049/4210] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:29 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:30.457325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:30.458367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:30.471582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:30.472357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:30.472984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:30.474359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:30.475219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:30.476257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:30.660485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:30.671154 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-976165d4-646e-4eca-a6c6-ae5ca5351006 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.552337 Oct 29 21:04:30.671847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2162/4211] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:30 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:30.883426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:30.894971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc757c68-d8af-4b95-8cb1-d6f70b43803b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.443330 Oct 29 21:04:30.895651 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2050/4212] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:30 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:31.143088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:31.143795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:31.154540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:31.155044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:31.155486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:31.156198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:31.165651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:31.166342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:31.482242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:31.485140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:31.496991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:31.498319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:31.498972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:31.500079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:31.500744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:31.501388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:31.638706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:31.648536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:31.650556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:31.651961 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e54bdc40-e6a4-454c-abc6-c21f221e1904 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1372 microversion: 2.47 time: 0.513115 Oct 29 21:04:31.652847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2163/4213] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:31 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1372 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:31.698778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:31.699976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:31.718734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:31.719741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:31.720501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:31.721552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:31.722099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:31.722544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:32.040318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:32.047029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:32.049046 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64508f11-2ab4-4994-b109-8e65388d46db tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.357681 Oct 29 21:04:32.061496 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7866e200-7dbf-44e0-a946-c4a47b398496 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.583535 Oct 29 21:04:32.061496 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2051/4214] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:31 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:32.062193 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2164/4215] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:31 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:32.068158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:32.069386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:32.081392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:32.082031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:32.082754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:32.083591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:32.084251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:32.084893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:32.350237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:32.386271 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36d3968b-54d4-4efa-99d8-0713dc824b60 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.321151 Oct 29 21:04:32.388645 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2052/4216] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:32 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:32.506894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e4522e9f-b734-4183-967c-34b29f05d36d req-264dfaf7-9ba5-4232-9581-1c4b13c6456d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e357c-33ce-49c3-9464-960551d978e4", "tag": "e04cdf9f-f5aa-40c4-93df-1494f08841ec"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:32.527980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e4522e9f-b734-4183-967c-34b29f05d36d req-264dfaf7-9ba5-4232-9581-1c4b13c6456d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:32.528474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e4522e9f-b734-4183-967c-34b29f05d36d req-264dfaf7-9ba5-4232-9581-1c4b13c6456d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:32.531777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e4522e9f-b734-4183-967c-34b29f05d36d req-264dfaf7-9ba5-4232-9581-1c4b13c6456d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:32.553551 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e4522e9f-b734-4183-967c-34b29f05d36d req-264dfaf7-9ba5-4232-9581-1c4b13c6456d service nova] Creating event network-changed:e04cdf9f-f5aa-40c4-93df-1494f08841ec for instance 7c9e357c-33ce-49c3-9464-960551d978e4 on nch1-master-1 Oct 29 21:04:32.570008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e4522e9f-b734-4183-967c-34b29f05d36d req-264dfaf7-9ba5-4232-9581-1c4b13c6456d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062154 Oct 29 21:04:32.572789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2165/4217] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:32.681902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:32.683218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:32.691459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:32.692379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:32.693173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:32.694127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:32.695105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:32.695755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:32.797954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:32.810691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:32.813162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:32.814971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87f597a9-47ca-4071-8940-4c0e1e48edf4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1372 microversion: 2.47 time: 0.139169 Oct 29 21:04:32.816191 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2053/4218] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:32 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:33.076177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:33.078046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:33.080389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:33.081010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:33.088204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.088949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.089903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.091036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.091847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.092945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.094242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.097659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.097659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.100441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.104938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.105364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.444802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.453504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c1c51d40-f614-4aae-8c52-20f97c115470 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.384406 Oct 29 21:04:33.454091 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2166/4219] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:33 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:33.462191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b31bfbbb-1843-422f-8d04-623c19fde027 req-c40b50e7-f83e-48f5-be3b-fffb9017e686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "name": "network-vif-plugged", "status": "completed", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:33.474095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.487158 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ecfb6f71-cce7-47c9-ae32-e451405446a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.411595 Oct 29 21:04:33.489358 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2054/4220] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:33 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:33.495963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:33.496744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:33.503980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.504590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.505302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.506187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.506794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.507490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.509391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b31bfbbb-1843-422f-8d04-623c19fde027 req-c40b50e7-f83e-48f5-be3b-fffb9017e686 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.519132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b31bfbbb-1843-422f-8d04-623c19fde027 req-c40b50e7-f83e-48f5-be3b-fffb9017e686 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.519132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b31bfbbb-1843-422f-8d04-623c19fde027 req-c40b50e7-f83e-48f5-be3b-fffb9017e686 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.526894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b31bfbbb-1843-422f-8d04-623c19fde027 req-c40b50e7-f83e-48f5-be3b-fffb9017e686 service nova] Creating event network-vif-plugged:51d03947-ece9-475c-b20e-71c5f2dcc21b for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee on nch2-master-1 Oct 29 21:04:33.534145 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b31bfbbb-1843-422f-8d04-623c19fde027 req-c40b50e7-f83e-48f5-be3b-fffb9017e686 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078800 Oct 29 21:04:33.536136 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2167/4221] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:33.701723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.711963 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60465f70-33c9-49fa-869a-349508a6466a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.219970 Oct 29 21:04:33.726283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2055/4222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:33 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:33.845479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:33.846221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:33.854075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.854792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.855348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.856193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.856780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.857419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.936198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.946235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.947905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.949096 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-99249f06-293d-4443-ac28-ba0d0534723d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1357 microversion: 2.47 time: 0.107908 Oct 29 21:04:33.949686 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2168/4223] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:33 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:33.976207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:33.981824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:33.982711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Searching by: {'deleted': False, 'project_id': 'a1430cb8bece48f0bb8fec9960625325'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:04:33.988236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.988717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.989153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:33.989917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:33.990363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:33.990959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.121672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:04:34.204722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.211766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.212827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.213586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.225235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.227304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.266692 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8ec3dfbf-7f63-464d-8b2e-0f4fd4994d5c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.296429 Oct 29 21:04:34.267467 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2056/4224] 10.222.0.36 () {60 vars in 1187 bytes} [Sat Oct 29 21:04:33 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:34.299170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:34.300012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:34.306860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.307724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.308178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.308890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.309352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.310012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.338786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:34.395437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:34.432962 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa99845e-d1e2-499e-b790-60a779c794db tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "DELETE /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 204 len: 0 microversion: 2.47 time: 0.136883 Oct 29 21:04:34.434310 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2169/4225] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:04:34 2022] DELETE /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:04:34.442401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:34.443452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:34.457636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.458150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.458774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.459499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.459973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.460416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.480636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:34.481854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:34.489041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.489871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.490509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.491439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.492743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.493357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.552247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.562563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.564096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.565292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0352b656-0762-400b-8bdf-0a85eee443a0 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1363 microversion: 2.47 time: 0.126864 Oct 29 21:04:34.565974 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2057/4226] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:34 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1363 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:34.689327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.698200 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc1b9fa1-9607-46c0-aa21-157eb7d9baf2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.222881 Oct 29 21:04:34.698794 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2170/4227] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:34 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:34.716251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:34.717168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:34.725867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.726692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.726905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.727617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.728036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.728735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.752749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-747e6fc0-4861-4029-aa76-4420345a5c64 tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] Calling method '.version_select at 0x7fa171070ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:34.858492 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-747e6fc0-4861-4029-aa76-4420345a5c64 tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.291081 Oct 29 21:04:34.859089 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2058/4228] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 21:04:34 2022] GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4/defaults => generated 371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:34.864135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:34.864758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:34.871575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.872069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.872519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.873305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:34.873806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:34.874252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:34.880055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:34.886533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:34.895161 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b4f6ea3-7883-4f5d-877d-10ee63b279ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1316 microversion: 2.1 time: 0.195028 Oct 29 21:04:34.895796 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2171/4229] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:34 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:34.901527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-58b5391e-329c-4ba9-a8fe-337c5f2f59ae tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] Calling method '.version_select at 0x7fa1703228b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.034842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:35.044154 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa66091b-680e-4575-b8a2-5d5ffea49032 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.183702 Oct 29 21:04:35.044745 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2059/4230] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:34 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:35.111047 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-58b5391e-329c-4ba9-a8fe-337c5f2f59ae tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4" status: 200 len: 371 microversion: 2.1 time: 0.214208 Oct 29 21:04:35.111638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2172/4231] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 21:04:34 2022] GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4 => generated 371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:35.125607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4546cd07-df19-43a4-9b84-5940ffd07c7d tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] Calling method '.version_select at 0x7fa1762468b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.335109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:35.340224 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4546cd07-df19-43a4-9b84-5940ffd07c7d tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.218469 Oct 29 21:04:35.340943 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2060/4232] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 21:04:35 2022] GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4/defaults => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:35.354637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-250e768a-540d-40fe-b5fc-b98f1a9bc41b tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] Calling method '.version_select at 0x7fa170317790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.423294 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-250e768a-540d-40fe-b5fc-b98f1a9bc41b tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4" status: 200 len: 371 microversion: 2.1 time: 0.072539 Oct 29 21:04:35.423873 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2173/4233] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 21:04:35 2022] GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:35.436388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0987946c-715c-49ff-a321-d26ee6e383ea tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] Calling method '.version_select at 0x7fa171070f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.516710 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0987946c-715c-49ff-a321-d26ee6e383ea tempest-QuotasTestJSON-3649652 tempest-QuotasTestJSON-3649652-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4?user_id=8354cec925794382893b3edfcd4fc1d2" status: 200 len: 371 microversion: 2.1 time: 0.084070 Oct 29 21:04:35.517398 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2061/4234] 10.222.0.36 () {58 vars in 1323 bytes} [Sat Oct 29 21:04:35 2022] GET /compute/v2.1/os-quota-sets/4116be6ea34e425fb0fe3ab086c2aaf4?user_id=8354cec925794382893b3edfcd4fc1d2 => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:35.593821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.594888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:35.602976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:35.604087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:35.605165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:35.605907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:35.606509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:35.606940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:35.678730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:35.689406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:35.691775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:35.693556 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-896d30eb-3e45-4746-99ab-99c0aad7995c tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1363 microversion: 2.47 time: 0.105511 Oct 29 21:04:35.695062 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2174/4235] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:35 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1363 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:35.720025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.720729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:35.730506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:35.731265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:35.731833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:35.732610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:35.733078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:35.733621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:35.922839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:35.923852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:35.927343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:35.932824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:35.933554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:35.934159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:35.935013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:35.935653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:35.936435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:35.939289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c848378-c8e9-4921-a9db-767b825c4a5f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.222927 Oct 29 21:04:35.955396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2062/4236] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:35 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:36.069406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:36.071254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:36.082406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.085850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.086602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:36.087458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.089232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.092102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:36.283258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:36.296268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:36.300039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-946ceb40-33f8-430c-85ac-0cda170f91e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.383091 Oct 29 21:04:36.301098 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2175/4237] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:35 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:36.451656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:36.464973 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9837b333-156a-4ace-9f25-6bc65968e923 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.400892 Oct 29 21:04:36.473500 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2063/4238] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:36 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:36.490234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1217073611", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:36.571708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] validate_networks() for [('3b68060f-ecb8-4b22-879b-438ab171c21d', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:04:36.732186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:36.733148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:36.747731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.748528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.748984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:36.749880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.750359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.750812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:36.829645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.830250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.830801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:36.832160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lazy-loading 'fault' on Instance uuid afecdcba-0345-4761-89af-df19180583a4 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:36.924101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:36.932611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:36.934199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:36.935789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-37e9f91f-a180-4654-8bad-77d564a3f36b tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 200 len: 1368 microversion: 2.47 time: 0.219867 Oct 29 21:04:36.936752 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2064/4239] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:36 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:04:36.965166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:36.965996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:36.973757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.974260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.974886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:36.975764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:36.976974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:36.977397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.211968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:37.219481 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3d494ca3-4fad-43f0-bbea-a0ef90678215 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.258081 Oct 29 21:04:37.221152 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2065/4240] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:36 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:37.268525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:37.268999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:37.269438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:37.269882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:37.270302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:37.280931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:37.281578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:37.282113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.282965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:37.283374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:37.284839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.302775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:37.307944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Getting quotas for project 6173752e65384e85a2bcc8c3e542931a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:37.313274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Getting quotas for user 7c7c243e53fb4f3a895b665028a14373 and project 6173752e65384e85a2bcc8c3e542931a. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:37.328220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:37.330806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:37.381336 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c26abf44-12eb-476d-b81d-a7c0e64ef6bd tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895002 Oct 29 21:04:37.382322 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2176/4241] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:04:37.394554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27bec8ec-cff8-4805-aa2f-64c07c85cbe8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:37.395258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27bec8ec-cff8-4805-aa2f-64c07c85cbe8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:37.453798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27bec8ec-cff8-4805-aa2f-64c07c85cbe8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:37.465489 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27bec8ec-cff8-4805-aa2f-64c07c85cbe8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1217 microversion: 2.1 time: 0.074929 Oct 29 21:04:37.467677 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2066/4242] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:37 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:37.491444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:37.493190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:37.506064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:37.508390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:37.510259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.511493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:37.512553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:37.513471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.723535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:37.733198 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea26419c-265e-4edd-8915-e008574f3e8a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.247370 Oct 29 21:04:37.734138 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2177/4243] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:37 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:37.745145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-471436ad-2dd5-4021-9b5f-b30915155445 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Action: 'create', calling method: .version_select at 0x7fa176246280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1591559093", "metadata": {"Type": "work"}}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:37.966946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:37.967821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: afecdcba-0345-4761-89af-df19180583a4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:37.974617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:37.975100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:37.975727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.976752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:37.977359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:37.977951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:37.998039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] HTTP exception thrown: Instance afecdcba-0345-4761-89af-df19180583a4 could not be found. Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Request method failure captured: Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 HTTP/1.1 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUviUksN6cU_SBxXeNWmyJV-tc0FocFMc8_mMcDpvVxybH_8LBHCQH5kHu4n0nTf-NvdGZqOOrciZ1fAlicVlSs1yGYyfza32CVWQYkER0BygUOoiYuXLv3nyAWD-y6balHr-QT6Q6jPqQGb-4_hhMI0TaBqSrDjwWN0c0mFpk0Yus Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a1430cb8bece48f0bb8fec9960625325 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerShowV247Test-1463282076 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerShowV247Test-1463282076 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a1430cb8bece48f0bb8fec9960625325 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerShowV247Test-1463282076 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerShowV247Test-1463282076-project Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 412a928bf8354ed797e1887ca4e7f3b4 Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerShowV247Test-1463282076-project Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance afecdcba-0345-4761-89af-df19180583a4 could not be found. Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'afecdcba-0345-4761-89af-df19180583a4'} Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afecdcba-0345-4761-89af-df19180583a4 could not be found. Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afecdcba-0345-4761-89af-df19180583a4 could not be found. Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:38.000131 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afecdcba-0345-4761-89af-df19180583a4 could not be found. Oct 29 21:04:38.004397 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:38.005646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Returning 404 to user: Instance afecdcba-0345-4761-89af-df19180583a4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:38.006513 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-775103df-7f0a-4059-84f3-bac79ed2d4c8 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4" status: 404 len: 111 microversion: 2.47 time: 0.046255 Oct 29 21:04:38.007947 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2178/4244] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:37 2022] GET /compute/v2.1/servers/afecdcba-0345-4761-89af-df19180583a4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:04:38.026445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:38.026955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:38.035756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.042065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.042517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.043283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.043747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.044480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.090380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:38.151720 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-471436ad-2dd5-4021-9b5f-b30915155445 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.567627 Oct 29 21:04:38.160049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2067/4245] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 29 21:04:37 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 569 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 29 21:04:38.167054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0261a8ba-0d98-4b7d-840a-e4a1d5fbfcd4 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Calling method '.version_select at 0x7fa1762e8f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:38.224330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e598365c-7497-4b5c-9431-536bf2b36763 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 204 len: 0 microversion: 2.47 time: 0.211819 Oct 29 21:04:38.231232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2179/4246] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:04:38 2022] DELETE /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 21:04:38.240656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:38.243202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:38.251566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.252711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.253255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.254112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.254651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.255213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.276476 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0261a8ba-0d98-4b7d-840a-e4a1d5fbfcd4 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe" status: 200 len: 346 microversion: 2.1 time: 0.113246 Oct 29 21:04:38.277063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2068/4247] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:04:38 2022] GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:38.281906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:38.282681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:38.300356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.301096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.301732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.302624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.306985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.307618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.436388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:38.449295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:38.456062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:38.457898 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acc39211-88ad-458a-9fc3-db307dde70be tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 200 len: 1362 microversion: 2.47 time: 0.224981 Oct 29 21:04:38.458828 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2180/4248] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:38 2022] GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:38.488742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:38.492643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:38.505686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.512224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.514126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.516890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.517942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.518395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.622503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:38.630367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ea3bbaa-aa77-446e-9f23-c0d0093a5235 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1269 microversion: 2.1 time: 0.145830 Oct 29 21:04:38.637901 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2181/4249] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:38 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:38.726654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:38.735440 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53daf39a-bd7b-459d-a036-efeea2d41a2f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.457070 Oct 29 21:04:38.742937 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2069/4250] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:38 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:38.758030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:38.758851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:38.766176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.766752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.767273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.768104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:38.768633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:38.769139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:38.930408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:38.941379 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-18988e19-7614-4e0c-a4f6-5a8cef15e32f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.187312 Oct 29 21:04:38.942253 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2182/4251] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:38 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:39.292068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f23bd510-58f0-4a6b-9c58-1faa4d6b52ff tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Calling method '.version_select at 0x7fa1762e8ee0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.344885 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f23bd510-58f0-4a6b-9c58-1faa4d6b52ff tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe" status: 200 len: 347 microversion: 2.1 time: 0.057909 Oct 29 21:04:39.345489 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2070/4252] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe => generated 347 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:39.358902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f23ca8e-b264-408b-b5d0-3e5a26decc1d tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Calling method '.version_select at 0x7fa1702fd700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.412152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f23ca8e-b264-408b-b5d0-3e5a26decc1d tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe" status: 200 len: 347 microversion: 2.1 time: 0.056939 Oct 29 21:04:39.421421 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2183/4253] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe => generated 347 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:39.426331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Calling method '.version_select at 0x7fa176280790>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.484973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.485942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:39.492378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.493151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.493986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.494909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.495611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.496796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.500698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe" status: 202 len: 0 microversion: 2.1 time: 0.078304 Oct 29 21:04:39.501112 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2071/4254] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:04:39 2022] DELETE /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:04:39.509832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4058e413-99e0-41e8-871a-9173ea45c643 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Calling method '.version_select at 0x7fa1762469d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.600662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:39.613563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:39.619040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4058e413-99e0-41e8-871a-9173ea45c643 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe" status: 200 len: 346 microversion: 2.1 time: 0.113813 Oct 29 21:04:39.619819 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2072/4255] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:39.620058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:39.622285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c68012e3-8bc5-4039-b256-ef6026d05da4 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 200 len: 1362 microversion: 2.47 time: 0.141130 Oct 29 21:04:39.622865 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2184/4256] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:04:39.654795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.655709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:39.665236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.666784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.667851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.669035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.669761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.670653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.760624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.761542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:39.768661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.769153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.769626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.770335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.770953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.771527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.900886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:39.911422 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e88e0824-06d9-417f-8f4e-c72e0a46ca9a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.261217 Oct 29 21:04:39.914545 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2073/4257] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:39.965777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:39.966417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:39.975028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.976785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.977823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:39.978911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:39.979941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:39.980663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:40.038366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:40.051561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a51c656e-0e11-45b7-98ef-e807a4fa0f6e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.296603 Oct 29 21:04:40.052158 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2185/4258] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:40.061376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0c33ece4-1dea-45ac-a064-3ccdbd807547 req-4fd00917-e3a2-4588-ad95-a13235955304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e357c-33ce-49c3-9464-960551d978e4", "name": "network-vif-plugged", "status": "completed", "tag": "e04cdf9f-f5aa-40c4-93df-1494f08841ec"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:40.085200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c33ece4-1dea-45ac-a064-3ccdbd807547 req-4fd00917-e3a2-4588-ad95-a13235955304 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:40.086012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c33ece4-1dea-45ac-a064-3ccdbd807547 req-4fd00917-e3a2-4588-ad95-a13235955304 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:40.088823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c33ece4-1dea-45ac-a064-3ccdbd807547 req-4fd00917-e3a2-4588-ad95-a13235955304 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:40.106058 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0c33ece4-1dea-45ac-a064-3ccdbd807547 req-4fd00917-e3a2-4588-ad95-a13235955304 service nova] Creating event network-vif-plugged:e04cdf9f-f5aa-40c4-93df-1494f08841ec for instance 7c9e357c-33ce-49c3-9464-960551d978e4 on nch1-master-1 Oct 29 21:04:40.111388 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0c33ece4-1dea-45ac-a064-3ccdbd807547 req-4fd00917-e3a2-4588-ad95-a13235955304 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056597 Oct 29 21:04:40.112586 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2186/4259] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:40.404349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:40.420271 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b44e286-c518-441d-8562-c18d0887a6ec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.458518 Oct 29 21:04:40.421069 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2074/4260] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:39 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:40.635700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61fcde3c-273b-4faf-9d0c-1b0c4ad46641 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Calling method '.version_select at 0x7fa170322dc0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:40.659964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:40.660834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:40.675144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:40.675652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:40.680234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:40.680961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:40.684219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:40.685823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:40.697438 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-61fcde3c-273b-4faf-9d0c-1b0c4ad46641 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] HTTP exception thrown: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61fcde3c-273b-4faf-9d0c-1b0c4ad46641 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Request method failure captured: Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe HTTP/1.1 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVlCKYaGhIbR1Gc6VBdUOfY3XCAhIzs6W-RXd4h58dkoYsBa74n53STQtRX4CcIk_vFlIjfSru5ElrmrgipX6V0Cn7_2XHL0zFiFWM-J8LZ-0WmbVy0qziKQXZ7EXhkqizQKxFRGGjZOyi863BWXemiVjN-bGjDJExThG7st-fYuG4 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 2d730ddfcf9a4b5493459c945d5a1f66 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesGetTestJSON-533515448 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d730ddfcf9a4b5493459c945d5a1f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2d730ddfcf9a4b5493459c945d5a1f66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2d730ddfcf9a4b5493459c945d5a1f66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2d730ddfcf9a4b5493459c945d5a1f66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesGetTestJSON-533515448 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 2d730ddfcf9a4b5493459c945d5a1f66 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesGetTestJSON-533515448 Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesGetTestJSON-533515448-project Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 08ac0426dab4419192fa23ffe3394b1a Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesGetTestJSON-533515448-project Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: exception: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'faba7380-43fe-45bc-924c-8ae70d5ba3fe'} Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. (HTTP 404) (Request-ID: req-6bd40c33-8594-4199-8170-90a0ee4120a1) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:04:40.751876 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61fcde3c-273b-4faf-9d0c-1b0c4ad46641 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] Returning 404 to user: Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:40.755566 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61fcde3c-273b-4faf-9d0c-1b0c4ad46641 tempest-VolumesGetTestJSON-533515448 tempest-VolumesGetTestJSON-533515448-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe" status: 404 len: 109 microversion: 2.1 time: 0.123889 Oct 29 21:04:40.759305 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2187/4261] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:04:40 2022] GET /compute/v2.1/os-volumes/faba7380-43fe-45bc-924c-8ae70d5ba3fe => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:40.764413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-15e0be33-7024-4db3-9b57-387fd505570f req-ebdeff12-92ad-4d67-be39-d311399f32e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5c6dc5-d9a2-43a8-816c-958c3f931aea", "tag": "060de5ac-dd48-41e6-b2bf-e87f6b52950f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:40.795011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-15e0be33-7024-4db3-9b57-387fd505570f req-ebdeff12-92ad-4d67-be39-d311399f32e8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:40.802409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-15e0be33-7024-4db3-9b57-387fd505570f req-ebdeff12-92ad-4d67-be39-d311399f32e8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:40.803106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-15e0be33-7024-4db3-9b57-387fd505570f req-ebdeff12-92ad-4d67-be39-d311399f32e8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:40.818367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-15e0be33-7024-4db3-9b57-387fd505570f req-ebdeff12-92ad-4d67-be39-d311399f32e8 service nova] Creating event network-changed:060de5ac-dd48-41e6-b2bf-e87f6b52950f for instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea on nch2-master-1 Oct 29 21:04:40.833909 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-15e0be33-7024-4db3-9b57-387fd505570f req-ebdeff12-92ad-4d67-be39-d311399f32e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074482 Oct 29 21:04:40.834805 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2188/4262] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:40.939344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:40.940226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:40.976835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:40.978067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:40.980429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:40.982370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:40.982852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:40.983598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:41.200374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:41.244072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:41.252132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:41.256550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12fcb4b5-c8f3-469d-80e2-452f30f60253 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 200 len: 1362 microversion: 2.47 time: 0.609067 Oct 29 21:04:41.271655 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2075/4263] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:40 2022] GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:41.293316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:41.295930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:41.306221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:41.306977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:41.308276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:41.309041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:41.309605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:41.310263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:41.381221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:41.389997 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b95596e-88f6-40c0-b47a-5692f86e2f1a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.456994 Oct 29 21:04:41.390781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2189/4264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:40 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:41.446060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:41.453926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:41.461024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:41.461638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:41.462146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:41.463090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:41.463885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:41.464398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:41.635642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:41.647597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b21dbd7c-bd23-48cf-8368-0f354440a0fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1315 microversion: 2.1 time: 0.367718 Oct 29 21:04:41.648710 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2076/4265] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:41 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:41.782482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:41.796538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45448b9b-4d5a-4b3b-b4a0-af8cfb3ef029 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.355684 Oct 29 21:04:41.797354 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2190/4266] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:41 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:42.287796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:42.289537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:42.301067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.303353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.304136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.308681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.309623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.310504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.415174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:42.416392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:42.429976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.432919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.434088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.435851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lazy-loading 'fault' on Instance uuid 74335a72-7639-4581-8ba5-48c52c1b302c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:42.435997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.436657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.438417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.452018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.455562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.456673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.511009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:42.534481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:42.550758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:42.554809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '412a928bf8354ed797e1887ca4e7f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1430cb8bece48f0bb8fec9960625325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:42.556090 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0396dc99-31e3-47ca-be32-6e28035dfb0d tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 200 len: 1367 microversion: 2.47 time: 0.272923 Oct 29 21:04:42.558793 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2077/4267] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:42 2022] GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:42.671138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:42.672542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:42.686441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.687212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.689782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.691336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.693025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.694334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.717576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:42.735464 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa6a9b1c-82bd-45a0-aff7-6dd5acf0d99e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.326154 Oct 29 21:04:42.736722 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2191/4268] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:42 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:42.821917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:42.823906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:42.830948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.831780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.832432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:42.833847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:42.834706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:42.835412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.008654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:43.023122 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-50000573-7b3e-415f-b817-75f82e0f1f8b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1503 microversion: 2.1 time: 0.354779 Oct 29 21:04:43.024039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2078/4269] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:42 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:43.059530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:43.060246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:43.078400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.080252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.081769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.085271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.085907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.086354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.133539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:43.144586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b2e1673-4894-4f1e-9c31-e4588069caff tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.327121 Oct 29 21:04:43.159275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2192/4270] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:42 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:43.244323 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-598d473a-ff4d-41e0-b62b-b588cb6abe16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4/action" status: 202 len: 0 microversion: 2.1 time: 0.194157 Oct 29 21:04:43.249690 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2079/4271] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:04:43 2022] POST /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:04:43.256793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:43.258096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:43.269297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.270445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.271162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.272789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.274390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.275063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.409812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fd34f8a-3027-45fa-ac4a-4dcc64ca1232 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Action: 'create', calling method: .version_select at 0x7fa170227ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1596390263", "metadata": {"Type": "work"}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fd34f8a-3027-45fa-ac4a-4dcc64ca1232 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Request method failure captured: Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 122 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVrRqCBxjsGWUlj3qIMai7VC7Wk2UrQYN-RGF6WbEtsPTiTKpRPSb4ZUEugTtcsUvgpboaNjYIk11jn--sF_YnwfYIocpcxH0l4lvV-wv_IKURHd5kIDWB8t_uW2mIHReoZrzzGrickoszQS5GJoShgSkSYETcNTswlbx3_cxwIyC4 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_006b12a2328f4abaa759d55029bc3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 71864975ca0a4e01b7ee1defdc7a8283 Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1596390263", "metadata": {"Type": "work"}}} Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1596390263', 'metadata': {'Type': 'work'}}}} Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '#$%' Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:04:43.416859 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.421492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fd34f8a-3027-45fa-ac4a-4dcc64ca1232 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.422586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9fd34f8a-3027-45fa-ac4a-4dcc64ca1232 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.190100 Oct 29 21:04:43.423677 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2193/4272] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 29 21:04:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:04:43.434580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dcab66a9-cf77-403d-b945-e018837c8c13 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Action: 'create', calling method: .version_select at 0x7fa17035b820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-917881337", "metadata": {"Type": "work"}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dcab66a9-cf77-403d-b945-e018837c8c13 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Request method failure captured: Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 119 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVrRqCBxjsGWUlj3qIMai7VC7Wk2UrQYN-RGF6WbEtsPTiTKpRPSb4ZUEugTtcsUvgpboaNjYIk11jn--sF_YnwfYIocpcxH0l4lvV-wv_IKURHd5kIDWB8t_uW2mIHReoZrzzGrickoszQS5GJoShgSkSYETcNTswlbx3_cxwIyC4 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_006b12a2328f4abaa759d55029bc3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 71864975ca0a4e01b7ee1defdc7a8283 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-917881337", "metadata": {"Type": "work"}}} Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-917881337', 'metadata': {'Type': 'work'}}}} Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '0' Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:04:43.439312 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dcab66a9-cf77-403d-b945-e018837c8c13 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.443837 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dcab66a9-cf77-403d-b945-e018837c8c13 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013750 Oct 29 21:04:43.446026 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2194/4273] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 29 21:04:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:04:43.455549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:43.463795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-164684c1-f327-43c8-b8cb-2a90fea4c9c4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Action: 'create', calling method: .version_select at 0x7fa17035b820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-254236173", "metadata": {"Type": "work"}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-164684c1-f327-43c8-b8cb-2a90fea4c9c4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Request method failure captured: Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 118 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVrRqCBxjsGWUlj3qIMai7VC7Wk2UrQYN-RGF6WbEtsPTiTKpRPSb4ZUEugTtcsUvgpboaNjYIk11jn--sF_YnwfYIocpcxH0l4lvV-wv_IKURHd5kIDWB8t_uW2mIHReoZrzzGrickoszQS5GJoShgSkSYETcNTswlbx3_cxwIyC4 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_006b12a2328f4abaa759d55029bc3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 71864975ca0a4e01b7ee1defdc7a8283 Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-254236173", "metadata": {"Type": "work"}}} Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-254236173', 'metadata': {'Type': 'work'}}}} Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '' Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:04:43.470921 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-164684c1-f327-43c8-b8cb-2a90fea4c9c4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-164684c1-f327-43c8-b8cb-2a90fea4c9c4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020626 Oct 29 21:04:43.476767 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2195/4274] 10.222.0.36 () {60 vars in 1156 bytes} [Sat Oct 29 21:04:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:04:43.487066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-289cc4a0-ab0e-44f1-8939-14fdf1770bc4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Calling method '.version_select at 0x7fa170227ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:43.487852 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-add43911-6752-4140-9d6a-b8b4c3ec7c5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1508 microversion: 2.1 time: 0.234612 Oct 29 21:04:43.490584 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2080/4275] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:43 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:43.523612 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-289cc4a0-ab0e-44f1-8939-14fdf1770bc4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] HTTP exception thrown: Volume tempest-invalid-646269926 could not be found. Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-289cc4a0-ab0e-44f1-8939-14fdf1770bc4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Request method failure captured: Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-646269926 HTTP/1.1 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVrRqCBxjsGWUlj3qIMai7VC7Wk2UrQYN-RGF6WbEtsPTiTKpRPSb4ZUEugTtcsUvgpboaNjYIk11jn--sF_YnwfYIocpcxH0l4lvV-wv_IKURHd5kIDWB8t_uW2mIHReoZrzzGrickoszQS5GJoShgSkSYETcNTswlbx3_cxwIyC4 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_006b12a2328f4abaa759d55029bc3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 71864975ca0a4e01b7ee1defdc7a8283 Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: exception: Volume tempest-invalid-646269926 could not be found. Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'tempest-invalid-646269926'} Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-646269926 could not be found. (HTTP 404) (Request-ID: req-80e153d8-f8e9-4d8a-9b3e-e49b04d0f194) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:43.525916 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-646269926 could not be found. Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-646269926 could not be found. Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-646269926 could not be found. Oct 29 21:04:43.529729 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.532655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-289cc4a0-ab0e-44f1-8939-14fdf1770bc4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Returning 404 to user: Volume tempest-invalid-646269926 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.533540 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-289cc4a0-ab0e-44f1-8939-14fdf1770bc4 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-646269926" status: 404 len: 98 microversion: 2.1 time: 0.051353 Oct 29 21:04:43.534241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2196/4276] 10.222.0.36 () {58 vars in 1215 bytes} [Sat Oct 29 21:04:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-646269926 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:04:43.543911 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a43afaf4-4ff6-4955-9ccb-1f95192dd1ea tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003831 Oct 29 21:04:43.544438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2081/4277] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 29 21:04:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 29 21:04:43.559300 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93daebf4-5db0-4dc9-ac97-7c552dae9929 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009304 Oct 29 21:04:43.560669 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2197/4278] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 21:04:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 21:04:43.570325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7fbf6170-e1a4-4542-96cd-77259c0b1dba tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Calling method '.version_select at 0x7fa1711511f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:43.590819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:43.591498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] [instance: 74335a72-7639-4581-8ba5-48c52c1b302c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:43.609953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.610474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.610922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.614866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.615416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.615868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.617243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7fbf6170-e1a4-4542-96cd-77259c0b1dba tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] HTTP exception thrown: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7fbf6170-e1a4-4542-96cd-77259c0b1dba tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Request method failure captured: Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-volumes/3a8b5dc2-8002-4733-bca7-6f47b545f713 HTTP/1.1 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVrRqCBxjsGWUlj3qIMai7VC7Wk2UrQYN-RGF6WbEtsPTiTKpRPSb4ZUEugTtcsUvgpboaNjYIk11jn--sF_YnwfYIocpcxH0l4lvV-wv_IKURHd5kIDWB8t_uW2mIHReoZrzzGrickoszQS5GJoShgSkSYETcNTswlbx3_cxwIyC4 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_006b12a2328f4abaa759d55029bc3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 71864975ca0a4e01b7ee1defdc7a8283 Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: exception: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '3a8b5dc2-8002-4733-bca7-6f47b545f713'} Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. (HTTP 404) (Request-ID: req-f993783e-3107-4186-860f-9e96de71ceef) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:04:43.620810 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. Oct 29 21:04:43.624930 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.627560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7fbf6170-e1a4-4542-96cd-77259c0b1dba tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Returning 404 to user: Volume 3a8b5dc2-8002-4733-bca7-6f47b545f713 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.628435 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7fbf6170-e1a4-4542-96cd-77259c0b1dba tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/3a8b5dc2-8002-4733-bca7-6f47b545f713" status: 404 len: 109 microversion: 2.1 time: 0.062326 Oct 29 21:04:43.633432 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2082/4279] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:04:43 2022] DELETE /compute/v2.1/os-volumes/3a8b5dc2-8002-4733-bca7-6f47b545f713 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:04:43.638827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4427af77-b660-476d-be9a-811d4d495907 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Calling method '.version_select at 0x7fa170c1d940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:43.660600 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] HTTP exception thrown: Instance 74335a72-7639-4581-8ba5-48c52c1b302c could not be found. Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Request method failure captured: Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c HTTP/1.1 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUviUksN6cU_SBxXeNWmyJV-tc0FocFMc8_mMcDpvVxybH_8LBHCQH5kHu4n0nTf-NvdGZqOOrciZ1fAlicVlSs1yGYyfza32CVWQYkER0BygUOoiYuXLv3nyAWD-y6balHr-QT6Q6jPqQGb-4_hhMI0TaBqSrDjwWN0c0mFpk0Yus Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a1430cb8bece48f0bb8fec9960625325 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerShowV247Test-1463282076 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a1430cb8bece48f0bb8fec9960625325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerShowV247Test-1463282076 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a1430cb8bece48f0bb8fec9960625325 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerShowV247Test-1463282076 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerShowV247Test-1463282076-project Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 412a928bf8354ed797e1887ca4e7f3b4 Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerShowV247Test-1463282076-project Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 74335a72-7639-4581-8ba5-48c52c1b302c could not be found. Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '74335a72-7639-4581-8ba5-48c52c1b302c'} Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74335a72-7639-4581-8ba5-48c52c1b302c could not be found. Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74335a72-7639-4581-8ba5-48c52c1b302c could not be found. Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.662866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74335a72-7639-4581-8ba5-48c52c1b302c could not be found. Oct 29 21:04:43.667683 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.670042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] Returning 404 to user: Instance 74335a72-7639-4581-8ba5-48c52c1b302c could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.670916 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3891bdc0-dcb8-487e-8f75-543fa8115535 tempest-ServerShowV247Test-1463282076 tempest-ServerShowV247Test-1463282076-project] 10.222.0.36 "GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c" status: 404 len: 111 microversion: 2.47 time: 0.088661 Oct 29 21:04:43.672423 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2198/4280] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:43 2022] GET /compute/v2.1/servers/74335a72-7639-4581-8ba5-48c52c1b302c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:04:43.693828 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4427af77-b660-476d-be9a-811d4d495907 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] HTTP exception thrown: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4427af77-b660-476d-be9a-811d4d495907 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Request method failure captured: Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/os-volumes/f0158cd8-b314-4515-8031-2b90fbe411d0 HTTP/1.1 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVrRqCBxjsGWUlj3qIMai7VC7Wk2UrQYN-RGF6WbEtsPTiTKpRPSb4ZUEugTtcsUvgpboaNjYIk11jn--sF_YnwfYIocpcxH0l4lvV-wv_IKURHd5kIDWB8t_uW2mIHReoZrzzGrickoszQS5GJoShgSkSYETcNTswlbx3_cxwIyC4 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_006b12a2328f4abaa759d55029bc3199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/006b12a2328f4abaa759d55029bc3199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 006b12a2328f4abaa759d55029bc3199 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesNegativeTest-904440306 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 71864975ca0a4e01b7ee1defdc7a8283 Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesNegativeTest-904440306-project Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: exception: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f0158cd8-b314-4515-8031-2b90fbe411d0'} Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. (HTTP 404) (Request-ID: req-7252c95e-b65b-4594-9005-0efdc056a8fb) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:04:43.696358 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4427af77-b660-476d-be9a-811d4d495907 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] Returning 404 to user: Volume f0158cd8-b314-4515-8031-2b90fbe411d0 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4427af77-b660-476d-be9a-811d4d495907 tempest-VolumesNegativeTest-904440306 tempest-VolumesNegativeTest-904440306-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f0158cd8-b314-4515-8031-2b90fbe411d0" status: 404 len: 109 microversion: 2.1 time: 0.063165 Oct 29 21:04:43.700585 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2083/4281] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:04:43 2022] GET /compute/v2.1/os-volumes/f0158cd8-b314-4515-8031-2b90fbe411d0 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:43.762546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:43.762546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:43.773689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.774185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.776351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.777172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:43.777674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:43.778317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:43.952388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:43.962310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ab5a6f3-d9d2-44a8-9280-2dce267617b5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.206265 Oct 29 21:04:43.962950 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2199/4282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:43 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:44.166707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:44.171254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:44.172076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:44.181334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.182140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:44.182859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:44.184050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.184977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:44.185673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:44.457298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:44.466968 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8fcc9559-1d1b-415b-9e4b-ccd65e3a0b9d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.301232 Oct 29 21:04:44.468063 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2084/4283] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:44 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:44.515909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:44.516878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:44.523910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.524523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:44.525176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:44.526586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.527118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:44.527784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:44.767789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:44.775806 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-88a75a33-3ef7-44bf-a1e5-e6d606489473 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1488 microversion: 2.1 time: 0.264753 Oct 29 21:04:44.780749 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2200/4284] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:44 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1488 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:44.798702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:44.800102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:44.808034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.808522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:44.809803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:44.810527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.811003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:44.811489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:44.816312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:44.846280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:44.986779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:44.988035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:44.998955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:44.999637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:45.000140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3fa851d3-4ada-4c5f-a8cf-f9b3da98a5fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 204 len: 0 microversion: 2.1 time: 0.204278 Oct 29 21:04:45.000425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:45.001529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:45.002233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:45.002713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:45.007115 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2085/4285] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:44 2022] DELETE /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:04:45.031374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:45.031374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:45.046837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:45.048337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:45.050778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:45.052505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:45.054490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:45.056023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:45.361899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:45.379747 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa13c59e-d7b9-4cbf-b997-4a50e52bf633 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.397523 Oct 29 21:04:45.394294 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2201/4286] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:44 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:45.492045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:45.492684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:45.520442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:45.520995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:45.521478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:45.522224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:45.524291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:45.532991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:45.533627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:45.534906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-40a4e4a0-c799-4e51-9c8e-58aa0477ec07 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1494 microversion: 2.1 time: 0.525728 Oct 29 21:04:45.542948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2086/4287] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:45 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1494 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:45.727988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:45.736867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6e9f405-ce56-4536-b209-bfd471063fe7 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.250284 Oct 29 21:04:45.744307 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2202/4288] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:45 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:46.298283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2056307675", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:46.377924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:46.383640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:46.385073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:46.386800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:46.387352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:46.402821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:46.403400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:46.410079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.410573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.410919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.411060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.411695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.411805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.412142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.412248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.412561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.414897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.415380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.415821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.467710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Getting quotas for project 250bb0d83cb849dea30ca3688f7ceefe. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:46.479673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Getting quotas for user fbe0439f98aa4e80b8389a1fb412eaa3 and project 250bb0d83cb849dea30ca3688f7ceefe. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:46.507896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:46.510756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:46.571592 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fca0a160-5101-4dd3-ae44-49926298dd94 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.444099 Oct 29 21:04:46.578574 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2087/4289] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 21:04:46.578574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:46.578574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:46.586398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.586903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.587359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.588086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.588556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.589002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.603691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:46.613859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab415d1f-a976-4ec7-b4c3-978cff03386b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.214931 Oct 29 21:04:46.615326 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2203/4290] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:46 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:46.620232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a7a8e320-41f3-40a1-a4da-2b97d88a1776 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:46.621236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a7a8e320-41f3-40a1-a4da-2b97d88a1776 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:46.767190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a7a8e320-41f3-40a1-a4da-2b97d88a1776 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:46.787624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=25 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:46.811507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a7a8e320-41f3-40a1-a4da-2b97d88a1776 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:46.817795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a7a8e320-41f3-40a1-a4da-2b97d88a1776 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:46.819397 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a7a8e320-41f3-40a1-a4da-2b97d88a1776 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1278 microversion: 2.54 time: 0.202866 Oct 29 21:04:46.820655 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2204/4291] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:46 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:46.841017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:46.843008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:46.856559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:46.873085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f63bdbc5-5b53-4a83-8e7e-172a1256931b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1494 microversion: 2.1 time: 0.299219 Oct 29 21:04:46.885642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.885642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.885642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:46.885925 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2088/4292] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:46 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1494 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:46.886054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:46.886054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:46.886054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.133422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:47.141639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4366f074-9517-43c1-b39f-670c3ffd3bc4 req-3be55462-d3b6-4888-95a4-6a9f4afa44ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c6dc5-d9a2-43a8-816c-958c3f931aea", "name": "network-vif-plugged", "status": "completed", "tag": "060de5ac-dd48-41e6-b2bf-e87f6b52950f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:47.162055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4366f074-9517-43c1-b39f-670c3ffd3bc4 req-3be55462-d3b6-4888-95a4-6a9f4afa44ca service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.162863 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fd1febe4-6913-470e-b8f5-a679b7e23527 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.336535 Oct 29 21:04:47.165668 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2205/4293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:46 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:47.168323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4366f074-9517-43c1-b39f-670c3ffd3bc4 req-3be55462-d3b6-4888-95a4-6a9f4afa44ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.169667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4366f074-9517-43c1-b39f-670c3ffd3bc4 req-3be55462-d3b6-4888-95a4-6a9f4afa44ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.196115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4366f074-9517-43c1-b39f-670c3ffd3bc4 req-3be55462-d3b6-4888-95a4-6a9f4afa44ca service nova] Creating event network-vif-plugged:060de5ac-dd48-41e6-b2bf-e87f6b52950f for instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea on nch2-master-1 Oct 29 21:04:47.216564 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4366f074-9517-43c1-b39f-670c3ffd3bc4 req-3be55462-d3b6-4888-95a4-6a9f4afa44ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066868 Oct 29 21:04:47.217915 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2089/4294] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:47.642294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:47.642933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:47.644940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:47.666270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.666793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.667260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.667989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.668455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.669066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.850736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:47.851493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:47.872686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.885818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.888182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.892259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.893055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.897545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.900581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:47.916088 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f7d245e6-48e2-4ae4-b2d5-c1d5ae0605c2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1317 microversion: 2.1 time: 0.277793 Oct 29 21:04:47.916882 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2206/4295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:47 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:47.922226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:47.923064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:47.936207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.937954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.939875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:47.942494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:47.943246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:47.943895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.085841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:48.099150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:48.103066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:48.106163 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6060585b-9b1e-46f9-86be-3a80e53fbec4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1274 microversion: 2.54 time: 0.261607 Oct 29 21:04:48.107196 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2090/4296] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:47 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:48.196588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:48.197569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:48.207608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.208469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.209359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.211037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.211745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.212462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.549382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:48.563370 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f22bc73f-5429-4ee3-aec4-ab8e280ba4b9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1494 microversion: 2.1 time: 0.645082 Oct 29 21:04:48.574685 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2207/4297] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:47 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1494 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:48.646779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:48.662525 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a964e9d3-979d-4928-9f79-937df8e702f3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1505 microversion: 2.1 time: 0.472055 Oct 29 21:04:48.664412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2091/4298] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:48 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:48.829088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:48.830563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:48.843121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.843899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.844675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.845900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.846642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.847502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.875458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1addbe4a-4950-44e1-921d-624b08e3fcff req-e11d4466-bfef-4c6d-9bbe-4d8c8ab0cc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e357c-33ce-49c3-9464-960551d978e4", "name": "network-vif-deleted", "tag": "e04cdf9f-f5aa-40c4-93df-1494f08841ec"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:48.890001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1addbe4a-4950-44e1-921d-624b08e3fcff req-e11d4466-bfef-4c6d-9bbe-4d8c8ab0cc58 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.890486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1addbe4a-4950-44e1-921d-624b08e3fcff req-e11d4466-bfef-4c6d-9bbe-4d8c8ab0cc58 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.891492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1addbe4a-4950-44e1-921d-624b08e3fcff req-e11d4466-bfef-4c6d-9bbe-4d8c8ab0cc58 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.914823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1addbe4a-4950-44e1-921d-624b08e3fcff req-e11d4466-bfef-4c6d-9bbe-4d8c8ab0cc58 service nova] Creating event network-vif-deleted:e04cdf9f-f5aa-40c4-93df-1494f08841ec for instance 7c9e357c-33ce-49c3-9464-960551d978e4 on nch1-master-1 Oct 29 21:04:48.922158 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1addbe4a-4950-44e1-921d-624b08e3fcff req-e11d4466-bfef-4c6d-9bbe-4d8c8ab0cc58 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050279 Oct 29 21:04:48.923289 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2092/4299] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:48.943103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:48.943936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:48.951634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.952392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.953067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:48.954051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:48.954725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:48.955384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.155342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.167993 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c51c93f9-2bc2-49fb-98b3-7b30cce91fc2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.352599 Oct 29 21:04:49.185512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2208/4300] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:48 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:49.192954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.214628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.223648 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a8dac0fc-4f72-4436-bb4d-316696f46874 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1506 microversion: 2.1 time: 0.286834 Oct 29 21:04:49.225138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.225998 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2093/4301] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:48 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:49.241118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.243951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.248730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.251119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.251891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.254839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.256444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.257078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.283588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.284267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.287358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.292727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.295246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.295869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.400290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.409572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.411155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.412528 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a6e90e3-d026-45b5-96d0-657f74b28283 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1338 microversion: 2.54 time: 0.223546 Oct 29 21:04:49.413302 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2209/4302] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:49 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:49.418335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.419063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.425665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.426373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.427000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.427972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.428723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.429533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.476653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:04:49.606389 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68a1673d-3e4e-4455-a880-410beb16c204 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 204 len: 0 microversion: 2.1 time: 0.191219 Oct 29 21:04:49.606990 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2210/4303] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:04:49 2022] DELETE /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:04:49.617851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.618557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.627004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.627662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.628108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.628813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.629269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.629720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.630081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.640252 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7623d534-f075-4acb-b8b7-8e2eedb314e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.412760 Oct 29 21:04:49.641542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2094/4304] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:49.646773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.647400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.653710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.654382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.655015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.656296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.656919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.657558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.682773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.683263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.683700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.687487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'fault' on Instance uuid 7c9e357c-33ce-49c3-9464-960551d978e4 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:49.777426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.794562 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c60190ed-1c0a-4aba-b910-71a3c641ee9c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 200 len: 1305 microversion: 2.1 time: 0.181527 Oct 29 21:04:49.795352 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2211/4305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:49 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:49.800187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.800783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.812198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.812796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.813217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.816408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.820865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.821074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.888006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:49.903887 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a2bc56d-29be-4583-81c1-10c2a415f660 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1512 microversion: 2.1 time: 0.260771 Oct 29 21:04:49.917481 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2095/4306] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:49 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:49.926530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:49.927673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:49.942336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.943135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.943807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:49.944874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:49.945590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:49.947879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.166729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:50.170649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:50.183120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a268afc-3b1e-47e9-baf6-78b4097be622 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.386582 Oct 29 21:04:50.184582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2212/4307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:50.210422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-635285118"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:50.214662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:50.222915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.225606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.227061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.228273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.228989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.229667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.287549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:50.309539 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7b10bae-2c1d-4fd9-9e2f-da934f1bd477 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1485 microversion: 2.1 time: 0.402543 Oct 29 21:04:50.310781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2096/4308] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:49 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1485 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:50.443152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:50.443803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:50.451069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.452330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.452938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.454648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.455305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.455922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.505661 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41636f21-46ba-452c-b0b4-12b1eee1f101 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.300213 Oct 29 21:04:50.509761 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2213/4309] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:04:50 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 21:04:50.515603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-434456034", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:50.539951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:50.561061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:50.562777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:50.564088 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-379aaa2f-0f5b-4e4c-9a3b-b684a5fd1f3d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1336 microversion: 2.54 time: 0.125867 Oct 29 21:04:50.564684 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2097/4310] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:50 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:04:50.596072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] validate_networks() for [('0afc686e-aecb-4fab-be22-b120e882e5e7', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:04:50.824046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:50.824422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:50.834133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.844200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.844906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.849295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.850057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.850552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.874540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 HTTP/1.1 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7c9e357c-33ce-49c3-9464-960551d978e4'} Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:50.877998 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:04:50.881570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:50.885342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:50.887829 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e78de76-ca60-4473-b250-f42d5b5ec31a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 404 len: 111 microversion: 2.1 time: 0.069425 Oct 29 21:04:50.903172 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2098/4311] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:50 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:04:50.931335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:50.932555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:50.954065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.955720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.958526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:50.959489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:50.960345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:50.963207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:51.381258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:51.392154 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b8a2811-fd99-4ef4-9eff-78ec8eee103f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1512 microversion: 2.1 time: 0.466651 Oct 29 21:04:51.393862 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2099/4312] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:50 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:51.400018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:51.400538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:51.401635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:51.402935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:51.405009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:51.419810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1873256111", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:51.426324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:51.426933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:51.431463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:51.432328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:51.432870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:51.433377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:51.501438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Getting quotas for project a47c15d746e94571b66736d37e9c92b4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:51.510702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Getting quotas for user bf5d75d7cdde44639d2f5ca9475c85b5 and project a47c15d746e94571b66736d37e9c92b4. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:51.535680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:04:51.545023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:51.547767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:51.562858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:51.622376 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-794a77ce-8521-42ac-83b4-5239f26031ae tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.111173 Oct 29 21:04:51.623651 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2214/4313] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:04:51.643901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:51.644885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:51.657006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:51.657975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:51.658712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:51.659817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:51.660597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:51.661222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:51.798160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:51.810659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:51.816242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:51.817498 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eacb3da7-7b5c-4ba8-b000-4defb3b957ba tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1336 microversion: 2.54 time: 0.192311 Oct 29 21:04:51.818775 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2215/4314] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:51 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1336 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:51.833657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edd93538-6486-45e7-bb22-f34566164363 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:51.834265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-edd93538-6486-45e7-bb22-f34566164363 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:51.931799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-edd93538-6486-45e7-bb22-f34566164363 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:51.947692 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edd93538-6486-45e7-bb22-f34566164363 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1213 microversion: 2.1 time: 0.128224 Oct 29 21:04:51.948487 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2216/4315] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:51 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:52.082334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-fdec460a-9112-443c-8dc0-340ca592d30f req-f7a22713-69ae-4765-927a-5e24b6590d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5c6dc5-d9a2-43a8-816c-958c3f931aea", "name": "network-vif-deleted", "tag": "060de5ac-dd48-41e6-b2bf-e87f6b52950f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:52.108849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fdec460a-9112-443c-8dc0-340ca592d30f req-f7a22713-69ae-4765-927a-5e24b6590d01 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.109344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fdec460a-9112-443c-8dc0-340ca592d30f req-f7a22713-69ae-4765-927a-5e24b6590d01 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.109829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fdec460a-9112-443c-8dc0-340ca592d30f req-f7a22713-69ae-4765-927a-5e24b6590d01 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.140065 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-fdec460a-9112-443c-8dc0-340ca592d30f req-f7a22713-69ae-4765-927a-5e24b6590d01 service nova] Creating event network-vif-deleted:060de5ac-dd48-41e6-b2bf-e87f6b52950f for instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea on nch2-master-1 Oct 29 21:04:52.155067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-fdec460a-9112-443c-8dc0-340ca592d30f req-f7a22713-69ae-4765-927a-5e24b6590d01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076554 Oct 29 21:04:52.155943 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2217/4316] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:52.418476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:52.420230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:52.446252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.453335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.454818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.456231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.457995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.459404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.574122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:52.608514 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9124595-1260-4ec6-b370-359aaaf83a93 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1470 microversion: 2.1 time: 0.196335 Oct 29 21:04:52.625966 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2218/4317] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:52 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:52.706515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:52.707594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:52.708078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:52.708493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:52.708905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:52.725174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.737952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.738514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.739522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.740015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.740504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.768374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:52.771004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:52.776021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:52.794649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:04:52.797008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:04:52.845770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:52.846649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:52.857841 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54282df2-0151-4606-8e92-5a4d56905f16 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461063 Oct 29 21:04:52.859480 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2100/4318] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:04:52.867431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.868028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.870518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.871581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:52.883089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:52.883810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:52.888148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-abcdfe42-97b1-493d-914f-761900642bc4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:52.902885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-abcdfe42-97b1-493d-914f-761900642bc4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:52.997018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-abcdfe42-97b1-493d-914f-761900642bc4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:53.009225 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-abcdfe42-97b1-493d-914f-761900642bc4 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1215 microversion: 2.1 time: 0.140427 Oct 29 21:04:53.010315 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2101/4319] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:52 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:53.023170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:53.024670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:53.037934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:53.039053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:53.039504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:53.040230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:53.043076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:53.044891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:53.074996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:53.086893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:53.089170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:53.090721 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f61df7a0-43c6-49b5-975d-4f91e6f12e27 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1336 microversion: 2.54 time: 0.250040 Oct 29 21:04:53.091878 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2219/4320] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:52 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:53.136863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:53.145686 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9dceb260-7f7d-427b-9e18-97a9d919bba0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1265 microversion: 2.1 time: 0.130824 Oct 29 21:04:53.146596 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2102/4321] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:53 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:53.642400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:53.643031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:53.656845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:53.657236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:53.657706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:53.658765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:53.659219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:53.659818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:53.700398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:53.700910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:53.701374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:53.701858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lazy-loading 'fault' on Instance uuid 9f5c6dc5-d9a2-43a8-816c-958c3f931aea {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:04:53.767598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:53.782443 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2ceb916-35ca-48b6-849b-a2103a1f9bfa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 200 len: 1307 microversion: 2.1 time: 0.147289 Oct 29 21:04:53.784756 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2220/4322] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:53 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:54.032313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:54.033080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:54.040122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.040865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.041311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.042208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.042827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.043533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.119707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:54.120327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:54.126524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.127007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.127444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.128137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.128592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.129014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.140426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:54.169655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f704bd7-71a0-4335-8af2-da0d34da1773 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1211 microversion: 2.1 time: 0.140379 Oct 29 21:04:54.174293 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2103/4323] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:54 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:54.195932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:54.197000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:54.217991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.218693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.219670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.221379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.222767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.223438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.250965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:54.312141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:54.323698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:54.330885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:54.332966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de91c915-b3b2-41e4-97a6-765b4959cd98 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1336 microversion: 2.54 time: 0.217565 Oct 29 21:04:54.334107 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2221/4324] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:54 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:04:54.370433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:54.380722 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-956346f5-dc30-429d-8bdf-5882d4686093 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1271 microversion: 2.1 time: 0.204818 Oct 29 21:04:54.384404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2104/4325] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:54 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:54.806673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:54.807303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:54.814962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.815450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.815888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.816594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.817045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.817496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.847488 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea HTTP/1.1 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9f5c6dc5-d9a2-43a8-816c-958c3f931aea'} Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:04:54.849602 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:04:54.853636 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:04:54.855781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:54.856922 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-02110680-2686-4a4b-a477-95bb18bb5ed9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 404 len: 111 microversion: 2.1 time: 0.054140 Oct 29 21:04:54.868081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:54.868632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:54.873782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2222/4326] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:54 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:04:54.875376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.876051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.876809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:54.877713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:54.878332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:54.879100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.135710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:55.147447 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0dabdaea-8827-4c93-abfb-145f38631a0b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.283945 Oct 29 21:04:55.154710 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2105/4327] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:54 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:04:55.200165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:55.200815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:55.223971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.223971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.224295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.227259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.227935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.228380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.362723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:55.363412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:55.374209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.374622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.375063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.383014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.388627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.389971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.424235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:55.438009 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-177b98cf-74b5-4ec5-8b00-2c8bff99fbdb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1267 microversion: 2.1 time: 0.244701 Oct 29 21:04:55.439191 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2223/4328] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:55 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:55.463727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:55.464605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:55.471703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.472441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.473265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.474165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.478203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.480001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.748714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:55.761861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:55.763695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:55.765247 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29077c66-49e4-4f40-b528-c023c5b139e5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1357 microversion: 2.54 time: 0.406814 Oct 29 21:04:55.788488 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2106/4329] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:55 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1357 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:55.798135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98acaa69-50fb-4d14-b061-5a015c8037dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98acaa69-50fb-4d14-b061-5a015c8037dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 163 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": 12345, "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 12345 Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:04:55.816914 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 21:04:55.822562 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:55.824348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98acaa69-50fb-4d14-b061-5a015c8037dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:55.825507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98acaa69-50fb-4d14-b061-5a015c8037dc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.034665 Oct 29 21:04:55.826162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2107/4330] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:55 2022] POST /compute/v2.1/servers => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:04:55.830954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b241e0f5-f94f-47c3-a122-764f2d332073 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Action: 'create', calling method: .version_select at 0x7fa171f06ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1844546751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb8MgUeOuGgFJl46kx2tHl2syxHCaat9rAGWHwc4DOhjmC6A8vf3iUHmiIvdGa5AYLuU7UubnzPMqlWzxs0dSa3aPFs5DHZirkI3QX85o3E6UobcQNsbue1jEeNyP0ZKA=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:55.849753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=25 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:55.856510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b241e0f5-f94f-47c3-a122-764f2d332073 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Getting quotas for project 250bb0d83cb849dea30ca3688f7ceefe. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:04:55.871563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b241e0f5-f94f-47c3-a122-764f2d332073 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Getting quotas for user fbe0439f98aa4e80b8389a1fb412eaa3 and project 250bb0d83cb849dea30ca3688f7ceefe. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:04:55.928458 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b241e0f5-f94f-47c3-a122-764f2d332073 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.100095 Oct 29 21:04:55.933973 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2108/4331] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 21:04:55 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 21:04:55.944381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:55.946147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:55.958365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.959511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.960841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:55.964632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:55.965704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:55.967596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.026525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.042111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-256f0728-76af-49e2-b11c-d1eecd4e64c3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.583797 Oct 29 21:04:56.058154 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2224/4332] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:55 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:56.064103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1844546751", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:56.068046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:56.075093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.075592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.076036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.076743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.077194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.077839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.181314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:04:56.181863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:04:56.182434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:04:56.182915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:04:56.183540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:04:56.311952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:56.327769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.328809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.329735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.330014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.330482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.331114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.351622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.367598 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e07ec567-72b1-4aa9-9245-9e48d1a15c9c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.432125 Oct 29 21:04:56.369924 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1e1bd1f2-7c7d-4ef1-aac5-ddfffed4d1c0 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "POST /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2/action" status: 202 len: 1140 microversion: 2.54 time: 0.310275 Oct 29 21:04:56.371177 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2225/4333] 10.222.0.36 () {62 vars in 1320 bytes} [Sat Oct 29 21:04:56 2022] POST /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2/action => generated 1140 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 21:04:56.381909 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2109/4334] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:55 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:56.395738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:56.396461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:56.398581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:56.402202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:56.412987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.415607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.416275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.416695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.417076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.418352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.419005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.419631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.421344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.422549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.423577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.425489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.602884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.615172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.620895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.623838 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e99b8edf-8c75-4864-a401-aeec28436f7f tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.232422 Oct 29 21:04:56.624815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2226/4335] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:56 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:56.630326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:56.631290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:56.640702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.641411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.642303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.643502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:56.644174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:56.644825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:56.769733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.791242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-27f6a3a9-5c2b-41db-9a19-8f33cb0e1426 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1273 microversion: 2.1 time: 0.155702 Oct 29 21:04:56.793246 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2227/4336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:56 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:56.827464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:56.838446 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-01248769-fadf-4954-a2e3-190ae0d964be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.446459 Oct 29 21:04:56.841110 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2110/4337] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:56 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:57.072128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:57.072761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:57.093602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:57.093602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:57.099136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:57.100136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:57.106006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:57.108880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:57.191189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:04:57.210300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f5608078-c725-4283-8630-f8be03d22b3d req-25a75d7b-d151-46c6-b6a2-25b25d2bb3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348488d4-f73a-44b3-b659-9f148405af57", "tag": "6b3419c1-12e6-450a-aa47-7b05a4090e45"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:57.240745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f5608078-c725-4283-8630-f8be03d22b3d req-25a75d7b-d151-46c6-b6a2-25b25d2bb3a0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:57.246095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f5608078-c725-4283-8630-f8be03d22b3d req-25a75d7b-d151-46c6-b6a2-25b25d2bb3a0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:57.249353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f5608078-c725-4283-8630-f8be03d22b3d req-25a75d7b-d151-46c6-b6a2-25b25d2bb3a0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:57.302927 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f5608078-c725-4283-8630-f8be03d22b3d req-25a75d7b-d151-46c6-b6a2-25b25d2bb3a0 service nova] Creating event network-changed:6b3419c1-12e6-450a-aa47-7b05a4090e45 for instance 348488d4-f73a-44b3-b659-9f148405af57 on nch1-master-1 Oct 29 21:04:57.322238 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f5608078-c725-4283-8630-f8be03d22b3d req-25a75d7b-d151-46c6-b6a2-25b25d2bb3a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116071 Oct 29 21:04:57.322902 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2111/4338] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:04:57.604604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4028e365-eb38-415f-9748-8fcc01459a37 req-02ae33b6-af0f-49c7-bdd4-a5bce82e56a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-plugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:57.619993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4028e365-eb38-415f-9748-8fcc01459a37 req-02ae33b6-af0f-49c7-bdd4-a5bce82e56a6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:57.622919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4028e365-eb38-415f-9748-8fcc01459a37 req-02ae33b6-af0f-49c7-bdd4-a5bce82e56a6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:57.624227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4028e365-eb38-415f-9748-8fcc01459a37 req-02ae33b6-af0f-49c7-bdd4-a5bce82e56a6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:57.658588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4028e365-eb38-415f-9748-8fcc01459a37 req-02ae33b6-af0f-49c7-bdd4-a5bce82e56a6 service nova] Creating event network-vif-plugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:04:57.670029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4028e365-eb38-415f-9748-8fcc01459a37 req-02ae33b6-af0f-49c7-bdd4-a5bce82e56a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070052 Oct 29 21:04:57.674135 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2112/4339] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:04:57.684226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:57.688395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:57.698875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:57.699733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:57.700426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:57.701313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:57.701953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:57.702628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:58.080349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:58.102873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:58.108000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:58.110483 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd1dff8d-fed5-4ab6-93da-e46aac967507 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.434678 Oct 29 21:04:58.114542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2113/4340] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:57 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:04:58.131695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:58.142903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:58.162242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:58.164921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:58.165583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:58.166483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:58.169682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:58.170516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:58.388512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:58.406248 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e91d36e-283c-43a4-bd5e-9d80a5fea543 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 1.333555 Oct 29 21:04:58.406999 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2228/4341] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:57 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:58.597138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:58.614159 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64f1145b-ca65-45e2-9a4b-bbb4f7e530b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.493990 Oct 29 21:04:58.620213 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2114/4342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:58 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:04:59.141432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:59.142592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:59.155770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:59.156426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:59.156976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:59.157833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:59.159152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:59.165822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:59.318280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f128327a-e0d7-4f0f-9b27-0af4cb139abf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1614863781", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6795ea29-e00f-4ecb-b9e9-c60c491b9c9d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:04:59.435264 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f128327a-e0d7-4f0f-9b27-0af4cb139abf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Block Device 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not bootable. Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f128327a-e0d7-4f0f-9b27-0af4cb139abf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 358 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1614863781", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6795ea29-e00f-4ecb-b9e9-c60c491b9c9d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: exception: Block Device 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not bootable. Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1614863781', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6795ea29-e00f-4ecb-b9e9-c60c491b9c9d'}], 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not bootable. Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:04:59.445600 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not bootable. Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not bootable. Oct 29 21:04:59.449523 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:04:59.451935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f128327a-e0d7-4f0f-9b27-0af4cb139abf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Block Device 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not bootable. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:04:59.452989 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f128327a-e0d7-4f0f-9b27-0af4cb139abf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.141585 Oct 29 21:04:59.456502 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2115/4343] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:04:59 2022] POST /compute/v2.1/servers => generated 110 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:04:59.462340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:59.463187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:59.469713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:59.470430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:59.471120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:59.472418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:59.473102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:59.473779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:59.695643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:59.709913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:59.714517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:04:59.719103 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d124a59b-c21d-453d-8e48-d8a17b5a2ef3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.581634 Oct 29 21:04:59.724940 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2229/4344] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:04:59 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:04:59.741966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:04:59.743505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:04:59.752913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:59.754219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:59.755094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:04:59.756067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:04:59.757006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:04:59.757726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.269260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.280735 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a7af5ce-8b4e-4081-b1b3-7ef289944fec tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.819595 Oct 29 21:05:00.297189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.302461 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2116/4345] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:59 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:00.313247 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d00dc19-4d5c-4aab-88e8-40d6c9d490e9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.583625 Oct 29 21:05:00.314209 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2230/4346] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:04:59 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:00.316594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:00.317604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:00.325789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:00.326616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:00.327940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.329087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:00.329937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:00.333291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.338595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:00.347810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:00.367834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:00.369085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:00.369585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.372028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:00.372924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:00.374693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.704338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.718363 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-506a4bf7-9ce6-463c-a871-5252585002e5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.384558 Oct 29 21:05:00.721559 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2231/4347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:00 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:00.756613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:00.758366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:00.768068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:00.778297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:00.780359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.781321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:00.787207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:00.787934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:00.861435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.873761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b35951e-28c9-48f4-86cf-bf2c58df52d2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.568522 Oct 29 21:05:00.875056 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2117/4348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:00 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:00.962026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.975307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.982357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:00.983885 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-830293ef-879b-4377-8108-88fde38a4c0b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.232396 Oct 29 21:05:00.984468 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2232/4349] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:00 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:05:01.310043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:01.310675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:01.319789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:01.320611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:01.327778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:01.332750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:01.332750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:01.332750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:01.771254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:01.792886 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4ab23ef8-5d6d-45e6-b829-32e34b1016b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.483494 Oct 29 21:05:01.796694 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2118/4350] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:01 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:01.879443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-34524ce3-13d2-4da2-aae4-f3811be79333 req-9a0b5f9d-370e-4389-9d90-69276acfbe8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283c0d72-0b7e-4802-ab7c-0d9ac1881f51", "tag": "2b7b2f74-72d4-4713-99f8-9765ff5b4bec"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:01.898378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:01.902787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-34524ce3-13d2-4da2-aae4-f3811be79333 req-9a0b5f9d-370e-4389-9d90-69276acfbe8c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:01.903539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-34524ce3-13d2-4da2-aae4-f3811be79333 req-9a0b5f9d-370e-4389-9d90-69276acfbe8c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:01.904432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-34524ce3-13d2-4da2-aae4-f3811be79333 req-9a0b5f9d-370e-4389-9d90-69276acfbe8c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:01.918715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:01.919449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:01.921874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-34524ce3-13d2-4da2-aae4-f3811be79333 req-9a0b5f9d-370e-4389-9d90-69276acfbe8c service nova] Creating event network-changed:2b7b2f74-72d4-4713-99f8-9765ff5b4bec for instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 on nch2-master-1 Oct 29 21:05:01.928465 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-34524ce3-13d2-4da2-aae4-f3811be79333 req-9a0b5f9d-370e-4389-9d90-69276acfbe8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065398 Oct 29 21:05:01.930007 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2233/4351] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:05:01.960631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:01.963470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:01.968168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:01.972515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:01.976497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:01.980564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:02.018234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:02.019087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:02.027668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=9 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:02.037047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:02.037629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:02.038468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:02.040535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:02.041143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:02.041629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:02.252443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:02.272358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:02.277113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:02.282704 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4711e1eb-0d16-4846-b3f7-970595341841 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.270574 Oct 29 21:05:02.285074 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2234/4352] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:02 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:02.419795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:02.438059 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5078433e-78b6-422a-928b-6c24ca6361ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.533690 Oct 29 21:05:02.442249 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2119/4353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:01 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:02.607869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0008b071-6e71-4600-97d4-583c6bb6643e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1044320227", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "destination_type": "local"}, {"source_type": "volume", "uuid": "41e8bc52-fb85-4a77-b392-bddd056f4bc8", "destination_type": "invalid"}], "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0008b071-6e71-4600-97d4-583c6bb6643e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 495 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1044320227", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "destination_type": "local"}, {"source_type": "volume", "uuid": "41e8bc52-fb85-4a77-b392-bddd056f4bc8", "destination_type": "invalid"}], "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1044320227', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '41e8bc52-fb85-4a77-b392-bddd056f4bc8', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:02.613575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0008b071-6e71-4600-97d4-583c6bb6643e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0008b071-6e71-4600-97d4-583c6bb6643e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012292 Oct 29 21:05:02.618644 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2235/4354] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:02.627397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:02.628041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:02.638365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:02.638870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:02.640984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:02.642875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:02.647295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:02.648042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:02.762549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:02.820454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:02.821070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:02.829700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:02.830195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:02.830639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:02.841715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:02.842686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:02.843507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.342764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:03.355685 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2a3d7164-13dc-49e8-b8cd-85250ebe9df7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.733736 Oct 29 21:05:03.356293 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2120/4355] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:02 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:03.364525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:03.365141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:03.383776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:03.385983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:03.387322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.391659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:03.394777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:03.395928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.617550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:03.628944 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-27a2c0da-2342-447f-b5ae-646371857c89 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.812351 Oct 29 21:05:03.634768 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2236/4356] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:02 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:03.643844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:03.648097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:03.661749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:03.662562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:03.671893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.682846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:03.683672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:03.685938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.698822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:03.709126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:03.729258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:03.765555 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af7dfd30-07b1-4b73-808c-4bbc9cfc4d40 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.408015 Oct 29 21:05:03.771359 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2121/4357] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:03 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:03.797113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:03.800252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:03.838549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:03.839353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:03.840052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.841036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:03.841916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:03.844919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:03.866849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:03.875931 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1e1458ae-9ea0-4d13-912c-43049e7d6fa2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.239736 Oct 29 21:05:03.880109 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2237/4358] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:03 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:04.184008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04c9b0a3-ff66-47be-91bf-93ee269d37c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1600759251", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04c9b0a3-ff66-47be-91bf-93ee269d37c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 492 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1600759251", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1600759251', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.188328 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04c9b0a3-ff66-47be-91bf-93ee269d37c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:04.191580 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-04c9b0a3-ff66-47be-91bf-93ee269d37c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011536 Oct 29 21:05:04.214599 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2238/4359] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:04 2022] POST /compute/v2.1/servers => generated 624 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:04.220304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:04.220917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:04.283588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:04.286277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:04.286732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:04.287491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:04.287950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:04.288422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:04.304519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:04.318550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90bc77a8-eb8e-464e-b10c-f449cad62dde tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.545718 Oct 29 21:05:04.325615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2122/4360] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:03 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:04.669573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:04.670990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:04.731455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:04.731455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:04.731455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:04.732259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:04.732259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:04.732592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:04.884267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:04.915656 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54d8a68b-f68f-4be5-8f06-79467d9a9330 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.690906 Oct 29 21:05:04.918678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2239/4361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:04 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:04.937785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:04.941733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:04.968028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:04.969107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:04.971681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:04.975228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:04.977966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:04.980149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:05.167879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:05.180506 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e26937f-d84f-4a47-93b1-c32c643fee3a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.528111 Oct 29 21:05:05.181108 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2123/4362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:04 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:05.232328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:05.232934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:05.261250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:05.261802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:05.262430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:05.263159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:05.263756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:05.264187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:05.424296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:05.438344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:05.440522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:05.447857 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca2380c8-e00e-480f-abaa-8fa2290aa14a tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.525805 Oct 29 21:05:05.449653 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2240/4363] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:04 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:05.460048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:05.461143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:05.470370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:05.471187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:05.472033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:05.472951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:05.474951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:05.475936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:05.554508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:05.566457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48ba0009-6591-4507-8b10-ad42f22aee40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.354233 Oct 29 21:05:05.567308 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2124/4364] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:05 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:05.790507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:05.802111 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6c914d42-af52-4635-a947-2df04c270a1e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.350337 Oct 29 21:05:05.806388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2241/4365] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:05 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:05.870531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f849f0c-1eaa-4454-b0b3-44702c1b338d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f849f0c-1eaa-4454-b0b3-44702c1b338d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 416 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 21:05:05.875459 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:05:05.878650 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:05.882149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f849f0c-1eaa-4454-b0b3-44702c1b338d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:05.885391 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5f849f0c-1eaa-4454-b0b3-44702c1b338d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.030697 Oct 29 21:05:05.886779 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2125/4366] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:05 2022] POST /compute/v2.1/servers => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:05.894725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:05.895347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:05.902534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:05.903024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:05.903465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:05.904166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:05.904613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:05.905056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.090479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:06.101878 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9c259d7-bb08-4562-ac87-bfffe102920c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.210235 Oct 29 21:05:06.103435 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2242/4367] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:05 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:06.127388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:06.132140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:06.133846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:06.145413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.146434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.148192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.149280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.150461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.151103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.177446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:06.215197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:06.215965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:06.244277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.244798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.248602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.249347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.249842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.250275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.452154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:06.470843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a31a4411-ac5f-4fcd-a65c-b8ba8347796a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.344145 Oct 29 21:05:06.499045 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2126/4368] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:06 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:06.512404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0fca71a8-4e34-4b4a-8577-2d8f8a30132a req-439d190a-acfc-4125-9f52-f60520284267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348488d4-f73a-44b3-b659-9f148405af57", "name": "network-vif-plugged", "status": "completed", "tag": "6b3419c1-12e6-450a-aa47-7b05a4090e45"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:06.541478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0fca71a8-4e34-4b4a-8577-2d8f8a30132a req-439d190a-acfc-4125-9f52-f60520284267 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.542711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0fca71a8-4e34-4b4a-8577-2d8f8a30132a req-439d190a-acfc-4125-9f52-f60520284267 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.547142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0fca71a8-4e34-4b4a-8577-2d8f8a30132a req-439d190a-acfc-4125-9f52-f60520284267 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.573664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0fca71a8-4e34-4b4a-8577-2d8f8a30132a req-439d190a-acfc-4125-9f52-f60520284267 service nova] Creating event network-vif-plugged:6b3419c1-12e6-450a-aa47-7b05a4090e45 for instance 348488d4-f73a-44b3-b659-9f148405af57 on nch1-master-1 Oct 29 21:05:06.587271 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0fca71a8-4e34-4b4a-8577-2d8f8a30132a req-439d190a-acfc-4125-9f52-f60520284267 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083486 Oct 29 21:05:06.591072 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2127/4369] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:06.603736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:06.607795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:06.629127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:06.636379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.641249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6928803-630d-48cd-8047-0f008f732790 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.437973 Oct 29 21:05:06.642296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.642962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.643717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.644178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.644610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.661354 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2243/4370] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:06 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:06.695249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b683fa6b-8e39-4549-8aa6-93d1146ac529 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-129793598", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": -1, "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:06.741042 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b683fa6b-8e39-4549-8aa6-93d1146ac529 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Flavor -1 could not be found. Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b683fa6b-8e39-4549-8aa6-93d1146ac529 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 205 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-129793598", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": -1, "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: exception: Flavor -1 could not be found. Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-129793598', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': -1, 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:06.766492 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 29 21:05:06.769866 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:06.773126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b683fa6b-8e39-4549-8aa6-93d1146ac529 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:06.774336 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b683fa6b-8e39-4549-8aa6-93d1146ac529 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.083113 Oct 29 21:05:06.775479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2244/4371] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 21:05:06.791812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:06.795099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:06.803048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.803773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.804318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.805242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.805832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.806630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.917363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:06.931278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:06.943210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:06.945693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f3abae48-51dc-47f6-a1d9-388c472dc541 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.351970 Oct 29 21:05:06.957806 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2128/4372] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:06 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:06.972100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:06.973050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:06.982996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.983970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.984939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:06.986145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:06.986827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:06.987491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:07.341222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:07.355231 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d7dc41f-c108-41ad-bb3a-38c1ac83dfe5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.573085 Oct 29 21:05:07.357150 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2245/4373] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:06 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:07.388808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:07.390235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:07.404136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:07.405071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:07.406675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:07.408188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:07.410728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:07.412148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:07.413194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:07.431833 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05aa33f4-eff7-44c8-a433-ab18800c5a00 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.471743 Oct 29 21:05:07.435274 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2129/4374] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:06 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:07.686538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:07.687166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:07.699507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:07.700274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:07.700730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:07.706324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:07.707513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:07.708978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.282990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.292759 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-723ea779-7b62-4fbe-9ba0-97e1e0218983 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.911448 Oct 29 21:05:08.293356 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2246/4375] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:07 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:08.308706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:08.309658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:08.323635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:08.324455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:08.325064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.325990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:08.329150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:08.329790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.516777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.530287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.531959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.535903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.540275 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9b8ab0a-5d80-46b0-b31b-d591d6542def tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.243331 Oct 29 21:05:08.541738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2247/4376] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:08 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:08.544711 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f9aa0b8a-0948-4047-97a4-542e495f1632 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1313 microversion: 2.1 time: 0.862512 Oct 29 21:05:08.559973 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2130/4377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:07 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:08.562850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:08.563770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:08.571793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16b17ca0-e0c1-415e-9531-c5afb3703677 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68920434", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16b17ca0-e0c1-415e-9531-c5afb3703677 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 171 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68920434", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-68920434', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi -1 Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:08.576322 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:08.579984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16b17ca0-e0c1-415e-9531-c5afb3703677 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:08.585997 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16b17ca0-e0c1-415e-9531-c5afb3703677 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.016707 Oct 29 21:05:08.586724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:08.587227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:08.587680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.588620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:08.589559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:08.590138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.596215 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2131/4378] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:08 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:08.610174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:08.611819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:08.635428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:08.638336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:08.639183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.642185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:08.642909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:08.643565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:08.899584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.906223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:08.909669 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eadd83e0-3d9d-494b-bbc4-3a12c0945413 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.362502 Oct 29 21:05:08.919937 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2248/4379] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:08 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:08.965396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:08.975791 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d9d9e74-a8d2-4b91-9c9f-4136bf7d6582 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.375484 Oct 29 21:05:08.977780 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2132/4380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:08 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:09.006509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:09.007823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:09.014157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.018116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.018577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.019421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.019949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.024719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.252650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:09.264153 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b5a36ed1-bb25-4676-9f8d-ad5e455eedae tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.264066 Oct 29 21:05:09.282355 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2249/4381] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:08 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:09.411776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-461c7ece-7da5-46ca-9af5-b1b1e5062d0b req-4c3783bf-01fe-4d5d-b3e6-4cc938f42cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283c0d72-0b7e-4802-ab7c-0d9ac1881f51", "name": "network-vif-plugged", "status": "completed", "tag": "2b7b2f74-72d4-4713-99f8-9765ff5b4bec"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:09.456392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-461c7ece-7da5-46ca-9af5-b1b1e5062d0b req-4c3783bf-01fe-4d5d-b3e6-4cc938f42cd8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.456901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-461c7ece-7da5-46ca-9af5-b1b1e5062d0b req-4c3783bf-01fe-4d5d-b3e6-4cc938f42cd8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.457382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-461c7ece-7da5-46ca-9af5-b1b1e5062d0b req-4c3783bf-01fe-4d5d-b3e6-4cc938f42cd8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.508225 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-461c7ece-7da5-46ca-9af5-b1b1e5062d0b req-4c3783bf-01fe-4d5d-b3e6-4cc938f42cd8 service nova] Creating event network-vif-plugged:2b7b2f74-72d4-4713-99f8-9765ff5b4bec for instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 on nch2-master-1 Oct 29 21:05:09.527873 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-461c7ece-7da5-46ca-9af5-b1b1e5062d0b req-4c3783bf-01fe-4d5d-b3e6-4cc938f42cd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117477 Oct 29 21:05:09.533112 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2133/4382] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:09.577293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:09.580310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:09.581020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:09.581382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:09.590606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.596404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.598772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.600152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.600327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.602117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.603131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.605557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.610388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.612265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:09.613728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:09.617761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:09.917960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:09.943287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:09.947206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:09.953335 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e1506d9-1cf4-4940-91cf-7234bd6b0b30 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.381724 Oct 29 21:05:09.954165 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2134/4383] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:09 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:09.984992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b0330b0-818d-4da7-a447-e9a8cdaac46e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1095688143", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:09.997585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4b0330b0-818d-4da7-a447-e9a8cdaac46e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b0330b0-818d-4da7-a447-e9a8cdaac46e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 216 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1095688143", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1095688143', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 21:05:09.999264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b0330b0-818d-4da7-a447-e9a8cdaac46e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b0330b0-818d-4da7-a447-e9a8cdaac46e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025174 Oct 29 21:05:10.006276 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2135/4384] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:09 2022] POST /compute/v2.1/servers => generated 123 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:10.007470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:10.008687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:10.018282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.019048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.019684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.021046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.021713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.023073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.091354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:10.106735 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d440773-e338-48a8-b62e-ec23bec71a94 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1499 microversion: 2.1 time: 0.535122 Oct 29 21:05:10.107446 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2250/4385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:09 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1499 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:10.120619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:10.121585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:10.138625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.139131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.139563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.141231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.144519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.145165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.242179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:10.252344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d32b594-dd1c-4409-b722-1c0600671069 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.250008 Oct 29 21:05:10.255635 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2136/4386] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:10 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:10.263168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:10.265761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:10.307515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.308308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.308753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.309609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.317707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.318471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.453577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:10.462683 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37c10279-004c-4d8e-8eb2-2c1f7264bca8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.353039 Oct 29 21:05:10.463738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lazy-loading 'flavor' on Instance uuid 348488d4-f73a-44b3-b659-9f148405af57 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:05:10.464796 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2251/4387] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:10 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:10.515463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:10.516341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:10.524243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.524726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.525808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.526594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.527112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.527761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.622411 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d88d077-7593-47d6-bb14-c2188a7902fe tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "POST /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57/action" status: 200 len: 32 microversion: 2.1 time: 0.364897 Oct 29 21:05:10.623672 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2137/4388] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:10 2022] POST /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:05:10.637971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:10.642187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:10.657136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.658295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.659772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:10.660883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:10.661674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:10.664242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:11.152486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:11.161788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-01ce75ce-7eba-4717-b1b6-0b3a0a0bb2cb tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.531802 Oct 29 21:05:11.163404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2138/4389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:10 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:11.169346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:11.170261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:11.185438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:11.189336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:11.190873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:11.191796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:11.197542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:11.200522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:11.201635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:11.204921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c8958fe-506e-4cd0-9449-4973de38df20 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.708327 Oct 29 21:05:11.206299 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2252/4390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:10 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:11.284798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:11.285867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:11.307494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:11.317052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:11.321427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:11.326887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:11.329198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:11.331479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:11.464612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:11.479600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:11.483215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:11.486857 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c32b943-50dc-448a-bece-d070e885434b tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.319960 Oct 29 21:05:11.487520 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2139/4391] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:11 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:11.501445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11c5defc-6262-4c40-a716-748125c0070d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1910351887", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "key_name": "tempest-key-774892285", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:11.602744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11c5defc-6262-4c40-a716-748125c0070d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] validate_networks() for [('3b68060f-ecb8-4b22-879b-438ab171c21d', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:05:11.865966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:11.874133 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f947639f-2a0c-47e3-b1b0-1aa16ede5222 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1315 microversion: 2.1 time: 0.595187 Oct 29 21:05:11.878484 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2253/4392] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:11 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:12.073086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-11c5defc-6262-4c40-a716-748125c0070d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Invalid key_name provided. Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11c5defc-6262-4c40-a716-748125c0070d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 246 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1910351887", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "key_name": "tempest-key-774892285", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid key_name provided. Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1910351887', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'key_name': 'tempest-key-774892285', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-774892285 not found for user 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:12.075187 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:12.078603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11c5defc-6262-4c40-a716-748125c0070d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid key_name provided. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:12.080153 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11c5defc-6262-4c40-a716-748125c0070d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.587788 Oct 29 21:05:12.080153 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2140/4393] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:11 2022] POST /compute/v2.1/servers => generated 70 bytes in 591 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 21:05:12.093164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:12.098075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:12.115043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.115971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.116959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.117968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.120225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.123001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.187613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:12.188433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:12.200130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.200639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.201087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.205342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.207157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.210185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.473168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:12.487354 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f03e070f-8d04-4b11-b816-2111b7c7c091 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.403456 Oct 29 21:05:12.492058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:12.515507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc17370d-ad1a-4037-ad45-2d29556b5410 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.332028 Oct 29 21:05:12.516816 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2141/4394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:12 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:12.520619 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2254/4395] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:12 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:12.523934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:12.524718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:12.532541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:12.533114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.533651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.534033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:12.552274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.553580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.554835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.556773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.558470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.559382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.562745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.564300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.574144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.574788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.705431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:12.728904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:12.738118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:12.740765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b5e11d2c-6061-4421-ac9b-ba65f6d27a77 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.222667 Oct 29 21:05:12.749880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2142/4396] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:12 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:12.903998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:12.905219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:12.911316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:12.924982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.927828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.928400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.929505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:12.930622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:12.931397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:12.960779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:12.971652 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ce038b2-8c6b-4c08-8d09-5489e2d7e04c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.448632 Oct 29 21:05:12.983413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2255/4397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:12 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:13.180538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9939963a-37de-4110-8276-d02a8fdd8adf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1016622863", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:13.377535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:13.403918 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5acf9902-6e0e-467d-ab6a-c95bfc086d3e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1502 microversion: 2.1 time: 0.504156 Oct 29 21:05:13.404441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-9939963a-37de-4110-8276-d02a8fdd8adf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Neutron security group does_not_exist not found {{(pid=138885) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 29 21:05:13.405069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-9939963a-37de-4110-8276-d02a8fdd8adf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 29 21:05:13.418418 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2143/4398] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:12 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1502 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:13.430634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:13.431197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9939963a-37de-4110-8276-d02a8fdd8adf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 258 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1016622863", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1016622863', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:13.435801 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 29 21:05:13.439556 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:13.442715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9939963a-37de-4110-8276-d02a8fdd8adf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:13.442715 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9939963a-37de-4110-8276-d02a8fdd8adf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.260984 Oct 29 21:05:13.442715 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2256/4399] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:13 2022] POST /compute/v2.1/servers => generated 106 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:05:13.447456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:13.448080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:13.459151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.459666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.460154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.460888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.461353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.461816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.466504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.467863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.468321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.469248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.469745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.470181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.514039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'flavor' on Instance uuid 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:05:13.628530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:13.727921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:13.736122 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-03038938-00c5-4fae-9fe4-f43742cdc764 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.293533 Oct 29 21:05:13.736704 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2257/4400] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:13 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:13.750611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:13.751398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:13.762825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.766944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.771621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.773218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.776250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.776874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.905000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d41ac8fc-ef5a-4538-8897-1e5cd0cc488d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51/action" status: 202 len: 0 microversion: 2.1 time: 0.480522 Oct 29 21:05:13.908750 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2144/4401] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:13 2022] POST /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:05:13.921940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:13.923484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:13.934104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.935292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.936030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:13.937855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:13.938958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:13.939617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.088120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.102760 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-429ce511-603d-45fd-b373-d9ce018a2276 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.361529 Oct 29 21:05:14.103955 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2258/4402] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:13 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:14.128957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:14.129639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:14.145990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.147033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.149684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.151239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.152580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.153168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.259604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.261267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.281727 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e8068243-b9ba-4337-aeb1-36e1b0b2ea8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.362438 Oct 29 21:05:14.283522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.284990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.286236 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa639893-1fab-4175-84e7-4caec2e4b845 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.181041 Oct 29 21:05:14.286852 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2145/4403] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:13 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:14.309316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:14.314716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:14.315298 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2259/4404] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:14 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:14.322367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ed7222f-4a87-438e-908e-0b3552581420 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:14.322926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ed7222f-4a87-438e-908e-0b3552581420 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: a8a37797-d394-4f68-b7e2-e2638e5b4a03] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:14.336153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.336666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.337111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.337860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.338324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.338764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.340616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:14.343906 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0ed7222f-4a87-438e-908e-0b3552581420 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance a8a37797-d394-4f68-b7e2-e2638e5b4a03 could not be found. Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ed7222f-4a87-438e-908e-0b3552581420 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/a8a37797-d394-4f68-b7e2-e2638e5b4a03 HTTP/1.1 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a8a37797-d394-4f68-b7e2-e2638e5b4a03 could not be found. Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a8a37797-d394-4f68-b7e2-e2638e5b4a03'} Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a37797-d394-4f68-b7e2-e2638e5b4a03 could not be found. Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a37797-d394-4f68-b7e2-e2638e5b4a03 could not be found. Oct 29 21:05:14.346302 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a37797-d394-4f68-b7e2-e2638e5b4a03 could not be found. Oct 29 21:05:14.350519 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:14.351492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ed7222f-4a87-438e-908e-0b3552581420 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance a8a37797-d394-4f68-b7e2-e2638e5b4a03 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:14.352943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ed7222f-4a87-438e-908e-0b3552581420 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a8a37797-d394-4f68-b7e2-e2638e5b4a03" status: 404 len: 111 microversion: 2.1 time: 0.034612 Oct 29 21:05:14.357855 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2260/4405] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:05:14 2022] DELETE /compute/v2.1/servers/a8a37797-d394-4f68-b7e2-e2638e5b4a03 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:14.363581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:14.364210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:14.389149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.393374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.393934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.394739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.395267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.395714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.752412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.762443 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c5c783e1-efb7-4095-9282-d2612790b6b8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.473932 Oct 29 21:05:14.768547 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2146/4406] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:14 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:14.817769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:14.828707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-29b267a2-df5a-46c5-a960-3d808577ed66 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.469246 Oct 29 21:05:14.829262 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2261/4407] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:14 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:14.862009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:14.862646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:14.878951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.879453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.880057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:14.884935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:14.885428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:14.885905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.125870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.129520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.130528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:15.139151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.139332 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-554e1065-9860-428c-b3df-8514101c59ba tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.280998 Oct 29 21:05:15.139915 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2147/4408] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:14 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:15.144602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.145287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.150151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.150809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.151417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.163656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a66fdcc-fb35-4511-a4fa-e95ae61fcfbc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.164475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4a66fdcc-fb35-4511-a4fa-e95ae61fcfbc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Failed to fetch instance by id 9223372036854775808 {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 21:05:15.167322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4a66fdcc-fb35-4511-a4fa-e95ae61fcfbc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a66fdcc-fb35-4511-a4fa-e95ae61fcfbc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 9223372036854775808 could not be found. Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9223372036854775808'} Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.168977 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a66fdcc-fb35-4511-a4fa-e95ae61fcfbc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:15.172876 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4a66fdcc-fb35-4511-a4fa-e95ae61fcfbc tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.012556 Oct 29 21:05:15.175090 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2148/4409] 10.222.0.36 () {58 vars in 1188 bytes} [Sat Oct 29 21:05:15 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 21:05:15.180976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.181661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:15.189143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.189692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.190100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.190899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.191364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.191866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.463962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.475696 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08bd48e1-7d4f-49d8-9d7e-1aa67553bd4f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.299511 Oct 29 21:05:15.476298 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2149/4410] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:15 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:15.485597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.486231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:15.497981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.502323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.502880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.503421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.509561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.510130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.510550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.514844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed0c2664-370c-4992-a74e-39eaf19beb4b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.388301 Oct 29 21:05:15.522255 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2262/4411] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:15 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:15.535512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.536522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:15.543960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.544796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.545545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.546617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.547239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.547818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.675581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.687240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.690406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.692130 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e07ac816-6030-4751-bef3-ef74553695a4 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.214869 Oct 29 21:05:15.693310 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2150/4412] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:15 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:15.791884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:15.792795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.794664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:15.802933 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6323e66-99d2-4094-9cb2-ff3cb5e858af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.278830 Oct 29 21:05:15.805851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2263/4413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:15 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:15.818328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.821156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.821927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.822948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.823837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.824535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.838899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55b89371-cd7f-4346-89e4-a25d05c0c422 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.839456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-55b89371-cd7f-4346-89e4-a25d05c0c422 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Failed to fetch instance by id -1 {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 21:05:15.839839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-55b89371-cd7f-4346-89e4-a25d05c0c422 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance -1 could not be found. Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55b89371-cd7f-4346-89e4-a25d05c0c422 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance -1 could not be found. Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '-1'} Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:15.841755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55b89371-cd7f-4346-89e4-a25d05c0c422 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance -1 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55b89371-cd7f-4346-89e4-a25d05c0c422 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008868 Oct 29 21:05:15.846422 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2264/4414] 10.222.0.36 () {58 vars in 1137 bytes} [Sat Oct 29 21:05:15 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 21:05:15.857230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:15.861025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:15.875416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.876181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.876830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:15.882954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:15.883676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:15.884470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.141608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:16.153821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3706c5b5-b3ab-4a3a-9bb0-766af63c8aa5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.366285 Oct 29 21:05:16.157216 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2151/4415] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:15 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:16.201352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:16.211789 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8c1a4b9-1309-4a7e-9017-8e1ef64b6265 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.360666 Oct 29 21:05:16.212678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2265/4416] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:15 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:16.239235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:16.240015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:16.247599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.248915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.250313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.255572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.256413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.258260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.432668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:16.447664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04b668af-21d0-43c6-88aa-5e956dc665f1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.212461 Oct 29 21:05:16.448856 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2152/4417] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:16 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:16.475784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68690620-1a3d-4b53-be5f-ef055afededf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:16.476576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68690620-1a3d-4b53-be5f-ef055afededf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 546df581-d62f-473a-be0b-d025640d75ff] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:16.484039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-68690620-1a3d-4b53-be5f-ef055afededf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 546df581-d62f-473a-be0b-d025640d75ff could not be found. Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68690620-1a3d-4b53-be5f-ef055afededf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/546df581-d62f-473a-be0b-d025640d75ff/action HTTP/1.1 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 19 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: {"forceDelete": {}} Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 546df581-d62f-473a-be0b-d025640d75ff could not be found. Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '546df581-d62f-473a-be0b-d025640d75ff', 'body': {'forceDelete': {}}} Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546df581-d62f-473a-be0b-d025640d75ff could not be found. Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546df581-d62f-473a-be0b-d025640d75ff could not be found. Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:16.493355 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:16.499517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:16.499517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:16.499517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:16.499517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546df581-d62f-473a-be0b-d025640d75ff could not be found. Oct 29 21:05:16.499517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:16.500858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68690620-1a3d-4b53-be5f-ef055afededf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 546df581-d62f-473a-be0b-d025640d75ff could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:16.502480 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68690620-1a3d-4b53-be5f-ef055afededf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/546df581-d62f-473a-be0b-d025640d75ff/action" status: 404 len: 111 microversion: 2.1 time: 0.031342 Oct 29 21:05:16.515103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:16.516089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:16.524055 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2266/4418] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:16 2022] POST /compute/v2.1/servers/546df581-d62f-473a-be0b-d025640d75ff/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:16.526558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.528439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.529112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.547875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.552578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:16.555602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.556435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.565171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:16.594784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.595681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.597621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.598570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.602012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.602663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.859628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:16.874702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5d21c79e-c89c-4efe-a8ea-dcb93ca8d755 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.334424 Oct 29 21:05:16.875847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:16.876331 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2267/4419] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:16 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:16.882835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:16.883635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:16.890112 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5400bc3c-a4de-4348-acdb-deb455dfcfd7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.381116 Oct 29 21:05:16.891962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.892454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.892892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.895997 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2153/4420] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:16 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:16.899242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.899735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.900180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.921861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:16.925556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:16.936837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.938067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.939063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:16.941618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:16.943414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:16.944629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:17.048509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:17.065640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:17.067094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:17.068426 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b996e142-9e76-41c4-8518-de0d91f31b03 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.191010 Oct 29 21:05:17.069751 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2268/4421] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:16 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:17.180338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:17.180964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:17.191914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:17.192431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:17.192882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:17.193639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:17.199730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:17.200302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:17.253045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:17.714986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:17.717778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:17.727767 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00ee4d93-1cab-408c-955f-5d7c56d87ba8 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.551446 Oct 29 21:05:17.741514 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d2a7afc-8093-4b21-bbc7-6eb22099402d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.813289 Oct 29 21:05:17.741514 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2154/4422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:16 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:17.743136 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2269/4423] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:17 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:17.753442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c375e0a-e02b-4bc7-9db3-d02c1c8f44be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:17.756003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c375e0a-e02b-4bc7-9db3-d02c1c8f44be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: c75c0b6d-3c9b-4141-b196-bbec75bacfeb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:17.762241 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4c375e0a-e02b-4bc7-9db3-d02c1c8f44be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance c75c0b6d-3c9b-4141-b196-bbec75bacfeb could not be found. Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c375e0a-e02b-4bc7-9db3-d02c1c8f44be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/c75c0b6d-3c9b-4141-b196-bbec75bacfeb/action HTTP/1.1 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 39 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: {"os-getConsoleOutput": {"length": 10}} Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance c75c0b6d-3c9b-4141-b196-bbec75bacfeb could not be found. Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c75c0b6d-3c9b-4141-b196-bbec75bacfeb', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75c0b6d-3c9b-4141-b196-bbec75bacfeb could not be found. Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75c0b6d-3c9b-4141-b196-bbec75bacfeb could not be found. Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:17.764555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75c0b6d-3c9b-4141-b196-bbec75bacfeb could not be found. Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c375e0a-e02b-4bc7-9db3-d02c1c8f44be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance c75c0b6d-3c9b-4141-b196-bbec75bacfeb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:17.768077 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c375e0a-e02b-4bc7-9db3-d02c1c8f44be tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/c75c0b6d-3c9b-4141-b196-bbec75bacfeb/action" status: 404 len: 111 microversion: 2.1 time: 0.016609 Oct 29 21:05:17.769995 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2155/4424] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:17 2022] POST /compute/v2.1/servers/c75c0b6d-3c9b-4141-b196-bbec75bacfeb/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:17.774925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:17.776004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:17.783594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:17.784084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:17.785396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:17.786227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:17.786694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:17.787128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:17.796006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:17.796754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:17.810411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:17.810932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:17.811822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:17.812655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:17.813126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:17.813690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.102709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.112579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c908a36-c237-4440-84a5-8d15e3c97cad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.341414 Oct 29 21:05:18.117994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2270/4425] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:17 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:18.124880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.128158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.146751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.148072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.154961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.156052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.156741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.157405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.173845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.183747 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ee24303-2ac0-4f81-822e-fa6464360fc3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 0.393713 Oct 29 21:05:18.186615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2156/4426] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:17 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:18.208596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.210120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.225083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.226568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.228537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.229834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.230818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.231457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.317721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.327421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.328882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.330802 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91eebbfd-88e4-4cae-a989-e72c2110b244 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.142833 Oct 29 21:05:18.331367 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2157/4427] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:18.337226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.338158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.345238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.346261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.347028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.347984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.348704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.349338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.394253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.409018 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6fe4e93-9dd7-47b5-b3fb-d4837c0ecce3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.289660 Oct 29 21:05:18.426430 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2271/4428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:18.529325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.538025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c281cc97-4a3e-47e0-91b0-2b0d8d2fc336 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.205203 Oct 29 21:05:18.538827 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2158/4429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:18.562147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d81c9adb-1d47-4706-8f25-44345c566f21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.563064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d81c9adb-1d47-4706-8f25-44345c566f21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 317d4d8c-dce1-46e9-a951-b908ca1459eb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.572396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d81c9adb-1d47-4706-8f25-44345c566f21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 317d4d8c-dce1-46e9-a951-b908ca1459eb could not be found. Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d81c9adb-1d47-4706-8f25-44345c566f21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/317d4d8c-dce1-46e9-a951-b908ca1459eb HTTP/1.1 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 317d4d8c-dce1-46e9-a951-b908ca1459eb could not be found. Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '317d4d8c-dce1-46e9-a951-b908ca1459eb'} Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317d4d8c-dce1-46e9-a951-b908ca1459eb could not be found. Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317d4d8c-dce1-46e9-a951-b908ca1459eb could not be found. Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:18.577175 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317d4d8c-dce1-46e9-a951-b908ca1459eb could not be found. Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d81c9adb-1d47-4706-8f25-44345c566f21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 317d4d8c-dce1-46e9-a951-b908ca1459eb could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d81c9adb-1d47-4706-8f25-44345c566f21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/317d4d8c-dce1-46e9-a951-b908ca1459eb" status: 404 len: 111 microversion: 2.1 time: 0.020674 Oct 29 21:05:18.580903 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2272/4430] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/317d4d8c-dce1-46e9-a951-b908ca1459eb => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:18.588913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.589742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.596335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.596834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.597309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.601090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.602857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.603311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.755700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.757928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.771170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.772103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.773649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.774609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.775036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:18.775532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.776334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.785028 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8edb3ed9-0c0f-45d8-9115-890c46d8b9e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.200721 Oct 29 21:05:18.806059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2159/4431] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:18.811351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:18.811985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:18.819889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.820387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.820836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:18.821742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:18.822379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:18.823594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.034716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.043557 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a5e8dbf-188a-416d-902c-95e945282c29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.293457 Oct 29 21:05:19.049132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2273/4432] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:19.067313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.076373 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6be78fc0-06e2-4e70-be70-2f32ad87e444 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.269101 Oct 29 21:05:19.077162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2160/4433] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:18 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:19.222406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:19.223278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:19.238631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.239491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.240789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.244235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.245058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.246788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.273620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1aac68e-b10a-41e2-ba01-0b0b2318d4e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-458075447", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1aac68e-b10a-41e2-ba01-0b0b2318d4e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 237 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-458075447", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-458075447', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:19.302309 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 21:05:19.309193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:19.315816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1aac68e-b10a-41e2-ba01-0b0b2318d4e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:19.319036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1aac68e-b10a-41e2-ba01-0b0b2318d4e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.051834 Oct 29 21:05:19.321004 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2161/4434] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:05:19.332491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:19.342111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:19.365399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.367199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.368660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.370262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.378771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.379592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.432257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.443242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cae4ca18-6f14-44f3-95d9-a616cdd6abbd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.232943 Oct 29 21:05:19.444291 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2274/4435] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:19 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:19.451899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:19.453097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:19.463742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.466477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.467097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.468035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.471347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.477339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.590683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.603114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.607470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.615404 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23131c59-f7f5-49c5-b7a4-05e1a0c8fadb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.165264 Oct 29 21:05:19.618277 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2275/4436] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:19 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:19.624430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:19.629689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:19.642894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.651606 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc362ae6-79b8-46e2-99f9-29fa5295ac9e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.324893 Oct 29 21:05:19.655533 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2162/4437] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:19 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:19.666904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.669481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.670145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.671110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.673042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-653717193"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:19.675747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.678068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.684707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:19.708428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.708952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.709403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.710198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.710662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.711098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.729519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:19.905329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:19.915452 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26d1782e-a06c-400d-bb51-1c43f85b913b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.295578 Oct 29 21:05:19.916184 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2276/4438] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:19 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:19.941493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:19.943326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:19.961290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.962074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.963292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:19.964174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:19.964735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:19.965232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.068091 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-071d42f6-51ed-48cb-b172-66ac705a7eed tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.404609 Oct 29 21:05:20.068091 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2163/4439] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:19 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 21:05:20.075837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:20.076524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:20.083308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.084151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.084863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.086092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.086747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.087393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.330792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:20.341655 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad2d3222-5ad7-4bab-ab83-56f4bcd01e3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.424271 Oct 29 21:05:20.343558 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2277/4440] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:19 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:20.417656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:20.429150 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c66fbf34-b066-48b8-9b85-3fcd7650598f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.357921 Oct 29 21:05:20.438033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2164/4441] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:20 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:20.580962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7b62bfc-05de-49d6-8c3b-ada417003642 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-933981042", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7b62bfc-05de-49d6-8c3b-ada417003642 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 234 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-933981042", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-933981042', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:20.587761 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 21:05:20.591316 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:20.595819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7b62bfc-05de-49d6-8c3b-ada417003642 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:20.596970 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7b62bfc-05de-49d6-8c3b-ada417003642 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.021280 Oct 29 21:05:20.598236 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2278/4442] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:20.608696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:20.609335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:20.617479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.617999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.618452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.619315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.620147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.620920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.649953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:20.650576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:20.660049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.660544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.661201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.662125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.662812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.664530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.762888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:20.784542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:20.792668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:20.796806 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a77d59f7-4f70-4824-9271-7fe2be2173fb tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.151834 Oct 29 21:05:20.810452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2279/4443] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:20 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:05:20.859023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:20.867634 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51ee4bc2-e8fb-4a46-90d4-622d0a659ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.264487 Oct 29 21:05:20.868968 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2165/4444] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:20 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:20.896126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:20.896998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:20.923937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.926181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.926870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.928079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.929297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.930593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.945642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:20.946271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:20.955789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.956298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.956786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:20.957785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:20.958381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:20.959181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.228967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.239949 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87afd3b8-49fd-4d3a-97df-c26e05bef11a tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.299002 Oct 29 21:05:21.255298 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2166/4445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:20 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:21.302353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9edc3897-ec99-436d-b8ab-7e4a40020c8b req-97766b37-6d4c-40c0-8923-145e929f0b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:21.324312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9edc3897-ec99-436d-b8ab-7e4a40020c8b req-97766b37-6d4c-40c0-8923-145e929f0b8e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.324808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9edc3897-ec99-436d-b8ab-7e4a40020c8b req-97766b37-6d4c-40c0-8923-145e929f0b8e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.328022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9edc3897-ec99-436d-b8ab-7e4a40020c8b req-97766b37-6d4c-40c0-8923-145e929f0b8e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.347089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.358584 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9edc3897-ec99-436d-b8ab-7e4a40020c8b req-97766b37-6d4c-40c0-8923-145e929f0b8e service nova] Creating event network-vif-unplugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:05:21.360691 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-896aa24f-2d72-4445-8b4c-9a832d4fd7a4 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.471664 Oct 29 21:05:21.368346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9edc3897-ec99-436d-b8ab-7e4a40020c8b req-97766b37-6d4c-40c0-8923-145e929f0b8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072438 Oct 29 21:05:21.369264 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2167/4446] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:05:21.375362 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2280/4447] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:20 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:21.391545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93c87f5f-1f5b-4a03-996c-bd666bd5e972 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:21.392470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93c87f5f-1f5b-4a03-996c-bd666bd5e972 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: ee3fa0c8-3d8b-4f64-959a-28521465e080] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:21.399545 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-93c87f5f-1f5b-4a03-996c-bd666bd5e972 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance ee3fa0c8-3d8b-4f64-959a-28521465e080 could not be found. Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93c87f5f-1f5b-4a03-996c-bd666bd5e972 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/ee3fa0c8-3d8b-4f64-959a-28521465e080/action HTTP/1.1 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 13 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: {"pause": {}} Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance ee3fa0c8-3d8b-4f64-959a-28521465e080 could not be found. Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ee3fa0c8-3d8b-4f64-959a-28521465e080', 'body': {'pause': {}}} Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee3fa0c8-3d8b-4f64-959a-28521465e080 could not be found. Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee3fa0c8-3d8b-4f64-959a-28521465e080 could not be found. Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:21.414329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:21.418929 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:21.418929 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:21.418929 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:21.418929 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee3fa0c8-3d8b-4f64-959a-28521465e080 could not be found. Oct 29 21:05:21.418929 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:21.418929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93c87f5f-1f5b-4a03-996c-bd666bd5e972 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance ee3fa0c8-3d8b-4f64-959a-28521465e080 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:21.420403 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93c87f5f-1f5b-4a03-996c-bd666bd5e972 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/ee3fa0c8-3d8b-4f64-959a-28521465e080/action" status: 404 len: 111 microversion: 2.1 time: 0.033519 Oct 29 21:05:21.421146 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2168/4448] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:21 2022] POST /compute/v2.1/servers/ee3fa0c8-3d8b-4f64-959a-28521465e080/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:21.433438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:21.434094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:21.454479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.454996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.455448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.456091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:21.456207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.456752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.456835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:21.457049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.469942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.470668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.471433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.472769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.473426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.474206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.760893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.770072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87bd3a91-fd09-46ba-8748-8eb5de691135 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.318862 Oct 29 21:05:21.770750 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2169/4449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:21 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:21.791276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.800025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-18dbdeee-df18-424c-ac03-6706a90d5f5e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.373283 Oct 29 21:05:21.801225 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2281/4450] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:21 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:21.825645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:21.826716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:21.836797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:21.838142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:21.845798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.846256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.847205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.848243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.849048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.849270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.849603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.850358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.850855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.851740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:21.852368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:21.852965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:21.964832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.974522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.976068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:21.977623 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cbf50d6e-7b99-4ede-85b8-9283a7bce901 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.156128 Oct 29 21:05:21.978442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2170/4451] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:21 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:22.109054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:22.122189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bba9fd47-5f9e-4712-a19b-a33768b1d24f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.292403 Oct 29 21:05:22.123290 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2282/4452] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:21 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:22.145125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:22.145692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:22.151920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.152409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.152848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.153701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.154171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.154719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.245706 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-208a5af2-bf87-457f-b5f8-f82ac39515e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 202 len: 0 microversion: 2.1 time: 0.104580 Oct 29 21:05:22.246686 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2171/4453] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:22 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:05:22.255507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:22.256886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:22.268641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.272412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:22.273139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:22.276962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.277961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.279540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.280199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.280784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.298405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.300981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.301644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.302560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.303072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.305324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.516348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:22.526804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92eec91d-865b-431c-9106-b76e412d0e1f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1511 microversion: 2.1 time: 0.275785 Oct 29 21:05:22.527397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2283/4454] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:22 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:22.530466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:22.546894 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b5d163d-a7aa-4d39-9be1-358a0d6e0031 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.282683 Oct 29 21:05:22.547541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2172/4455] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:22 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:22.794099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:22.794796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:22.803086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.803713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.804303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:22.805210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:22.805762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:22.806263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.004921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:23.007024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:23.014935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.015726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.016279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.017064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.017638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.018629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.129874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:23.136271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:23.140186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:23.142128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:23.144091 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51cc8e28-b1f5-4bae-9f16-5a15c9dd4f8e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.143673 Oct 29 21:05:23.148801 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-960dcfc8-6a74-4e72-b239-f75a4417531d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.358366 Oct 29 21:05:23.149660 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2284/4456] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:22 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:23.155579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2173/4457] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:22 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:05:23.552822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:23.554118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:23.562378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.562872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.563311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.564280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.564929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.565593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.576230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:23.577647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:23.586802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.587562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.588873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.589717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.590779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.591218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.876662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:23.885150 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0b32bc7-c690-458d-8b6e-427469534702 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1491 microversion: 2.1 time: 0.338181 Oct 29 21:05:23.886214 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2174/4458] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:23 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1491 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:23.891383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:23.900007 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae19dd14-bd12-4a32-b7eb-c474ef79cc20 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.329654 Oct 29 21:05:23.900909 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2285/4459] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:23 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:23.923182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:23.923734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:23.936616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.937493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.938111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.939111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.939570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.940148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.967851 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'pause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state paused Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 13 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: {"pause": {}} Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'pause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state paused Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'pause': {}}} Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state paused. Cannot pause while the instance is in this state. Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state paused Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:23.969765 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:23.974640 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:23.974640 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:23.974640 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:23.974640 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:23.974640 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state paused Oct 29 21:05:23.974640 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:23.976420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'pause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state paused {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:23.977605 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5f7a3e7f-b8e0-41e7-8051-1e963e09775c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 143 microversion: 2.1 time: 0.059074 Oct 29 21:05:23.978314 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2175/4460] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:23 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 143 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:05:23.988044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:23.988595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:23.995313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.995807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.996246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:23.997163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:23.997662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:23.998096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.092414 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c10aee1-10ee-496a-b7de-d81bc1ad6958 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 202 len: 0 microversion: 2.1 time: 0.108776 Oct 29 21:05:24.095964 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2286/4461] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:23 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:05:24.104978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:24.106040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:24.114516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.115374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.116127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.117260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.117902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.118613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.171659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:24.172386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:24.181610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.182116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.182557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.183263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.183757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.184283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.189062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:24.283072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:24.312205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:24.314032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:24.315370 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b25052b8-c986-4832-ab6d-13bc4e9ba809 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.148334 Oct 29 21:05:24.316020 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2287/4462] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:24 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:24.321527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:24.323009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:24.330128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.330823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.331450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.332523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.333142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.333770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.401962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:24.428304 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43b095ab-10b2-48a4-9b74-3265e2f3aa8e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1498 microversion: 2.1 time: 0.328234 Oct 29 21:05:24.442103 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2176/4463] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:24 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:24.919039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:24.936403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:24.940827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:24.955622 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbc521f2-1139-4306-aa1e-3e41f89ce25b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.637081 Oct 29 21:05:24.958580 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2288/4464] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:24 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:24.960100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.960820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.961491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:24.962431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:24.963082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:24.964469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.245040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:25.261540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ae62603-632b-4e20-87c7-b61805823733 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.332727 Oct 29 21:05:25.262454 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2177/4465] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:24 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:25.345871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:25.346876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:25.364623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:25.365376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:25.369942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.370767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:25.371250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:25.371690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.459679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:25.460287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:25.468187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:25.468686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:25.469126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.472497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:25.473922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:25.478452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.501342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:25.512795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:25.516394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:25.518970 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dde9e357-ae59-4872-b413-e5f8cd201cce tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.176831 Oct 29 21:05:25.520418 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2289/4466] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:25 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:25.695581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:25.706618 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3eef5580-a502-42db-9fe4-04bf95d66e43 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.251352 Oct 29 21:05:25.707638 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2178/4467] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:25 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:25.738943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:25.741999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:25.757877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:25.758381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:25.758824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.759539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:25.760002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:25.774971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:25.978190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:25.985921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:25.986559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:25.997182 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-547773ad-3521-45fb-9e04-3473d1d1026d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.264151 Oct 29 21:05:26.017516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2290/4468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:25 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:26.018900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.019619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.020819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.023687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.024346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.025159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.031188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:26.036231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.048524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.052342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.052909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.053833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.054410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.055297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:26.055421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.091733 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea/action HTTP/1.1 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 28 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: {"reboot": {"type": "SOFT"}} Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9f5c6dc5-d9a2-43a8-816c-958c3f931aea', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:26.096719 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:26.103238 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-70df461d-ae2f-44e1-afcf-81ed9a79400c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea/action" status: 404 len: 111 microversion: 2.1 time: 0.080144 Oct 29 21:05:26.110278 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2291/4469] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:26 2022] POST /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:26.130009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:26.130633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.141652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.142516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.143114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.144073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.145379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.146062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.342242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.355297 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-83c1cf70-1ff3-4e42-b7f3-cb0fd9a8bb84 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.379648 Oct 29 21:05:26.356458 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2179/4470] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:25 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:26.364660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:26.366385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.373987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.374525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.375181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.375803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.376681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.377291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.378137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.386417 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-77a71a14-0ea3-45c0-b951-93fc046280f2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.274189 Oct 29 21:05:26.387919 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2292/4471] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:26 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:26.412301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:26.416166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.429391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.432503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.433443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.435158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.436758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.438106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.628132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.637184 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a95f19a9-f5ae-45c9-bc70-08eb4fe26e73 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.279536 Oct 29 21:05:26.642275 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2180/4472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:26 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:26.648178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:26.649016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.671584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.672514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.675022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.677016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.677701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.680406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.744163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.758949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4be2a55b-7fd0-4635-99cd-53a021b6eaad tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.350713 Oct 29 21:05:26.759769 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2293/4473] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:26 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:26.782954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ec7ffe7-1341-432d-b220-b340ad906f08 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:26.785582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ec7ffe7-1341-432d-b220-b340ad906f08 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 7172af5a-538a-4664-8620-e911f772082d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.792221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0ec7ffe7-1341-432d-b220-b340ad906f08 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 7172af5a-538a-4664-8620-e911f772082d could not be found. Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ec7ffe7-1341-432d-b220-b340ad906f08 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/7172af5a-538a-4664-8620-e911f772082d/action HTTP/1.1 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 28 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: {"reboot": {"type": "SOFT"}} Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7172af5a-538a-4664-8620-e911f772082d could not be found. Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '7172af5a-538a-4664-8620-e911f772082d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7172af5a-538a-4664-8620-e911f772082d could not be found. Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:26.793824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7172af5a-538a-4664-8620-e911f772082d could not be found. Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7172af5a-538a-4664-8620-e911f772082d could not be found. Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ec7ffe7-1341-432d-b220-b340ad906f08 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 7172af5a-538a-4664-8620-e911f772082d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ec7ffe7-1341-432d-b220-b340ad906f08 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/7172af5a-538a-4664-8620-e911f772082d/action" status: 404 len: 111 microversion: 2.1 time: 0.017950 Oct 29 21:05:26.799324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2294/4474] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:26 2022] POST /compute/v2.1/servers/7172af5a-538a-4664-8620-e911f772082d/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:05:26.807005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:26.807666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.807806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:26.815618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.816260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.816868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.817008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.817816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:26.818506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:26.819119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:26.823554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:26.826782 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa0fc5c7-06c1-4f70-a9a5-7f2cdd64506e tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.183081 Oct 29 21:05:26.827383 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2181/4475] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:26 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:27.040106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:27.050461 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6bb41c00-db30-4007-8628-72cabbe4a028 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.247507 Oct 29 21:05:27.051049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2295/4476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:26 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:27.077360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:27.078726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:27.087759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.089890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.091381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.093079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.094019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.096101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.315916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:27.326369 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e5eb6eb-a3be-4348-95ec-37a2e71f6872 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.253366 Oct 29 21:05:27.332775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2182/4477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:27 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:27.356071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6ffa2287-81e3-4b28-9c0d-38a019e102ac req-887c986f-ecbd-47c2-838e-d7b1a5bc86e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-plugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:27.367274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:27.377590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:27.405568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.406122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.406576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.409162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ffa2287-81e3-4b28-9c0d-38a019e102ac req-887c986f-ecbd-47c2-838e-d7b1a5bc86e3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.412625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ffa2287-81e3-4b28-9c0d-38a019e102ac req-887c986f-ecbd-47c2-838e-d7b1a5bc86e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.413625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ffa2287-81e3-4b28-9c0d-38a019e102ac req-887c986f-ecbd-47c2-838e-d7b1a5bc86e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.414866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.415480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.415947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.450159 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6ffa2287-81e3-4b28-9c0d-38a019e102ac req-887c986f-ecbd-47c2-838e-d7b1a5bc86e3 service nova] Creating event network-vif-plugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:05:27.463166 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6ffa2287-81e3-4b28-9c0d-38a019e102ac req-887c986f-ecbd-47c2-838e-d7b1a5bc86e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120545 Oct 29 21:05:27.464045 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2296/4478] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:27.471166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:27.472221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:27.472997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea/action HTTP/1.1 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 65 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9f5c6dc5-d9a2-43a8-816c-958c3f931aea', 'body': {'rebuild': {'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7'}}} Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:27.474185 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:05:27.477734 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:27.481873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:27.483111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35a4cf1c-0815-438f-ba33-5ae429e6c4fa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea/action" status: 404 len: 111 microversion: 2.1 time: 0.126017 Oct 29 21:05:27.483521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.483994 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2183/4479] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:27 2022] POST /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea/action => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:05:27.484104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.484466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.486853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.488107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.488586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.493158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:27.494057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:27.502520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.503173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.503733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.504393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.504755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.505590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.778797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:27.796079 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1522da09-2f09-4118-800b-c507f8e098f9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.328463 Oct 29 21:05:27.810713 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2297/4480] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:27 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:27.820709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:27.821638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:27.826134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:27.829154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.829880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.831026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.831907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.832543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.833134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.836054 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8ede1b9d-d9e8-4616-88fb-57e03db5a3f0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.347733 Oct 29 21:05:27.850836 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2184/4481] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:27 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:27.863633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:27.864454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:27.874169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.874840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.875425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:27.876296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:27.876901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:27.877541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.016188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.045528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.048458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.051143 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-556c03d5-0c4a-45f8-ba50-82a811cbbcc5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1409 microversion: 2.54 time: 0.198745 Oct 29 21:05:28.052198 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2185/4482] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:27 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1409 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:28.058946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:28.059923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:28.073419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.074219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.074799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.075808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.085789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.094388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.095883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.099562 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63da7f1e-d434-4a1f-a94c-797cfd2f6b6f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.287051 Oct 29 21:05:28.103703 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2298/4483] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:27 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:28.286654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.297305 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7f45feb9-7295-4c21-99ed-713a1ae81a40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.242654 Oct 29 21:05:28.298558 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2186/4484] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:28 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:28.322270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecf64989-5fed-4c68-bc13-b687c0063aa5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:28.326580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ecf64989-5fed-4c68-bc13-b687c0063aa5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: c089662e-cdee-4cb4-acfb-0e1bc4471105] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:28.334931 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ecf64989-5fed-4c68-bc13-b687c0063aa5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance c089662e-cdee-4cb4-acfb-0e1bc4471105 could not be found. Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecf64989-5fed-4c68-bc13-b687c0063aa5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/c089662e-cdee-4cb4-acfb-0e1bc4471105/action HTTP/1.1 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 65 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance c089662e-cdee-4cb4-acfb-0e1bc4471105 could not be found. Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'c089662e-cdee-4cb4-acfb-0e1bc4471105', 'body': {'rebuild': {'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7'}}} Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c089662e-cdee-4cb4-acfb-0e1bc4471105 could not be found. Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 21:05:28.337901 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c089662e-cdee-4cb4-acfb-0e1bc4471105 could not be found. Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c089662e-cdee-4cb4-acfb-0e1bc4471105 could not be found. Oct 29 21:05:28.342454 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.345136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecf64989-5fed-4c68-bc13-b687c0063aa5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance c089662e-cdee-4cb4-acfb-0e1bc4471105 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:28.346568 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ecf64989-5fed-4c68-bc13-b687c0063aa5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/c089662e-cdee-4cb4-acfb-0e1bc4471105/action" status: 404 len: 111 microversion: 2.1 time: 0.029436 Oct 29 21:05:28.347172 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2299/4485] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:28 2022] POST /compute/v2.1/servers/c089662e-cdee-4cb4-acfb-0e1bc4471105/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:05:28.356820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:28.357446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:28.368835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.370250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.370953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.372017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.372639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.373292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.597765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.609737 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12d2284a-6610-4bbb-9a73-f9508966283c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.256553 Oct 29 21:05:28.626591 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2187/4486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:28 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:28.646637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:28.648562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:28.657654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.658503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.659219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.660223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.660924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.661782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.825306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:28.826316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:28.838071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.841590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.842252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.843145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:28.843767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:28.844351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:28.923169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:28.935331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b73efe0-eff7-42c4-87cd-eba3349ae1b0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.292868 Oct 29 21:05:28.945111 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2300/4487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:28 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:28.975457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d8eea02-fe7d-4b09-b50b-b4678dc38893 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:28.976433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d8eea02-fe7d-4b09-b50b-b4678dc38893 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 907e8b90-6de2-4995-bd9a-aa29ea057a57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:28.988193 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-2d8eea02-fe7d-4b09-b50b-b4678dc38893 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 907e8b90-6de2-4995-bd9a-aa29ea057a57 could not be found. Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d8eea02-fe7d-4b09-b50b-b4678dc38893 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/907e8b90-6de2-4995-bd9a-aa29ea057a57/action HTTP/1.1 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 15 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: {"restore": {}} Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 907e8b90-6de2-4995-bd9a-aa29ea057a57 could not be found. Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '907e8b90-6de2-4995-bd9a-aa29ea057a57', 'body': {'restore': {}}} Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907e8b90-6de2-4995-bd9a-aa29ea057a57 could not be found. Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907e8b90-6de2-4995-bd9a-aa29ea057a57 could not be found. Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:28.993166 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:28.996843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:28.996843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:28.996843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:28.996843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907e8b90-6de2-4995-bd9a-aa29ea057a57 could not be found. Oct 29 21:05:28.996843 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:28.998855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d8eea02-fe7d-4b09-b50b-b4678dc38893 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 907e8b90-6de2-4995-bd9a-aa29ea057a57 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:29.002406 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d8eea02-fe7d-4b09-b50b-b4678dc38893 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/907e8b90-6de2-4995-bd9a-aa29ea057a57/action" status: 404 len: 111 microversion: 2.1 time: 0.030695 Oct 29 21:05:29.003917 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2301/4488] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:28 2022] POST /compute/v2.1/servers/907e8b90-6de2-4995-bd9a-aa29ea057a57/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:05:29.015924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:29.019018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:29.039300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.040492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.041404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.042453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.043842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.044776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.144638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.167041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e8484e0-c62f-4851-ba30-cd8a481f2697 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.345971 Oct 29 21:05:29.186219 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2188/4489] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:28 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:29.191383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:29.196932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:29.216993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.217758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.219004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.220474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.221440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.224037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.352346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.361959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca92df6c-a222-48b1-bccc-3bfb6d35f02f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.352281 Oct 29 21:05:29.365064 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2302/4490] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:29 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:29.377444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:29.378506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:29.398547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.399298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.399901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.400786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.401252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.401723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.412134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.424584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.426843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.429875 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be539c32-622b-4f7d-8343-8c58d58912a3 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1415 microversion: 2.54 time: 0.242256 Oct 29 21:05:29.431117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2189/4491] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:29 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1415 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:29.438050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:29.439039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:29.452929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.456174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.456914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.458875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.460180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.462990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.697951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.711118 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cb97f4f-dbbc-43fe-86b6-0649bac34e69 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.343772 Oct 29 21:05:29.716445 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2303/4492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:29 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:29.764318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:29.785947 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10539720-d159-4088-a3ae-e4337a9cce21 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.352974 Oct 29 21:05:29.813313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:29.814108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:29.817535 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2190/4493] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:29 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:29.828451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.828964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.829555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.830533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.831354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.831468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.870493 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'restore' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 15 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: {"restore": {}} Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'restore' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'restore': {}}} Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state active. Cannot restore while the instance is in this state. Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:29.872637 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:29.876369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:29.876369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:29.876369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:29.876369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:29.876369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:29.876369 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:29.878927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'restore' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:29.879980 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-403c3c9e-6530-463e-bad8-c011bdaa92ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 145 microversion: 2.1 time: 0.070745 Oct 29 21:05:29.884895 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2304/4494] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:29 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:05:29.889010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:29.889716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:29.902851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.903962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.904579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:29.905322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:29.905775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:29.906376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.130147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:30.142777 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16cb541b-292f-4717-a569-22e38313540c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.254694 Oct 29 21:05:30.155276 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2191/4495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:29 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:30.171411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:30.172030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:30.181364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.182208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.183605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.185067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.186727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.187587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.191237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:30.193356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:30.204305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.208985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.210247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.215430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.216079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.216754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.508043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:30.520759 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3373270f-28c2-4fb1-8c52-fce6e82a9f9f tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.350831 Oct 29 21:05:30.533268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:30.540583 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2305/4496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:30 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:30.545938 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-665f1673-f043-4038-97af-a3bd3d917aeb tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.356795 Oct 29 21:05:30.547756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:30.548303 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2192/4497] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:30 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:30.548864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:30.556539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.557215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.558156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.559150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.559755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.561250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.566023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa33164e-6da3-4d84-9ec3-145d68240d41 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:30.570026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa33164e-6da3-4d84-9ec3-145d68240d41 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:30.580114 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-fa33164e-6da3-4d84-9ec3-145d68240d41 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2 could not be found. Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa33164e-6da3-4d84-9ec3-145d68240d41 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2/action HTTP/1.1 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 14 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: {"resume": {}} Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2 could not be found. Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2', 'body': {'resume': {}}} Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2 could not be found. Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2 could not be found. Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:30.591732 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:30.595479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:30.595479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:30.595479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:30.595479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2 could not be found. Oct 29 21:05:30.595479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:30.597561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa33164e-6da3-4d84-9ec3-145d68240d41 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:30.598733 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa33164e-6da3-4d84-9ec3-145d68240d41 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2/action" status: 404 len: 111 microversion: 2.1 time: 0.049177 Oct 29 21:05:30.599835 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2193/4498] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:30 2022] POST /compute/v2.1/servers/01b2bdb8-7eb9-4d9e-b17e-345e57a7beb2/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:30.610056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:30.618686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:30.639537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.640016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.640514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.641643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.642254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.642949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.652792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:30.664286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:30.666064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:30.667544 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-666d1894-d575-40b4-a984-0467e172104d tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1415 microversion: 2.54 time: 0.125879 Oct 29 21:05:30.682940 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2306/4499] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:30 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1415 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:30.759880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:30.761807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:30.782530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.783656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.784206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:30.785025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:30.785635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:30.786396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.036741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:31.049622 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d01b634d-ff24-4455-aae3-8d97d892e6e9 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.307828 Oct 29 21:05:31.054578 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2307/4500] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:30 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:31.058138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:31.067000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b373bf6-d619-4a7d-b948-42ccc9a1c331 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.462298 Oct 29 21:05:31.082104 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2194/4501] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:30 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:31.091819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:31.093036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:31.099876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.101152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.101810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.103017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.103707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.104471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.139740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:31.398004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:31.409440 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0861e0bd-ae60-4e2b-a5f7-eb9c71570e53 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.320231 Oct 29 21:05:31.425556 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2308/4502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:31 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:31.441038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:31.442758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:31.451696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:31.453332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.454027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.454639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.455513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.456146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.457017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.516246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'resume' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 14 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: {"resume": {}} Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'resume' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'resume': {}}} Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state active. Cannot resume while the instance is in this state. Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:31.521682 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:05:31.528140 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:31.548261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'resume' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:31.551289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f856aaa-3f73-438c-b9ce-f877459f8788 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 144 microversion: 2.1 time: 0.117502 Oct 29 21:05:31.554935 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2195/4503] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:31 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 144 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:05:31.564427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:31.565272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:31.574521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:31.575943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.576718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.576860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:31.579289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.580345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.583004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.585661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.588044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.588559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.591208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.591995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:31.592479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:31.595064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:31.986517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.000095 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-efd11f34-7349-4bcb-af6c-f21bc915552b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.428597 Oct 29 21:05:32.001969 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2196/4504] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:31 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:32.009009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.017530 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d39c6ed-361c-46c9-b96a-5384ab8c452c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.457814 Oct 29 21:05:32.019232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2309/4505] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:31 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:32.025061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:32.025747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:32.038246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.038777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.039234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.039964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.040819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.041267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.041520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:32.042336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:32.048979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.049970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.050589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.051450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.052089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.052530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.187203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.206721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.212775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.217727 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ffbec1f-f03d-43c5-ae8d-4634eb4eeeed tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1400 microversion: 2.54 time: 0.214118 Oct 29 21:05:32.218525 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2197/4506] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:32 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1400 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:32.227911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:32.228466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:32.245612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.246275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.246605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.247518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.248210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.248858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.257674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:32.345673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.357445 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5c8263d6-9510-4dfe-b399-ccb83c5be27a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.319725 Oct 29 21:05:32.358797 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2310/4507] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:32 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:32.363744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a921766-a21e-4791-bb5f-563fd4150c2a"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:32.367020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:32.373447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.374357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.375029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.376068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.376729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.377364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.611527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:32.627599 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82bf3f1e-b5f4-4808-87ca-e89b410c9fbc tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.407769 Oct 29 21:05:32.642615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2198/4508] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:32 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:32.666722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4eaa8a7d-2c55-4610-a494-4539d4589566 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '.version_select at 0x7fa1721b71f0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:32.745142 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4eaa8a7d-2c55-4610-a494-4539d4589566 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1844546751" status: 204 len: 0 microversion: 2.54 time: 0.099520 Oct 29 21:05:32.745864 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2199/4509] 10.222.0.36 () {60 vars in 1319 bytes} [Sat Oct 29 21:05:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1844546751 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:05:32.760153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9946aee-90a7-43a4-abbd-17805c2b25c7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9946aee-90a7-43a4-abbd-17805c2b25c7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 160 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3b68060f-ecb8-4b22-879b-438ab171c21d"}]}} Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'body': {'server': {'name': '', 'imageRef': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'flavorRef': '452', 'networks': [{'uuid': '3b68060f-ecb8-4b22-879b-438ab171c21d'}]}}} Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi '' Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:05:32.776613 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 21:05:32.780679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:32.783111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9946aee-90a7-43a4-abbd-17805c2b25c7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:32.784244 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9946aee-90a7-43a4-abbd-17805c2b25c7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.035997 Oct 29 21:05:32.785039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2200/4510] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:32 2022] POST /compute/v2.1/servers => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:32.791715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:32.795958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:32.811474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.813552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.814312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.815902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:32.817927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:32.819500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:32.876572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:05:32.956374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91506595-625f-42fd-8092-f98a685fe769 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "POST /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.596075 Oct 29 21:05:32.970135 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2311/4511] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:05:32 2022] POST /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:32.991277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:32.997067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:33.003498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:33.012946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.017220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.022557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.023630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.024326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.024969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.110604 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10549139-716e-47e6-ace9-b1c05639fb96 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 204 len: 0 microversion: 2.54 time: 0.322469 Oct 29 21:05:33.111899 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2201/4512] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:05:32 2022] DELETE /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:05:33.138228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:33.139091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:33.153807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.154773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.156660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.157974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.161824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.163096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.551240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:33.560228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d911d507-146a-4e3b-93ed-07113e3f136d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.586645 Oct 29 21:05:33.566028 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2312/4513] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:32 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:33.578047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:33.579929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:33.599161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.600595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.601241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.603723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.606726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.613833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.748379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:33.763354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:33.764885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:33.782465 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b0ac067-dac0-466c-b879-5760a297e368 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1406 microversion: 2.54 time: 0.214651 Oct 29 21:05:33.783106 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2313/4514] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:33 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:33.788461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:33.789087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:33.803584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.804075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.804524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.805245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.814289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.815044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.923218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:33.939131 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5855cd5c-265a-43c3-b06f-8ecc8d501075 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.824155 Oct 29 21:05:33.940219 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2202/4515] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:33 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:33.951371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:33.952212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:33.968080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.968905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.975727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:33.976690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:33.977331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:33.977947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.274841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:34.290407 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f761eb4d-5d5a-4534-bc5e-63c6f8dffd0a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.506217 Oct 29 21:05:34.305945 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2314/4516] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:33 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:34.317086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1ed4aab-c4bb-4503-a093-7de84afcf0a5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:34.317676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1ed4aab-c4bb-4503-a093-7de84afcf0a5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: a405ea9f-6be8-47f6-ae63-f0929728aeee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:34.328604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e1ed4aab-c4bb-4503-a093-7de84afcf0a5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance a405ea9f-6be8-47f6-ae63-f0929728aeee could not be found. Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1ed4aab-c4bb-4503-a093-7de84afcf0a5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/a405ea9f-6be8-47f6-ae63-f0929728aeee/action HTTP/1.1 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 14 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: {"shelve": {}} Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a405ea9f-6be8-47f6-ae63-f0929728aeee could not be found. Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a405ea9f-6be8-47f6-ae63-f0929728aeee', 'body': {'shelve': {}}} Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a405ea9f-6be8-47f6-ae63-f0929728aeee could not be found. Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a405ea9f-6be8-47f6-ae63-f0929728aeee could not be found. Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:34.339014 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a405ea9f-6be8-47f6-ae63-f0929728aeee could not be found. Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1ed4aab-c4bb-4503-a093-7de84afcf0a5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance a405ea9f-6be8-47f6-ae63-f0929728aeee could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:34.343322 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e1ed4aab-c4bb-4503-a093-7de84afcf0a5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/a405ea9f-6be8-47f6-ae63-f0929728aeee/action" status: 404 len: 111 microversion: 2.1 time: 0.027649 Oct 29 21:05:34.344695 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2315/4517] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:34 2022] POST /compute/v2.1/servers/a405ea9f-6be8-47f6-ae63-f0929728aeee/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:05:34.356544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:34.357182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:34.372799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:34.373317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:34.386560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.390032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:34.391335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:34.395384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.434371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:34.447099 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a0e775cf-6a08-4c31-ad7d-450b270f8f48 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.505366 Oct 29 21:05:34.447802 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2203/4518] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:33 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:34.607819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:34.622543 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3749b395-b89b-4a6c-b7ea-b81b1a1ec6aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.277181 Oct 29 21:05:34.626371 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2316/4519] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:34 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:34.659879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:34.660512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:34.697936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:34.698457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:34.698919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.699969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:34.700107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:34.707536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.809892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:34.810787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:34.827154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:34.828013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:34.828626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.832084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:34.832814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:34.833432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:34.996196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:34.999041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:35.005473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd65b740-d73f-4a6d-9cbb-eb0e3e807793 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.349336 Oct 29 21:05:35.011113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2204/4520] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:34 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:35.019188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:35.021165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:35.023285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:35.027871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3280d686-917e-4d1b-bd49-9bff1745bc99 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1406 microversion: 2.54 time: 0.220643 Oct 29 21:05:35.028792 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2317/4521] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:34 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:05:35.031972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:35.044007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:35.045981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:35.050684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.051212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.052823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.054166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.058847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.059458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.060963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.064458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.065033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.070329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.070931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.071512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.126264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lazy-loading 'flavor' on Instance uuid 97e7bb8a-f42c-415a-9898-3cb84f34e2ee {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:05:35.264095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:35.277296 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd39d460-1055-4efa-8376-7ecba1af7607 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.265021 Oct 29 21:05:35.280197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2205/4522] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:35 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:35.478904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:35.479808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:35.493089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.495487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.496688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.497728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.497877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-704ad56e-663f-45ce-a077-cbb32d9e5370 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 202 len: 0 microversion: 2.1 time: 0.466918 Oct 29 21:05:35.499307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.500056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.501747 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2318/4523] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:35 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:05:35.516396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:35.517780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:35.534339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.535266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.535900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.536925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:35.539102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:35.539738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:35.907342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:35.919447 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e050d4b5-0fe5-4ea6-80fc-e0d39ebc9da2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.446732 Oct 29 21:05:35.920466 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2206/4524] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:35 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:35.934776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:35.945113 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f90ad23-baef-42c0-afff-122330c9553a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.441766 Oct 29 21:05:35.946319 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2319/4525] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:35 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:36.056770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:36.057397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:36.065378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.068796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.069274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:36.071739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.072237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.072684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:36.202226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.203233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.204603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:36.205349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lazy-loading 'fault' on Instance uuid d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:05:36.303554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:36.304528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:36.311161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:36.318991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.320587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.321585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:36.322983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.323799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:36.325508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.326026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbe0439f98aa4e80b8389a1fb412eaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '250bb0d83cb849dea30ca3688f7ceefe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:36.327545 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78cb54f9-77ce-45e0-b00f-52c812ff44c5 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 200 len: 1411 microversion: 2.54 time: 0.274731 Oct 29 21:05:36.328235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:36.342425 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2207/4526] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:36 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 1411 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:05:36.692234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:36.704456 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1424d055-6b43-4230-8c0d-b33a04b4ec51 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.405110 Oct 29 21:05:36.705761 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2320/4527] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:36 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:36.947160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:36.948018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:36.961939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.962697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.966911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:36.968369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:36.970345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:36.970998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.220370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:37.229138 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fdf04110-06ec-47b2-aaeb-83ded7ed80e0 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.287304 Oct 29 21:05:37.230741 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2321/4528] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:36 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:37.235780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:37.236603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:37.243890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.246258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.246876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.247778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.248399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.248988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.346771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3928e1bb-b727-45c3-aa60-e03449dd650b"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:37.349355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:37.359785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.360550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.361193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.362299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.363007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.363662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.464787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:37.469679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:37.474331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4318092f-5fcd-407d-a962-06071dd82125 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.242342 Oct 29 21:05:37.478274 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2322/4529] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:37 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:37.485832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:37.486986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] [instance: d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:37.494364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.495073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.495660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.496978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.497642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.498233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.504032 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] HTTP exception thrown: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Request method failure captured: Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments/4a921766-a21e-4791-bb5f-563fd4150c2a HTTP/1.1 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 74 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUzW2houJnGhKy7wl_UqJeXbmHJUue2QvKe8WWGgrKC9rUoIPlPEtymDqBz0KOzuCEAaILWNfxI4rn2dtsQfdQm6Y1TtbXnvxnix4KftG3JFvs0vljcpspHXE9poru6tL_CaxgjRGybTjLTjcvJFsegkiTQcOITIqVAm3V5l8mEfNU Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 0a7767202be74199acfdb66e3ef98ff0 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesAdminNegativeTest-1362361443 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesAdminNegativeTest-1362361443 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 0a7767202be74199acfdb66e3ef98ff0 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1362361443 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesAdminNegativeTest-1362361443-project-admin Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 3faa0a776b2b465f9f98dd81ad268010 Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesAdminNegativeTest-1362361443-project-admin Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: {"volumeAttachment": {"volumeId": "3928e1bb-b727-45c3-aa60-e03449dd650b"}} Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: exception: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'server_id': 'b266901d-80f5-4033-91e9-4198d82cc551', 'id': '4a921766-a21e-4791-bb5f-563fd4150c2a', 'body': {'volumeAttachment': {'volumeId': '3928e1bb-b727-45c3-aa60-e03449dd650b'}}} Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. (HTTP 404) (Request-ID: req-ea952f55-46c1-4f59-a6b7-a4a3069f1ef5) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:05:37.510050 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Returning 400 to user: Volume 3928e1bb-b727-45c3-aa60-e03449dd650b could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3062818d-2eda-4475-a32e-16ac43c72a0e tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments/4a921766-a21e-4791-bb5f-563fd4150c2a" status: 400 len: 107 microversion: 2.1 time: 0.726823 Oct 29 21:05:37.514018 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2208/4530] 10.222.0.36 () {60 vars in 1433 bytes} [Sat Oct 29 21:05:36 2022] PUT /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments/4a921766-a21e-4791-bb5f-563fd4150c2a => generated 107 bytes in 728 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:37.529118 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] HTTP exception thrown: Instance d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 could not be found. Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Request method failure captured: Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 HTTP/1.1 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVtXg880vDkXpW3Q42cC0RLQGS4g2vTFqPqGXG6lJZyviXYbIPF-KuR7Z3ZSGGJVITvpe-T1ADcwgF65jn6gvC5fZPPuBLYxoP33LS0VNC0aEJMLb_M8HlLx-xAU-wTpvD66oziEjY7c75ZHCa0BJAPExuKpS1jTgZ8CSyzJKd0y5A Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.54 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 250bb0d83cb849dea30ca3688f7ceefe Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerShowV254Test-1567371699 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/250bb0d83cb849dea30ca3688f7ceefe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_250bb0d83cb849dea30ca3688f7ceefe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/250bb0d83cb849dea30ca3688f7ceefe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/250bb0d83cb849dea30ca3688f7ceefe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerShowV254Test-1567371699 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 250bb0d83cb849dea30ca3688f7ceefe Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerShowV254Test-1567371699 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerShowV254Test-1567371699-project Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: fbe0439f98aa4e80b8389a1fb412eaa3 Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerShowV254Test-1567371699-project Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 could not be found. Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2'} Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 could not be found. Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 could not be found. Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:05:37.531322 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 could not be found. Oct 29 21:05:37.535865 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:05:37.536985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] Returning 404 to user: Instance d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:05:37.538920 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43f8c13f-311b-4d73-9aca-0f0466862a85 tempest-ServerShowV254Test-1567371699 tempest-ServerShowV254Test-1567371699-project] 10.222.0.36 "GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2" status: 404 len: 111 microversion: 2.54 time: 0.058581 Oct 29 21:05:37.543576 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2323/4531] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:05:37 2022] GET /compute/v2.1/servers/d75dc7a1-df3d-44ee-8e26-6aa24d8d1cb2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:05:37.612993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:37.613768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:37.621223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.621990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.622585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.624111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.624595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.625036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.728908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:37.729554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:37.739205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.743775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.745494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.748723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.751922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.753727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.780975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lazy-loading 'services' on Instance uuid b266901d-80f5-4033-91e9-4198d82cc551 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:05:37.911668 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36b203e3-bd9a-44e7-9797-bd42dc388253 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments/4a921766-a21e-4791-bb5f-563fd4150c2a" status: 202 len: 0 microversion: 2.1 time: 0.302520 Oct 29 21:05:37.912625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2209/4532] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:05:37 2022] DELETE /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments/4a921766-a21e-4791-bb5f-563fd4150c2a => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:05:37.941679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:37.948360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:37.963083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.964160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.965070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:37.966438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:37.967159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:37.967678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:38.051596 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bb7aa23f-dcd2-459d-969c-8b3e65feb0b3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134397 Oct 29 21:05:38.053540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2210/4533] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:05:37 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:05:38.121483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:38.129957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab3cecd1-d73d-460e-ab61-7c0f0eb99b04 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.405619 Oct 29 21:05:38.135860 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2324/4534] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:37 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:38.258069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:38.258689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:38.277651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:38.278162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:38.278778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:38.279672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:38.280315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:38.280915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:38.501529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:38.502173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:38.514411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:38.514822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:38.515269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:38.520944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:38.522188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:38.525860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:38.879809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:38.894607 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b7ce0357-ecad-4553-96fc-c60c24f75815 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.395924 Oct 29 21:05:38.904239 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2325/4535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:38 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:38.941712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:38.951784 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1dae8aaf-d029-4a0e-8209-b9d010bd9d7b tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.698106 Oct 29 21:05:38.968026 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2211/4536] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:38 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:39.064230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:39.067706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:39.078268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:39.079385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:39.080061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:39.080959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:39.081643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:39.082438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:39.140810 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bab8e481-bbc3-4b3e-9fb2-4665973cfea3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080558 Oct 29 21:05:39.142595 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2326/4537] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:05:39 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:39.158960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:39.159613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:39.179770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:39.180747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:39.181441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:39.184451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:39.185162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:39.185849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:39.592237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:39.604551 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f1cbd3d-2a53-4ff3-867b-6721bd20980f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.450299 Oct 29 21:05:39.618463 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2212/4538] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:39 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:39.931551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:39.932992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:39.946296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:39.953071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:39.956035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:39.960468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:39.961132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:39.962142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:39.994063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:39.994696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:40.011560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:40.012077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:40.014653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:40.017772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:40.018243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:40.023316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:40.460118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:40.469019 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b8b3258-303e-423f-a9ae-7d8f59cba90d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.542690 Oct 29 21:05:40.472235 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2327/4539] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:39 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:40.500415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:40.513264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:40.522254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5a94eab1-c6e0-4c20-8050-dc14cf35bc10 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.530536 Oct 29 21:05:40.523594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:40.525076 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2213/4540] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:39 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:40.542467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:40.543754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:40.545251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:40.549627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:40.550695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:40.551412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:40.630687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:40.632441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:40.646451 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3454fdd1-ef9e-424f-9599-0e28e4c69f38 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171507 Oct 29 21:05:40.650685 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2328/4541] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:05:40 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:05:40.656492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:40.656492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:40.656492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:40.656492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:40.656492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:40.656959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:40.704416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:40.951936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:40.962621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2025151367", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1f0bf1b8-b500-4b43-b33b-d9e1c3ff1ffe"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:40.964825 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-846d4f2a-96c0-4de1-b70e-c3b96d3c756a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.334929 Oct 29 21:05:40.967110 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2214/4542] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:40 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:41.063705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] validate_networks() for [('1f0bf1b8-b500-4b43-b33b-d9e1c3ff1ffe', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:05:41.582069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54676f75-8201-43fe-85a1-538b51ee784b tempest-ComputeTenantNetworksTest-1200905751 tempest-ComputeTenantNetworksTest-1200905751-project] Calling method '.version_select at 0x7fa1717ba0d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:42.044914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:05:42.046182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:05:42.046877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:05:42.047515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:05:42.048157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:05:42.077673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.078201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.078670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.082058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.082543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.084754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.115685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Getting quotas for project c4e54075f50e468dbd398cc3df0d30a6. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:05:42.125669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Getting quotas for user 317c7fc1b0be4187bb3b719ac5c8fde3 and project c4e54075f50e468dbd398cc3df0d30a6. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:05:42.138607 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54676f75-8201-43fe-85a1-538b51ee784b tempest-ComputeTenantNetworksTest-1200905751 tempest-ComputeTenantNetworksTest-1200905751-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.713851 Oct 29 21:05:42.139206 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2215/4543] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 21:05:41 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:05:42.146162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:05:42.149137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:42.150247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:42.151677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:05:42.164610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.165128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.165612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.166341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.166805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.167249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.242780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-04a8d7c4-f340-45b5-b373-9f28676aa4e3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285780 Oct 29 21:05:42.244148 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2329/4544] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:05:42.249999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:42.250921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:42.258367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.259165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.259808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.260723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.261378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.262859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.633217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:42.647833 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8772168e-0a74-47a1-bd18-afda2131b38f tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1485 microversion: 2.1 time: 0.402112 Oct 29 21:05:42.649922 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2330/4545] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:42 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1485 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:42.659970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:42.663022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:42.681654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:42.693300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.694985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-19d68e43-7eb7-4e63-9067-4a6c8b9dc2e2 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.554505 Oct 29 21:05:42.695941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.696754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2216/4546] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:42 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:42.697720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.699009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:42.702587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:42.703302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:42.711659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa505846-ea40-471e-a1c3-65927f65bf13 tempest-ComputeTenantNetworksTest-1200905751 tempest-ComputeTenantNetworksTest-1200905751-project] Calling method '.version_select at 0x7fa171a374c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:43.046115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa505846-ea40-471e-a1c3-65927f65bf13 tempest-ComputeTenantNetworksTest-1200905751 tempest-ComputeTenantNetworksTest-1200905751-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks/eec0f113-4809-4166-8caa-b2225df4f4f1" status: 200 len: 140 microversion: 2.1 time: 0.345989 Oct 29 21:05:43.046969 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2217/4547] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 21:05:42 2022] GET /compute/v2.1/os-tenant-networks/eec0f113-4809-4166-8caa-b2225df4f4f1 => generated 140 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:43.054954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9cd328b9-fb35-4f8e-9487-969c07864ab2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:43.056010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9cd328b9-fb35-4f8e-9487-969c07864ab2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:43.203559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:43.218503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9cd328b9-fb35-4f8e-9487-969c07864ab2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:43.247253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3e8a62e8-dcf3-49a8-9b48-2674eb2eb4b3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1508 microversion: 2.1 time: 0.595379 Oct 29 21:05:43.250664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9cd328b9-fb35-4f8e-9487-969c07864ab2 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1218 microversion: 2.1 time: 0.202219 Oct 29 21:05:43.257357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2218/4548] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:43 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:43.272007 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2331/4549] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:42 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:43.292648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:43.294148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:43.309283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:43.310879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:43.311769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:43.312658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:43.313287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:43.313921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:43.449228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1179058f-ac86-4b7c-b379-e5af93e5f272 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "POST /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57/action" status: 202 len: 0 microversion: 2.1 time: 0.175137 Oct 29 21:05:43.451768 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2219/4550] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:43 2022] POST /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:05:43.460090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:43.461024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:43.474168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:43.475469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:43.478899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:43.479889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:43.480528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:43.481250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:43.728052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:43.729588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:43.745027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:43.745606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:43.746073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:43.747596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:43.748110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:43.748564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:44.258266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:44.267449 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a032794-d5fe-406c-8ea6-8ff5a0f45c19 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1493 microversion: 2.1 time: 0.811196 Oct 29 21:05:44.275853 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2332/4551] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:43 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1493 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:44.293868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:44.294735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:44.304458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:44.305244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:44.305872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:44.306940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:44.307916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:44.308526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:44.485900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:44.514984 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4ef3971-5b1c-480a-9795-62a01acc156c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.794603 Oct 29 21:05:44.516011 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2220/4552] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:43 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:44.537669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:44.539519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:44.546286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:44.552072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:44.554128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:44.559306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:44.560442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:44.561488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:44.562184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:44.563563 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa68c649-cf31-4d2b-914c-3a0139fb9b69 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1288 microversion: 2.1 time: 0.285804 Oct 29 21:05:44.564172 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2333/4553] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:44 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1288 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:44.980055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:44.996185 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0741a1fc-1444-4473-8aac-0fae1d855cc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1529 microversion: 2.1 time: 0.477255 Oct 29 21:05:44.997918 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2221/4554] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:44 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1529 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:45.302938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:45.304289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:45.313159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:45.314247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:45.315500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:45.317829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:45.318824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:45.320267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:45.539789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:45.540680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:45.555490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:45.557099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:45.557707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:45.559692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:45.561375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:45.562770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:45.679326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:45.692306 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73a81580-3926-4692-a62d-c1b91f7b5f01 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1493 microversion: 2.1 time: 0.397248 Oct 29 21:05:45.710290 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2334/4555] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:45 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:45.716779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:45.719607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:45.746770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:45.747399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:45.747869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:45.752373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:45.752902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:45.754353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.139969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:46.153292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9ad5ee11-dc3b-4ecd-a090-5ab8ff3567a0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.618209 Oct 29 21:05:46.154672 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2222/4556] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:45 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:46.160184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:46.161062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:46.164680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:46.167847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.168551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.169302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.170288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.170931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.172190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.174060 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e62e8a9-08df-4a86-a7fe-6998d3cd25b8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.462032 Oct 29 21:05:46.176983 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2335/4557] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:45 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:46.190592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:46.194702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:46.220844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.222013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.223481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.226438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.227073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.229676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.842657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:46.851062 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e8de553-133a-478c-801c-a721dbb027dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.695197 Oct 29 21:05:46.865917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:46.865917 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1240249a-6790-47d7-8c11-1dab57781e5a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1529 microversion: 2.1 time: 0.676235 Oct 29 21:05:46.867069 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2223/4558] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:46 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:46.874890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:46.875981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:46.878728 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2336/4559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:46 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1529 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:46.882687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.883360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.883990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.884868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.885536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.885747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-265955156"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:46.886289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.888323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:46.896144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.896681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.897120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:46.897868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:46.898325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:46.898751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:47.034421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:47.046320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e6b0666f-6b5b-40db-9e55-a903145fc972 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1493 microversion: 2.1 time: 0.177751 Oct 29 21:05:47.047383 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2224/4560] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:46 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:47.170790 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9927a471-5582-4360-923a-7d4b4a330eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.290462 Oct 29 21:05:47.171392 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2337/4561] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:05:46 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 21:05:47.180769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:47.181400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:47.195175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:47.200027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:47.201068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:47.201993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:47.203341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:47.203856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:47.204534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:47.210512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:47.225281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:47.227633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:47.228075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:47.236216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:47.236911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:47.237591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:47.826718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:47.840132 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61d9f19f-38a0-4425-9a93-d3334aaaeb18 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.663869 Oct 29 21:05:47.840734 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2225/4562] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:47 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:47.861119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:47.862022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:47.868404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:47.869135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:47.869764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:47.870634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:47.871251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:47.871858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:48.063297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:48.089827 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-196ed308-ab33-4bbe-a5a6-d5555173b62e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.896884 Oct 29 21:05:48.105039 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2338/4563] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:47 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:48.128181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-19192514-3143-448c-848e-f6164132f050 req-315bf427-41cb-446f-b5b4-894f3c927dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:48.153653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-19192514-3143-448c-848e-f6164132f050 req-315bf427-41cb-446f-b5b4-894f3c927dd8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:48.154395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-19192514-3143-448c-848e-f6164132f050 req-315bf427-41cb-446f-b5b4-894f3c927dd8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:48.155172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-19192514-3143-448c-848e-f6164132f050 req-315bf427-41cb-446f-b5b4-894f3c927dd8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:48.187888 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-19192514-3143-448c-848e-f6164132f050 req-315bf427-41cb-446f-b5b4-894f3c927dd8 service nova] Creating event network-vif-unplugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:05:48.220141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-19192514-3143-448c-848e-f6164132f050 req-315bf427-41cb-446f-b5b4-894f3c927dd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108751 Oct 29 21:05:48.221137 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2339/4564] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:48.237606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:48.241358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:48.256481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:48.258303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:48.261045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:48.262123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:48.263582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:48.264440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:48.320444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:48.671272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:48.682938 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-73aafa3c-34b4-45c8-8c00-45b28adb5a9d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.825578 Oct 29 21:05:48.701493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2226/4565] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:47 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:48.721870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:48.722566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:48.760832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:48.763909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:48.764571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:48.771041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:48.772971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:48.774319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.072388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:49.082799 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2498f87f-83ac-440a-9c1f-cf88dde0c746 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 0.855830 Oct 29 21:05:49.087821 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2340/4566] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:48 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:49.097795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:49.100462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:49.118805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.119902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.121380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.123370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.125958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.129822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.551036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:49.567091 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c78dd88b-16f1-4f06-8e8c-92748790b337 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1499 microversion: 2.1 time: 0.864183 Oct 29 21:05:49.567732 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2227/4567] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:48 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1499 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:49.585941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:49.597855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:49.613191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.614661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.616241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.619569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.622059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.624636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.675114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:49.688872 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ecc8d5ce-f86a-4488-b77f-eaaeb29bf76b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1687 microversion: 2.1 time: 0.599324 Oct 29 21:05:49.689568 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2341/4568] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1687 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:49.703975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3fef8c29-3372-4637-82c5-0671280a7026 req-1a46d268-59d6-4fea-b104-80b4636908f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0e32cb-37fe-482c-bde3-ddefc35be559", "tag": "b6e7dd7a-7228-4819-a46d-d2c6ca2df7f6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:49.734209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3fef8c29-3372-4637-82c5-0671280a7026 req-1a46d268-59d6-4fea-b104-80b4636908f9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.736102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3fef8c29-3372-4637-82c5-0671280a7026 req-1a46d268-59d6-4fea-b104-80b4636908f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.736795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3fef8c29-3372-4637-82c5-0671280a7026 req-1a46d268-59d6-4fea-b104-80b4636908f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.780506 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3fef8c29-3372-4637-82c5-0671280a7026 req-1a46d268-59d6-4fea-b104-80b4636908f9 service nova] Creating event network-changed:b6e7dd7a-7228-4819-a46d-d2c6ca2df7f6 for instance fc0e32cb-37fe-482c-bde3-ddefc35be559 on nch1-master-1 Oct 29 21:05:49.793208 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3fef8c29-3372-4637-82c5-0671280a7026 req-1a46d268-59d6-4fea-b104-80b4636908f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099323 Oct 29 21:05:49.795781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2342/4569] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:49.810837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:49.811452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:49.824801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.825310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.825781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.826495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.826955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.827382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.891693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:05:49.932353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:49.945222 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ea125e3-c3fa-489a-b344-81017617a4aa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.372706 Oct 29 21:05:49.961608 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2228/4570] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:49 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:49.983822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:49.984860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:49.993350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.995145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:49.995802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:49.997290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:49.998274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.000227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.092232 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-801aafe8-9df9-4e19-80ec-67ec5a43d9c1 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "DELETE /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 204 len: 0 microversion: 2.1 time: 0.292620 Oct 29 21:05:50.093329 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2343/4571] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:05:49 2022] DELETE /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:05:50.109070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:50.114013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:50.135298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.135806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.136257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.143004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.143695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.144172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.520828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:50.531116 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a0232d26-5ff0-488b-8978-fe043c13d484 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.433294 Oct 29 21:05:50.535936 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2344/4572] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:50 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:50.542019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:50.542943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:50.560308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.564766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.566790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.570295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.571083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.571792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.598442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:50.611900 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-432ffbbb-3a26-4429-90aa-1d02468074d0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.633371 Oct 29 21:05:50.613253 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2229/4573] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:49 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:50.628544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f352d41c-f9f8-48fe-841d-94742b8a92dc req-6fe7ed04-7ab7-4b4a-ba51-9645d1b74bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283c0d72-0b7e-4802-ab7c-0d9ac1881f51", "name": "network-vif-plugged", "status": "completed", "tag": "2b7b2f74-72d4-4713-99f8-9765ff5b4bec"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:50.655764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f352d41c-f9f8-48fe-841d-94742b8a92dc req-6fe7ed04-7ab7-4b4a-ba51-9645d1b74bbf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.658171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f352d41c-f9f8-48fe-841d-94742b8a92dc req-6fe7ed04-7ab7-4b4a-ba51-9645d1b74bbf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.659284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f352d41c-f9f8-48fe-841d-94742b8a92dc req-6fe7ed04-7ab7-4b4a-ba51-9645d1b74bbf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.692473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f352d41c-f9f8-48fe-841d-94742b8a92dc req-6fe7ed04-7ab7-4b4a-ba51-9645d1b74bbf service nova] Creating event network-vif-plugged:2b7b2f74-72d4-4713-99f8-9765ff5b4bec for instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 on nch2-master-1 Oct 29 21:05:50.710902 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f352d41c-f9f8-48fe-841d-94742b8a92dc req-6fe7ed04-7ab7-4b4a-ba51-9645d1b74bbf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095400 Oct 29 21:05:50.710902 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2230/4574] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:50.724033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:50.725483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:50.736730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.738097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.739410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.750135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:50.750753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:50.751791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:50.803783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:50.812219 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-414bd562-e153-4f3b-a944-0305d93f14ec tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 0.273829 Oct 29 21:05:50.813651 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2345/4575] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:50 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:50.983430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:50.984317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:50.991086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:51.001525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:51.001664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54822dd7-5da6-434c-a402-1dd1f39b81e4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1687 microversion: 2.1 time: 0.283797 Oct 29 21:05:51.002312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:51.002898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:51.004347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:51.004980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:51.007008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:51.017107 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2231/4576] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:50 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1687 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:51.477953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:51.497587 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed68418c-5dde-44ce-820f-fe9dde702362 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.519636 Oct 29 21:05:51.509919 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2346/4577] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:50 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:51.563323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:51.564641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:51.572911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:51.573790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:51.574776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:51.575752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:51.576436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:51.577104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:51.640980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:51.647338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:51.662989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:51.664866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:51.666387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:51.667132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:51.671790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:51.676390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:51.999255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:52.014126 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-07b0f381-e91b-4027-b407-8e984403de3d tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.449792 Oct 29 21:05:52.015049 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2232/4578] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:51 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:52.027731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:52.028655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:52.038694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:52.041942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:52.042651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:52.043555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:52.049417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:52.050194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:52.101852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:52.138025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:52.463690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:52.477247 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a01813d0-c132-4391-aa3d-6e835926b558 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.839858 Oct 29 21:05:52.481295 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2347/4579] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:51 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:52.506405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:52.507376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:52.533136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:52.533864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:52.535412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:52.540314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:52.540714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:52.541756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:52.542444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:52.551341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:52.613186 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-670f5090-18c5-412e-8e94-e429d265892b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 0.593292 Oct 29 21:05:52.617109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2233/4580] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:52 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:52.655758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:52.658234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:52.712834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:52.722776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:52.727468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:52.729880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:52.739615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:52.744517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:53.241811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:53.374234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:53.383647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e82386d-be20-4abb-b3ba-f44af5f286e7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1533 microversion: 2.1 time: 0.757086 Oct 29 21:05:53.385370 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2234/4581] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:52 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1533 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:53.393601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:53.394597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:53.405813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:53.406687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:53.407557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:53.408574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:53.409271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:53.410010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.067317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:54.080796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37ab6d3c-2c17-42b6-8040-67379fc802a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 1.597558 Oct 29 21:05:54.085190 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2348/4582] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:52 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:54.096007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:54.097020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:54.119911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:54.120945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:54.122140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.128758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:54.134201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:54.135186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.171330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:54.192277 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78f3001f-ed01-4f84-9d9b-34c1eede3e33 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 0.804870 Oct 29 21:05:54.203679 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2235/4583] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:53 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:54.230596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:54.231383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:54.279438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:54.280247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:54.280383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.281126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:54.281622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:54.282061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.741681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:54.762619 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-67cbb003-dbde-473b-8b9e-bda971db6d35 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 0.565803 Oct 29 21:05:54.765771 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2236/4584] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:54 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:54.784201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:54.785226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:54.807968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:54.808781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:54.809473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.816874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:54.817743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:54.820709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:54.915670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:54.938420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e40d928-da13-4d7e-b110-009882c700aa tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.851647 Oct 29 21:05:54.940333 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2349/4585] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:54 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:55.113030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:55.113977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:55.139796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:55.140684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:55.142884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:55.143807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:55.149011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:55.151566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:56.036233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:56.048924 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79a117e2-e7d0-4ee8-90e8-3886ebdae949 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.276971 Oct 29 21:05:56.050409 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2237/4586] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:54 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:56.058231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:56.066306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:56.089300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:56.094251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:56.094803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:56.096065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:56.097482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:56.099217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:56.949668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:56.961826 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67d64cb2-9de7-4e03-8f02-a2e818869ce8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 1.854146 Oct 29 21:05:56.963923 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2350/4587] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:55 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:05:56.976240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:56.977146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:56.989161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:56.992954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:56.996241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:56.998994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:57.006550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:57.007278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:57.081757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:57.100239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62178b87-9a56-4897-a47b-302599019dba tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1505 microversion: 2.1 time: 1.046279 Oct 29 21:05:57.109388 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2238/4588] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:56 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1505 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:57.122465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:57.126794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:57.154559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:57.155350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:57.159573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:57.160364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:57.160836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:57.161638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:58.257813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:58.273569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2030a265-e30d-484f-b300-ba2e995434e0 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 1.155623 Oct 29 21:05:58.293905 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2239/4589] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:57 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:58.312486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-deabc4b3-7036-4827-8616-6348054d3dac req-891340fa-4a88-4723-80b5-a17e33e9cdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-plugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:05:58.349381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-deabc4b3-7036-4827-8616-6348054d3dac req-891340fa-4a88-4723-80b5-a17e33e9cdcd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:58.352409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-deabc4b3-7036-4827-8616-6348054d3dac req-891340fa-4a88-4723-80b5-a17e33e9cdcd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:58.353062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-deabc4b3-7036-4827-8616-6348054d3dac req-891340fa-4a88-4723-80b5-a17e33e9cdcd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:58.403232 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-deabc4b3-7036-4827-8616-6348054d3dac req-891340fa-4a88-4723-80b5-a17e33e9cdcd service nova] Creating event network-vif-plugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:05:58.422671 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-deabc4b3-7036-4827-8616-6348054d3dac req-891340fa-4a88-4723-80b5-a17e33e9cdcd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127068 Oct 29 21:05:58.430062 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2240/4590] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:05:58.441862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:58.445520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:58.460937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:58.461878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:58.463222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:58.465398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:58.467864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:58.468699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:59.234696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:59.250682 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d97fced2-d498-4402-9341-f09281eb20a0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 2.271971 Oct 29 21:05:59.252736 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2351/4591] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:56 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:59.278744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:59.281090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:59.288637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:05:59.291556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:59.292240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:59.293004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:59.294073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:05:59.294682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:05:59.296159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:05:59.922322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:05:59.945500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7cfaa5b-357d-4568-bf7b-45b1b36f48de tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.509108 Oct 29 21:05:59.954301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2241/4592] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:58 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:05:59.972393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:05:59.980801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:05:59.988774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:00.015401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.020352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.021046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.025828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.030354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.030991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.138158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:00.161973 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aaa5ba88-82ed-4e9a-8af6-1c9b5c6ce27c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 0.884410 Oct 29 21:06:00.162971 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2352/4593] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:59 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:00.169686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5cb721b4-2238-4f50-9211-3d7766c7e58b req-0c8fca88-7435-4c6a-af2e-86761d69662a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348488d4-f73a-44b3-b659-9f148405af57", "name": "network-vif-deleted", "tag": "6b3419c1-12e6-450a-aa47-7b05a4090e45"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:00.226102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.230515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.234374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.236358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lazy-loading 'fault' on Instance uuid 348488d4-f73a-44b3-b659-9f148405af57 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:06:00.238770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5cb721b4-2238-4f50-9211-3d7766c7e58b req-0c8fca88-7435-4c6a-af2e-86761d69662a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.257047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5cb721b4-2238-4f50-9211-3d7766c7e58b req-0c8fca88-7435-4c6a-af2e-86761d69662a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.257657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5cb721b4-2238-4f50-9211-3d7766c7e58b req-0c8fca88-7435-4c6a-af2e-86761d69662a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.293731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5cb721b4-2238-4f50-9211-3d7766c7e58b req-0c8fca88-7435-4c6a-af2e-86761d69662a service nova] Creating event network-vif-deleted:6b3419c1-12e6-450a-aa47-7b05a4090e45 for instance 348488d4-f73a-44b3-b659-9f148405af57 on nch1-master-1 Oct 29 21:06:00.324840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5cb721b4-2238-4f50-9211-3d7766c7e58b req-0c8fca88-7435-4c6a-af2e-86761d69662a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160183 Oct 29 21:06:00.325591 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2353/4594] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:00.351620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:00.352859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:00.377255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.384755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.385267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.389303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.390314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.396958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.481809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:00.507858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d73c13b-ee13-41ec-9594-a3974f466155 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 200 len: 1303 microversion: 2.1 time: 0.550151 Oct 29 21:06:00.513691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2242/4595] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:05:59 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 1303 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:00.542900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:00.546867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:00.576017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.577690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.579207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.580616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.589686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.591518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.882990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:00.891490 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f982d2e5-1940-48ac-b6eb-51bc5d190430 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.560856 Oct 29 21:06:00.902821 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2354/4596] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:00 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:00.915985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a25f7a0b-8f85-4721-9bc1-bef439044628 req-3be0c6fd-525d-4853-a0a3-c5ce21097cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "name": "network-vif-plugged", "status": "completed", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:00.934971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a25f7a0b-8f85-4721-9bc1-bef439044628 req-3be0c6fd-525d-4853-a0a3-c5ce21097cef service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:00.936212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a25f7a0b-8f85-4721-9bc1-bef439044628 req-3be0c6fd-525d-4853-a0a3-c5ce21097cef service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:00.936828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a25f7a0b-8f85-4721-9bc1-bef439044628 req-3be0c6fd-525d-4853-a0a3-c5ce21097cef service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:00.949428 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a25f7a0b-8f85-4721-9bc1-bef439044628 req-3be0c6fd-525d-4853-a0a3-c5ce21097cef service nova] Creating event network-vif-plugged:51d03947-ece9-475c-b20e-71c5f2dcc21b for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee on nch2-master-1 Oct 29 21:06:00.959777 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a25f7a0b-8f85-4721-9bc1-bef439044628 req-3be0c6fd-525d-4853-a0a3-c5ce21097cef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054352 Oct 29 21:06:00.964200 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2355/4597] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:01.006316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:01.009647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:01.033815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:01.037732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:01.043133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:01.048404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:01.062196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:01.063494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:01.140581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:01.156473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8798a37-4e28-460d-b2ae-516f031bd869 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 0.638316 Oct 29 21:06:01.157745 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2243/4598] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:00 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:01.190813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:01.191770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:01.206941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:01.214882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:01.216790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:01.218700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:01.224277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:01.227575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:01.993765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:02.021371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:02.030107 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e981a88b-05bc-4949-9a31-52a64ed7f17c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 0.826093 Oct 29 21:06:02.034156 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e0aeebb-f2ed-4b7b-9a68-1fc6f01427ee tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.033166 Oct 29 21:06:02.034676 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2244/4599] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:01 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:02.055888 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2356/4600] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:00 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:02.080591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:02.081567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 348488d4-f73a-44b3-b659-9f148405af57] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:02.110892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.113360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.114461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.116422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.119453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.120608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.211227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:02.221265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] HTTP exception thrown: Instance 348488d4-f73a-44b3-b659-9f148405af57 could not be found. Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Request method failure captured: Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 HTTP/1.1 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZU2-CWNyyPzODlMUHbUTyYZMKkOXGDVLtQGJfHGIkf90MzRb4VmCmDZWDRCe9VTUikHGIJbZSM9u-cjA3NK42JrA2pmWphSK4g84b31I_Y26FfmXwGB7xnJjk2An0_gSmYRkuJbbGYBZMjbyhob8G-PqeOQyvece4H4kpybUWj7vWg Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a47c15d746e94571b66736d37e9c92b4 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerRescueTestJSON-340200152 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerRescueTestJSON-340200152 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a47c15d746e94571b66736d37e9c92b4 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerRescueTestJSON-340200152 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerRescueTestJSON-340200152-project Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: bf5d75d7cdde44639d2f5ca9475c85b5 Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerRescueTestJSON-340200152-project Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 348488d4-f73a-44b3-b659-9f148405af57 could not be found. Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '348488d4-f73a-44b3-b659-9f148405af57'} Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348488d4-f73a-44b3-b659-9f148405af57 could not be found. Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348488d4-f73a-44b3-b659-9f148405af57 could not be found. Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:02.225327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348488d4-f73a-44b3-b659-9f148405af57 could not be found. Oct 29 21:06:02.229693 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:02.243310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Returning 404 to user: Instance 348488d4-f73a-44b3-b659-9f148405af57 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:02.246718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4422c5f1-620e-4fdb-9a89-f6bb47f9b048 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57" status: 404 len: 111 microversion: 2.1 time: 0.189415 Oct 29 21:06:02.253415 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2357/4601] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:02 2022] GET /compute/v2.1/servers/348488d4-f73a-44b3-b659-9f148405af57 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:06:02.275066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:02.281583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:02.312719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.313257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.313758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.315791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.316658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.320631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.502526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a9b0053-9e29-41f0-8260-2c85cf413944 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: .version_select at 0x7fa171a07160>, body: {"keypair": {"name": "tempest-keypair-1958703509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiRlYEDWuM/CN0Rv9EnMFUtpJ+cADhA+zjN/SwAiftX+t2dSeWvTOUtA4UAGX8wOyNBBpARfsUKaBEYYGKgM/7vcDwr6FRNGb9vHkwi4HF5WNAr0RMNc61mOD2mWkZj7Q=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:02.619490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9a9b0053-9e29-41f0-8260-2c85cf413944 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for project 208de26bb7304ee793bac715fb73fbdc. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:06:02.637668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9a9b0053-9e29-41f0-8260-2c85cf413944 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for user 04d3c643e9c245eeaa6328d22184bc00 and project 208de26bb7304ee793bac715fb73fbdc. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:06:02.670513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:02.683457 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-300a273b-f146-40e0-850b-02b71a553900 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.428584 Oct 29 21:06:02.684663 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2358/4602] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:02 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:02.693916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a9b0053-9e29-41f0-8260-2c85cf413944 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.645986 Oct 29 21:06:02.695394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2245/4603] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:06:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:02.700548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:02.714553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:02.717297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:02.721124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:02.737876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.741590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.743216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.743476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.745737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.746386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.747289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.748204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:02.748809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.749725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:02.750835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.751983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:02.892893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:06:03.124057 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3d76001-b69c-4c15-a3ef-5864ec40c85e tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 204 len: 0 microversion: 2.1 time: 0.426242 Oct 29 21:06:03.124965 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2246/4604] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:06:02 2022] DELETE /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:06:03.138939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:03.142675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:03.157162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:03.160104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:03.164474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:03.167762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:03.169270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:03.171278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:03.807225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:03.837708 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-100d5d59-19b3-4afd-9371-859bc9b56972 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 1.151626 Oct 29 21:06:03.866827 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2359/4605] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:02 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:03.889377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:03.890082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:03.928886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:03.928886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:03.929266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:03.942266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:03.942781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:03.943799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:04.105300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:04.129179 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf87d69e-5968-44e6-91a5-5c69be554151 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 1.002476 Oct 29 21:06:04.129822 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2247/4606] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:03 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:04.153777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:04.154740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:04.173749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:04.178719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:04.179488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:04.180242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:04.180712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:04.181143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:05.451938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:05.470809 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2063a2dd-a7ca-4e9c-93ff-c76d3b35088d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.602530 Oct 29 21:06:05.493892 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2360/4607] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:03 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:05.506912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:05.507548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:05.537401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:05.540196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:05.540819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:05.541583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:05.542053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:05.542491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:06.045900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:06.060902 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fea3da2e-cc71-4e94-8c09-34ef55be31b3 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1491 microversion: 2.1 time: 1.923708 Oct 29 21:06:06.066338 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2248/4608] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:04 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1491 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:06.078121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:06.079451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:06.092958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:06.097780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:06.098545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:06.101535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:06.102278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:06.103195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:06.949213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:06.969519 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2e0c0c7-da48-4092-908f-5843a4fe5518 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 1.473858 Oct 29 21:06:06.970514 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2361/4609] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:05 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:06.991069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:06.991687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:07.032786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:07.033726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:07.034361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:07.035286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:07.039765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:07.040654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:07.892156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:07.934824 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a7b89b2c-bdc0-47ff-b334-a2c948b64bb0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 1.866899 Oct 29 21:06:07.942683 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2249/4610] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:06 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:07.958572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2147ad95-7568-47c5-862e-e90fbefea81c req-cd3a0801-3acd-4e29-871a-c37a25759fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0e32cb-37fe-482c-bde3-ddefc35be559", "name": "network-vif-plugged", "status": "completed", "tag": "b6e7dd7a-7228-4819-a46d-d2c6ca2df7f6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:08.015739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2147ad95-7568-47c5-862e-e90fbefea81c req-cd3a0801-3acd-4e29-871a-c37a25759fb0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:08.016240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2147ad95-7568-47c5-862e-e90fbefea81c req-cd3a0801-3acd-4e29-871a-c37a25759fb0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:08.016688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2147ad95-7568-47c5-862e-e90fbefea81c req-cd3a0801-3acd-4e29-871a-c37a25759fb0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:08.085068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:08.092664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2147ad95-7568-47c5-862e-e90fbefea81c req-cd3a0801-3acd-4e29-871a-c37a25759fb0 service nova] Creating event network-vif-plugged:b6e7dd7a-7228-4819-a46d-d2c6ca2df7f6 for instance fc0e32cb-37fe-482c-bde3-ddefc35be559 on nch1-master-1 Oct 29 21:06:08.139406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2147ad95-7568-47c5-862e-e90fbefea81c req-cd3a0801-3acd-4e29-871a-c37a25759fb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186870 Oct 29 21:06:08.147056 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2250/4611] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:08.201925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:08.216988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:08.319803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:08.320568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:08.321036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:08.321836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:08.322307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:08.322745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:08.940847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:08.949991 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2aad8d02-e140-4f13-babc-7814148753ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 1.978284 Oct 29 21:06:08.954513 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2362/4612] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:06 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:08.970730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:08.972572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:09.003894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:09.004577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:09.005128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:09.007007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:09.007592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:09.012085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:09.337154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5d75d7cdde44639d2f5ca9475c85b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47c15d746e94571b66736d37e9c92b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:09.351727 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-56e86251-c8d8-47c5-8dc2-c4ecceaac6f2 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 200 len: 1449 microversion: 2.1 time: 0.392226 Oct 29 21:06:09.354281 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2363/4613] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:08 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 1449 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:09.388658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:09.392194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:09.413203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:09.413999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:09.414658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:09.415599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:09.416306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:09.416947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:10.174759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:10.195405 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-998fca89-5d1e-4e2e-882b-2246ba89fadd tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1318 microversion: 2.1 time: 0.831239 Oct 29 21:06:10.211944 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2364/4614] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:09 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1318 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:10.229723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-259760023", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d09707fa-b151-4dfb-b463-3c54e9612bf6"}], "security_groups": [{"name": "tempest-securitygroup--973668518"}], "key_name": "tempest-keypair-1958703509", "user_data": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:10.361236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:10.378112 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8990520-e06b-4e6c-8b94-da8aa5aa8042 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 2.229530 Oct 29 21:06:10.390739 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2251/4615] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:08 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:10.410560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:10.421172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:10.453130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:10.457722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:10.461742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:10.463089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:10.463704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:10.464303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:11.679927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:11.696665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cdcbcfe2-8d9b-48df-959f-b3a8277f9d73 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1524 microversion: 2.1 time: 1.304002 Oct 29 21:06:11.697642 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2252/4616] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:10 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1524 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:11.731900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5f4379dd-0026-421c-8cb3-5ff2a08b4f1e req-56fb818d-7bee-43f6-9279-3160ee9a066b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a12a156-5f53-400d-bd24-6dc2d98cb50e", "name": "network-vif-deleted", "tag": "d0ae7a24-ca93-4e95-8078-518a813e7127"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:11.807234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5f4379dd-0026-421c-8cb3-5ff2a08b4f1e req-56fb818d-7bee-43f6-9279-3160ee9a066b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:11.809263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5f4379dd-0026-421c-8cb3-5ff2a08b4f1e req-56fb818d-7bee-43f6-9279-3160ee9a066b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:11.811813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5f4379dd-0026-421c-8cb3-5ff2a08b4f1e req-56fb818d-7bee-43f6-9279-3160ee9a066b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:11.889373 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5f4379dd-0026-421c-8cb3-5ff2a08b4f1e req-56fb818d-7bee-43f6-9279-3160ee9a066b service nova] Creating event network-vif-deleted:d0ae7a24-ca93-4e95-8078-518a813e7127 for instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e on nch1-master-1 Oct 29 21:06:11.917894 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5f4379dd-0026-421c-8cb3-5ff2a08b4f1e req-56fb818d-7bee-43f6-9279-3160ee9a066b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199626 Oct 29 21:06:11.920813 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2253/4617] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:11.941086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:11.945228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:11.984179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:11.991059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:11.992412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:11.994851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:11.998984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:12.003816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:12.650479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:13.127603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:13.142555 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26470a7b-c1a4-442f-a450-ddfee610fca8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 1.216065 Oct 29 21:06:13.143470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2254/4618] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:11 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:13.148202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:13.148980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] [instance: 7a12a156-5f53-400d-bd24-6dc2d98cb50e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:13.168311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] validate_networks() for [('d09707fa-b151-4dfb-b463-3c54e9612bf6', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:06:13.179596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:13.181746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:13.184226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:13.186323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:13.189859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:13.191300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:13.242391 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] HTTP exception thrown: Instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e could not be found. Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Request method failure captured: Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e HTTP/1.1 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZU2-CWNyyPzODlMUHbUTyYZMKkOXGDVLtQGJfHGIkf90MzRb4VmCmDZWDRCe9VTUikHGIJbZSM9u-cjA3NK42JrA2pmWphSK4g84b31I_Y26FfmXwGB7xnJjk2An0_gSmYRkuJbbGYBZMjbyhob8G-PqeOQyvece4H4kpybUWj7vWg Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a47c15d746e94571b66736d37e9c92b4 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerRescueTestJSON-340200152 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a47c15d746e94571b66736d37e9c92b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerRescueTestJSON-340200152 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a47c15d746e94571b66736d37e9c92b4 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerRescueTestJSON-340200152 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerRescueTestJSON-340200152-project Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: bf5d75d7cdde44639d2f5ca9475c85b5 Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerRescueTestJSON-340200152-project Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e could not be found. Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7a12a156-5f53-400d-bd24-6dc2d98cb50e'} Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e could not be found. Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e could not be found. Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:13.247362 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e could not be found. Oct 29 21:06:13.253033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:13.254234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] Returning 404 to user: Instance 7a12a156-5f53-400d-bd24-6dc2d98cb50e could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:13.260336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d3a2de8-769c-4efb-98e6-c7bd0b771216 tempest-ServerRescueTestJSON-340200152 tempest-ServerRescueTestJSON-340200152-project] 10.222.0.36 "GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e" status: 404 len: 111 microversion: 2.1 time: 0.115647 Oct 29 21:06:13.261576 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2255/4619] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:13 2022] GET /compute/v2.1/servers/7a12a156-5f53-400d-bd24-6dc2d98cb50e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:06:13.270685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:13.272984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:13.288561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:13.291611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:13.294098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:13.295144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:13.296615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:13.297267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:13.945959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:13.962970 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1269d970-24d6-4ef4-914b-315e3906c15b tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1508 microversion: 2.1 time: 0.691834 Oct 29 21:06:13.963816 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2256/4620] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:13 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:13.977761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:13.978620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:13.991979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:13.993962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:13.994761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:13.997794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:13.998439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:13.999058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:14.846823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:14.855856 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc2baf9c-170f-41c8-9c4c-c77491b59fa6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.890807 Oct 29 21:06:14.881573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2257/4621] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:13 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:14.887622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:14.888607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:14.916465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:14.917544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:14.918644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:14.929079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:14.933012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:14.933765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:15.073311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:06:15.074657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:06:15.075546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:06:15.076260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:06:15.077594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:06:15.099550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:15.101227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:15.108340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:15.109576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:15.112595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:15.113324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:15.185384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for project 208de26bb7304ee793bac715fb73fbdc. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:06:15.201151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for user 04d3c643e9c245eeaa6328d22184bc00 and project 208de26bb7304ee793bac715fb73fbdc. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:06:15.238840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:06:15.242347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:06:15.354011 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6868af7a-8329-4a5d-8493-dbf25994068a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.138472 Oct 29 21:06:15.356119 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2365/4622] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:06:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 5143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:06:15.369335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:15.375780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:15.412166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:15.413570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:15.414582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:15.416644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:15.428149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:15.429547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:15.638294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:15.680287 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad748210-3a8a-4480-bb89-979af69d4eef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1506 microversion: 2.1 time: 0.796792 Oct 29 21:06:15.694353 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2258/4623] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:14 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:15.725714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-330422c9-0274-4a23-ad8b-0dcaccfaccba tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:15.731399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-330422c9-0274-4a23-ad8b-0dcaccfaccba tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:16.196564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-330422c9-0274-4a23-ad8b-0dcaccfaccba tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:16.205023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-330422c9-0274-4a23-ad8b-0dcaccfaccba tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1237 microversion: 2.1 time: 0.509273 Oct 29 21:06:16.231187 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2259/4624] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:15 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1237 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:16.240732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a4def1a5-1241-4166-ba58-197ca028172b"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:16.244704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:16.261642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:16.262950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:16.263808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:16.264981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:16.265722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:16.266424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:16.301870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:16.312617 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e826dd3b-d89c-462f-938e-a2d6bc53cc89 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 0.951775 Oct 29 21:06:16.313224 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2366/4625] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:15 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:16.348092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:16.354740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:16.369741 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] HTTP exception thrown: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Request method failure captured: Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559/os-volume_attachments/50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a HTTP/1.1 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 74 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUzW2houJnGhKy7wl_UqJeXbmHJUue2QvKe8WWGgrKC9rUoIPlPEtymDqBz0KOzuCEAaILWNfxI4rn2dtsQfdQm6Y1TtbXnvxnix4KftG3JFvs0vljcpspHXE9poru6tL_CaxgjRGybTjLTjcvJFsegkiTQcOITIqVAm3V5l8mEfNU Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 0a7767202be74199acfdb66e3ef98ff0 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesAdminNegativeTest-1362361443 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0a7767202be74199acfdb66e3ef98ff0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesAdminNegativeTest-1362361443 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 0a7767202be74199acfdb66e3ef98ff0 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1362361443 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesAdminNegativeTest-1362361443-project-admin Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 3faa0a776b2b465f9f98dd81ad268010 Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesAdminNegativeTest-1362361443-project-admin Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: {"volumeAttachment": {"volumeId": "a4def1a5-1241-4166-ba58-197ca028172b"}} Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: exception: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'server_id': 'fc0e32cb-37fe-482c-bde3-ddefc35be559', 'id': '50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a', 'body': {'volumeAttachment': {'volumeId': 'a4def1a5-1241-4166-ba58-197ca028172b'}}} Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. (HTTP 404) (Request-ID: req-72d31983-2b1b-4784-bc7d-79a162366207) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:06:16.372544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] Returning 404 to user: Volume 50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54989f8e-60d1-4752-97a9-8bbe2e16df68 tempest-VolumesAdminNegativeTest-1362361443 tempest-VolumesAdminNegativeTest-1362361443-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559/os-volume_attachments/50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a" status: 404 len: 109 microversion: 2.1 time: 0.141026 Oct 29 21:06:16.376586 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2260/4626] 10.222.0.36 () {60 vars in 1433 bytes} [Sat Oct 29 21:06:16 2022] PUT /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559/os-volume_attachments/50d72a08-7f20-4ce4-9dd2-1affc2d2dc8a => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:06:16.381733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:16.382433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:16.386093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:16.387173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:16.388124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:16.388774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:16.716370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:16.717000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:16.748010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:16.748599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:16.752150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:16.755751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:16.756257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:16.757115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:16.846626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:16.857867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dce2d09b-c079-4421-b893-769c48844250 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.518263 Oct 29 21:06:16.862687 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2367/4627] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:16 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:17.156247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:17.202328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-411f3d43-6d5b-4972-ac63-3f81ce370141 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1506 microversion: 2.1 time: 0.490948 Oct 29 21:06:17.203023 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2261/4628] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:16 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:17.240991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:17.241881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:17.254540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.260567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.264097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.265061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.267425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.270424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.345509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:17.346675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:17.373045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.382669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.383229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.388233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.388746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.389200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.643113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:17.656714 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a0c6c60-2b81-435b-a4d0-c71c6d084189 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1241 microversion: 2.1 time: 0.422379 Oct 29 21:06:17.660740 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2368/4629] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:17 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1241 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:17.747492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:17.747959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:17.748475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:17.771252 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60f1aed3-36be-4949-b4d2-133fa28f13c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 0.435577 Oct 29 21:06:17.771469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.771893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.772354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.773067 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2262/4630] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:17 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:17.778332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.780946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.781655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.853567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:06:17.895413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:17.896126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:17.939522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.943953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.945657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:17.946635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:17.954617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:17.961714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.057391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4b0a11e-32e0-4e62-a213-f24525ea0f4d tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 204 len: 0 microversion: 2.1 time: 0.313592 Oct 29 21:06:18.058698 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2369/4631] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:06:17 2022] DELETE /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:06:18.069790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:18.070860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:18.085387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.088633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.090814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.091775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.093629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.094241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.590356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:18.593079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:18.599523 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b670b176-9565-4e66-918c-5c6ad41e8373 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1514 microversion: 2.1 time: 0.536297 Oct 29 21:06:18.611725 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b3f299d-418a-4bda-8c4f-15077e4ac8ff tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.731005 Oct 29 21:06:18.612513 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2263/4632] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:17 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:18.629666 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2370/4633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:18 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1514 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:18.629666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8b31dd90-b699-41c7-9cee-3aa8674d5306 req-cf8dc355-45ad-46c9-a549-a1ef1459c650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283c0d72-0b7e-4802-ab7c-0d9ac1881f51", "name": "network-vif-unplugged", "status": "completed", "tag": "2b7b2f74-72d4-4713-99f8-9765ff5b4bec"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:18.644103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:18.644855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:18.654930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b31dd90-b699-41c7-9cee-3aa8674d5306 req-cf8dc355-45ad-46c9-a549-a1ef1459c650 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.659637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b31dd90-b699-41c7-9cee-3aa8674d5306 req-cf8dc355-45ad-46c9-a549-a1ef1459c650 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.660488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b31dd90-b699-41c7-9cee-3aa8674d5306 req-cf8dc355-45ad-46c9-a549-a1ef1459c650 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.663586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.667329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.667896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.669345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.671088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.673344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.686296 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8b31dd90-b699-41c7-9cee-3aa8674d5306 req-cf8dc355-45ad-46c9-a549-a1ef1459c650 service nova] Creating event network-vif-unplugged:2b7b2f74-72d4-4713-99f8-9765ff5b4bec for instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 on nch2-master-1 Oct 29 21:06:18.693378 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8b31dd90-b699-41c7-9cee-3aa8674d5306 req-cf8dc355-45ad-46c9-a549-a1ef1459c650 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074974 Oct 29 21:06:18.695816 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2371/4634] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:18.709858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:18.711176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:18.719475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.720400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.721387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.722425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.723134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.724476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.884925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:18.900890 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-645f5646-4480-4075-adcb-01953624af11 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1289 microversion: 2.1 time: 0.193905 Oct 29 21:06:18.902507 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2372/4635] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:18 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1289 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:18.907714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:18.913868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:18.930894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.935943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.936622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:18.938384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:18.939874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:18.944749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:19.030773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:19.049312 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e406af4-cd10-4ebe-ba50-b3578ddd2004 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 200 len: 1509 microversion: 2.1 time: 0.426545 Oct 29 21:06:19.089385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2264/4636] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:18 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:19.103516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:19.104262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:19.126663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:19.127298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:19.128871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:19.131971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:19.135060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:19.135793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:19.270454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:06:19.302659 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.api [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Working on deleting snapshot caad1fbe-0c9d-4fba-8adf-7128c3140557 from shelved instance... Oct 29 21:06:19.369715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:19.381935 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-33bd415a-7bce-494d-b5e9-3240609d024a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1682 microversion: 2.1 time: 0.477917 Oct 29 21:06:19.382546 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2373/4637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:18 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1682 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:19.638366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:19.639198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:19.652645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:19.654139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:19.656096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:19.658006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:19.658641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:19.662132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:19.725804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:20.643693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:20.663893 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-84f3b71f-c201-4dc0-a3b6-64b313846334 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1514 microversion: 2.1 time: 1.026818 Oct 29 21:06:20.665383 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2374/4638] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:19 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1514 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:20.691166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:20.692036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:20.713243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:20.717350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:20.718075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:20.719099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:20.720046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:20.721900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:21.202406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:21.215690 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-46b5e4bf-a90a-4e63-8639-b4581bc063d5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.540465 Oct 29 21:06:21.217126 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2375/4639] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:20 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:21.231590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:21.236963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:21.254416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:21.255101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:21.256218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:21.261431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:21.262120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:21.262677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:21.449210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Doing local delete in cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=138884) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 21:06:21.451334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:21.454556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:21.456813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:21.457867 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.api [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 21:06:21.466327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] deallocate_for_instance() {{(pid=138884) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 21:06:21.967004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:21.987199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49af3f7b-0ca6-4d79-86c5-93d4a2d37614 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1295 microversion: 2.1 time: 0.768976 Oct 29 21:06:22.009598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2376/4640] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:21 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1295 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:22.019351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:22.019974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:22.039606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:22.040120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:22.040564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:22.043139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:22.048072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:22.048928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:22.882772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:22.913891 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f023dcf-ecbb-4601-ae92-03710a3d54d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.902615 Oct 29 21:06:22.934146 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2377/4641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:22 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:22.940797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:22.941652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:22.957006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:22.958670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:22.966613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:22.967590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:22.968185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:22.968493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:23.079737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:23.081489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:23.084358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:23.085233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lazy-loading 'fault' on Instance uuid fc0e32cb-37fe-482c-bde3-ddefc35be559 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:06:23.251267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:23.271131 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7d7dc4f4-fe31-482c-b6c8-bd7084ca0de8 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 200 len: 1308 microversion: 2.1 time: 0.335026 Oct 29 21:06:23.289189 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2378/4642] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:22 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:23.298767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:23.299759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:23.308514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:23.309418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:23.310051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:23.311081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:23.311941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:23.312569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:24.725205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:24.760756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de0692ef-3fb2-4dd8-9da0-eb223d838bb0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.469414 Oct 29 21:06:24.776817 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2379/4643] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:23 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:24.787480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f7567f17-9b82-4027-bbf1-fd870389a27b req-cbedd0cb-c763-4258-acd9-47b1d28fcab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0e32cb-37fe-482c-bde3-ddefc35be559", "name": "network-vif-deleted", "tag": "b6e7dd7a-7228-4819-a46d-d2c6ca2df7f6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:24.799779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f7567f17-9b82-4027-bbf1-fd870389a27b req-cbedd0cb-c763-4258-acd9-47b1d28fcab5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:24.800875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f7567f17-9b82-4027-bbf1-fd870389a27b req-cbedd0cb-c763-4258-acd9-47b1d28fcab5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:24.801555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f7567f17-9b82-4027-bbf1-fd870389a27b req-cbedd0cb-c763-4258-acd9-47b1d28fcab5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:24.830029 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f7567f17-9b82-4027-bbf1-fd870389a27b req-cbedd0cb-c763-4258-acd9-47b1d28fcab5 service nova] Creating event network-vif-deleted:b6e7dd7a-7228-4819-a46d-d2c6ca2df7f6 for instance fc0e32cb-37fe-482c-bde3-ddefc35be559 on nch1-master-1 Oct 29 21:06:24.837569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f7567f17-9b82-4027-bbf1-fd870389a27b req-cbedd0cb-c763-4258-acd9-47b1d28fcab5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054035 Oct 29 21:06:24.838541 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2380/4644] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:24.853252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:24.854778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:24.868576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:24.869312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:24.870421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:24.872081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:24.872775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:24.873435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:25.159075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:25.219926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:25.397743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:25.410809 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b2cb007-37a1-40b5-a426-1ed4cde1577b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1362 microversion: 2.1 time: 0.567268 Oct 29 21:06:25.412357 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2381/4645] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:24 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:25.433057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:25.434482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:25.443593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:25.444512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:25.445427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:25.446379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:25.447047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:25.447685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:25.968060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:25.980616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Updating instance_info_cache with network_info: [] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 21:06:25.990066 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97638616-5e91-4b1b-8a08-d4aded02b505 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.564973 Oct 29 21:06:25.990682 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2382/4646] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:25 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:26.006094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-30c56eb0-f911-4a98-9072-f77a378c143c req-09e9fe49-3358-4832-b2c6-60a869f4465e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-unplugged", "status": "completed", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:26.029086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-30c56eb0-f911-4a98-9072-f77a378c143c req-09e9fe49-3358-4832-b2c6-60a869f4465e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.030739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-30c56eb0-f911-4a98-9072-f77a378c143c req-09e9fe49-3358-4832-b2c6-60a869f4465e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.031629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-30c56eb0-f911-4a98-9072-f77a378c143c req-09e9fe49-3358-4832-b2c6-60a869f4465e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:26.088567 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-30c56eb0-f911-4a98-9072-f77a378c143c req-09e9fe49-3358-4832-b2c6-60a869f4465e service nova] Creating event network-vif-unplugged:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:06:26.106922 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-30c56eb0-f911-4a98-9072-f77a378c143c req-09e9fe49-3358-4832-b2c6-60a869f4465e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114577 Oct 29 21:06:26.108090 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2383/4647] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:26.124129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:26.129636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: fc0e32cb-37fe-482c-bde3-ddefc35be559] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:26.145288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.148353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.148879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:26.149834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.152405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.153092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:26.184314 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] HTTP exception thrown: Instance fc0e32cb-37fe-482c-bde3-ddefc35be559 could not be found. Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Request method failure captured: Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 HTTP/1.1 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUmc78YReg_hVKcXnfHJlIVsxLYLnXCnIKCgkghiidWdd2CXuWjmUtm0a-RJ5bfwbZYNYxvWF-sAStRWRAMEHUug8f23vSgl4MhO6xXHD9eIVFLF5pVi11y9POlTcySMtH3hHChed9Pa8tr3jIt3AU6UUrRZNo6xySXIHEb19KRJTA Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c4e54075f50e468dbd398cc3df0d30a6 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesAdminNegativeTest-775941430 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesAdminNegativeTest-775941430 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c4e54075f50e468dbd398cc3df0d30a6 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-775941430 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesAdminNegativeTest-775941430-project Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 317c7fc1b0be4187bb3b719ac5c8fde3 Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesAdminNegativeTest-775941430-project Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance fc0e32cb-37fe-482c-bde3-ddefc35be559 could not be found. Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'fc0e32cb-37fe-482c-bde3-ddefc35be559'} Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc0e32cb-37fe-482c-bde3-ddefc35be559 could not be found. Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc0e32cb-37fe-482c-bde3-ddefc35be559 could not be found. Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:26.189528 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc0e32cb-37fe-482c-bde3-ddefc35be559 could not be found. Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Returning 404 to user: Instance fc0e32cb-37fe-482c-bde3-ddefc35be559 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:26.193995 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3828ed7-4d8d-4c1d-b137-6ea3eabd2a0a tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559" status: 404 len: 111 microversion: 2.1 time: 0.079395 Oct 29 21:06:26.195609 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2384/4648] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:26 2022] GET /compute/v2.1/servers/fc0e32cb-37fe-482c-bde3-ddefc35be559 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:06:26.203441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:26.207189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:26.207946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:26.225958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.226724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.227444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:26.229836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.230517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.231560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:26.615358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:26.748177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11607485-64d4-4a17-b7b2-3790fe060a87 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 204 len: 0 microversion: 2.1 time: 7.657279 Oct 29 21:06:26.748855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2265/4649] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:06:19 2022] DELETE /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 0 bytes in 7659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:06:26.756382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:26.756909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:26.773290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.776453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.777171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:26.778127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:26.781295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:26.782217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.216763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:27.254285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f61b14e-d055-40cb-9c04-18524a99b9ea tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.057195 Oct 29 21:06:27.267004 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2385/4650] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:26 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:27.283243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:27.288399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:27.319761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.320780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.322158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.324066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.327310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.328304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.397099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 HTTP/1.1 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '283c0d72-0b7e-4802-ab7c-0d9ac1881f51'} Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:27.406743 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:06:27.412100 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:06:27.414176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:27.416597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a68e9f7-dda8-4861-b56d-6d1164448e10 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 404 len: 111 microversion: 2.1 time: 0.148179 Oct 29 21:06:27.423895 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2386/4651] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:27 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:06:27.468402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283c0d72-0b7e-4802-ab7c-0d9ac1881f51", "name": "network-vif-deleted", "tag": "2b7b2f74-72d4-4713-99f8-9765ff5b4bec"}, {"name": "network-changed", "server_uuid": "799d00cc-130b-4a02-b9ed-0fdb136dad85", "tag": "1e445f51-367e-4d35-a04a-828db8ff7b10"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:27.522360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.524380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.526572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.609549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.compute.server_external_events [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] Unable to find a host for instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51. Dropping event network-vif-deleted {{(pid=138885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 21:06:27.611457 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] Creating event network-changed:1e445f51-367e-4d35-a04a-828db8ff7b10 for instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 on nch2-master-1 Oct 29 21:06:27.620160 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-27e07ce7-c9e5-4119-824c-f4f8005c887c req-e49b6ca5-362c-4624-9cd6-21051ec5cfaa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.194363 Oct 29 21:06:27.622308 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2387/4652] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 198 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 21:06:27.636254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:27.638057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:27.640170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:27.648438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.649041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4555cb1-c16c-49d3-b1ed-9bf92b4af2f9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1362 microversion: 2.1 time: 0.899155 Oct 29 21:06:27.649786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.650453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.651721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.652438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.653065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.657109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2266/4653] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:26 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1362 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:27.740771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:06:27.788597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-383175108", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:27.940339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:27.953020 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59da79a2-bbf8-49a9-acaa-199a4551bf00 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 204 len: 0 microversion: 2.1 time: 0.328553 Oct 29 21:06:27.955233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2388/4654] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:06:27 2022] DELETE /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:06:27.966756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:27.967786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:27.977375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.978381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.980088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:27.981085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:27.981928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:27.983404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:28.716322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:28.741303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1eb82d8f-2956-49a6-bae1-c53b791ae742 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1681 microversion: 2.1 time: 0.777994 Oct 29 21:06:28.744000 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2389/4655] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:27 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1681 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:28.762938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:28.764790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:28.794043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:28.804576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:28.805743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:28.809880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:28.810762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:28.811706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:29.157730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:29.172296 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2fd639c5-9ab0-4381-af01-75c760f7e43c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.423370 Oct 29 21:06:29.174460 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2390/4656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:28 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:29.203926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:29.207288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:29.221221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:29.222771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:29.226184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:29.228402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:29.228906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:29.229406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:29.524203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:29.532525 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb72458d-ea4a-4560-a493-ff85f95c6e52 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1362 microversion: 2.1 time: 0.339300 Oct 29 21:06:29.537826 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2391/4657] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:29 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:29.545371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:29.558601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:29.577970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:06:29.584694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:29.585186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:29.585664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:29.586452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:29.586867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:29.587264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:29.592468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:30.992039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:31.006244 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a76796b6-590c-4b21-b7b7-98450ab7b420 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.464598 Oct 29 21:06:31.008678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2392/4658] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:29 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:31.038502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:31.039345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:31.048843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:31.049559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:31.050446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:31.057234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:31.057918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:31.058513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:31.803860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:06:31.804430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:06:31.804797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:06:31.805216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:06:31.805665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:06:31.807750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:31.844290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:31.845271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:31.846008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:31.846935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:31.850070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:31.853601 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d196e3e-6014-468f-b694-afce426fd935 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1681 microversion: 2.1 time: 0.827096 Oct 29 21:06:31.854199 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2393/4659] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:31 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1681 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:31.854836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:31.855579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:31.863023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:31.863637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:31.884161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:31.884692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:31.885096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:31.885845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:31.886304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:31.886731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:31.903583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:06:31.920553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:06:31.951264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:06:31.962779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:06:32.046565 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74c14bb5-465d-4da9-9083-6c00374bfcd6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.268126 Oct 29 21:06:32.048046 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2267/4660] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:06:32.059220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:32.063118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:32.079022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:32.080240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:32.080920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:32.082722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:32.086248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:32.087954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:32.975985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:32.986522 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ffff1d79-ae49-43fa-a11a-a13976d653b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 1.131256 Oct 29 21:06:32.992280 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2394/4661] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:31 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:33.005639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:33.006649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:33.020696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:33.024126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:33.024828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:33.029087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:33.029809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:33.030374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:33.149953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:33.160755 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0e691d7-f854-4d8b-8014-74bb2eec67ce tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1362 microversion: 2.1 time: 1.110933 Oct 29 21:06:33.163801 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2268/4662] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:32 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1362 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:33.174655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:33.178349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:33.193825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:33.196491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:33.197237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:33.202783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:33.203702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:33.204420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:33.396387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:33.405383 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0b921bf-10ff-4970-b428-48734e9c1e06 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1218 microversion: 2.1 time: 0.238974 Oct 29 21:06:33.413537 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2269/4663] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:33 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:33.430197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:33.431185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:33.444143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:33.445614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:33.446947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:33.449871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:33.450613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:33.451604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:33.851067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:33.874634 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d05d8dd-e78d-471d-9f7c-b14d49373420 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1614 microversion: 2.1 time: 0.459633 Oct 29 21:06:33.889077 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2270/4664] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:33 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1614 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:33.966339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:33.984414 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94012e4f-4a3d-407f-8d56-92354ae2685d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.989596 Oct 29 21:06:33.990123 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2395/4665] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:32 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:34.008434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:34.009638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:34.020126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:34.025314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:34.054596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.055469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.056062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.059088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.063384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.063691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.064464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.065375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.066113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.068000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.071601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.078378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.779249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:34.794192 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a7cd098a-c4c0-4438-a9ff-320d035527a9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.783199 Oct 29 21:06:34.795067 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2396/4666] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:34 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:34.799776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:34.802985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:34.825234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.825762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.826395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.827258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.827862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.828449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.868519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:34.892940 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6382c7a2-6359-43c9-9a62-02f774cd9afb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.878907 Oct 29 21:06:34.911819 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2271/4667] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:34 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:34.918151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:34.923346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:34.964124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.966806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.970286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:34.972525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:34.975365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:34.979587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.203478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:35.215274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:35.222211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-537f439a-5b7b-4630-a9d8-2a629de7a9bf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1272 microversion: 2.1 time: 0.322755 Oct 29 21:06:35.227235 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b37be5b-96fc-4056-a1b2-7ff3fedea1bc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1362 microversion: 2.1 time: 0.430964 Oct 29 21:06:35.229900 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2397/4668] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:34 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:35.236438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-06d18ec9-7e52-48d5-bf09-90ce968248d6 req-faa5817d-035d-4358-8aa8-265d7df9c236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b266901d-80f5-4033-91e9-4198d82cc551", "name": "network-vif-deleted", "tag": "d097fa95-f63b-4a03-b4eb-d20a2483c344"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:35.242453 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2272/4669] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:34 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:35.254001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7bc66cab-9162-451f-8f16-363b2b0c11b0 req-f4cebc42-daeb-42b1-9654-34c9078e5d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799d00cc-130b-4a02-b9ed-0fdb136dad85", "name": "network-vif-plugged", "status": "completed", "tag": "1e445f51-367e-4d35-a04a-828db8ff7b10"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:35.265818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-06d18ec9-7e52-48d5-bf09-90ce968248d6 req-faa5817d-035d-4358-8aa8-265d7df9c236 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.266400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-06d18ec9-7e52-48d5-bf09-90ce968248d6 req-faa5817d-035d-4358-8aa8-265d7df9c236 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.267095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-06d18ec9-7e52-48d5-bf09-90ce968248d6 req-faa5817d-035d-4358-8aa8-265d7df9c236 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.283911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7bc66cab-9162-451f-8f16-363b2b0c11b0 req-f4cebc42-daeb-42b1-9654-34c9078e5d54 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.284443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7bc66cab-9162-451f-8f16-363b2b0c11b0 req-f4cebc42-daeb-42b1-9654-34c9078e5d54 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.284888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7bc66cab-9162-451f-8f16-363b2b0c11b0 req-f4cebc42-daeb-42b1-9654-34c9078e5d54 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.292417 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-06d18ec9-7e52-48d5-bf09-90ce968248d6 req-faa5817d-035d-4358-8aa8-265d7df9c236 service nova] Creating event network-vif-deleted:d097fa95-f63b-4a03-b4eb-d20a2483c344 for instance b266901d-80f5-4033-91e9-4198d82cc551 on nch1-master-1 Oct 29 21:06:35.306439 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-06d18ec9-7e52-48d5-bf09-90ce968248d6 req-faa5817d-035d-4358-8aa8-265d7df9c236 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075079 Oct 29 21:06:35.307376 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2398/4670] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:35.321972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:35.322127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7bc66cab-9162-451f-8f16-363b2b0c11b0 req-f4cebc42-daeb-42b1-9654-34c9078e5d54 service nova] Creating event network-vif-plugged:1e445f51-367e-4d35-a04a-828db8ff7b10 for instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 on nch2-master-1 Oct 29 21:06:35.323329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:35.334576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.337140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7bc66cab-9162-451f-8f16-363b2b0c11b0 req-f4cebc42-daeb-42b1-9654-34c9078e5d54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091484 Oct 29 21:06:35.337944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.338596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.339567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.339769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2273/4671] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:35.342039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.342704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.350754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:35.353650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:35.387378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.387887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.388325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.392511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.396008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.396480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.431737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.432618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.434396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.435118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lazy-loading 'fault' on Instance uuid b266901d-80f5-4033-91e9-4198d82cc551 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:06:35.595372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25ad4a97-c84d-4e2e-addd-5b7606da8081 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.253873 Oct 29 21:06:35.599611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2274/4672] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:06:35 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:06:35.631518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:35.632737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:35.642129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.643816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.644448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.645212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.646111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.646733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.863846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317c7fc1b0be4187bb3b719ac5c8fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e54075f50e468dbd398cc3df0d30a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:35.874766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f374fa30-87ae-43cc-ba63-80e359314b18 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 200 len: 1331 microversion: 2.1 time: 0.565992 Oct 29 21:06:35.878472 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2399/4673] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:35 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 1331 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:35.883807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:35.890056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:35.909334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.910135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.910800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:35.912300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:35.912993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:35.913729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.372966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:36.385025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a125b7b-7e51-4f4b-964a-4e9027161b9d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1671 microversion: 2.1 time: 0.782636 Oct 29 21:06:36.405505 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2275/4674] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:35 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1671 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:36.405505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:36.405505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:36.410092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:36.410598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:36.411155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.412293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:36.412908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:36.414028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.473573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:36.486544 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6bf4f52-6d87-483f-b62a-24f6e01df048 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.606717 Oct 29 21:06:36.490381 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2400/4675] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:35 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:36.497447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:36.500622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:36.516329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:36.517053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:36.517685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.518566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:36.519021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:36.527567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.743298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:36.757484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10b6abe1-7f99-478b-8666-1fe5eda3b1d0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1272 microversion: 2.1 time: 0.362387 Oct 29 21:06:36.769528 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2276/4676] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:36 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1272 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:36.902887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:36.903551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] [instance: b266901d-80f5-4033-91e9-4198d82cc551] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:36.912635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:36.915449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:36.915960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.916708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:36.917935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:36.919661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:36.967761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] HTTP exception thrown: Instance b266901d-80f5-4033-91e9-4198d82cc551 could not be found. Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Request method failure captured: Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 HTTP/1.1 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUmc78YReg_hVKcXnfHJlIVsxLYLnXCnIKCgkghiidWdd2CXuWjmUtm0a-RJ5bfwbZYNYxvWF-sAStRWRAMEHUug8f23vSgl4MhO6xXHD9eIVFLF5pVi11y9POlTcySMtH3hHChed9Pa8tr3jIt3AU6UUrRZNo6xySXIHEb19KRJTA Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c4e54075f50e468dbd398cc3df0d30a6 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesAdminNegativeTest-775941430 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4e54075f50e468dbd398cc3df0d30a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesAdminNegativeTest-775941430 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c4e54075f50e468dbd398cc3df0d30a6 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-775941430 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesAdminNegativeTest-775941430-project Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 317c7fc1b0be4187bb3b719ac5c8fde3 Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesAdminNegativeTest-775941430-project Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b266901d-80f5-4033-91e9-4198d82cc551 could not be found. Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b266901d-80f5-4033-91e9-4198d82cc551'} Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b266901d-80f5-4033-91e9-4198d82cc551 could not be found. Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b266901d-80f5-4033-91e9-4198d82cc551 could not be found. Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:36.975047 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b266901d-80f5-4033-91e9-4198d82cc551 could not be found. Oct 29 21:06:36.979304 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:36.981427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Returning 404 to user: Instance b266901d-80f5-4033-91e9-4198d82cc551 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:36.982750 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b62d2782-2ada-4394-9126-86ddc91a77fc tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551" status: 404 len: 111 microversion: 2.1 time: 0.084310 Oct 29 21:06:36.983876 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2277/4677] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:36 2022] GET /compute/v2.1/servers/b266901d-80f5-4033-91e9-4198d82cc551 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:06:37.005405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4b78ee0-1c07-40b2-9d8b-16ef2df40ef3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] Calling method '.version_select at 0x7fa1718d7940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:37.044336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4b78ee0-1c07-40b2-9d8b-16ef2df40ef3 tempest-VolumesAdminNegativeTest-775941430 tempest-VolumesAdminNegativeTest-775941430-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519502543" status: 202 len: 0 microversion: 2.1 time: 0.049488 Oct 29 21:06:37.049047 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2278/4678] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519502543 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:06:37.417852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:37.420065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:37.435055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:37.438767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:37.444088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:37.447711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:37.448848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:37.450004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:38.312849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:38.330229 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e0e3a2e7-f9b3-48fc-886c-38f4bb002ff2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1362 microversion: 2.1 time: 1.832595 Oct 29 21:06:38.333684 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2401/4679] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:36 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1362 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:38.353614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:38.361560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:38.412455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:38.412986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:38.413502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:38.422588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:38.423416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:38.425718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:38.426238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:38.435072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-257816b3-a316-4075-bf44-ed81a60523c3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1671 microversion: 2.1 time: 1.022640 Oct 29 21:06:38.449486 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2279/4680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:37 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1671 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:38.450583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:38.451251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:38.461851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:38.462356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:38.470511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:38.471420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:38.471914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:38.472365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:38.886930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:38.914171 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-016efe05-3bfc-46f5-8d0a-95799a293bc2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.475870 Oct 29 21:06:38.915599 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2280/4681] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:38 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:39.057049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:39.073267 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-808e9ebf-7655-4320-a4d2-d7cb69e20caa tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.738134 Oct 29 21:06:39.093426 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2402/4682] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:38 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:39.360456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:39.362987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:39.382806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:39.392411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:39.403131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:39.404418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:39.409313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:39.413042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:39.468474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:39.470831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:39.485958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:39.486771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:39.487408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:39.492864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:39.499602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:39.500396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.001164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:40.014844 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-443a1528-4b8b-46ce-b40d-776372f5ffe5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1548 microversion: 2.1 time: 0.660788 Oct 29 21:06:40.057627 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2281/4683] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:39 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1548 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:40.074051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:40.075246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:40.079430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:40.091838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:40.092281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:40.094761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.094761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:40.095143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:40.100720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-feda099e-6cf8-415e-8c3f-4781706101a0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1676 microversion: 2.1 time: 0.633988 Oct 29 21:06:40.101281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.101412 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2403/4684] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:39 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1676 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:40.130534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:40.132891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:40.134963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:40.148181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:40.161851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:40.163040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.163816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:40.164290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:40.164722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.494181 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01ad6f02-2fc7-4a2b-9394-f7ea5e0025aa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.375580 Oct 29 21:06:40.496806 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2404/4685] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:06:40 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-interface => generated 284 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:40.503586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:40.504612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:40.515084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:40.516482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:40.517127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.518659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:40.519935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:40.521003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:40.654732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:40.668811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e66dd36c-ff76-4f0a-bd12-c885e37cf07b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.608385 Oct 29 21:06:40.683301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2282/4686] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:40 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:40.878205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:40.895391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f1a97bb3-4632-408a-bee2-8ea5ff156620 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1528 microversion: 2.1 time: 0.397011 Oct 29 21:06:40.897604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2405/4687] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:40 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1528 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:41.130621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:41.131234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:41.145333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.145936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.146327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.147055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.147526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.147982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.642762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:41.669395 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-213e9a50-019d-4718-92b6-3bf655d48173 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.542983 Oct 29 21:06:41.670865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2283/4688] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:41 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:41.693921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:41.697550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:41.705254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.706552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.707243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.708825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.709548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.710088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:41.710476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.710903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:41.721730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.722292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.722747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.724477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.725114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.727058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.770914 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2affa06c-d0fb-42f7-8806-3bee062ad1b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 200 len: 322 microversion: 2.1 time: 0.080593 Oct 29 21:06:41.771923 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2406/4689] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:06:41 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 322 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:41.782945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:41.784032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:41.802475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.804836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.807047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.810163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:41.815674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:41.818350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:41.878377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:41.941746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:42.298602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:42.309797 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae43e482-a0ac-4afe-b294-a9dd94fd55e9 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.604594 Oct 29 21:06:42.310893 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2284/4690] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:41 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:42.318323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a3c74fd6-ab51-4008-ae64-15793c3e94b7 req-7556193d-ab52-4073-ba7e-ca46ae72b39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a", "tag": "e720f11d-3662-48b2-9ab5-2600931f8ec2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:42.329796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a3c74fd6-ab51-4008-ae64-15793c3e94b7 req-7556193d-ab52-4073-ba7e-ca46ae72b39f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:42.330523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a3c74fd6-ab51-4008-ae64-15793c3e94b7 req-7556193d-ab52-4073-ba7e-ca46ae72b39f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:42.331132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a3c74fd6-ab51-4008-ae64-15793c3e94b7 req-7556193d-ab52-4073-ba7e-ca46ae72b39f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:42.353980 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a3c74fd6-ab51-4008-ae64-15793c3e94b7 req-7556193d-ab52-4073-ba7e-ca46ae72b39f service nova] Creating event network-changed:e720f11d-3662-48b2-9ab5-2600931f8ec2 for instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a on nch1-master-1 Oct 29 21:06:42.359421 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a3c74fd6-ab51-4008-ae64-15793c3e94b7 req-7556193d-ab52-4073-ba7e-ca46ae72b39f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045500 Oct 29 21:06:42.360403 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2285/4691] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:42.368888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:42.369843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:42.371105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:42.378620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:42.379325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:42.379999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:42.381055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:42.381715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:42.381839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-826d6a04-68e3-42ff-b115-9eb066a7886f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.603775 Oct 29 21:06:42.382423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:42.402110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2407/4692] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:41 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:42.428254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:42.429637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:42.446662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:42.448427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:42.449109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:42.450706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:42.452510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:42.453084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:43.258828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:43.268670 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6998df6-6a43-4bdb-b185-d71f54b5c0e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.865054 Oct 29 21:06:43.271231 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2408/4693] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:42 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:43.292142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:43.292750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:43.299042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:43.299529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:43.299965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:43.301033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:43.301630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:43.302641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:43.312325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:43.322712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f56ef2a-2648-4d86-965b-c003684a7a06 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1510 microversion: 2.1 time: 0.960850 Oct 29 21:06:43.325441 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2286/4694] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:42 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1510 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:43.341914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:43.343045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:43.351698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:43.352661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:43.353552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:43.355152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:43.356244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:43.356942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:43.785366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:43.799471 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-804804f6-ebaa-409d-b4fe-f0ca6c41218a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.464066 Oct 29 21:06:43.809934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:43.819792 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2287/4695] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:43 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:43.829062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:43.837078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f5db5cf-b916-4183-a2e9-5388b85db10e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.547740 Oct 29 21:06:43.851343 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2409/4696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:43 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:43.867693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:43.868539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:43.889486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:43.894415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:43.897434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:43.898641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:43.900266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:43.903959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:44.334211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1539849717", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:44.350691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:44.359089 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8fc704b5-8e6c-4a0e-8773-82bfa7d700e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.497582 Oct 29 21:06:44.369487 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2288/4697] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:43 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:44.383489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:44.387849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:44.415064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:44.416008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:44.417581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:44.418815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:44.420613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:44.421424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:44.450301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] validate_networks() for [('9f52494a-96f3-4813-b563-8abeb5d916ec', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:06:44.838148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:44.849001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74b94a88-b294-4f36-a409-ba431f3db57d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1510 microversion: 2.1 time: 0.481611 Oct 29 21:06:44.853204 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2289/4698] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:44 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:44.865985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2838e20d-1316-4969-875f-5f8fccc7ff72 req-02607c09-4ce3-4383-8c26-ae4c52017469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799d00cc-130b-4a02-b9ed-0fdb136dad85", "tag": "1e445f51-367e-4d35-a04a-828db8ff7b10"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:44.898166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2838e20d-1316-4969-875f-5f8fccc7ff72 req-02607c09-4ce3-4383-8c26-ae4c52017469 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:44.899016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2838e20d-1316-4969-875f-5f8fccc7ff72 req-02607c09-4ce3-4383-8c26-ae4c52017469 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:44.899651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2838e20d-1316-4969-875f-5f8fccc7ff72 req-02607c09-4ce3-4383-8c26-ae4c52017469 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:44.913821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2838e20d-1316-4969-875f-5f8fccc7ff72 req-02607c09-4ce3-4383-8c26-ae4c52017469 service nova] Creating event network-changed:1e445f51-367e-4d35-a04a-828db8ff7b10 for instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 on nch2-master-1 Oct 29 21:06:44.921346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2838e20d-1316-4969-875f-5f8fccc7ff72 req-02607c09-4ce3-4383-8c26-ae4c52017469 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066028 Oct 29 21:06:44.922280 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2290/4699] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:44.929156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-568345318", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1afe3e15-ddc2-4d60-825a-7983ed3bd0c7"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:44.996616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] validate_networks() for [('1afe3e15-ddc2-4d60-825a-7983ed3bd0c7', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:06:46.421371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:06:46.421987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:06:46.422746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:06:46.423034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:06:46.424952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:06:46.449287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:46.453570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:46.455492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:46.458929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:46.460627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:46.463156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:46.523965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Getting quotas for project a7c2c32214f44c15baa6d6dc2aa95b2d. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:06:46.535250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Getting quotas for user d0935d27b49345729582625be6946cfa and project a7c2c32214f44c15baa6d6dc2aa95b2d. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:06:46.552208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:06:46.557910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:06:46.657068 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5a4b275-6b05-4f3e-bac9-9ba6ce6332cf tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.525941 Oct 29 21:06:46.666770 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2410/4700] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:06:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:06:46.680773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:46.681815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:46.693006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:46.693910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:46.694606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:46.695583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:46.696267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:46.697087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.632808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:47.641954 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-56d6e06f-dfab-42a8-b2bb-015d8ce1d210 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.973655 Oct 29 21:06:47.654455 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2411/4701] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:46 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:47.659948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:47.660788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:47.678078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.679275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.679275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.679733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.680195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.681309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.688307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:06:47.690932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:06:47.691601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:06:47.692725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:06:47.693340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:06:47.703751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.704501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.705312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.706264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.706918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.708193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.732870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:06:47.739318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for user c35b0dd86eb14cbbab1732cc96ab2573 and project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:06:47.755186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:06:47.758149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:06:47.812281 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da49aa55-e7b4-44f9-900a-2c5e353e8311 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.888411 Oct 29 21:06:47.822074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2291/4702] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:06:47.828476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d9b22199-260e-4b1d-a718-1f4560d55113 req-895363dc-aaab-4655-b6a5-85a8e1efe268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "name": "network-vif-unplugged", "status": "completed", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:47.843079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9b22199-260e-4b1d-a718-1f4560d55113 req-895363dc-aaab-4655-b6a5-85a8e1efe268 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.844129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9b22199-260e-4b1d-a718-1f4560d55113 req-895363dc-aaab-4655-b6a5-85a8e1efe268 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.844847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9b22199-260e-4b1d-a718-1f4560d55113 req-895363dc-aaab-4655-b6a5-85a8e1efe268 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.863266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.server_external_events [req-d9b22199-260e-4b1d-a718-1f4560d55113 req-895363dc-aaab-4655-b6a5-85a8e1efe268 service nova] Unable to find a host for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee. Dropping event network-vif-unplugged {{(pid=138884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 21:06:47.864863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d9b22199-260e-4b1d-a718-1f4560d55113 req-895363dc-aaab-4655-b6a5-85a8e1efe268 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041118 Oct 29 21:06:47.866528 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2292/4703] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 21:06:47.888825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:47.890062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:47.899062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.899931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.900580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:47.901591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:47.902467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:47.903344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:48.156816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:48.170142 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13505232-b2c9-4cac-a1e6-94fc47f6415d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1275 microversion: 2.1 time: 0.302211 Oct 29 21:06:48.171057 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2293/4704] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:47 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:48.177254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9c829410-cabb-4da4-bbb4-0c3383c949a3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:48.190434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9c829410-cabb-4da4-bbb4-0c3383c949a3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:48.398845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9c829410-cabb-4da4-bbb4-0c3383c949a3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:48.406933 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9c829410-cabb-4da4-bbb4-0c3383c949a3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1214 microversion: 2.1 time: 0.234542 Oct 29 21:06:48.418602 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2294/4705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:48 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:48.682369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:48.683246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:48.689794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:48.690633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:48.692161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:48.692161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:48.692161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:48.692394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:48.721554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:48.741615 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a23b5dca-0fbf-4b82-8e7d-b694382849c3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1453 microversion: 2.1 time: 1.085598 Oct 29 21:06:48.742503 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2412/4706] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:47 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1453 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:48.770662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:48.771561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:48.780723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:48.788741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:48.789473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:48.790379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:48.791003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:48.791613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.437094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:49.470510 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c43758f-8e14-4584-b158-88c733ee47bd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.791803 Oct 29 21:06:49.480062 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2295/4707] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:48 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:49.511608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:49.512327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:49.534595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:49.541628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:49.544440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.547242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:49.548021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:49.550103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.564865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:49.582129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9785192-19b2-4da6-b35f-7b826cd7a0f8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1453 microversion: 2.1 time: 0.814458 Oct 29 21:06:49.586065 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2413/4708] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:48 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1453 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:49.597143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:49.624673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:49.653303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:49.654993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:49.659994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.660993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:49.663605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:49.668575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.797909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:49.812535 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4da2546-0aae-42f0-9dab-48410342312b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1281 microversion: 2.1 time: 0.331132 Oct 29 21:06:49.813554 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2296/4709] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:49 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1281 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:49.836416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:49.849734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:49.867502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:49.869716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:49.872539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.873613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:49.874304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:49.876566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:49.934236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lazy-loading 'flavor' on Instance uuid 97e7bb8a-f42c-415a-9898-3cb84f34e2ee {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:06:49.962283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'shelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state shelved_offloaded Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 14 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: {"shelve": {}} Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'shelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state shelved_offloaded Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'shelve': {}}} Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 29 21:06:49.968816 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state shelved_offloaded Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state shelved_offloaded Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'shelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state shelved_offloaded {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:06:49.972855 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-39abdc80-c143-492b-a3c2-7a4b186aae3a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 155 microversion: 2.1 time: 0.155318 Oct 29 21:06:49.976139 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2297/4710] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:06:49 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 155 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:06:49.979790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:49.984500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:49.985193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:49.992620 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3342306b-e62c-4342-89bd-49ebf1a4c0c0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1274 microversion: 2.1 time: 0.403656 Oct 29 21:06:49.999077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.001648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.002189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.003012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.005887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.006424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.009829 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2414/4711] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:49 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1274 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:50.094650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138884) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 21:06:50.247426 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6816ccd2-30f9-4bd4-a146-fa29449a5608 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 202 len: 0 microversion: 2.1 time: 0.266841 Oct 29 21:06:50.256107 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2298/4712] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:06:49 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:06:50.261069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:50.261756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:50.289171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.305957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.306513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.309480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.313618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.315684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.494701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:50.495329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:50.498468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:50.514788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.515305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.515761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.516490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.516962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.517401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.897516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:50.914059 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-652bad76-07af-4738-956d-9c809f7a1bb1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1461 microversion: 2.1 time: 0.657170 Oct 29 21:06:50.914918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2415/4713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:50 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1461 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:50.933641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:50.934585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:50.947343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.948107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.948753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:50.951725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:50.965417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:50.966169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:51.016683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:51.026145 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-884add6b-b34b-4317-9a94-f3fd2f042fe5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.535266 Oct 29 21:06:51.043601 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2299/4714] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:50 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:51.049541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-87f82a60-8562-461a-a090-9bc9b1d41598 req-7f036952-e2fb-4dfd-85e9-4e750927e058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a", "name": "network-vif-plugged", "status": "completed", "tag": "e720f11d-3662-48b2-9ab5-2600931f8ec2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:51.061595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-87f82a60-8562-461a-a090-9bc9b1d41598 req-7f036952-e2fb-4dfd-85e9-4e750927e058 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:51.062189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-87f82a60-8562-461a-a090-9bc9b1d41598 req-7f036952-e2fb-4dfd-85e9-4e750927e058 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:51.062881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-87f82a60-8562-461a-a090-9bc9b1d41598 req-7f036952-e2fb-4dfd-85e9-4e750927e058 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:51.077184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:51.078904 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-87f82a60-8562-461a-a090-9bc9b1d41598 req-7f036952-e2fb-4dfd-85e9-4e750927e058 service nova] Creating event network-vif-plugged:e720f11d-3662-48b2-9ab5-2600931f8ec2 for instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a on nch1-master-1 Oct 29 21:06:51.090692 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-87f82a60-8562-461a-a090-9bc9b1d41598 req-7f036952-e2fb-4dfd-85e9-4e750927e058 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043948 Oct 29 21:06:51.092901 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2300/4715] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:06:51.094299 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-679b51e7-2bf2-4cd7-90c6-6d2bea5f25ab tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1281 microversion: 2.1 time: 0.175598 Oct 29 21:06:51.095566 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2416/4716] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:50 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:51.106682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:51.107663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:51.133234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:51.134039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:51.137994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:51.139031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:51.139671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:51.140666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:51.470831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:51.488374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e1eff99d-8baf-4796-a883-f4f44b929faa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1272 microversion: 2.1 time: 0.391916 Oct 29 21:06:51.489588 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2301/4717] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:51 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:51.946240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:51.946872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:51.965435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:51.965963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:51.966591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:51.967488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:51.968121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:51.968725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.049019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:52.049833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:52.064655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:52.065918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:52.067022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.068862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:52.069939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:52.070649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.108648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:52.336698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:52.352160 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8286ccdf-9f99-4065-919d-531f60ce5930 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1461 microversion: 2.1 time: 0.408072 Oct 29 21:06:52.353929 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2417/4718] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:51 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1461 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:52.367546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:52.368314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:52.378284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:52.378789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:52.379755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.380485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:52.380953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:52.381390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.479624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:52.492914 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a026175-5eab-4798-ab71-3d032b635194 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.448025 Oct 29 21:06:52.505812 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2302/4719] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:52 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:52.512630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:52.513511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:52.527365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:52.528061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:52.529501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.530326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:52.531178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:52.531702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:52.660897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:52.674846 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a71a1d2-a30e-4a7b-a0df-b8cec8f356e5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1272 microversion: 2.1 time: 0.165851 Oct 29 21:06:52.690264 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2303/4720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:52 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:06:52.762873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:52.771829 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df5c5524-1c1a-411b-aa68-121bef6e900c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.415890 Oct 29 21:06:52.775913 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2418/4721] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:52 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:53.382240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:53.384110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:53.397227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:53.398489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:53.401019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:53.402006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:53.402717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:53.404177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:53.518826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:53.519453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:53.530260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:53.530762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:53.531205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:53.531918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:53.532376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:53.533468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:53.935034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:53.944215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f64f207-8c73-44fb-a4b9-62ece96641af tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1463 microversion: 2.1 time: 0.567099 Oct 29 21:06:53.945153 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2304/4722] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:53 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1463 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:53.951861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:53.952755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:53.960495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:53.961281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:53.962104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:53.963053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:53.963736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:53.964391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:53.975197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:53.986938 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-418d7be7-0847-46c6-aad2-06780a25c96c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1314 microversion: 2.1 time: 0.471931 Oct 29 21:06:53.990308 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2419/4723] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:53 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:53.997187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:53.998397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:54.009994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:54.011102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:54.011831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:54.014407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:54.017407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:54.018402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:54.546499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:54.556951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bd43adfe-43ea-4c7d-844a-ceaac5d93149 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.610295 Oct 29 21:06:54.558252 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2305/4724] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:53 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:54.578614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:54.589958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d740ba3-5852-4ca2-9f1b-af162a75d975 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.598272 Oct 29 21:06:54.590785 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2420/4725] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:53 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:54.972733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:54.973751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:54.980423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:54.983933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:54.984834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:54.985949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:54.986861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:54.987766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.013659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9550bd8b-ed76-4236-af46-ea4bb91ef15d req-09edf04d-c981-4449-9b12-7a1af870674d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:55.055329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9550bd8b-ed76-4236-af46-ea4bb91ef15d req-09edf04d-c981-4449-9b12-7a1af870674d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.057311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9550bd8b-ed76-4236-af46-ea4bb91ef15d req-09edf04d-c981-4449-9b12-7a1af870674d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.058076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9550bd8b-ed76-4236-af46-ea4bb91ef15d req-09edf04d-c981-4449-9b12-7a1af870674d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.078755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9550bd8b-ed76-4236-af46-ea4bb91ef15d req-09edf04d-c981-4449-9b12-7a1af870674d service nova] Creating event network-changed:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:06:55.085641 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9550bd8b-ed76-4236-af46-ea4bb91ef15d req-09edf04d-c981-4449-9b12-7a1af870674d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076051 Oct 29 21:06:55.086723 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2421/4726] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:06:55.096022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:55.096962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:55.104621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.105118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.105581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.106764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.107412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.107841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.481189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:55.494194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0bafbb0f-cf4b-4a98-a536-d5fd996c9d1b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.524995 Oct 29 21:06:55.495285 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2306/4727] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:54 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:55.556357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:55.567122 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de00097f-e251-4f6b-b686-2794dc505fcc tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1502 microversion: 2.1 time: 0.478846 Oct 29 21:06:55.568435 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2422/4728] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:55 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:55.584025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:55.586145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:55.590422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad95b75c-823e-4b6d-a11d-3d28a0934e26 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:55.594561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.594998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.595511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.596287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.596746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.597647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.598901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad95b75c-823e-4b6d-a11d-3d28a0934e26 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.599567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad95b75c-823e-4b6d-a11d-3d28a0934e26 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.600192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad95b75c-823e-4b6d-a11d-3d28a0934e26 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.634364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad95b75c-823e-4b6d-a11d-3d28a0934e26 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Going to try to stop instance {{(pid=138885) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:06:55.731374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad95b75c-823e-4b6d-a11d-3d28a0934e26 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a/action" status: 202 len: 0 microversion: 2.1 time: 0.144697 Oct 29 21:06:55.735898 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2423/4729] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:06:55 2022] POST /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:06:55.744627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:55.748735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:55.760510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.761400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.762074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:55.762999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:55.763625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:55.764240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:56.084645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:56.100850 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d3eae083-5ec7-4e93-b8fb-dd7d4231b0a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.522265 Oct 29 21:06:56.103669 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2307/4730] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:55 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:56.110912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:56.114093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:56.134029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:56.134864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:56.136852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:56.137711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:56.138188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:56.139000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:56.165734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:56.174310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2817dd3-a346-40bd-a9de-826ea9807401 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.436902 Oct 29 21:06:56.174942 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2424/4731] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:55 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:56.359893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:56.369690 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5078c55a-41b3-4fc9-8fbc-d91bb1dddb1f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.264650 Oct 29 21:06:56.372361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2308/4732] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:56 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:56.390183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-81ba1ac6-b9aa-4515-a708-e6efeef56252 req-aed8c2bc-edea-45eb-8913-64b8e62bbd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafab2fe-44ea-428b-95ab-85c953df9675", "tag": "0aefd86a-8ed6-4932-871d-0aa364162209"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:56.401428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-81ba1ac6-b9aa-4515-a708-e6efeef56252 req-aed8c2bc-edea-45eb-8913-64b8e62bbd98 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:56.403247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-81ba1ac6-b9aa-4515-a708-e6efeef56252 req-aed8c2bc-edea-45eb-8913-64b8e62bbd98 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:56.403975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-81ba1ac6-b9aa-4515-a708-e6efeef56252 req-aed8c2bc-edea-45eb-8913-64b8e62bbd98 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:56.416913 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-81ba1ac6-b9aa-4515-a708-e6efeef56252 req-aed8c2bc-edea-45eb-8913-64b8e62bbd98 service nova] Creating event network-changed:0aefd86a-8ed6-4932-871d-0aa364162209 for instance fafab2fe-44ea-428b-95ab-85c953df9675 on nch2-master-1 Oct 29 21:06:56.423342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-81ba1ac6-b9aa-4515-a708-e6efeef56252 req-aed8c2bc-edea-45eb-8913-64b8e62bbd98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037107 Oct 29 21:06:56.424452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2425/4733] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:06:56.521143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:56.521780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:56.528646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:56.529131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:56.529595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:56.530475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:56.531117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:56.531774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:56.722367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:56.761126 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32551d9a-5599-402b-bebc-ae0ab5a30a1c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.243744 Oct 29 21:06:56.765673 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2309/4734] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:56 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:57.131922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:57.135538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:57.142070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e37088b6-c351-46ab-8019-1e52c362fc64 req-60b1c03d-3552-4a85-9537-302b15d250c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:06:57.157831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:57.162769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:57.164359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e37088b6-c351-46ab-8019-1e52c362fc64 req-60b1c03d-3552-4a85-9537-302b15d250c1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.166259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e37088b6-c351-46ab-8019-1e52c362fc64 req-60b1c03d-3552-4a85-9537-302b15d250c1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.166742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e37088b6-c351-46ab-8019-1e52c362fc64 req-60b1c03d-3552-4a85-9537-302b15d250c1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.167979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.168466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.169051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.171795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.172282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.172749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.189491 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e37088b6-c351-46ab-8019-1e52c362fc64 req-60b1c03d-3552-4a85-9537-302b15d250c1 service nova] Creating event network-changed:51d03947-ece9-475c-b20e-71c5f2dcc21b for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee on nch1-master-1 Oct 29 21:06:57.203677 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e37088b6-c351-46ab-8019-1e52c362fc64 req-60b1c03d-3552-4a85-9537-302b15d250c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065456 Oct 29 21:06:57.217834 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2310/4735] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:06:57.230109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:57.230825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:57.243114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.243847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.244638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.246546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.247413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.248009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.464433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:57.474358 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43bcc5aa-c186-4834-b967-f56d813c56a2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.349800 Oct 29 21:06:57.482563 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2426/4736] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:57 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:57.490078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:57.491012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:57.508535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.509987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.510612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.511585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.512044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.512470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.578048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:57.581066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:57.593062 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-24dcd61e-b1ed-4d7b-81f3-943f504bd831 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.373623 Oct 29 21:06:57.594197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2311/4737] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:57 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:57.769011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:57.778245 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-719b9dd8-0f54-4479-baf2-e32c594410da tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.294271 Oct 29 21:06:57.778973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2427/4738] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:57 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:57.787002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:57.787755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:57.803196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:57.809930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.810460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.812357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:57.815176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:57.815874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:57.816689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:58.406597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:58.509488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:58.510697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:58.517008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:06:58.527710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:58.528541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:58.529337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:58.534775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:58.535577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:58.536298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:58.786811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:58.796929 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c478b99f-57cd-47a4-81c6-3877991e2a12 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 1.015248 Oct 29 21:06:58.799849 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2312/4739] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:57 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:58.809820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:58.809820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:58.818274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:58.818274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:58.818274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:58.818274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:58.818274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:58.818274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:59.151591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:59.159433 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cda79e43-76fe-43ae-abc4-f0f109294fd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.659277 Oct 29 21:06:59.175640 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2428/4740] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:58 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:59.181413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:59.182271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:59.217666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:59.218437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:59.219432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:59.220333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:59.220954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:59.221967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:59.337909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:59.346457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8fc5807f-53e5-4044-a94e-ebf6f7631c0a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.545091 Oct 29 21:06:59.354888 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2313/4741] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:58 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:59.836255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:06:59.836945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:06:59.842126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:06:59.854221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2d85b6d-97e8-42b0-a18e-2954ba84ff29 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.676222 Oct 29 21:06:59.854820 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2429/4742] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:59 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:06:59.868900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:59.869400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:59.873946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:06:59.874713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:06:59.875176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:06:59.875620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.184787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:00.185528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:00.193235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:00.193844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:00.194371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.195162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:00.196365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:00.196751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.359482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:00.372146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-59fb82ad-ebbf-4481-aab9-281bde23fc59 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.541640 Oct 29 21:07:00.388674 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2314/4743] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:06:59 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:00.394447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:00.395730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:00.402494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:00.403117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:00.403812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.404586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:00.405359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:00.406483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.619063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:00.628191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb35c1ba-26b1-4ed8-a373-164d4194ccf1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.448477 Oct 29 21:07:00.628779 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2430/4744] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:00 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:00.881603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:00.882238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:00.899265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:00.899782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:00.900234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.900964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:00.901430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:00.901901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:00.942961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:00.959500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d4ceabf1-84ca-4f54-ba26-279009bf42db tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.569264 Oct 29 21:07:00.965438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2315/4745] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:00 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:01.397011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:01.397620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:01.417718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:01.419888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:01.422399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:01.427320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:01.431403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:01.433416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:02.679060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:02.695388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5b5b1bb7-052b-424c-abe9-57fb64483bdf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 1.302499 Oct 29 21:07:02.701217 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2316/4746] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:01 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:02.730258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:02.733235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:02.751916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:02.764333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:02.765559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:02.767342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:02.768802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:02.770671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:02.771570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:02.772673 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8832dc99-9074-4959-b79e-75757eb87d7e tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 1.893697 Oct 29 21:07:02.795331 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2431/4747] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:00 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:02.804505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:02.808094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:02.828642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:02.830260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:02.831453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:02.834071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:02.835437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:02.836122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:03.102644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:03.138323 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b101f73-177a-4646-9e5f-8b62fb19179a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.420038 Oct 29 21:07:03.144386 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2317/4748] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:02 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:03.213390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:03.230582 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87725729-9674-46c9-bbce-3ce3251cbf5a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.432642 Oct 29 21:07:03.231385 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2432/4749] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:02 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:03.734041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:03.735548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:03.748997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:03.751586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:03.755721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:03.756732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:03.757378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:03.758017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:03.806704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:03.807482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:03.822288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:03.831532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:03.841254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:03.842405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:03.843007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:03.843564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:04.249529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:04.267466 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98d5664a-2ca8-4a01-b0a2-7590a17d89b8 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.538752 Oct 29 21:07:04.284842 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2318/4750] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:03 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:04.284842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:04.284842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:04.284842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:04.286308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:04.286308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:04.287085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:04.287341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:04.287775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:04.418545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:04.433967 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-467f67da-0504-446e-a6d8-a229f1551f72 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.633851 Oct 29 21:07:04.434916 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2433/4751] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:03 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:04.447695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:04.450687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:04.469349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:04.471980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:04.473409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:04.476506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:04.477008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:04.477498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:04.904280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:04.909865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:04.923013 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9af0ecb6-7628-4dea-a553-a57c529ff587 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.652990 Oct 29 21:07:04.925537 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2319/4752] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:04 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:04.937997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0957c55b-ce2c-47f3-aa40-46889c566794 req-ebdc3935-e8ea-4c72-91e6-8def103ae76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "name": "network-vif-plugged", "status": "completed", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:04.956626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:04.967729 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a8b3451-51a6-4e9f-ab88-8e12d2de6823 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.530117 Oct 29 21:07:04.975812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0957c55b-ce2c-47f3-aa40-46889c566794 req-ebdc3935-e8ea-4c72-91e6-8def103ae76c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:04.976308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0957c55b-ce2c-47f3-aa40-46889c566794 req-ebdc3935-e8ea-4c72-91e6-8def103ae76c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:04.976751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0957c55b-ce2c-47f3-aa40-46889c566794 req-ebdc3935-e8ea-4c72-91e6-8def103ae76c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:04.979285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2434/4753] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:04 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:05.011633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0957c55b-ce2c-47f3-aa40-46889c566794 req-ebdc3935-e8ea-4c72-91e6-8def103ae76c service nova] Creating event network-vif-plugged:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:07:05.027101 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0957c55b-ce2c-47f3-aa40-46889c566794 req-ebdc3935-e8ea-4c72-91e6-8def103ae76c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098992 Oct 29 21:07:05.027981 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2320/4754] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:05.302324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:05.303598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:05.315567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:05.316405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:05.318456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:05.320345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:05.323148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:05.324631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:05.460159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:05.461300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:05.482166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:05.483173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:05.485130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:05.488516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:05.491077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:05.492083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:06.090658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:06.135523 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e0b0de5-d1cd-4db5-b49d-4042c86bfa80 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.845785 Oct 29 21:07:06.140379 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2435/4755] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:05 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:06.159289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:06.161799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:06.180611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:06.181144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:06.181633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:06.182361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:06.182822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:06.183256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:06.284442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:06.302165 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1e8c626-c20b-48f6-92f6-0ae2ea5ec0ce tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.846374 Oct 29 21:07:06.303402 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2321/4756] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:05 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:06.322543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:06.324059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:06.334923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:06.338739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:06.339518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:06.343701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:06.345657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:06.351295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:06.756152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:06.772794 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-47ea046f-a7ef-452f-80c6-e52c8af21387 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.464446 Oct 29 21:07:06.773625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2322/4757] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:06 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:06.833928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:06.847351 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d589bd4d-c695-43db-af51-c61137c387f6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.703040 Oct 29 21:07:06.871177 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2436/4758] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:06 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:07.172637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:07.172637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:07.184802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.193565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.197061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.203050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.203799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.206052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.332913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:07.334144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:07.343568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.349899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.350407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.351160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.354395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.360161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.704272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:07.718751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84b06bd8-02f8-4200-b1fb-fec417fc60ab tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.552654 Oct 29 21:07:07.722749 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2323/4759] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:07 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:07.734524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-94e354f1-5858-4116-9e47-adedc7c3ff2f req-084ff2da-7a97-441f-be39-a972007618ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafab2fe-44ea-428b-95ab-85c953df9675", "name": "network-vif-plugged", "status": "completed", "tag": "0aefd86a-8ed6-4932-871d-0aa364162209"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:07.747400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94e354f1-5858-4116-9e47-adedc7c3ff2f req-084ff2da-7a97-441f-be39-a972007618ea service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.748232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94e354f1-5858-4116-9e47-adedc7c3ff2f req-084ff2da-7a97-441f-be39-a972007618ea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.748900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94e354f1-5858-4116-9e47-adedc7c3ff2f req-084ff2da-7a97-441f-be39-a972007618ea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.776846 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-94e354f1-5858-4116-9e47-adedc7c3ff2f req-084ff2da-7a97-441f-be39-a972007618ea service nova] Creating event network-vif-plugged:0aefd86a-8ed6-4932-871d-0aa364162209 for instance fafab2fe-44ea-428b-95ab-85c953df9675 on nch2-master-1 Oct 29 21:07:07.779126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:07.782647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-94e354f1-5858-4116-9e47-adedc7c3ff2f req-084ff2da-7a97-441f-be39-a972007618ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057944 Oct 29 21:07:07.784001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2324/4760] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:07.789369 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-990b38c7-4d67-41a6-bb1b-87518040e1f0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.461871 Oct 29 21:07:07.790072 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2437/4761] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:07 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:07.813322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:07.814147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:07.821415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.821955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.822958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.823692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.824162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.824647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.875253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:07.876404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:07.915515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.916357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.920621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:07.921870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:07.923232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:07.923902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:08.227295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:08.236117 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f9fcc1c8-4a18-40fc-97b9-20a394eff4e2 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1323 microversion: 2.1 time: 0.432189 Oct 29 21:07:08.240741 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2325/4762] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:07 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:08.299743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:08.313042 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb919ffa-2546-41ea-84df-fbbb8b86a480 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1314 microversion: 2.1 time: 0.443863 Oct 29 21:07:08.314093 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2438/4763] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:07 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:08.753634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:08.756068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:08.782118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:08.786748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:08.787531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:08.790472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:08.792818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:08.794840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:08.820813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:08.821500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:08.838279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:08.842254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:08.849722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:08.855015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:08.855829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:08.856508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.111771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:10.123655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26defb31-7a81-4b9e-98e1-d2ddb4b84855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 1.374939 Oct 29 21:07:10.127470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2326/4764] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:08 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:10.128207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:10.140825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:10.142192 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc5a53d8-93a7-4d46-b4c3-93dab8709396 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 1.329041 Oct 29 21:07:10.143368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:10.162700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.163608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.165202 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2439/4765] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:08 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:10.165678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.166697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.169791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.174865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.180291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:10.188546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:10.224409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.227633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.228104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.228841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.236813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.237374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.673440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:10.696368 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9ed7a1a2-5088-40cf-8dfe-a33f3cfe7e0b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1518 microversion: 2.1 time: 0.563540 Oct 29 21:07:10.699284 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2327/4766] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:10 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1518 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:10.731842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:10.742624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:10.761384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:10.770431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.771100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.771658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.774943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.775547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.776092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.776786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59762817-13f3-405d-b439-7a727d8ed7e9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1501 microversion: 2.1 time: 0.606623 Oct 29 21:07:10.779100 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2440/4767] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:10 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1501 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:10.804144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dae2ebd7-f7d4-4767-a66a-25c50d9029a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:10.814973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dae2ebd7-f7d4-4767-a66a-25c50d9029a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:10.819010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dae2ebd7-f7d4-4767-a66a-25c50d9029a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:10.819830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dae2ebd7-f7d4-4767-a66a-25c50d9029a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:10.869050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lazy-loading 'flavor' on Instance uuid 26866831-09f1-497e-a037-571a033b29d3 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:07:10.881587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dae2ebd7-f7d4-4767-a66a-25c50d9029a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Going to try to stop instance {{(pid=138885) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:07:10.989946 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dae2ebd7-f7d4-4767-a66a-25c50d9029a7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675/action" status: 202 len: 0 microversion: 2.1 time: 0.188545 Oct 29 21:07:10.992851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2441/4768] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:10 2022] POST /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:07:11.015773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:11.016506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:11.048804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:11.049429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:11.049893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:11.052020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:11.052742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:11.053558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:11.079482 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d0ca41d-e4c4-4bbd-82b9-f244bb0ba549 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action" status: 200 len: 32 microversion: 2.1 time: 0.356103 Oct 29 21:07:11.083305 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2328/4769] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:10 2022] POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:07:11.117511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:11.119502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:11.144273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:11.144823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:11.145267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:11.146024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:11.146488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:11.147092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:11.979357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:11.988097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c304212-5035-4ba2-b219-885e01686abe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.990218 Oct 29 21:07:11.989232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2442/4770] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:10 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:12.006438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:12.010736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:12.027837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:12.028807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:12.029472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:12.030430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:12.031102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:12.031750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:12.037227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:12.098002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:12.131400 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ada623b-937d-4d08-adfd-71e56f507712 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 1.031303 Oct 29 21:07:12.146267 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2329/4771] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:11 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:12.159498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:12.161924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:12.178748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:12.179609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:12.181408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:12.183667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:12.184352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:12.187160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:12.939572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:12.954555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e8de140c-abd5-4163-a35a-d43c9ddd5ba5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.957384 Oct 29 21:07:12.955279 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2443/4772] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:11 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:13.018759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:13.020670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:13.034729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:13.036010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:13.040361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:13.041330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:13.041975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:13.050040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:13.233785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:13.261431 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fb8a8ba0-6fe1-4d61-9a28-fc778bbde709 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 1.106006 Oct 29 21:07:13.287434 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2330/4773] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:12 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:13.313734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:13.315002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:13.329553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:13.331612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:13.332872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:13.333943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:13.335870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:13.336626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:14.103118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:14.120333 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e38d9a17-bb65-4477-85bf-f1fcc7180e71 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.828995 Oct 29 21:07:14.122342 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2331/4774] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:13 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:14.129020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:14.129924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:14.139697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:14.141531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:14.142892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:14.143853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:14.146483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:14.148404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:14.288919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:14.311405 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f202b35f-3ac0-49bd-8930-acdc6fe8683d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 1.296377 Oct 29 21:07:14.338320 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2444/4775] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:13 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:14.346261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:14.346906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:14.357123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:14.357717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:14.358230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:14.359047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:14.359572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:14.360070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:14.503142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:14.511339 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbbd1f3b-9327-4599-a05c-9741be5dc338 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.388213 Oct 29 21:07:14.512609 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2332/4776] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:14 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:14.557892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:14.568798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f66fdd34-e62e-40a3-b22e-a645e4201601 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.229289 Oct 29 21:07:14.569557 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2445/4777] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:14 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:15.149249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:15.150099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:15.160697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:15.161201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:15.161683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:15.162410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:15.162869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:15.163304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:15.354697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:15.356004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:15.374244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:15.374737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:15.375174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:15.376115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:15.376785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:15.377408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:15.561653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:15.577207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-448a414d-cbc2-401d-9e0b-edadf1fc0887 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.432531 Oct 29 21:07:15.577938 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2333/4778] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:15 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:15.587207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:15.588119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:15.598395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:15.599526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:15.600228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:15.601788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:15.602523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:15.603200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:16.401313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:16.420544 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e1f9091-f7bf-4370-ae54-a2fb56746da3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 1.071452 Oct 29 21:07:16.421125 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2446/4779] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:15 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:16.445234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:16.446815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:16.457055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:16.457779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:16.462577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:16.476298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:16.477536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:16.478844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:16.480184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:16.480714 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94586301-352c-42f9-826c-5084d87f867c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.899971 Oct 29 21:07:16.481978 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2334/4780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:15 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:16.604545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:16.605396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:16.619336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:16.620067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:16.620721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:16.621657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:16.622283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:16.622980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:17.108667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:17.121702 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d7f8a60d-081d-4ca1-9f5f-3df94d47d918 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.682111 Oct 29 21:07:17.123384 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2447/4781] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:16 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:17.246946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:17.256707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:17.262084 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36292f8a-cd8b-40f6-ae51-72308902f44f tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.662202 Oct 29 21:07:17.263183 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2335/4782] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:16 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:17.448337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:17.449394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:17.471742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:17.473234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:17.474279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:17.481804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:17.482428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:17.483088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:17.511150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:17.512092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:17.538556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:17.539399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:17.542091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:17.543709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:17.545829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:17.549666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:17.713997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:17.728739 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41a02461-f66d-4021-ba30-a3798c2b98c1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.287918 Oct 29 21:07:17.733783 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2448/4783] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:17 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:17.787173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:17.797333 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c25b5ff-2274-4e84-a9cd-c3c93a5c74e6 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.294281 Oct 29 21:07:17.809623 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2336/4784] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:17 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:18.150290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:18.151382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:18.158122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.159005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.159558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.161493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.162096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.162636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.242525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:18.243604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:18.253065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.253948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.254878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.255763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.256387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.256989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.286543 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6b5cac45-30b3-4de9-bdeb-0355cbc3a672 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/ips" status: 200 len: 146 microversion: 2.1 time: 0.049032 Oct 29 21:07:18.287992 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2337/4785] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:07:18 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:07:18.297003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:18.298198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:18.316511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.317297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.319041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.320288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.320918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.322074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.467204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:18.482695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-22f3f704-29c6-4354-93be-2628ae636dad tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.336602 Oct 29 21:07:18.490733 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2449/4786] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:18 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:18.626846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:18.637538 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5cce3445-a091-41f7-b289-f04550b8b7f9 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.348143 Oct 29 21:07:18.642109 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2338/4787] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:18 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:18.758338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:18.760028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:18.767850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.769838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.770563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.773376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:18.775267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:18.776035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:18.921543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87393b05-ee6d-468a-9feb-69de3d22ed1e tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170319670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2006533936", "description": "tempest-description-20522212"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:19.062152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:19.074225 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad848717-c0f6-4c64-b356-f7cd39f6d826 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.322012 Oct 29 21:07:19.074816 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2339/4788] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:18 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:19.079431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:19.080055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:19.094561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:19.095065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:19.095906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:19.096787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:19.097984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:19.098420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:19.473894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87393b05-ee6d-468a-9feb-69de3d22ed1e tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.765588 Oct 29 21:07:19.475225 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2450/4789] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:19.490601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4376d5cd-3b5f-4ecb-8fdc-d7fcebe95f0a tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa1702514c0>, body: {"security_group_rule": {"parent_group_id": "6ea916f4-ba58-4848-89ba-aa0f896e5cc7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:20.107427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:20.120940 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6d1645f-9032-4d5d-9892-53f556d58d15 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 1.044764 Oct 29 21:07:20.136336 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2340/4790] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:19 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:20.148402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:20.149032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:20.173710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:20.174223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:20.174660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:20.175727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:20.185917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:20.186440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:20.608923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:20.627215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b806761-3b00-4247-ae59-bd8845a706fa tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1512 microversion: 2.1 time: 0.483761 Oct 29 21:07:20.628616 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2341/4791] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:20 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:20.636670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:20.637665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:20.646357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=85 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:20.651370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:20.651898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:20.652567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:20.654227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:20.659343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:20.661855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:20.775459 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4376d5cd-3b5f-4ecb-8fdc-d7fcebe95f0a tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.286431 Oct 29 21:07:20.777743 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2451/4792] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 21:07:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:07:20.783208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:20.784087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:20.793152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:20.793936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:20.796604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:20.798329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:20.799554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:20.800189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:20.979377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:20.986052 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3766743a-f5a6-473b-9529-402d882fc37c tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.355847 Oct 29 21:07:21.002727 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2342/4793] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:20 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:21.007926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-01d5daf8-ad93-41aa-bee0-f5be5efab796 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170e99d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-916970121", "description": "tempest-description-773452110"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:21.122234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:21.145009 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f0cd9f7-f70d-4e0d-a339-ad1395e555d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.364250 Oct 29 21:07:21.146607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2452/4794] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:20 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:21.156044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c40a99ee-b65d-4555-8a47-9a9439c99cae"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:21.159646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:21.166927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:21.168152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:21.168793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:21.169727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:21.170434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:21.171117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:21.436039 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-01d5daf8-ad93-41aa-bee0-f5be5efab796 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.431952 Oct 29 21:07:21.447669 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2343/4795] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:21.457750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:21.458798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:21.465738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:21.466818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:21.467491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:21.468371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:21.468981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:21.469657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:21.561537 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412140 Oct 29 21:07:21.568789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2453/4796] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:07:21 2022] POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:21.574667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68249401-159d-46cf-bb8b-50f4a7871352 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa1701c4dc0>, body: {"security_group_rule": {"parent_group_id": "102825f7-ab64-4334-865f-33748bd797fb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:22.002540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:22.020887 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-570b86b5-d735-431e-a7ca-4a4ee50b5a7d tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.570969 Oct 29 21:07:22.023005 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2344/4797] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:21 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:22.033348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:22.036307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:22.052891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.054931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.056829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.058417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.060279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.062700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.316682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:22.329996 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b29ee4c-bda2-4047-9722-5d029797e255 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1489 microversion: 2.1 time: 0.299173 Oct 29 21:07:22.332466 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2345/4798] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:22 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1489 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:22.339003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:22.339628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:22.349757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.351258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.352017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.353925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.354603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.355331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.376997 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68249401-159d-46cf-bb8b-50f4a7871352 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.806567 Oct 29 21:07:22.385537 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2454/4799] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 21:07:21 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:22.385537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:22.388548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:22.413884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.414718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.416800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.418146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.419118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.429619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.710970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:22.725047 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ba1e405-9f5e-43ba-8cde-f95df75276d1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.345692 Oct 29 21:07:22.737671 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2455/4800] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:22 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:22.744404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:22.744404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:22.771091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.771768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.774747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.776306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:22.777266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:22.777784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:22.778393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:22.786006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6467143b-19b3-4557-a13c-63e009a5db9d tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.452024 Oct 29 21:07:22.787249 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2346/4801] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:22 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:22.792108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54cc6071-6057-4443-9ab0-fb02141d5014 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170e7b670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1585876296", "description": "tempest-description-1460655735"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:22.849405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:07:23.037183 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ac2764c-701d-42a9-baf5-7eb4d524acc0 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 204 len: 0 microversion: 2.1 time: 0.306843 Oct 29 21:07:23.038304 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2456/4802] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:07:22 2022] DELETE /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:07:23.048421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:23.049925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:23.058046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:23.059053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:23.059853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:23.060794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:23.061426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:23.062041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:23.107085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54cc6071-6057-4443-9ab0-fb02141d5014 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.318512 Oct 29 21:07:23.108417 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2347/4803] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:23.114791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:23.115665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:23.133961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:23.134968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:23.138269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:23.139660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:23.140577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:23.141250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:23.342105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:23.351614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-698e5b14-398c-4147-90e4-ff7291d59b4b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1495 microversion: 2.1 time: 0.307949 Oct 29 21:07:23.352218 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2457/4804] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:23 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1495 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:23.364481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-24cf17d7-d656-4b27-bb49-bff589e78879 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa1701c4940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-780415696", "description": "tempest-description-809290902"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:23.467931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:23.479083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0167be4d-c5bb-4a13-a301-32cbf5742f91 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.367039 Oct 29 21:07:23.480096 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2348/4805] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:23 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:23.614234 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-24cf17d7-d656-4b27-bb49-bff589e78879 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.255729 Oct 29 21:07:23.615428 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2458/4806] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:23 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:23.629529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0599bc5-a6d8-4572-a476-84651c48ee9e tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170e7b040>, body: {"security_group_rule": {"parent_group_id": "a5ee9053-26b6-44c4-b226-6f78472da767", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5fb90f4f-3786-479f-9502-724ceb0b7d1e"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:23.753323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:23.754022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:23.762404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:23.763199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:23.764561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:23.765987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:23.774268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:23.774997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:24.084734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:24.101104 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-32a9aff3-b36c-48e5-91dc-8fa31bf5618f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.352751 Oct 29 21:07:24.117570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2459/4807] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:23 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:24.134427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:24.135207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:24.152081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:24.156817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:24.157419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:24.158369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:24.158992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:24.159509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:24.306297 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0599bc5-a6d8-4572-a476-84651c48ee9e tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.678585 Oct 29 21:07:24.307971 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2349/4808] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 21:07:23 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:24.338566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f6dc511-387e-42bd-8cad-5458f7006e31 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170e8eca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2129882238", "description": "tempest-description-1182583910"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:24.432868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:24.437341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:24.448270 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf49c390-e3e2-44f7-91a5-a8a590797136 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.329400 Oct 29 21:07:24.450982 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2460/4809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:24 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:24.462185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:24.462816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:24.480942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:24.481794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:24.484885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:24.485862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:24.491267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:24.491898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:24.922773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f6dc511-387e-42bd-8cad-5458f7006e31 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.602780 Oct 29 21:07:24.923919 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2350/4810] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:24.929420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:24.930286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:24.961079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:24.963862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:24.964454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:24.966519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:24.967909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:24.970345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:25.001088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:25.014265 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a38c1662-56fd-4b51-aded-5e3d2e2223ca tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1495 microversion: 2.1 time: 0.562164 Oct 29 21:07:25.015401 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2461/4811] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:24 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1495 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:25.040200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-426ebf78-4bdf-4145-8a7e-8a6c25946ca8 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170290b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-423299421", "description": "tempest-description-725014331"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:25.402386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:25.418346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a37e74ac-0fc0-4bde-af0b-48f4fb0a0276 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.493066 Oct 29 21:07:25.435861 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2351/4812] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:24 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:25.441944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:25.442576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:25.449365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:25.450090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:25.450723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:25.451604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:25.452234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:25.452666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:25.810593 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-426ebf78-4bdf-4145-8a7e-8a6c25946ca8 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.793052 Oct 29 21:07:25.812468 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2462/4813] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:25 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:25.828416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eecab6c9-55c5-4b30-9587-ddce68f25b90 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:25.875109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eecab6c9-55c5-4b30-9587-ddce68f25b90 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:25.878955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eecab6c9-55c5-4b30-9587-ddce68f25b90 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:25.880412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eecab6c9-55c5-4b30-9587-ddce68f25b90 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:25.931103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:25.939943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eecab6c9-55c5-4b30-9587-ddce68f25b90 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Going to try to stop instance {{(pid=138885) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:07:25.940153 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-864a3b0f-51c9-40dd-b21f-deb6c2eed7ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.502702 Oct 29 21:07:25.940612 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2352/4814] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:25 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:25.958162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:25.958789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:25.974168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:25.974667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:25.975116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:25.975848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:25.976297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:25.976736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:26.033709 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eecab6c9-55c5-4b30-9587-ddce68f25b90 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action" status: 202 len: 0 microversion: 2.1 time: 0.217963 Oct 29 21:07:26.037476 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2463/4815] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:25 2022] POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:26.060279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a8a48c3-870d-4e3b-bd39-8503a8c0a08b tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170145430>, body: {"security_group_rule": {"parent_group_id": "c452f194-70e3-4a5b-8e1f-c240d0f632f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9616ca27-aca7-4f69-b217-4c88b2e0bb51"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:26.384889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:26.410392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02615d0a-e171-4fd2-863b-371af70dcdd4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.464817 Oct 29 21:07:26.413619 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2353/4816] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:25 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:26.422776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-33b8d3cd-7883-4998-9e6c-a26c8d6c0cd5 req-49fd3060-d1d0-4eb9-8838-8b1ac8ec41fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a", "name": "network-vif-deleted", "tag": "e720f11d-3662-48b2-9ab5-2600931f8ec2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:26.446841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-33b8d3cd-7883-4998-9e6c-a26c8d6c0cd5 req-49fd3060-d1d0-4eb9-8838-8b1ac8ec41fe service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:26.447700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-33b8d3cd-7883-4998-9e6c-a26c8d6c0cd5 req-49fd3060-d1d0-4eb9-8838-8b1ac8ec41fe service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:26.448458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-33b8d3cd-7883-4998-9e6c-a26c8d6c0cd5 req-49fd3060-d1d0-4eb9-8838-8b1ac8ec41fe service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:26.470541 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-33b8d3cd-7883-4998-9e6c-a26c8d6c0cd5 req-49fd3060-d1d0-4eb9-8838-8b1ac8ec41fe service nova] Creating event network-vif-deleted:e720f11d-3662-48b2-9ab5-2600931f8ec2 for instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a on nch1-master-1 Oct 29 21:07:26.477713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-33b8d3cd-7883-4998-9e6c-a26c8d6c0cd5 req-49fd3060-d1d0-4eb9-8838-8b1ac8ec41fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062398 Oct 29 21:07:26.479637 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2354/4817] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:26.489017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:26.489879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:26.498072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:26.498878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:26.499435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:26.500277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:26.500986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:26.501647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:26.542791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:26.543278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:26.543717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:26.544178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'fault' on Instance uuid e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:07:27.036333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:27.045757 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bf0d1f1-f71b-4c97-a11c-75da0a90967c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 200 len: 1304 microversion: 2.1 time: 0.564295 Oct 29 21:07:27.047799 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2355/4818] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:26 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 1304 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:27.059514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:27.060132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:27.070929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.071537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.072112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.073210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.073821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.074409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.384648 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a8a48c3-870d-4e3b-bd39-8503a8c0a08b tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.342036 Oct 29 21:07:27.385994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2464/4819] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 21:07:26 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:27.399369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-270521f9-9d37-4f8c-90c9-9e8d34495670 req-50ce74e5-6676-4a2a-8ce3-ef345439f350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "name": "network-vif-plugged", "status": "completed", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:27.401978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:27.411941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-270521f9-9d37-4f8c-90c9-9e8d34495670 req-50ce74e5-6676-4a2a-8ce3-ef345439f350 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.412736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-270521f9-9d37-4f8c-90c9-9e8d34495670 req-50ce74e5-6676-4a2a-8ce3-ef345439f350 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.413446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-270521f9-9d37-4f8c-90c9-9e8d34495670 req-50ce74e5-6676-4a2a-8ce3-ef345439f350 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.416547 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1c085d3a-69de-4cd9-91bb-1d8b4a569067 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1723 microversion: 2.1 time: 0.360834 Oct 29 21:07:27.417508 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2356/4820] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:27 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:27.425661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:27.426538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:27.436432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.438081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.438826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.439748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.442122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.443185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.445949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-270521f9-9d37-4f8c-90c9-9e8d34495670 req-50ce74e5-6676-4a2a-8ce3-ef345439f350 service nova] Creating event network-vif-plugged:51d03947-ece9-475c-b20e-71c5f2dcc21b for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee on nch1-master-1 Oct 29 21:07:27.449842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:27.459969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-270521f9-9d37-4f8c-90c9-9e8d34495670 req-50ce74e5-6676-4a2a-8ce3-ef345439f350 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061620 Oct 29 21:07:27.462526 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2465/4821] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:27.480453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:27.482423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:27.500553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.501074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.501548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.502480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.502945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.504092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.783657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:27.793293 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7fd9d26-8549-482b-a89b-dd076bca58c5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.374572 Oct 29 21:07:27.809813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:27.810151 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2357/4822] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:27 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:27.815002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-905288df-93ac-447a-a2f9-4460698fb606 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170e7bb80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:27.823610 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b444ca8-4c77-4f4b-a763-971a70fc795d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.359222 Oct 29 21:07:27.825375 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2466/4823] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:27 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:27.834107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:27.835068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:27.841725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.843128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.843987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:27.844666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:27.845336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:27.845994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:28.149058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:28.163284 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee523ce8-75f8-4dfc-b464-82aad3fc55af tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.335052 Oct 29 21:07:28.164868 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2467/4824] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:27 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:28.173277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:28.174302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:28.189283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:28.191918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:28.192887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:28.195385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:28.196035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:28.196626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:28.222926 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a HTTP/1.1 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a'} Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:28.224631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:28.229203 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-99764103-6c8c-4c4e-8250-0fa6bc81f2c5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 404 len: 111 microversion: 2.1 time: 0.059370 Oct 29 21:07:28.246245 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2468/4825] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:28 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:07:28.345250 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-905288df-93ac-447a-a2f9-4460698fb606 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/9616ca27-aca7-4f69-b217-4c88b2e0bb51" status: 202 len: 0 microversion: 2.1 time: 0.533904 Oct 29 21:07:28.346091 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2358/4826] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:27 2022] DELETE /compute/v2.1/os-security-groups/9616ca27-aca7-4f69-b217-4c88b2e0bb51 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:28.355942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5787801-0621-4904-a7ce-64e8c2ad17c1 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa1701c4e50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:28.374835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1200747817", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "56091c1f-37a8-4b8f-94ea-0056799483df"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:28.455182 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5787801-0621-4904-a7ce-64e8c2ad17c1 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/c452f194-70e3-4a5b-8e1f-c240d0f632f3" status: 200 len: 248 microversion: 2.1 time: 0.103711 Oct 29 21:07:28.470706 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2469/4827] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 21:07:28 2022] GET /compute/v2.1/os-security-groups/c452f194-70e3-4a5b-8e1f-c240d0f632f3 => generated 248 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:28.479829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:28.480105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] validate_networks() for [('56091c1f-37a8-4b8f-94ea-0056799483df', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:07:28.480820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:28.492181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:28.495908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:28.496450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:28.497279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:28.497825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:28.498488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:28.943064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:28.955640 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f501513-6ba1-4468-acff-7e8715a564df tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1723 microversion: 2.1 time: 0.483296 Oct 29 21:07:28.969564 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2470/4828] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:28 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1723 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:28.969564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a05a79f-942d-42ef-b61e-5201da344baa tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa1701b3310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1909716716", "description": "tempest-description-911120160"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:29.361754 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a05a79f-942d-42ef-b61e-5201da344baa tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.402943 Oct 29 21:07:29.367144 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2471/4829] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:29.377841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:29.380958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:29.393351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:29.396852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.398794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.399894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.400997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.401787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.426914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.490908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:07:29.491354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:07:29.491677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:07:29.492198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:07:29.493181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:07:29.509875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.513139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.513705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.514524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.515000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.517650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.549588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:07:29.557099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Getting quotas for user 282339dc65a54bc99850b172ed427d75 and project 6a46c1f647934440925ebc5e0b373ca0. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:07:29.581877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:07:29.585108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:07:29.639896 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12a5fa54-df27-41e1-b1ff-9eaf971d917c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270005 Oct 29 21:07:29.640976 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2359/4830] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:07:29.647824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:29.650839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:29.669384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.669947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.670400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.671123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.671583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.672012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.759869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:29.770900 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-11b42c4d-7fb8-49d6-9a2f-1f3b91f1ccf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1519 microversion: 2.1 time: 0.402127 Oct 29 21:07:29.771500 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2472/4831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:29 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:29.786886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:29.787518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:29.805004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.807557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.808014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:29.808750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:29.809215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:29.811696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:30.264288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:30.273627 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20d18e60-a731-4e48-8f24-a63a6b7bf1f1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.499506 Oct 29 21:07:30.285480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2473/4832] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:29 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:30.285480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-af82f478-8b18-4664-a919-6472bae4fd00 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170145dc0>, body: {"security_group_rule": {"parent_group_id": "7bca9851-5145-4b60-9517-360d53054436", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:30.349382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:30.360560 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cf9dd56c-e334-4a0e-99b0-38e364bcc261 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.718379 Oct 29 21:07:30.363209 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2360/4833] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:29 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:30.387270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-33eb1c94-3258-4804-8891-d2d500235f08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:30.388021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-33eb1c94-3258-4804-8891-d2d500235f08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:30.500246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-33eb1c94-3258-4804-8891-d2d500235f08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:30.521559 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-33eb1c94-3258-4804-8891-d2d500235f08 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1215 microversion: 2.1 time: 0.156725 Oct 29 21:07:30.539956 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2361/4834] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:30 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:30.551078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:30.553506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:30.565807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:30.568446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:30.570342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:30.571188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:30.571880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:30.572574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:30.890089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:30.890757 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-af82f478-8b18-4664-a919-6472bae4fd00 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.614924 Oct 29 21:07:30.900685 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2338e449-dc32-47da-a639-8e1933f9a3d5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1723 microversion: 2.1 time: 0.358418 Oct 29 21:07:30.901325 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2474/4835] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 21:07:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:30.918192 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2362/4836] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:30 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:30.923043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12517cb7-1bee-4d0d-8b40-39894c6238ae tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Action: 'create', calling method: .version_select at 0x7fa170ee5160>, body: {"security_group_rule": {"parent_group_id": "7bca9851-5145-4b60-9517-360d53054436", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:30.925045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:30.928154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:30.938267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:30.939415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:30.940098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:30.943832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:30.946151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:30.946805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.280488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:31.290105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3420de8-5f49-4458-98a9-ad096542e0d0 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.386582 Oct 29 21:07:31.291051 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2475/4837] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:30 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:31.301176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:31.302241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:31.309271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:31.309872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:31.310464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.311251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:31.311733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:31.312233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.483861 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12517cb7-1bee-4d0d-8b40-39894c6238ae tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.564528 Oct 29 21:07:31.484952 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2363/4838] 10.222.0.36 () {60 vars in 1195 bytes} [Sat Oct 29 21:07:30 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:31.491096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:31.491716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:31.515012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:31.516783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:31.517897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.520639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:31.521513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:31.522492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.766768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:31.775830 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a6ea8e9-057c-49c4-824c-24b7d169135a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.479240 Oct 29 21:07:31.776647 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2476/4839] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:31 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:31.781596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:31.782461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:31.789960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:31.790691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:31.791204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.791988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:31.792659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:31.793171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:31.982649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:31.993110 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6240482-73ab-4c84-b243-ccf4e990e870 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.505931 Oct 29 21:07:31.993232 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2364/4840] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:31 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:32.005672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d66cd28-b4ac-48ce-a550-fc150d832050 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa171ffa700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:32.194300 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2d66cd28-b4ac-48ce-a550-fc150d832050 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/7bca9851-5145-4b60-9517-360d53054436" status: 200 len: 664 microversion: 2.1 time: 0.199756 Oct 29 21:07:32.195506 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2365/4841] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 21:07:31 2022] GET /compute/v2.1/os-security-groups/7bca9851-5145-4b60-9517-360d53054436 => generated 664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:32.200481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:32.201598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:32.212085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.212693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.213204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.214135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.216405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.216758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.222695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:32.230894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c056cba0-2a31-46b1-9214-5abd9dbcb1c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.452994 Oct 29 21:07:32.231490 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2477/4842] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:31 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:32.236755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:32.238193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:32.245530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.246279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.247012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.248169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.249106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.249668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.365621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:32.373550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96b28d88-f1a0-4339-99f4-be24874f0686 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1273 microversion: 2.1 time: 0.176790 Oct 29 21:07:32.374131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2366/4843] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:32 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:32.379293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:32.380132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:32.386252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.386734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.387169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.387860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.388313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.388832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.581025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:32.610539 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3271d5b-ccfa-4c89-bad5-6836447be2a0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1723 microversion: 2.1 time: 0.377688 Oct 29 21:07:32.611478 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2478/4844] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:32 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1723 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:32.646090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b27c93d-f311-457b-a59e-1f7da2e040b4 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170317af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:32.749868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:32.765204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10f9aa59-9de0-41a4-986d-3c28b6317838 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.389904 Oct 29 21:07:32.774432 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2367/4845] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:32 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:32.789117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a28405c3-39b2-4971-a7bd-417347e21569 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:32.795897 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-a28405c3-39b2-4971-a7bd-417347e21569 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance f88d6309-f400-476c-b2ac-15c9fe844c8f has no mapping to a cell. Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a28405c3-39b2-4971-a7bd-417347e21569 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/f88d6309-f400-476c-b2ac-15c9fe844c8f/action HTTP/1.1 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 15 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: {"os-stop": {}} Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f88d6309-f400-476c-b2ac-15c9fe844c8f has no mapping to a cell. Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f88d6309-f400-476c-b2ac-15c9fe844c8f', 'body': {'os-stop': {}}} Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance f88d6309-f400-476c-b2ac-15c9fe844c8f has no mapping to a cell. Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 29 21:07:32.807738 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f88d6309-f400-476c-b2ac-15c9fe844c8f has no mapping to a cell. Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f88d6309-f400-476c-b2ac-15c9fe844c8f has no mapping to a cell. Oct 29 21:07:32.814386 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:32.817781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a28405c3-39b2-4971-a7bd-417347e21569 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance f88d6309-f400-476c-b2ac-15c9fe844c8f has no mapping to a cell. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:32.818895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a28405c3-39b2-4971-a7bd-417347e21569 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/f88d6309-f400-476c-b2ac-15c9fe844c8f/action" status: 404 len: 117 microversion: 2.1 time: 0.034535 Oct 29 21:07:32.825398 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2368/4846] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:32 2022] POST /compute/v2.1/servers/f88d6309-f400-476c-b2ac-15c9fe844c8f/action => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:07:32.834489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:32.837006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:32.851792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.852303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.852759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:32.853506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:32.853981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:32.854415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:33.563153 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b27c93d-f311-457b-a59e-1f7da2e040b4 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/486b261d-c156-403e-848a-eeea292462e2" status: 202 len: 0 microversion: 2.1 time: 0.947630 Oct 29 21:07:33.563869 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2479/4847] 10.222.0.36 () {58 vars in 1287 bytes} [Sat Oct 29 21:07:32 2022] DELETE /compute/v2.1/os-security-group-rules/486b261d-c156-403e-848a-eeea292462e2 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:33.570567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:33.571197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:33.589756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:33.590744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:33.591378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:33.592671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:33.593672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:33.594535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:33.811715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:33.822637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f05f0319-a1af-4e02-90ea-f735dd908288 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.995134 Oct 29 21:07:33.842910 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2369/4848] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:32 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:33.848449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:33.849294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:33.858912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:33.859654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:33.860510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:33.861649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:33.862508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:33.863658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:33.993197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:34.007172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65b940d4-e86b-4fe5-be5c-7d217a04bcc9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.441838 Oct 29 21:07:34.007805 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2480/4849] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:33 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:34.018893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:34.019550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:34.032407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.033300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.033899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.035188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.036043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.036796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.262430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:34.273398 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a8e608db-cf27-48b1-b433-b5b51679676d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.428601 Oct 29 21:07:34.274037 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2370/4850] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:33 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:34.278885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-719e95d8-81d2-4069-b99a-954b2d967e38 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170e993a0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:34.366997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:34.384009 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30744097-4a58-4696-81d8-448cd14fd2cd tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.373927 Oct 29 21:07:34.399121 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2481/4851] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:34 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:34.415211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:34.416098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:34.429519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.430357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.431069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.432199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.433049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.433762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.794216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:34.809416 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8e50cd8-be28-4060-a6d6-301f065f0f08 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1723 microversion: 2.1 time: 0.409002 Oct 29 21:07:34.810542 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2482/4852] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:34 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:34.821255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:34.821950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:34.842675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.843087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.844138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.845051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.845709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.846320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.918842 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-719e95d8-81d2-4069-b99a-954b2d967e38 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/7bca9851-5145-4b60-9517-360d53054436" status: 202 len: 0 microversion: 2.1 time: 0.643508 Oct 29 21:07:34.922730 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2371/4853] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:34 2022] DELETE /compute/v2.1/os-security-groups/7bca9851-5145-4b60-9517-360d53054436 => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:34.929847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:34.930561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:34.946888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.947415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.947869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:34.949243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:34.949729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:34.950306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:35.298429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:35.303336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:35.309350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-605a8e35-0d45-44f4-954e-eaa08a4c7ae5 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.497768 Oct 29 21:07:35.314575 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2483/4854] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:34 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:35.323547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa1702e8a60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:35.338400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:35.346827 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9864c0f2-3be7-4c83-89fb-cf9eb3d2e209 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.422741 Oct 29 21:07:35.348235 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2372/4855] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:34 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:35.352722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:35.353330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:35.359960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:35.360445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:35.360911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:35.361603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:35.362309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:35.362934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:35.408627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG neutronclient.v2_0.client [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist", "detail": ""}} {{(pid=138885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 21:07:35.409523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.security_group_api [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Neutron security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 not found {{(pid=138885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 21:07:35.410490 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] HTTP exception thrown: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.410490 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Request method failure captured: Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/os-security-groups/9616ca27-aca7-4f69-b217-4c88b2e0bb51 HTTP/1.1 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZYGsF2r8dIz8nR0FxyWjDnmwel86lyLXhHpuv5UnP90L5G3wNq4ZX2E-i6Lh6s3AEdx76330E7ayfFFgB-WG0LgYGPNFjMhgSnTMd0Z0XDdAtBZWZS4qlqgpuV_mjLDqDxm6JInY3POo4XZ2VnZi_6sCoi7A5RnlVaSgIkiHssEeYM Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c4dd29b256944c9ba2538745a26489c8 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1643573932 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4dd29b256944c9ba2538745a26489c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4dd29b256944c9ba2538745a26489c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4dd29b256944c9ba2538745a26489c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4dd29b256944c9ba2538745a26489c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1643573932 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c4dd29b256944c9ba2538745a26489c8 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1643573932 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-SecurityGroupRulesTestJSON-1643573932-project Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: fd7d0a5c0ff44cd5949ac477a3335b47 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1643573932-project Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: exception: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9616ca27-aca7-4f69-b217-4c88b2e0bb51'} Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 21:07:35.412484 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Returning 404 to user: Security group 9616ca27-aca7-4f69-b217-4c88b2e0bb51 does not exist Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: Neutron server returns request_ids: ['req-18368d8e-7557-4120-855f-a8e8371c93a8'] {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f0eab61-c0ee-4b93-b836-16b4af6757d0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/9616ca27-aca7-4f69-b217-4c88b2e0bb51" status: 404 len: 194 microversion: 2.1 time: 0.096945 Oct 29 21:07:35.418738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2484/4856] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:35 2022] DELETE /compute/v2.1/os-security-groups/9616ca27-aca7-4f69-b217-4c88b2e0bb51 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:07:35.423209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6697b960-2186-432e-9344-8270bb749b05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:35.423209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6697b960-2186-432e-9344-8270bb749b05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 380917f4-ae74-47d1-901f-57d9ed4bc275] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:35.441023 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6697b960-2186-432e-9344-8270bb749b05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 380917f4-ae74-47d1-901f-57d9ed4bc275 could not be found. Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6697b960-2186-432e-9344-8270bb749b05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/380917f4-ae74-47d1-901f-57d9ed4bc275/action HTTP/1.1 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 15 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: {"suspend": {}} Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 380917f4-ae74-47d1-901f-57d9ed4bc275 could not be found. Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '380917f4-ae74-47d1-901f-57d9ed4bc275', 'body': {'suspend': {}}} Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380917f4-ae74-47d1-901f-57d9ed4bc275 could not be found. Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380917f4-ae74-47d1-901f-57d9ed4bc275 could not be found. Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:35.443149 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380917f4-ae74-47d1-901f-57d9ed4bc275 could not be found. Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6697b960-2186-432e-9344-8270bb749b05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 380917f4-ae74-47d1-901f-57d9ed4bc275 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6697b960-2186-432e-9344-8270bb749b05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/380917f4-ae74-47d1-901f-57d9ed4bc275/action" status: 404 len: 111 microversion: 2.1 time: 0.026095 Oct 29 21:07:35.448795 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2485/4857] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:35 2022] POST /compute/v2.1/servers/380917f4-ae74-47d1-901f-57d9ed4bc275/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:07:35.453209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:35.453857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:35.460669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:35.461197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:35.461652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:35.462354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:35.462809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:35.463239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:35.749701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:35.760980 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22cd6f20-de05-4f71-926a-9e425a988508 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.411909 Oct 29 21:07:35.778486 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2373/4858] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:35 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:35.784255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b4fe0ce1-05e7-4a0f-aa83-59447d030288 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170e9e9d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:35.849504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:35.867036 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e84a0c7e-6c32-4429-b8e3-00c79601a2ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.417301 Oct 29 21:07:35.868148 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2486/4859] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:35 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:35.876238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:35.877167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:35.888236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:35.889367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:35.889845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:35.891504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:35.891970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:35.892594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.395969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:36.423488 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6f9ab8a-0e8f-4776-98d3-299b0772a676 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.552167 Oct 29 21:07:36.423921 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2487/4860] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:35 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:36.433000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:36.434072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:36.450004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.452528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.453276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.454358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.455230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.456264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.614226 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b4fe0ce1-05e7-4a0f-aa83-59447d030288 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c452f194-70e3-4a5b-8e1f-c240d0f632f3" status: 202 len: 0 microversion: 2.1 time: 0.833270 Oct 29 21:07:36.614882 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2374/4861] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:35 2022] DELETE /compute/v2.1/os-security-groups/c452f194-70e3-4a5b-8e1f-c240d0f632f3 => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:36.621410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bb002f24-dbef-47e9-b606-526628e8405e req-b616c40f-2496-473a-9b0e-bd92e0cfea6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee24132-334a-4feb-afe0-95a3a8f725c4", "tag": "1b906195-2cbc-41b8-be84-5882e77b71a6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:36.633724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bb002f24-dbef-47e9-b606-526628e8405e req-b616c40f-2496-473a-9b0e-bd92e0cfea6c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.634272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bb002f24-dbef-47e9-b606-526628e8405e req-b616c40f-2496-473a-9b0e-bd92e0cfea6c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.634805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bb002f24-dbef-47e9-b606-526628e8405e req-b616c40f-2496-473a-9b0e-bd92e0cfea6c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.648749 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bb002f24-dbef-47e9-b606-526628e8405e req-b616c40f-2496-473a-9b0e-bd92e0cfea6c service nova] Creating event network-changed:1b906195-2cbc-41b8-be84-5882e77b71a6 for instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 on nch1-master-1 Oct 29 21:07:36.653945 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bb002f24-dbef-47e9-b606-526628e8405e req-b616c40f-2496-473a-9b0e-bd92e0cfea6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037540 Oct 29 21:07:36.655735 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2375/4862] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:36.662523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:36.663545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:36.681549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.682320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.683028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.683988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.684674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.685332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.726075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:36.736385 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cb63ee0-ac49-4bd5-98fc-424d75657a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1700 microversion: 2.1 time: 0.311036 Oct 29 21:07:36.748229 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2488/4863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:36 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1700 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:36.753904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:36.753904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:36.759279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.759781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.760233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.760953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:36.761472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:36.761916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:36.961541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:36.974314 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a64bae9-be38-4666-b016-addf8c8615c8 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.317118 Oct 29 21:07:36.976086 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2376/4864] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:36 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:36.981344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cbe21495-fec8-4720-8172-25db890864b6 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170a38670>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:37.048769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:37.059021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-775ae165-c416-437b-a9a8-9490eed0cd05 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.314576 Oct 29 21:07:37.060074 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2489/4865] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:36 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:37.065957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5cf011ef-0fba-4c1f-a362-a212ca4fb0d7 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:37.073993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cf011ef-0fba-4c1f-a362-a212ca4fb0d7 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.074856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cf011ef-0fba-4c1f-a362-a212ca4fb0d7 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.075639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5cf011ef-0fba-4c1f-a362-a212ca4fb0d7 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.112099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5cf011ef-0fba-4c1f-a362-a212ca4fb0d7 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Going to try to start instance {{(pid=138885) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 21:07:37.168412 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5cf011ef-0fba-4c1f-a362-a212ca4fb0d7 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action" status: 202 len: 0 microversion: 2.1 time: 0.106624 Oct 29 21:07:37.170417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2490/4866] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:37 2022] POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:37.178846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:37.179908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:37.187437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.188567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.189261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.190245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.191526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.192251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.405201 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cbe21495-fec8-4720-8172-25db890864b6 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/5fb90f4f-3786-479f-9502-724ceb0b7d1e" status: 202 len: 0 microversion: 2.1 time: 0.427639 Oct 29 21:07:37.406631 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2377/4867] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:36 2022] DELETE /compute/v2.1/os-security-groups/5fb90f4f-3786-479f-9502-724ceb0b7d1e => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:37.415410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:37.416143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:37.436886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.437754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.438288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.439126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.439707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.440245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.511818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:37.526405 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7bd00d0-fb5f-4541-a482-2c18e249dda4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.353951 Oct 29 21:07:37.530332 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2491/4868] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:37 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:37.542569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:37.544701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:37.561820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.562535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.565731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.567368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.568009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.569989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.635039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lazy-loading 'flavor' on Instance uuid 97e7bb8a-f42c-415a-9898-3cb84f34e2ee {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:07:37.721442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:37.743114 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c36a4c5-1059-4d86-82c1-fa829b9bd834 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.332153 Oct 29 21:07:37.745484 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2378/4869] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:37 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:37.759767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:37.760703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:37.774437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.774944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.776995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.778460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:37.778936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:37.779059 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f2e4f27-d452-427b-bfbb-93e9df042c44 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 202 len: 0 microversion: 2.1 time: 0.244924 Oct 29 21:07:37.779418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:37.784886 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2492/4870] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:37 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:37.803861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e54af7e-2cb7-4941-986c-fb73d1f8c229 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170290820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.020014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:38.032446 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bdfe16d6-1051-42e2-8b28-9ed10fb1355f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1709 microversion: 2.1 time: 0.285621 Oct 29 21:07:38.042560 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2379/4871] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:37 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1709 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:38.048722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.050077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:38.060797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.061657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.062601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.063453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.064025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.064560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.322933 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e54af7e-2cb7-4941-986c-fb73d1f8c229 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/a5ee9053-26b6-44c4-b226-6f78472da767" status: 202 len: 0 microversion: 2.1 time: 0.536427 Oct 29 21:07:38.323531 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2493/4872] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:37 2022] DELETE /compute/v2.1/os-security-groups/a5ee9053-26b6-44c4-b226-6f78472da767 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:38.328398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.329639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:38.338478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.339330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.340446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.341707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.342439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.343351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.438023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:38.463191 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12faa0f8-1c39-4e08-9b4b-ac3f04ed441b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1514 microversion: 2.1 time: 0.418919 Oct 29 21:07:38.466317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2380/4873] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:38 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1514 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:38.473583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2e43cc97-b8f8-4eee-a2e7-e606733cb589 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa1763a2820>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.611826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:38.620406 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d3f24f6-023d-4734-b2b5-9bdf5929f2ed tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.295732 Oct 29 21:07:38.621010 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2494/4874] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:38 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:38.625625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.626915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:38.634986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.636096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.636563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.637309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.637801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.638246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.930977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:38.944695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce9f0d09-1494-41e4-be22-c462f5c861da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.321986 Oct 29 21:07:38.946336 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2495/4875] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:38 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:38.957211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2e43cc97-b8f8-4eee-a2e7-e606733cb589 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/102825f7-ab64-4334-865f-33748bd797fb" status: 202 len: 0 microversion: 2.1 time: 0.488963 Oct 29 21:07:38.959222 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2381/4876] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:38 2022] DELETE /compute/v2.1/os-security-groups/102825f7-ab64-4334-865f-33748bd797fb => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:38.960058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.960893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:38.967238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-838d0088-9f51-45aa-a429-afc1cc606ee0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] Calling method '.version_select at 0x7fa170e99f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:38.984875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.986035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.986680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:38.988211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:38.988905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:38.989409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:39.239250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:39.248338 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2a59f0a-802b-4f56-8726-e9fc68dca706 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.300142 Oct 29 21:07:39.262105 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2496/4877] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:38 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:39.280442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:39.281785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:39.290350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:39.291011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:39.291834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:39.292826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:39.293883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:39.294403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:39.505805 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-838d0088-9f51-45aa-a429-afc1cc606ee0 tempest-SecurityGroupRulesTestJSON-1643573932 tempest-SecurityGroupRulesTestJSON-1643573932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/6ea916f4-ba58-4848-89ba-aa0f896e5cc7" status: 202 len: 0 microversion: 2.1 time: 0.542742 Oct 29 21:07:39.507264 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2382/4878] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:07:38 2022] DELETE /compute/v2.1/os-security-groups/6ea916f4-ba58-4848-89ba-aa0f896e5cc7 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:07:39.518763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:39.519853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:39.527940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:39.528878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:39.529555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:39.530605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:39.531459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:39.532096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:39.564006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:40.113570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:40.123719 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc0ef5a7-b05d-4d16-8625-383d7d812b77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1709 microversion: 2.1 time: 0.860093 Oct 29 21:07:40.130328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2497/4879] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:39 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1709 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:40.139939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:40.140974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:40.162796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:40.163617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:40.164352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:40.165368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:40.166169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:40.166799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:40.306866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:40.320312 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2490dca1-dfc1-45a6-a5ae-a9b905b1f531 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1514 microversion: 2.1 time: 0.806097 Oct 29 21:07:40.321504 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2383/4880] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:39 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1514 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:40.348957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:40.349637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:40.369181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:40.370101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:40.370687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:40.372006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:40.372618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:40.373065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:40.520187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:40.773916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:40.785962 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e766691-22e4-43aa-a1b4-3c51f85af66b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.654121 Oct 29 21:07:40.786575 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2498/4881] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:40 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:40.793151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:40.795417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:40.807642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:40.820421 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f592469-0797-446f-af38-78e943dc48f8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1511 microversion: 2.1 time: 0.481020 Oct 29 21:07:40.821647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:40.822339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:40.839055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:40.839055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:40.839055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:40.839055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:40.840792 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2384/4882] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:40 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1511 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:41.071657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:41.081411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-994575ab-3b7b-42d0-b8b3-4ea08effcb76 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.293558 Oct 29 21:07:41.083200 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2499/4883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:40 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:41.160650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:41.161664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:41.170664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.171555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.172219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.173195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.174148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.176669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.232942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:41.353185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:41.354079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:41.365856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.367707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.368686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.371375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.373289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.373938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.617730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:41.636380 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d492302f-b4f4-4ec9-91a7-a9ff71846a4f tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1713 microversion: 2.1 time: 0.475581 Oct 29 21:07:41.637361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2385/4884] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:41 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1713 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:41.816555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:41.817189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:41.831943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.832357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.832803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.833545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.834004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.834432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.867396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:41.873852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:41.880116 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9dbaf7ed-47af-4119-8f18-ce7964d3ecaf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1497 microversion: 2.1 time: 0.538373 Oct 29 21:07:41.884442 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2500/4885] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:41 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1497 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:41.895443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:41.896304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:41.923515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.929600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.930167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:41.931020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:41.931724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:41.932253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.312196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:42.327220 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b5ea81a4-889c-4502-9273-62f3eedf5f53 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.513705 Oct 29 21:07:42.331809 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2386/4886] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:41 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:42.347923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:42.348403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:42.368707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.369260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.369829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.370549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.371972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.372403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.441971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lazy-loading 'flavor' on Instance uuid 97e7bb8a-f42c-415a-9898-3cb84f34e2ee {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:07:42.469587 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'suspend' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state suspended Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 15 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: {"suspend": {}} Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'suspend' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state suspended Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'suspend': {}}} Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state suspended. Cannot suspend while the instance is in this state. Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:42.473533 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state suspended Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state suspended Oct 29 21:07:42.478264 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:42.484061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'suspend' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state suspended {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:42.485664 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f9812f0-820c-494d-8599-7a466c673d40 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 148 microversion: 2.1 time: 0.152585 Oct 29 21:07:42.486452 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2387/4887] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:42 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 148 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:07:42.486933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:42.498884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:42.499060 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-646082b1-69ea-443d-a847-1c3c43079c7d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1488 microversion: 2.1 time: 0.613436 Oct 29 21:07:42.508377 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2501/4888] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:41 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1488 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:42.510508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:42.513477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:42.514039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:42.530785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.530944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.531066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.531066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.531915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.532387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.532823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.532935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.533304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.535595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.538656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.539138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.683437 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-379878ff-3532-4455-9d98-fd7158ae6c8c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 202 len: 0 microversion: 2.1 time: 0.173748 Oct 29 21:07:42.685671 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2502/4889] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:42 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:42.698236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:42.700803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:42.718381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.719022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.719337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.720063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.720530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.720968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.826170 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81ca6ce3-60ab-4725-b98a-a44ebeb18ca4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 200 len: 152 microversion: 2.1 time: 0.138961 Oct 29 21:07:42.827131 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2503/4890] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:42 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:42.832996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:42.842541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:42.850836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.851337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.851785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:42.852500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:42.852968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:42.853400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.138667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:43.150544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d2cf351b-3fa6-4b99-8222-b8707cb6ac2d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.662153 Oct 29 21:07:43.155308 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2388/4891] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:42 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:43.165006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:43.166022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:43.173977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:43.174729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:43.175433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.176638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:43.177320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:43.177991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.402229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:43.411413 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96f213f7-25d1-4c85-80bf-c5f54f7f3d5a tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1503 microversion: 2.1 time: 0.583039 Oct 29 21:07:43.414766 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2504/4892] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:42 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1503 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:43.424030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:43.430538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:43.442431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:43.443220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:43.443872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.444798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:43.445557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:43.446193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.656791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:43.677846 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c2b98083-490c-45ea-9e23-1fc49334f233 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.516993 Oct 29 21:07:43.679675 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2389/4893] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:43 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:43.707049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:43.708229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:43.723126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:43.725080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:43.725667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.730461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:43.731042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:43.733509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:43.771806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:43.782449 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b30726f-0a9d-4a56-ac01-a0c2a5ce07e4 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1524 microversion: 2.1 time: 0.362171 Oct 29 21:07:43.786344 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2505/4894] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:43 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1524 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:44.156737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:44.165992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05a5e5f2-10a5-4ad7-bd5e-2d31a87d5d96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.464052 Oct 29 21:07:44.166588 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2390/4895] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:43 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:07:44.336542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f6c7ea0c-83cc-41c8-810a-f567d1e148f0 req-b485cbd1-2a10-4630-add1-16e543c9db5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee24132-334a-4feb-afe0-95a3a8f725c4", "name": "network-vif-plugged", "status": "completed", "tag": "1b906195-2cbc-41b8-be84-5882e77b71a6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:44.347526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6c7ea0c-83cc-41c8-810a-f567d1e148f0 req-b485cbd1-2a10-4630-add1-16e543c9db5a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.348820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6c7ea0c-83cc-41c8-810a-f567d1e148f0 req-b485cbd1-2a10-4630-add1-16e543c9db5a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.349611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6c7ea0c-83cc-41c8-810a-f567d1e148f0 req-b485cbd1-2a10-4630-add1-16e543c9db5a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.362245 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f6c7ea0c-83cc-41c8-810a-f567d1e148f0 req-b485cbd1-2a10-4630-add1-16e543c9db5a service nova] Creating event network-vif-plugged:1b906195-2cbc-41b8-be84-5882e77b71a6 for instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 on nch1-master-1 Oct 29 21:07:44.368229 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f6c7ea0c-83cc-41c8-810a-f567d1e148f0 req-b485cbd1-2a10-4630-add1-16e543c9db5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368158 Oct 29 21:07:44.368852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2506/4896] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:07:44.377194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:44.377946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:44.385433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.385811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.386483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.387242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.387943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.388551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.446920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:44.447534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:44.457054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.464290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.464778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.465585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.466089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.466521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.865075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:44.874040 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bf76910-4eb1-4b12-b37b-30bfcb76c07b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.501021 Oct 29 21:07:44.874713 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2507/4897] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:44 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:44.886503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:44.887951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:44.899725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.900525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.902646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.904571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.905276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.907423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.933918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:44.943847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d3dddd50-7796-47ac-8936-12f8145807be tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1315 microversion: 2.1 time: 0.766668 Oct 29 21:07:44.957301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2391/4898] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:44 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:44.968090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:44.969407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:44.980107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.985249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.986146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:44.993269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:44.994562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:44.995273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:45.263557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:45.275681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b88f5d25-33fc-4d3e-8bb6-b1b502a23198 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1503 microversion: 2.1 time: 0.399553 Oct 29 21:07:45.276280 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2508/4899] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:44 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:45.289266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:45.293745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:45.311788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:45.312297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:45.312923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:45.313744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:45.314181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:45.314608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:45.454468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:45.465820 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c2db269-1562-4aa5-b87d-c3a52c98a7bd tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1504 microversion: 2.1 time: 0.506815 Oct 29 21:07:45.467504 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2392/4900] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:44 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:45.491427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52d4fe9b-f287-44b0-97aa-13d627e29d21 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'create', calling method: .version_select at 0x7fa1709e5d30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1793691046", "description": "tempest-description-44485507"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:45.572486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:45.593242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-830f6f63-53cd-4f1e-8171-8d1a00fa353c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.311284 Oct 29 21:07:45.599627 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2509/4901] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:45 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:45.842623 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52d4fe9b-f287-44b0-97aa-13d627e29d21 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.355222 Oct 29 21:07:45.843221 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2393/4902] 10.222.0.36 () {60 vars in 1180 bytes} [Sat Oct 29 21:07:45 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:07:45.857189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1793691046"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:45.863250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:45.872740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-73318038", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1afe3e15-ddc2-4d60-825a-7983ed3bd0c7"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:45.890336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:45.890916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:45.894454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:45.894454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:45.895049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:45.895417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:46.006221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] validate_networks() for [('1afe3e15-ddc2-4d60-825a-7983ed3bd0c7', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:07:46.624722 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Adding security group 02fc1eaf-112a-460d-8fb1-70e58e444f59 to port 35b75f78-bda7-48b1-a06f-42da9a136ed2 Oct 29 21:07:47.391188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:07:47.391735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:07:47.392086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:07:47.392808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:07:47.393231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:07:47.408971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:47.411218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:47.411686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:47.412445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:47.412912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:47.413937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:47.455154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:47.467294 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0e20f4cd-03df-416c-8334-2dd32ba684e1 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action" status: 202 len: 0 microversion: 2.1 time: 1.613996 Oct 29 21:07:47.467919 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2510/4903] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:45 2022] POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action => generated 0 bytes in 1615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:47.477591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:47.478224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:47.506300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:47.507192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:47.510426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:47.513280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:47.514289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:07:47.517012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:47.517610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:47.538807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for user c35b0dd86eb14cbbab1732cc96ab2573 and project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:07:47.599220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:07:47.615768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:07:47.728923 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e534bf50-1038-467d-b706-431938c4f474 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859406 Oct 29 21:07:47.732204 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2394/4904] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:07:47.745217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:47.748603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:47.764766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:47.765623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:47.766255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:47.767150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:47.767769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:47.768448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:47.921244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:47.955722 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-271b9c72-fe01-4985-b00e-23e5caf9cb97 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1502 microversion: 2.1 time: 0.483672 Oct 29 21:07:47.956365 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2511/4905] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:47 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1502 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:47.983812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1793691046"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:47.984379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:48.001948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.002605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.003195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:48.004160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.004690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.005187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:48.090276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:48.105365 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0834c6bf-0149-4f26-ab71-e96dc63bbf26 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.371184 Oct 29 21:07:48.127218 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2395/4906] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:47 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:48.141975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a832235a-dd2e-4975-a96c-ab4e50dfea3e req-1a3fd093-98d6-4048-908a-a939e9731e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:48.161280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a832235a-dd2e-4975-a96c-ab4e50dfea3e req-1a3fd093-98d6-4048-908a-a939e9731e4d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.162255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a832235a-dd2e-4975-a96c-ab4e50dfea3e req-1a3fd093-98d6-4048-908a-a939e9731e4d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.162993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a832235a-dd2e-4975-a96c-ab4e50dfea3e req-1a3fd093-98d6-4048-908a-a939e9731e4d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:48.194957 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a832235a-dd2e-4975-a96c-ab4e50dfea3e req-1a3fd093-98d6-4048-908a-a939e9731e4d service nova] Creating event network-changed:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:07:48.209031 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a832235a-dd2e-4975-a96c-ab4e50dfea3e req-1a3fd093-98d6-4048-908a-a939e9731e4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074087 Oct 29 21:07:48.210198 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2396/4907] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:48.219037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-218fef69-1aaa-4c39-be0f-7a2be4bf6f71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:48.219909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-218fef69-1aaa-4c39-be0f-7a2be4bf6f71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:48.291077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Removing security group 02fc1eaf-112a-460d-8fb1-70e58e444f59 from port 35b75f78-bda7-48b1-a06f-42da9a136ed2 Oct 29 21:07:48.543119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-218fef69-1aaa-4c39-be0f-7a2be4bf6f71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:48.559635 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-218fef69-1aaa-4c39-be0f-7a2be4bf6f71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1213 microversion: 2.1 time: 0.345262 Oct 29 21:07:48.567631 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2397/4908] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:48 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1213 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:48.586328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:48.588886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:48.618856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.620017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.621614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:48.624471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.626168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.627738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:48.671207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'flavor' on Instance uuid 3ee24132-334a-4feb-afe0-95a3a8f725c4 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:07:48.815010 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2fc05bd-9a4f-4973-b7ae-967f524947e2 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "POST /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4/action" status: 202 len: 0 microversion: 2.1 time: 0.245320 Oct 29 21:07:48.819754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2398/4909] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:48 2022] POST /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:48.860644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:48.861246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:48.890671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.894405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.896727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:48.900411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:48.901144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:48.903611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:49.375030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:49.386897 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4aca95d0-8555-43b6-a5b3-fdfb358bc3d7 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.564637 Oct 29 21:07:49.401492 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2399/4910] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:48 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:49.413042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:49.413734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:49.422913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:49.422913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:49.422913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:49.422913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:49.422913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:49.423295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:49.454171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d9f280e-5b40-4af3-bfad-d2801a6e74bb tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action" status: 202 len: 0 microversion: 2.1 time: 1.486051 Oct 29 21:07:49.454785 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2512/4911] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:47 2022] POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:07:49.467699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-023c3de5-cf8b-419b-98bc-ce87806eb29c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:49.468470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-023c3de5-cf8b-419b-98bc-ce87806eb29c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: aeaa125b-6fa5-463e-9d76-f6ba17c742b5] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:49.493872 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-023c3de5-cf8b-419b-98bc-ce87806eb29c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance aeaa125b-6fa5-463e-9d76-f6ba17c742b5 could not be found. Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-023c3de5-cf8b-419b-98bc-ce87806eb29c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/aeaa125b-6fa5-463e-9d76-f6ba17c742b5/action HTTP/1.1 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 15 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: {"unpause": {}} Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance aeaa125b-6fa5-463e-9d76-f6ba17c742b5 could not be found. Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'aeaa125b-6fa5-463e-9d76-f6ba17c742b5', 'body': {'unpause': {}}} Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeaa125b-6fa5-463e-9d76-f6ba17c742b5 could not be found. Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeaa125b-6fa5-463e-9d76-f6ba17c742b5 could not be found. Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:49.495992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:49.501028 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:49.501028 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:49.501028 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:49.501028 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeaa125b-6fa5-463e-9d76-f6ba17c742b5 could not be found. Oct 29 21:07:49.501028 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:49.503640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-023c3de5-cf8b-419b-98bc-ce87806eb29c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance aeaa125b-6fa5-463e-9d76-f6ba17c742b5 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:49.505103 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-023c3de5-cf8b-419b-98bc-ce87806eb29c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/aeaa125b-6fa5-463e-9d76-f6ba17c742b5/action" status: 404 len: 111 microversion: 2.1 time: 0.041586 Oct 29 21:07:49.506735 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2513/4912] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:49 2022] POST /compute/v2.1/servers/aeaa125b-6fa5-463e-9d76-f6ba17c742b5/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:07:49.512452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99abcb49-a46c-45a0-8a37-916b1f266834 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'create', calling method: .version_select at 0x7fa1702ef280>, body: {"pool": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:50.081842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:50.093633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a199a817-e979-4dfc-a856-169342bc0c70 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1510 microversion: 2.1 time: 0.689792 Oct 29 21:07:50.105939 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2400/4913] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:49 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1510 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:50.115333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:50.116257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:50.123251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.123780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.124272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.125494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.126815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.127573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.609339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:50.629736 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8e960e0-54aa-4b8f-aa9c-e8c4c3dde967 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.511017 Oct 29 21:07:50.629736 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2401/4914] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:50 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:50.629736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:50.629736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:50.643721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.644159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.644918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.645646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.646103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.646706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.792975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:50.814561 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2a477ded-53f1-4d1a-aea2-3a1c203c6725 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1271 microversion: 2.1 time: 0.193390 Oct 29 21:07:50.817805 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2402/4915] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:50 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:50.850889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ada1506b-025f-4830-a9f3-384fc5fcc2eb req-a74c7ae8-2a34-4d49-818c-f5d39055e280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:50.874437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ada1506b-025f-4830-a9f3-384fc5fcc2eb req-a74c7ae8-2a34-4d49-818c-f5d39055e280 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.877066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ada1506b-025f-4830-a9f3-384fc5fcc2eb req-a74c7ae8-2a34-4d49-818c-f5d39055e280 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.878649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ada1506b-025f-4830-a9f3-384fc5fcc2eb req-a74c7ae8-2a34-4d49-818c-f5d39055e280 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.911133 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ada1506b-025f-4830-a9f3-384fc5fcc2eb req-a74c7ae8-2a34-4d49-818c-f5d39055e280 service nova] Creating event network-changed:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:07:50.923653 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ada1506b-025f-4830-a9f3-384fc5fcc2eb req-a74c7ae8-2a34-4d49-818c-f5d39055e280 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104138 Oct 29 21:07:50.927208 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2403/4916] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:50.933823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:50.935243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:50.943710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.944555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.945244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.947125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:50.947855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:50.948510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:50.987975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:51.852046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:51.863410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-904c4ab4-2c35-440a-b66d-e73ba49d5cf3 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.934806 Oct 29 21:07:51.864413 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2404/4917] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:50 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:51.870065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:51.870882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:51.877234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:51.878626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:51.879615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:51.880502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:51.881132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:51.881591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:52.274144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:52.282072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06d6a198-6a73-4839-9e42-49a133b6a32b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1493 microversion: 2.1 time: 0.416537 Oct 29 21:07:52.294945 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2405/4918] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:51 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1493 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:52.306619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:52.307250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:52.313802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:52.314303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:52.314813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:52.315604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:52.316052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:52.316668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:52.887083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:52.897376 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffc68e34-c4b2-4bfd-9e1e-226ae04f7c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 0.601714 Oct 29 21:07:52.901622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2406/4919] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:52 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:52.906751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:52.918364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:52.927404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:52.928545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:52.929052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:52.931313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:52.931786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:52.933768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:52.981876 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'unpause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 15 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: {"unpause": {}} Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: exception: Cannot 'unpause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'unpause': {}}} Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state active. Cannot unpause while the instance is in this state. Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:52.983556 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:52.988874 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:52.988874 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:52.988874 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:52.988874 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:52.988874 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:07:52.988874 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:07:52.990044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'unpause' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:53.001773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6164b21-6379-470f-82a4-03a1d9e14e68 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 145 microversion: 2.1 time: 0.098714 Oct 29 21:07:53.002374 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2407/4920] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:52 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:07:53.014339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:53.014853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:53.025562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:53.026061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:53.026498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:53.027186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:53.027931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:53.028515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:53.061859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:07:53.255585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8292d0ce-b48b-4b1a-99e5-51294fced0ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 204 len: 0 microversion: 2.1 time: 0.251356 Oct 29 21:07:53.260051 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2408/4921] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:07:53 2022] DELETE /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:07:53.268585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:53.269782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:53.282544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:53.283513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:53.284347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:53.291396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:53.294331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:53.296986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:53.731170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:53.744081 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-28882b92-39ab-4cfa-b176-0a4afa321258 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.482363 Oct 29 21:07:53.747129 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2409/4922] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:53 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:53.761193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:53.762639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:53.793378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:53.794820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:53.805425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:53.806397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:53.807116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:53.807627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:54.225295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:54.233249 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d75c11a-8ac4-4c9e-878e-796c374c7320 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1499 microversion: 2.1 time: 0.484725 Oct 29 21:07:54.245902 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2410/4923] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:53 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1499 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:54.251664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:54.252617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:54.260886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:54.265330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:54.266112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:54.267075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:54.268426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:54.272484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:54.855420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:54.865289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5c881b1-df53-4ded-8e66-03d7f92a105c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.617790 Oct 29 21:07:54.867244 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2411/4924] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:54 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:54.873090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:54.874040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:54.888662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:54.890120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:54.890579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:54.891429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:54.891892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:54.893063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:55.304597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-99abcb49-a46c-45a0-8a37-916b1f266834 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.796501 Oct 29 21:07:55.314191 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2514/4925] 10.222.0.36 () {60 vars in 1170 bytes} [Sat Oct 29 21:07:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:55.320453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-223a2c49-9ca3-4814-9d39-7cd96168b1e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:55.321081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-223a2c49-9ca3-4814-9d39-7cd96168b1e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 27b0d0ee-736f-4057-902d-6c7381f6123e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:55.340008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-223a2c49-9ca3-4814-9d39-7cd96168b1e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 27b0d0ee-736f-4057-902d-6c7381f6123e could not be found. Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-223a2c49-9ca3-4814-9d39-7cd96168b1e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/27b0d0ee-736f-4057-902d-6c7381f6123e/action HTTP/1.1 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 18 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: {"unshelve": null} Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 27b0d0ee-736f-4057-902d-6c7381f6123e could not be found. Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '27b0d0ee-736f-4057-902d-6c7381f6123e', 'body': {'unshelve': None}} Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b0d0ee-736f-4057-902d-6c7381f6123e could not be found. Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b0d0ee-736f-4057-902d-6c7381f6123e could not be found. Oct 29 21:07:55.343534 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b0d0ee-736f-4057-902d-6c7381f6123e could not be found. Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-223a2c49-9ca3-4814-9d39-7cd96168b1e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 27b0d0ee-736f-4057-902d-6c7381f6123e could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-223a2c49-9ca3-4814-9d39-7cd96168b1e1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/27b0d0ee-736f-4057-902d-6c7381f6123e/action" status: 404 len: 111 microversion: 2.1 time: 0.033687 Oct 29 21:07:55.355697 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2515/4926] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:55 2022] POST /compute/v2.1/servers/27b0d0ee-736f-4057-902d-6c7381f6123e/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:07:55.361355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:55.362052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:55.371493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:55.372529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:55.373370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:55.375690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:55.376414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:55.377314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:55.398555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:55.410190 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64393ab2-bb2d-496e-b31d-e0798f5e6a67 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 0.541649 Oct 29 21:07:55.411375 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2412/4927] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:54 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:55.425887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.148"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:55.435248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:55.446794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:55.448410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:55.449434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:55.450335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:55.452715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:55.453229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:55.492818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "refresh_cache-26866831-09f1-497e-a037-571a033b29d3" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 21:07:55.493342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquired lock "refresh_cache-26866831-09f1-497e-a037-571a033b29d3" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 21:07:56.532967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:56.555636 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0eb6d50b-9b8f-4ce1-9f48-e9a13d2a66ae tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1499 microversion: 2.1 time: 1.203426 Oct 29 21:07:56.556408 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2516/4928] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:55 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1499 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:56.562204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:56.563180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:56.571092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:56.572008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:56.574965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:56.576100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:56.576739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:56.577611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:57.233911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:57.247992 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba91de50-5066-4f17-ac70-ebccf11df759 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.687924 Oct 29 21:07:57.248637 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2517/4929] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:56 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:57.259259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:57.266578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:57.277836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:57.278600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:57.284418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:57.285417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:57.286229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:57.286834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:57.435127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:58.216789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:58.229119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1f92323b-4eaa-4f26-81c8-c64a489d425f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 0.977880 Oct 29 21:07:58.231903 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2518/4930] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:57 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:58.247888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:58.248528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:58.262769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:58.265377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:58.265987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:58.266743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:58.267167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:58.267644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:58.550380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:58.798537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:58.806855 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-710564eb-536c-4009-9507-0ff8e410672b tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.573888 Oct 29 21:07:58.823316 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2519/4931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:58 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:58.835352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:07:58.836792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:07:58.848908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:58.851529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:58.851822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:58.852568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:58.853512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:58.853512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:58.894999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:58.895499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:58.895940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:58.896398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lazy-loading 'fault' on Instance uuid 3ee24132-334a-4feb-afe0-95a3a8f725c4 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:07:58.986532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282339dc65a54bc99850b172ed427d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a46c1f647934440925ebc5e0b373ca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:07:58.991398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:59.004534 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ddfd0bda-8e7d-4371-9a7c-e4bd5065d36c tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 200 len: 1305 microversion: 2.1 time: 0.179712 Oct 29 21:07:59.017488 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2520/4932] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:07:58 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 1305 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:07:59.295931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c86a98b1-f2a9-4bce-bbb8-5b4217bee67d req-ba08145e-4846-44e0-b248-cecc0364ebd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b140d99d-dddc-4190-9cb9-daede056c5d9", "tag": "771dcf6d-287d-49aa-bdc8-b7a12e4c6218"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:59.314858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c86a98b1-f2a9-4bce-bbb8-5b4217bee67d req-ba08145e-4846-44e0-b248-cecc0364ebd3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:07:59.319439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c86a98b1-f2a9-4bce-bbb8-5b4217bee67d req-ba08145e-4846-44e0-b248-cecc0364ebd3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:07:59.320655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c86a98b1-f2a9-4bce-bbb8-5b4217bee67d req-ba08145e-4846-44e0-b248-cecc0364ebd3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:07:59.360543 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c86a98b1-f2a9-4bce-bbb8-5b4217bee67d req-ba08145e-4846-44e0-b248-cecc0364ebd3 service nova] Creating event network-changed:771dcf6d-287d-49aa-bdc8-b7a12e4c6218 for instance b140d99d-dddc-4190-9cb9-daede056c5d9 on nch1-master-1 Oct 29 21:07:59.373717 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c86a98b1-f2a9-4bce-bbb8-5b4217bee67d req-ba08145e-4846-44e0-b248-cecc0364ebd3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364127 Oct 29 21:07:59.375426 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2521/4933] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:07:59.449890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1026285380", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "dd5fa7d3-ba97-486d-80bf-43f552b38173"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:07:59.477510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:07:59.533167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] validate_networks() for [('dd5fa7d3-ba97-486d-80bf-43f552b38173', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:08:00.072036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Building network info cache for instance {{(pid=138884) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 21:08:01.004767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:08:01.005732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:08:01.007149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:08:01.007737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:08:01.008548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:08:01.028595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:01.029098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:01.029575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:01.030664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:01.031286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:01.032281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:01.095440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Getting quotas for project f1428735000841b98c5a859956a09b15. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:08:01.109669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Getting quotas for user b138e34a1c534b4da85766be38220e20 and project f1428735000841b98c5a859956a09b15. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:08:01.155751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:08:01.159950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:08:01.255589 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-971c2395-a2cd-4870-b47d-2b73c3d64e0a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.876369 Oct 29 21:08:01.256469 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2522/4934] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 21:08:01.275344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:01.275978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:01.316772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:01.317215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:01.317698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:01.319131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:01.319602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:01.320092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:01.498959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Cannot 'unshelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action HTTP/1.1 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 18 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: {"unshelve": null} Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: exception: Cannot 'unshelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'unshelve': None}} Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee in vm_state active. Cannot unshelve while the instance is in this state. Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 21:08:01.503246 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active Oct 29 21:08:01.507809 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:01.514312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 409 to user: Cannot 'unshelve' instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee while it is in vm_state active {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:01.516153 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2658f3d-f197-4b1e-a67c-19e032a50d51 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action" status: 409 len: 146 microversion: 2.1 time: 0.258496 Oct 29 21:08:01.517335 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2523/4935] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:01 2022] POST /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee/action => generated 146 bytes in 260 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:08:01.530559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:01.531209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:01.549417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:01.550446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:01.551342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:01.552098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:01.553773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:01.554235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.170896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:02.194501 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0db2dec2-c316-460d-93f3-ffc1adf98e60 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 0.675214 Oct 29 21:08:02.195687 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2524/4936] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:01 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:02.201123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:02.201776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:02.217574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.217791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.218241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.218942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.219587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.220190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.251755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 HTTP/1.1 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '3ee24132-334a-4feb-afe0-95a3a8f725c4'} Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:02.256341 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.260493 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.263495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:02.264717 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee7cffc4-8446-4c48-b61a-0ac9c7378e5b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 404 len: 111 microversion: 2.1 time: 0.067816 Oct 29 21:08:02.265508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2525/4937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:02 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:02.271645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:02.273353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:02.285587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.286426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.287765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.304551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.308312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.309177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.339329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Updating instance_info_cache with network_info: [{"id": "35b75f78-bda7-48b1-a06f-42da9a136ed2", "address": "fa:16:3e:ad:bd:7d", "network": {"id": "9f52494a-96f3-4813-b563-8abeb5d916ec", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1817506073-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a7c2c32214f44c15baa6d6dc2aa95b2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap35b75f78-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138884) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 21:08:02.355943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Releasing lock "refresh_cache-26866831-09f1-497e-a037-571a033b29d3" {{(pid=138884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 21:08:02.356847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3d8efc7-afde-4df6-9b1e-c052b73d7a88 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action" status: 202 len: 0 microversion: 2.1 time: 6.942025 Oct 29 21:08:02.357809 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2413/4938] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:07:55 2022] POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action => generated 0 bytes in 6943 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 21:08:02.375068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee24132-334a-4feb-afe0-95a3a8f725c4", "name": "network-vif-deleted", "tag": "1b906195-2cbc-41b8-be84-5882e77b71a6"}, {"name": "network-changed", "server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:02.396519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.397023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.397491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.421674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] Creating event network-vif-deleted:1b906195-2cbc-41b8-be84-5882e77b71a6 for instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 on nch1-master-1 Oct 29 21:08:02.422216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] Creating event network-changed:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:08:02.431363 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bac05c5b-7929-4cd4-a5e9-5d29d24e919d req-3af5d0ae-83e0-4083-9340-1dddc142b33c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071751 Oct 29 21:08:02.433253 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2414/4939] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:02.441510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:02.444662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:02.453745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.454264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.455108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.456624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.457269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.458054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.577158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:02.591173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:02.594387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:02.599895 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8952abcd-1be7-4eec-94a5-e80374a41edf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1266 microversion: 2.26 time: 0.333116 Oct 29 21:08:02.600500 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2526/4940] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:02 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:02.605220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:02.605762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:02.626798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.628058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.628833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.631753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:02.632477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:02.633090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:02.683021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 HTTP/1.1 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '3ee24132-334a-4feb-afe0-95a3a8f725c4'} Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:02.685007 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:02.689711 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:02.698284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:02.701246 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7e247c4f-404e-48f4-a188-725904471bfe tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 404 len: 111 microversion: 2.1 time: 0.097977 Oct 29 21:08:02.702278 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2527/4941] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:02 2022] DELETE /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:02.707959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.148"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:03.391700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:03.402671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:03.403441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:03.404135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:03.410988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:03.416951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:03.419456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:03.420306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:03.426112 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4192ad0-1cad-4899-811b-d36069322b82 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.989925 Oct 29 21:08:03.448573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2415/4942] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:02 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:03.456427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:03.459738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 3ee24132-334a-4feb-afe0-95a3a8f725c4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:03.488503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:03.489092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:03.489567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:03.490823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:03.492736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:03.493484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:03.531199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 HTTP/1.1 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '3ee24132-334a-4feb-afe0-95a3a8f725c4'} Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:03.535702 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. Oct 29 21:08:03.541438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:03.547882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 3ee24132-334a-4feb-afe0-95a3a8f725c4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:03.548981 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74f61e3f-bcae-4062-a5d6-de8ac3a197ef tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4" status: 404 len: 111 microversion: 2.1 time: 0.099135 Oct 29 21:08:03.550854 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2416/4943] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:03 2022] GET /compute/v2.1/servers/3ee24132-334a-4feb-afe0-95a3a8f725c4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:03.563835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:03.564812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:03.579921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:03.580432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:03.580917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:03.581674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:03.582143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:03.582579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:04.246190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:04.257752 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45267176-d738-4bf9-8601-b94fee564244 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 0.697761 Oct 29 21:08:04.260577 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2417/4944] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:03 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:04.278513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:04.279298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:04.286342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:04.286901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:04.287352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:04.290560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:04.292450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:04.292925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:04.528976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "refresh_cache-26866831-09f1-497e-a037-571a033b29d3" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 21:08:04.530139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquired lock "refresh_cache-26866831-09f1-497e-a037-571a033b29d3" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 21:08:05.395821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:05.449420 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e8fdc13-6da7-402d-bb34-7e682cceb5c1 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 1.174881 Oct 29 21:08:05.453375 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2418/4945] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:04 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:05.475111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:05.475629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:05.496032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:05.496544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:05.496991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:05.497747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:05.498209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:05.500583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:05.534965 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a HTTP/1.1 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a'} Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:05.542169 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:05.545943 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:05.549115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:05.551108 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29e4a439-f1c3-4405-aa62-1986cbef0964 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 404 len: 111 microversion: 2.1 time: 0.094440 Oct 29 21:08:05.559042 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2419/4946] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:05 2022] DELETE /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:05.565031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:05.572364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:05.585392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:05.587142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:05.588225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:05.590374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:05.591096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:05.592600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:05.902626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:05.908095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:05.938817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:05.940879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:05.943118 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff0e4de2-619a-4fec-8c37-e1cee93d7641 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1362 microversion: 2.26 time: 0.382809 Oct 29 21:08:05.944887 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2420/4947] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:05 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:05.952689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:05.953965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:05.961995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:05.962754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:05.963385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:05.964178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:05.964795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:05.966947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:06.318517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:06.365990 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89c0d551-f46d-4d85-b6f6-f12bf365c2dc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 0.418549 Oct 29 21:08:06.367886 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2421/4948] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:05 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:06.387428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c931051-728b-41aa-a53d-5609de601aec tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-808871486_updated"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:06.395670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Building network info cache for instance {{(pid=138885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 21:08:06.410041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c931051-728b-41aa-a53d-5609de601aec tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: abc11551-1c02-414f-8295-24a7a80a3773] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:06.420529 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-2c931051-728b-41aa-a53d-5609de601aec tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance abc11551-1c02-414f-8295-24a7a80a3773 could not be found. Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c931051-728b-41aa-a53d-5609de601aec tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: request: PUT /compute/v2.1/servers/abc11551-1c02-414f-8295-24a7a80a3773 HTTP/1.1 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 80 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-808871486_updated"}} Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance abc11551-1c02-414f-8295-24a7a80a3773 could not be found. Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'abc11551-1c02-414f-8295-24a7a80a3773', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-808871486_updated'}}} Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc11551-1c02-414f-8295-24a7a80a3773 could not be found. Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 21:08:06.422486 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc11551-1c02-414f-8295-24a7a80a3773 could not be found. Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc11551-1c02-414f-8295-24a7a80a3773 could not be found. Oct 29 21:08:06.427594 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.430285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c931051-728b-41aa-a53d-5609de601aec tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance abc11551-1c02-414f-8295-24a7a80a3773 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:06.431350 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c931051-728b-41aa-a53d-5609de601aec tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "PUT /compute/v2.1/servers/abc11551-1c02-414f-8295-24a7a80a3773" status: 404 len: 111 microversion: 2.1 time: 0.062291 Oct 29 21:08:06.432118 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2422/4949] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:08:06 2022] PUT /compute/v2.1/servers/abc11551-1c02-414f-8295-24a7a80a3773 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:06.437160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:06.438022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:06.447704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:06.448452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:06.449068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:06.450139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:06.450905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:06.451508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:06.470213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a HTTP/1.1 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a'} Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:06.472193 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. Oct 29 21:08:06.477199 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:06.479282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:06.480354 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-400a2462-1123-4d92-9e21-175ad6572f96 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a" status: 404 len: 111 microversion: 2.1 time: 0.047077 Oct 29 21:08:06.481117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2423/4950] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:06 2022] GET /compute/v2.1/servers/e1a0659c-8e8d-4f82-99c7-1e2f0bc9716a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:06.825844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e165cfc7-a516-430e-876c-5c8b9a11fd65 req-497b50ef-209d-4530-9f5a-03c24d5e305c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cac2c229-9a05-4448-820f-7fb7940d7f64", "tag": "199a5f5d-8714-4226-96ea-035293fc0b41"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:06.846299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e165cfc7-a516-430e-876c-5c8b9a11fd65 req-497b50ef-209d-4530-9f5a-03c24d5e305c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:06.846875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e165cfc7-a516-430e-876c-5c8b9a11fd65 req-497b50ef-209d-4530-9f5a-03c24d5e305c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:06.847900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e165cfc7-a516-430e-876c-5c8b9a11fd65 req-497b50ef-209d-4530-9f5a-03c24d5e305c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:06.870248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e165cfc7-a516-430e-876c-5c8b9a11fd65 req-497b50ef-209d-4530-9f5a-03c24d5e305c service nova] Creating event network-changed:199a5f5d-8714-4226-96ea-035293fc0b41 for instance cac2c229-9a05-4448-820f-7fb7940d7f64 on nch2-master-1 Oct 29 21:08:06.876597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e165cfc7-a516-430e-876c-5c8b9a11fd65 req-497b50ef-209d-4530-9f5a-03c24d5e305c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393867 Oct 29 21:08:06.878335 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2424/4951] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:06.887290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8aa05c89-4969-4d3c-bd91-3ca8656d616e req-8307af2b-a140-49da-a1d5-0819254967f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:06.898926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8aa05c89-4969-4d3c-bd91-3ca8656d616e req-8307af2b-a140-49da-a1d5-0819254967f0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:06.899724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8aa05c89-4969-4d3c-bd91-3ca8656d616e req-8307af2b-a140-49da-a1d5-0819254967f0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:06.900546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8aa05c89-4969-4d3c-bd91-3ca8656d616e req-8307af2b-a140-49da-a1d5-0819254967f0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:06.914400 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8aa05c89-4969-4d3c-bd91-3ca8656d616e req-8307af2b-a140-49da-a1d5-0819254967f0 service nova] Creating event network-changed:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:08:06.920441 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8aa05c89-4969-4d3c-bd91-3ca8656d616e req-8307af2b-a140-49da-a1d5-0819254967f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040359 Oct 29 21:08:06.921813 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2425/4952] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:06.929572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:06.930980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:06.946164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:06.946878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:06.947674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:06.948770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:06.949515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:06.950145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:07.475083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:07.491575 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d0b4d2d9-14f1-4e8e-95a9-b5f60dff0e37 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.567876 Oct 29 21:08:07.493396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2426/4953] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:06 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:07.504812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:07.505529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:07.530766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:07.535843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:07.536713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:07.537778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:07.538530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:07.539799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:07.587389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 HTTP/1.1 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '283c0d72-0b7e-4802-ab7c-0d9ac1881f51'} Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:07.589070 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11e278c2-0636-4608-a8d5-cd884eba4079 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 404 len: 111 microversion: 2.1 time: 0.096035 Oct 29 21:08:07.594638 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2427/4954] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:07 2022] DELETE /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:07.618092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:07.618789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:07.629710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:07.634173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:07.638086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:07.639524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:07.640173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:07.640773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:07.869986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Updating instance_info_cache with network_info: [{"id": "35b75f78-bda7-48b1-a06f-42da9a136ed2", "address": "fa:16:3e:ad:bd:7d", "network": {"id": "9f52494a-96f3-4813-b563-8abeb5d916ec", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1817506073-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a7c2c32214f44c15baa6d6dc2aa95b2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap35b75f78-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=138885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 21:08:07.889439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Releasing lock "refresh_cache-26866831-09f1-497e-a037-571a033b29d3" {{(pid=138885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 21:08:07.890786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acde71a3-7f7b-415a-a153-8c3aa4dd6c08 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action" status: 202 len: 0 microversion: 2.1 time: 5.186960 Oct 29 21:08:07.891733 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2528/4955] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:02 2022] POST /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3/action => generated 0 bytes in 5189 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 21:08:07.899633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f58d84fc-2c51-4106-ad70-04ca202ec8fe req-ae802afa-fa2f-45ca-b1fe-591c0e0b627e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b140d99d-dddc-4190-9cb9-daede056c5d9", "name": "network-vif-plugged", "status": "completed", "tag": "771dcf6d-287d-49aa-bdc8-b7a12e4c6218"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:07.920553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f58d84fc-2c51-4106-ad70-04ca202ec8fe req-ae802afa-fa2f-45ca-b1fe-591c0e0b627e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:07.921482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f58d84fc-2c51-4106-ad70-04ca202ec8fe req-ae802afa-fa2f-45ca-b1fe-591c0e0b627e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:07.922123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f58d84fc-2c51-4106-ad70-04ca202ec8fe req-ae802afa-fa2f-45ca-b1fe-591c0e0b627e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:07.941233 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f58d84fc-2c51-4106-ad70-04ca202ec8fe req-ae802afa-fa2f-45ca-b1fe-591c0e0b627e service nova] Creating event network-vif-plugged:771dcf6d-287d-49aa-bdc8-b7a12e4c6218 for instance b140d99d-dddc-4190-9cb9-daede056c5d9 on nch1-master-1 Oct 29 21:08:07.949969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f58d84fc-2c51-4106-ad70-04ca202ec8fe req-ae802afa-fa2f-45ca-b1fe-591c0e0b627e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056701 Oct 29 21:08:07.952008 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2529/4956] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:07.958896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:07.960366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:07.978280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:07.999932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:08.000870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:08.004047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:08.005749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:08.009117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:08.009871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:08.012681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:08.013754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:08.015221 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1aa727b2-44f7-4a94-89ec-6092f22400ec tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1362 microversion: 2.26 time: 0.414398 Oct 29 21:08:08.023513 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2428/4957] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:07 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:08.045364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:08.046615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:08.062285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:08.064735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:08.068504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:08.072576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:08.073128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:08.074757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:08.717269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:08.736460 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a361469f-ef7f-434d-921b-4e8266b00ef9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.704717 Oct 29 21:08:08.737400 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2429/4958] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:08 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:08.742518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:08.743441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 283c0d72-0b7e-4802-ab7c-0d9ac1881f51] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:08.750859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:08.751675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:08.752385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:08.754561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:08.755276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:08.755938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:08.787530 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 HTTP/1.1 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '283c0d72-0b7e-4802-ab7c-0d9ac1881f51'} Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:08.791339 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. Oct 29 21:08:08.796237 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:08.799016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 283c0d72-0b7e-4802-ab7c-0d9ac1881f51 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:08.803655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1bf6a35c-19d9-46bb-af47-944def9aadaf tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51" status: 404 len: 111 microversion: 2.1 time: 0.064267 Oct 29 21:08:08.806765 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2430/4959] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:08 2022] GET /compute/v2.1/servers/283c0d72-0b7e-4802-ab7c-0d9ac1881f51 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:08.821027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-33e4756a-95c8-4399-b78f-0a0e23123b6b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '.version_select at 0x7fa170a38ca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:08.946874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:08.959732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67733595-2a55-4c43-95ef-f32c4ef949ec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1313 microversion: 2.1 time: 1.005064 Oct 29 21:08:08.963174 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2530/4960] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:07 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1313 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:08.992124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b70c153-7aa0-45ec-9abb-f75313a37285 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b70c153-7aa0-45ec-9abb-f75313a37285 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee HTTP/1.1 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 280 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.003897 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b70c153-7aa0-45ec-9abb-f75313a37285 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:09.007975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b70c153-7aa0-45ec-9abb-f75313a37285 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "PUT /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 400 len: 619 microversion: 2.1 time: 0.026365 Oct 29 21:08:09.014611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2531/4961] 10.222.0.36 () {60 vars in 1257 bytes} [Sat Oct 29 21:08:08 2022] PUT /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:08:09.029759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:09.030607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:09.046498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:09.047261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:09.047884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:09.050445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:09.054141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:09.054942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:09.086661 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 HTTP/1.1 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '7c9e357c-33ce-49c3-9464-960551d978e4'} Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:09.091065 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:09.096380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:09.099245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:09.101434 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d13386d-849f-4616-9a7d-44035a62c42a tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 404 len: 111 microversion: 2.1 time: 0.085572 Oct 29 21:08:09.104570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2532/4962] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:09 2022] DELETE /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:09.115771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:09.122061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:09.135569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:09.137047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:09.137753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:09.141069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:09.142084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:09.143420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:09.566071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:09.589864 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-80865854-a5ac-42bd-a337-e6a91a7ea83e tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.483907 Oct 29 21:08:09.590757 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2533/4963] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:09 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:09.617165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:09.618196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:09.625979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:09.626731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:09.627517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:09.628576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:09.629209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:09.630019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.004949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:10.014734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:10.019680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:10.026120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62855ec0-5d01-469b-92af-009416e73d38 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1362 microversion: 2.26 time: 0.417207 Oct 29 21:08:10.026930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2534/4964] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:09 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:10.042129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:10.042769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 7c9e357c-33ce-49c3-9464-960551d978e4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.050864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.051489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.051984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.052795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.053264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.053779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.069945 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 HTTP/1.1 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '7c9e357c-33ce-49c3-9464-960551d978e4'} Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.071883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. Oct 29 21:08:10.076625 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.077875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 7c9e357c-33ce-49c3-9464-960551d978e4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:10.078902 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ca21f8e-bfd5-486a-ab9a-981c585f40ea tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4" status: 404 len: 111 microversion: 2.1 time: 0.050879 Oct 29 21:08:10.080128 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2535/4965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:10 2022] GET /compute/v2.1/servers/7c9e357c-33ce-49c3-9464-960551d978e4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:10.093653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:10.094330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.112873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.113960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.114377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.115145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.115613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.116200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.346041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:10.357860 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-277ffa6a-2a00-42b6-8f65-aafab20bcb31 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.275835 Oct 29 21:08:10.359804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2536/4966] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:10 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:10.367058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:10.368017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.375732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.378392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.379189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.379960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.380431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.380961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.595061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:10.608240 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc8072e9-4511-4146-81ea-0485dd329bf0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1499 microversion: 2.1 time: 0.246047 Oct 29 21:08:10.609949 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2537/4967] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:10 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1499 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:10.625630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:10.626146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.639579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.640126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.640586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.641319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.641832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.642263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.658675 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 HTTP/1.1 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '93143995-41eb-46b6-881a-d9c9c353df71'} Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:10.660274 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:10.664790 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3e0815e-c2b2-46c3-82d5-88e006dbd5a3 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 404 len: 111 microversion: 2.1 time: 0.050740 Oct 29 21:08:10.665776 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2538/4968] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:10 2022] DELETE /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:10.670276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb35e398-64fc-48c3-babf-f9bff928d684 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb35e398-64fc-48c3-babf-f9bff928d684 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee HTTP/1.1 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 24 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": ""}} Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee', 'body': {'server': {'name': ''}}} Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '' Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:08:10.674139 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb35e398-64fc-48c3-babf-f9bff928d684 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:10.679716 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb35e398-64fc-48c3-babf-f9bff928d684 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "PUT /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 400 len: 108 microversion: 2.1 time: 0.009934 Oct 29 21:08:10.680764 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2539/4969] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:08:10 2022] PUT /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:08:10.685232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:10.687598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.696294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.696797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.697282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.698048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.698521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.698959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.760778 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-12028200-8a8f-474d-b16b-89c4fc0e6195 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.079189 Oct 29 21:08:10.764282 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2540/4970] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:10 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:10.775372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:10.776133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 93143995-41eb-46b6-881a-d9c9c353df71] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.792161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.792666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.794691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.796100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.796585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.803836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.830377 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.839187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-33e4756a-95c8-4399-b78f-0a0e23123b6b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/8e3bed6b-4031-4e5a-b61b-01ad4aed25de" status: 202 len: 0 microversion: 2.1 time: 2.030272 Oct 29 21:08:10.839887 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2431/4971] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:08:08 2022] DELETE /compute/v2.1/os-floating-ips/8e3bed6b-4031-4e5a-b61b-01ad4aed25de => generated 0 bytes in 2032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 HTTP/1.1 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '93143995-41eb-46b6-881a-d9c9c353df71'} Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:10.846769 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 93143995-41eb-46b6-881a-d9c9c353df71 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:10.850757 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a35f277b-8b52-424d-bdf3-2fb23602058b tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71" status: 404 len: 111 microversion: 2.1 time: 0.082913 Oct 29 21:08:10.851315 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2541/4972] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:10 2022] GET /compute/v2.1/servers/93143995-41eb-46b6-881a-d9c9c353df71 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:10.853111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:10.854677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:10.864933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.865703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.866520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.867411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:10.868176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:10.868825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:10.884703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a415dd9-8349-4490-b8ea-6e937f1c204b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '.version_select at 0x7fa170345c10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:11.055654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:11.130229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:11.162539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:11.175127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff1281bb-df25-4547-bec7-b56859485573 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1506 microversion: 2.1 time: 0.333347 Oct 29 21:08:11.175985 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2432/4973] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:10 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:11.186498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:11.187407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:11.206720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.207511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.208129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.209037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.209736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.212718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.356859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a415dd9-8349-4490-b8ea-6e937f1c204b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/02fc1eaf-112a-460d-8fb1-70e58e444f59" status: 202 len: 0 microversion: 2.1 time: 0.504719 Oct 29 21:08:11.358337 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2542/4974] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:08:10 2022] DELETE /compute/v2.1/os-security-groups/02fc1eaf-112a-460d-8fb1-70e58e444f59 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:11.369119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:11.369974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:11.388002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.388548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.389000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.395071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.395638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.396154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.475808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:08:11.562348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:11.577897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:11.590257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:11.591652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54e06283-c2e4-4711-ac51-ab416a465a94 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1362 microversion: 2.26 time: 0.414607 Oct 29 21:08:11.606286 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2433/4975] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:11 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:11.668185 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34ca3cc0-ae91-4689-a4e8-16c98f2e8502 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "DELETE /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 204 len: 0 microversion: 2.1 time: 0.304521 Oct 29 21:08:11.669702 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2543/4976] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:11 2022] DELETE /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:08:11.679407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:11.680740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:11.689743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.690774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.691945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.692963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.694007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.694710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.782707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:11.786362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:11.825745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.826263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.826718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.827455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:11.827912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:11.828427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:11.952114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:11.962525 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8beb4c22-35b9-4173-9dba-8b73c824c84b tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1510 microversion: 2.1 time: 0.288883 Oct 29 21:08:11.964546 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2434/4977] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:11 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:12.068162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:12.068694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:12.076844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.077445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.077782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.080867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.081784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.083223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.098550 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a HTTP/1.1 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ca9675b6-7c57-4107-987d-c6f581c3d43a'} Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:12.100351 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-feb51488-c3ca-49de-8975-ca2de55a0b0d tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 404 len: 111 microversion: 2.1 time: 0.038262 Oct 29 21:08:12.104509 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2435/4978] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:12 2022] DELETE /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:08:12.110055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:12.110886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: ca9675b6-7c57-4107-987d-c6f581c3d43a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:12.117132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:12.118757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.120893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.121351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.122098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.122561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.123000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.156324 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a HTTP/1.1 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'ca9675b6-7c57-4107-987d-c6f581c3d43a'} Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.158902 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance ca9675b6-7c57-4107-987d-c6f581c3d43a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6bf601c9-d23e-434e-8910-41c476e4e40f tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a" status: 404 len: 111 microversion: 2.1 time: 0.054000 Oct 29 21:08:12.166484 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2436/4979] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:12 2022] GET /compute/v2.1/servers/ca9675b6-7c57-4107-987d-c6f581c3d43a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:08:12.175935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:12.176457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:12.182958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.183452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.183893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.184601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.185220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.185834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.200795 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb HTTP/1.1 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '90c44b4c-753e-4d71-b652-2ac9e04befcb'} Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:12.202520 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.207570 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.211322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:12.211543 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f02878d-be3b-48ec-82a9-7e41f8e19cd5 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 404 len: 111 microversion: 2.1 time: 0.045089 Oct 29 21:08:12.214604 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2437/4980] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:12 2022] DELETE /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:08:12.222483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:12.223105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] [instance: 90c44b4c-753e-4d71-b652-2ac9e04befcb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:12.229811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.230482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.231130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.233118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.233774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.234360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.253554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] HTTP exception thrown: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Request method failure captured: Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb HTTP/1.1 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZT0FiQ2PgFXnvHTygCfiKC7s08DOt47RTXIvxP4fuJ7mkxx4fU-WEV34dr_EBghifO5oZ3vHXJ-YEUz9wflFZS7gAo4oT8uUCP0RCh_I9ab3CNDgcx7awineypLze033vn0lsyvT5btcfXbs0rkHTm_lNmaOmAsSJJikMzd3cf4vWM Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6a46c1f647934440925ebc5e0b373ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6a46c1f647934440925ebc5e0b373ca0 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-860327279 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 282339dc65a54bc99850b172ed427d75 Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-860327279-project Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '90c44b4c-753e-4d71-b652-2ac9e04befcb'} Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:12.255103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] Returning 404 to user: Instance 90c44b4c-753e-4d71-b652-2ac9e04befcb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-722a4bab-8383-4e76-8908-7be6d67bd5e6 tempest-DeleteServersTestJSON-860327279 tempest-DeleteServersTestJSON-860327279-project] 10.222.0.36 "GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb" status: 404 len: 111 microversion: 2.1 time: 0.038046 Oct 29 21:08:12.259375 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2438/4981] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:12 2022] GET /compute/v2.1/servers/90c44b4c-753e-4d71-b652-2ac9e04befcb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:08:12.357408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d9899b80-781b-4723-86ae-e2b65df5c3a7 req-9a427e51-d665-47b3-8869-03316b1ee4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac2c229-9a05-4448-820f-7fb7940d7f64", "name": "network-vif-plugged", "status": "completed", "tag": "199a5f5d-8714-4226-96ea-035293fc0b41"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:12.376214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9899b80-781b-4723-86ae-e2b65df5c3a7 req-9a427e51-d665-47b3-8869-03316b1ee4e4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.376752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9899b80-781b-4723-86ae-e2b65df5c3a7 req-9a427e51-d665-47b3-8869-03316b1ee4e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.377241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d9899b80-781b-4723-86ae-e2b65df5c3a7 req-9a427e51-d665-47b3-8869-03316b1ee4e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.413827 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d9899b80-781b-4723-86ae-e2b65df5c3a7 req-9a427e51-d665-47b3-8869-03316b1ee4e4 service nova] Creating event network-vif-plugged:199a5f5d-8714-4226-96ea-035293fc0b41 for instance cac2c229-9a05-4448-820f-7fb7940d7f64 on nch2-master-1 Oct 29 21:08:12.418621 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d9899b80-781b-4723-86ae-e2b65df5c3a7 req-9a427e51-d665-47b3-8869-03316b1ee4e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065509 Oct 29 21:08:12.419524 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2439/4982] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:08:12.622888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:12.623720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:12.634519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.635881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.636878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.638180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:12.638865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:12.640250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:12.965778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:12.979994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:12.983727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:12.987129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d245281-4fd2-4b34-bc39-f80e3d14a68b tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1362 microversion: 2.26 time: 0.368556 Oct 29 21:08:12.989495 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2440/4983] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:12 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:08:12.995873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:12.997866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:13.014919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.015746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.016463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.017643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.018900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.019423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.308138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:13.318218 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af868e18-4b16-439a-8cff-21ac810af3a7 tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1510 microversion: 2.1 time: 0.327419 Oct 29 21:08:13.319079 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2441/4984] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:12 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:13.551035 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-248744be-d26d-4ad5-bb18-09baea82cb12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 1.779479 Oct 29 21:08:13.567644 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2544/4985] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:11 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 21:08:13.744409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:13.745339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:13.753077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.753957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.754803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.755776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.756461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.757132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.786401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea HTTP/1.1 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9f5c6dc5-d9a2-43a8-816c-958c3f931aea'} Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:13.788447 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.792245 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.795014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:13.797719 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5cd26cf0-7cb0-4945-9b3e-6160c31eeee9 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 404 len: 111 microversion: 2.1 time: 0.058230 Oct 29 21:08:13.798838 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2442/4986] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:13 2022] DELETE /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:13.808646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:13.810339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 9f5c6dc5-d9a2-43a8-816c-958c3f931aea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:13.819850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.820351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.820794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.825774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.826456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.828088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.859628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:13.862390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea HTTP/1.1 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9f5c6dc5-d9a2-43a8-816c-958c3f931aea'} Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.864522 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. Oct 29 21:08:13.869196 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:13.871239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 9f5c6dc5-d9a2-43a8-816c-958c3f931aea could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:13.872140 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65667e8b-08c4-437e-a569-40a61b2ac855 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea" status: 404 len: 111 microversion: 2.1 time: 0.068152 Oct 29 21:08:13.872733 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2545/4987] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:13 2022] GET /compute/v2.1/servers/9f5c6dc5-d9a2-43a8-816c-958c3f931aea => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:13.881939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:13.882792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:13.891537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.892275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.892976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.893954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:13.894611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:13.895482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:13.938508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:08:14.028670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:14.029730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:14.044511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.046338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.048799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.050549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.053695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.054413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.083811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e73edfd2-eee1-430c-8466-870a400e676c tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 204 len: 0 microversion: 2.1 time: 0.205992 Oct 29 21:08:14.084436 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2443/4988] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:08:13 2022] DELETE /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:08:14.093528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:14.094639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:14.114047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.114937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.115635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.116649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.117378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.118069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.847128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:14.856328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-751e9f54-576d-47a2-9564-65fc539bfd35 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.767230 Oct 29 21:08:14.856916 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2444/4989] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:14 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:14.866726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:14.877224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:14.878648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:14.879086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:14.880945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:14.884478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9e2b931-1f1c-4f6c-b7f0-909137e7f1a1 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1362 microversion: 2.26 time: 0.864610 Oct 29 21:08:14.886738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.889003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.890335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.891391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.892068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.893966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.901670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:14.909789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2546/4990] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:14 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1362 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:14.915920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:14.916487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:14.950846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.951371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.951810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:14.952568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:14.953029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:14.962983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:15.140671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lazy-loading 'services' on Instance uuid 799d00cc-130b-4a02-b9ed-0fdb136dad85 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:15.228813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:15.242831 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84d9270a-23aa-4a14-8b99-47eebe6efc0e tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1510 microversion: 2.1 time: 0.384568 Oct 29 21:08:15.256412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2445/4991] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:14 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:15.266953 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f54f9673-9011-40bf-8693-518b482099b0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-volume_attachments/c40a99ee-b65d-4555-8a47-9a9439c99cae" status: 202 len: 0 microversion: 2.1 time: 0.355150 Oct 29 21:08:15.267852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2547/4992] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:08:14 2022] DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-volume_attachments/c40a99ee-b65d-4555-8a47-9a9439c99cae => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:15.286024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:15.305444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:15.332096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:15.332692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:15.333353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:15.335378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:15.338797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:15.339267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:15.512021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a602780-f888-4947-ab2a-4200aeb041a8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.253782 Oct 29 21:08:15.513122 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2446/4993] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:15 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:15.883319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:15.884095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:15.901382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:15.903494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:15.904203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:15.907767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:15.911093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:15.912000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:15.919230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:15.920241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:15.931779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:15.932285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:15.932739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:15.933481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:15.939055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:15.941863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:16.821368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:16.832948 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1fee888-3370-4855-8638-1c8b983eaedf tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.956278 Oct 29 21:08:16.854048 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2548/4994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:15 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:16.860974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:16.862762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:16.872810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:16.873729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:16.874674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:16.875631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:16.876360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:16.877027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:16.973029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:16.983531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:16.985287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:16.986656 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3cdafdc0-d640-43b9-9110-849c258673e7 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1545 microversion: 2.26 time: 1.073567 Oct 29 21:08:16.987880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2447/4995] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:15 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1545 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:17.003051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4ccef72-7be1-42dc-b43c-30664c3067de tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:17.021609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ccef72-7be1-42dc-b43c-30664c3067de tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.022579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ccef72-7be1-42dc-b43c-30664c3067de tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.023231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4ccef72-7be1-42dc-b43c-30664c3067de tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.057209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4ccef72-7be1-42dc-b43c-30664c3067de tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Going to try to stop instance {{(pid=138884) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:08:17.132736 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4ccef72-7be1-42dc-b43c-30664c3067de tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action" status: 202 len: 0 microversion: 2.1 time: 0.137959 Oct 29 21:08:17.133651 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2448/4996] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:16 2022] POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:17.153668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:17.161126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:17.172710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.173553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.176082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.177063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.181437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.183154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.273517 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e43d63e-8b85-49c9-b413-4543101489db tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.138192 Oct 29 21:08:17.274479 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2449/4997] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:17 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:17.281782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa170a27430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:17.298486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.299369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.300958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.302038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:17.318548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.319284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.319918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.323355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.324109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.324754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.379113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.379708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.380345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.407161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.408386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.409736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.480096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:17.519807 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-486cc500-2b6d-434a-94b1-757e14e405cd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-387707551" status: 201 len: 0 microversion: 2.26 time: 0.243333 Oct 29 21:08:17.532501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2450/4998] 10.222.0.36 () {62 vars in 1377 bytes} [Sat Oct 29 21:08:17 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-387707551 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 21:08:17.538618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:17.539574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:17.546021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.546515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.546961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.547678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.548142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.548576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.560826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0935d27b49345729582625be6946cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c2c32214f44c15baa6d6dc2aa95b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:17.576703 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8a1cdce9-4110-424c-ab72-53f1cac1506a tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 200 len: 1510 microversion: 2.1 time: 0.721191 Oct 29 21:08:17.577296 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2549/4999] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:16 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 1510 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:17.583196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61da292b-d093-4113-b187-bb15542843d3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1762981f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:17.609421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61da292b-d093-4113-b187-bb15542843d3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.610401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61da292b-d093-4113-b187-bb15542843d3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.611435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61da292b-d093-4113-b187-bb15542843d3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.651541 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61da292b-d093-4113-b187-bb15542843d3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-387707551" status: 204 len: 0 microversion: 2.26 time: 0.072479 Oct 29 21:08:17.655977 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2550/5000] 10.222.0.36 () {60 vars in 1358 bytes} [Sat Oct 29 21:08:17 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-387707551 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:17.662555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4c732737-b387-4ea3-9e38-cf2a16ce5391 req-7f28c58f-747e-42fd-be2f-25dbcb27709a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26866831-09f1-497e-a037-571a033b29d3", "name": "network-vif-deleted", "tag": "35b75f78-bda7-48b1-a06f-42da9a136ed2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:17.673345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4c732737-b387-4ea3-9e38-cf2a16ce5391 req-7f28c58f-747e-42fd-be2f-25dbcb27709a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.674232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4c732737-b387-4ea3-9e38-cf2a16ce5391 req-7f28c58f-747e-42fd-be2f-25dbcb27709a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.674915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4c732737-b387-4ea3-9e38-cf2a16ce5391 req-7f28c58f-747e-42fd-be2f-25dbcb27709a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.694326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4c732737-b387-4ea3-9e38-cf2a16ce5391 req-7f28c58f-747e-42fd-be2f-25dbcb27709a service nova] Creating event network-vif-deleted:35b75f78-bda7-48b1-a06f-42da9a136ed2 for instance 26866831-09f1-497e-a037-571a033b29d3 on nch1-master-1 Oct 29 21:08:17.700370 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4c732737-b387-4ea3-9e38-cf2a16ce5391 req-7f28c58f-747e-42fd-be2f-25dbcb27709a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042618 Oct 29 21:08:17.701279 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2551/5001] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:17.713097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa176344b80>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:17.723476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.724340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.725446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.727723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:17.737404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.738262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.740021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.741579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.743588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.746299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.777852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:17.779724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:17.780719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:17.804275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:17.820103 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [22be7d3f-3c68-493e-a533-41213e7f7ed6] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:08:17.986102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:18.007977 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d40dadb-f052-4f91-b814-7965ac147218 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1677 microversion: 2.1 time: 0.467529 Oct 29 21:08:18.009083 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2451/5002] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:17 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1677 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:18.016764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:18.019419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:18.035383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.035892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.036338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.037079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.037579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.038018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.490909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7c243e53fb4f3a895b665028a14373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6173752e65384e85a2bcc8c3e542931a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:18.509842 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d43d6551-6a29-4889-a82a-76ef5908d590 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 200 len: 1512 microversion: 2.1 time: 0.499307 Oct 29 21:08:18.511168 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2452/5003] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:18 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 1512 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:18.523349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:18.526756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:18.535796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.536616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.537300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.538706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.539642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.540340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.659710 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e0fc915-6a05-4ab6-9ca9-f516ce32e48a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.145708 Oct 29 21:08:18.660873 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2453/5004] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:18 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:18.676899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:18.679146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] [instance: 26866831-09f1-497e-a037-571a033b29d3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:18.710942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.711457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.711903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.712627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.713094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.713565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.736343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] HTTP exception thrown: Instance 26866831-09f1-497e-a037-571a033b29d3 could not be found. Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Request method failure captured: Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 HTTP/1.1 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZXjqcRCCMBkJzGaMDsYYJ1y3BVbLeB9Jf3k5AHLg6EGSjgdWCQ5hBulfciVkeulyglXGpq_a90WMcLfNO0O0mzrZlaBwwl9NTFhWkXl3SofRMl-c_8h9xoMXQJiVFyHFJOz7E01zkQ9LkanTgm1DgtuYAhKA0j5W1PArpsdZvOTpj0 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a7c2c32214f44c15baa6d6dc2aa95b2d Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-284036932 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c2c32214f44c15baa6d6dc2aa95b2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a7c2c32214f44c15baa6d6dc2aa95b2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c2c32214f44c15baa6d6dc2aa95b2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a7c2c32214f44c15baa6d6dc2aa95b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-284036932 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a7c2c32214f44c15baa6d6dc2aa95b2d Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-284036932 Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerRescueTestJSONUnderV235-284036932-project Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d0935d27b49345729582625be6946cfa Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-284036932-project Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 26866831-09f1-497e-a037-571a033b29d3 could not be found. Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '26866831-09f1-497e-a037-571a033b29d3'} Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26866831-09f1-497e-a037-571a033b29d3 could not be found. Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26866831-09f1-497e-a037-571a033b29d3 could not be found. Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:18.751976 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26866831-09f1-497e-a037-571a033b29d3 could not be found. Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:08:18.756538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] Returning 404 to user: Instance 26866831-09f1-497e-a037-571a033b29d3 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:18.757505 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d80d42b-b699-4d6b-b21c-0edae42132fc tempest-ServerRescueTestJSONUnderV235-284036932 tempest-ServerRescueTestJSONUnderV235-284036932-project] 10.222.0.36 "GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3" status: 404 len: 111 microversion: 2.1 time: 0.094895 Oct 29 21:08:18.759483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2454/5005] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:18 2022] GET /compute/v2.1/servers/26866831-09f1-497e-a037-571a033b29d3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:18.829374 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [22be7d3f-3c68-493e-a533-41213e7f7ed6] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 39316. Oct 29 21:08:18.836427 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-adb6dd63-f79c-45a1-8d28-ce4d55c07b0e tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 204 len: 0 microversion: 2.26 time: 1.133659 Oct 29 21:08:18.837191 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2552/5006] 10.222.0.36 () {60 vars in 1295 bytes} [Sat Oct 29 21:08:17 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:18.852047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43ed2c47-79e4-4d3b-a975-55d44d04eeee tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa170e99430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:18.863149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43ed2c47-79e4-4d3b-a975-55d44d04eeee tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.863644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43ed2c47-79e4-4d3b-a975-55d44d04eeee tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.864093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43ed2c47-79e4-4d3b-a975-55d44d04eeee tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.899964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43ed2c47-79e4-4d3b-a975-55d44d04eeee tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 200 len: 12 microversion: 2.26 time: 0.056882 Oct 29 21:08:18.911800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1762988b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:18.913721 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2455/5007] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 21:08:18 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 12 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:18.931151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.931753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.932222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.932756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:18.940872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.941963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.942643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.943667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.944633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.945438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:18.985694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:18.986874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:18.987560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.018979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.019858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.020780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.036504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.037202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:19.062455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.063108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.063577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.064369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.067151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:19.073868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.074342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.091840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-501b7da5-bb90-4e42-a84f-14602f336180 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-382548939" status: 201 len: 0 microversion: 2.26 time: 0.184361 Oct 29 21:08:19.098113 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2553/5008] 10.222.0.36 () {62 vars in 1377 bytes} [Sat Oct 29 21:08:18 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-382548939 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 21:08:19.105661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26e35ed3-b48a-4be5-aa58-f394576f8967 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa17631bee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.114386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26e35ed3-b48a-4be5-aa58-f394576f8967 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.115164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26e35ed3-b48a-4be5-aa58-f394576f8967 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.115766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26e35ed3-b48a-4be5-aa58-f394576f8967 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.132950 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26e35ed3-b48a-4be5-aa58-f394576f8967 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 200 len: 35 microversion: 2.26 time: 0.032203 Oct 29 21:08:19.142310 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2554/5009] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 21:08:19 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 35 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:19.154541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1762fe790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.176441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.177060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.177740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.179126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:19.206975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.206975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.206975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.206975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.206975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.206975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.262710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.263668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.265079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.334758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:19.390922 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-145fdf31-401a-47dc-a6c9-9f03a48b38cf tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-382548939" status: 204 len: 0 microversion: 2.26 time: 0.245923 Oct 29 21:08:19.392890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2555/5010] 10.222.0.36 () {60 vars in 1361 bytes} [Sat Oct 29 21:08:19 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-382548939 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:19.405151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee6c9270-8e6e-422c-aa15-2095e42061f3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa17626a8b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.442657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6c9270-8e6e-422c-aa15-2095e42061f3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.443575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6c9270-8e6e-422c-aa15-2095e42061f3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.444845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee6c9270-8e6e-422c-aa15-2095e42061f3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.470482 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee6c9270-8e6e-422c-aa15-2095e42061f3 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 200 len: 12 microversion: 2.26 time: 0.070958 Oct 29 21:08:19.478349 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2556/5011] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 21:08:19 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 12 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:19.492280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa17626a820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.516958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.517738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.518422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.519230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:19.530734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.534613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.535211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.536117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.536711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.537423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.569041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.569707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.570254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.583438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:19.612754 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-665e7620-b1e8-4bff-babc-49e7001ebc91 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 204 len: 0 microversion: 2.26 time: 0.131836 Oct 29 21:08:19.621170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2557/5012] 10.222.0.36 () {60 vars in 1295 bytes} [Sat Oct 29 21:08:19 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:19.626568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.627410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] [instance: 97e7bb8a-f42c-415a-9898-3cb84f34e2ee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:19.634466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.635114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.635665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.636481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.637837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.638509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.661606 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] HTTP exception thrown: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee could not be found. Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Request method failure captured: Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee HTTP/1.1 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZVUIh0SGGkGSh59gJNZoIR6eK2VWzQsGHpulumHmUNLmzAawj6JkI8uF4BCsu-BKkPT25BgKIcF1FeHLdC0IW39CkEMMRReBlIkFqMvjuGSAFjFbPHZIvA7mjBGDO0VlE80qVcIZ5xjJAMyKupjsjiOffKAOO69u0tnZmU_WuuFvjw Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "tempest-type-1057867955", "name": "tempest-service-1018942887", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6173752e65384e85a2bcc8c3e542931a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6173752e65384e85a2bcc8c3e542931a Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1286545161 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 7c7c243e53fb4f3a895b665028a14373 Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-1286545161-project Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee could not be found. Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '97e7bb8a-f42c-415a-9898-3cb84f34e2ee'} Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee could not be found. Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee could not be found. Oct 29 21:08:19.664163 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee could not be found. Oct 29 21:08:19.672441 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:19.674876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] Returning 404 to user: Instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:19.676099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6955967f-2725-45fa-8ebb-2ec445872b98 tempest-ServersNegativeTestJSON-1286545161 tempest-ServersNegativeTestJSON-1286545161-project] 10.222.0.36 "GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee" status: 404 len: 111 microversion: 2.1 time: 0.053200 Oct 29 21:08:19.679825 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2558/5013] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:19 2022] GET /compute/v2.1/servers/97e7bb8a-f42c-415a-9898-3cb84f34e2ee => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:08:19.691192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa17630d940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:19.709195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.717926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.718661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.719326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:19.727141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.730230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.735263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.737280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.738051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.738685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.796369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.797315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.797315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.811918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.812409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.812858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.821358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:19.847331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:19.877704 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b55a8c98-33c5-409f-bc4a-cb899f5e26dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-1025820393" status: 201 len: 0 microversion: 2.26 time: 0.196025 Oct 29 21:08:19.883199 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2559/5014] 10.222.0.36 () {62 vars in 1380 bytes} [Sat Oct 29 21:08:19 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-1025820393 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 21:08:19.888872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:19.892454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:19.898878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:19.900521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.901021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.901528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.902240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:19.902867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:19.903471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:19.978979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b74a6a8-2046-4dbf-8541-90c9facdad10 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.094120 Oct 29 21:08:19.983218 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2560/5015] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:19 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:19.989853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa176384040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:20.004895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.006095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.006727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.007718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:20.016939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.017668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.019271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.020192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.020904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.021528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.057755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.058726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.059331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.071659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.072408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.073020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.132791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:20.162991 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08f44923-8f19-4858-ae12-c4018121b64a tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-1579076063" status: 201 len: 0 microversion: 2.26 time: 0.178103 Oct 29 21:08:20.165565 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2561/5016] 10.222.0.36 () {62 vars in 1380 bytes} [Sat Oct 29 21:08:19 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-1579076063 => generated 0 bytes in 180 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 21:08:20.179079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1763840d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:20.195152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.195965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.196427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.197009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:20.204319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.205112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.206550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.207484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.208111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.208705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.240591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.241600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.242719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.281985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:20.321330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-744dbc94-9755-4062-993d-1d59af163dba tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 204 len: 0 microversion: 2.26 time: 0.146531 Oct 29 21:08:20.325032 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2562/5017] 10.222.0.36 () {60 vars in 1295 bytes} [Sat Oct 29 21:08:20 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:20.338508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-659dedd9-996d-4069-abdd-3fcf3246eb9f tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1763aa820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:20.356189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-659dedd9-996d-4069-abdd-3fcf3246eb9f tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.356819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-659dedd9-996d-4069-abdd-3fcf3246eb9f tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.357346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-659dedd9-996d-4069-abdd-3fcf3246eb9f tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.393114 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-659dedd9-996d-4069-abdd-3fcf3246eb9f tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 200 len: 12 microversion: 2.26 time: 0.062022 Oct 29 21:08:20.394433 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2563/5018] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 21:08:20 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:20.405739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:20.408817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa17636c0d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:20.419166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f72441aa-e054-420b-885d-efd68ad486fa tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1677 microversion: 2.1 time: 1.385331 Oct 29 21:08:20.419418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.419807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.420410 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2456/5019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:19 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1677 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:20.423651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.424942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:20.427027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7da3c581-6551-4b75-83cc-95d690aa66b6 req-fcb8f450-bf25-4e44-b1bd-fc3dc9b92d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e7bb8a-f42c-415a-9898-3cb84f34e2ee", "name": "network-vif-deleted", "tag": "51d03947-ece9-475c-b20e-71c5f2dcc21b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:20.443067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7da3c581-6551-4b75-83cc-95d690aa66b6 req-fcb8f450-bf25-4e44-b1bd-fc3dc9b92d97 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.443812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7da3c581-6551-4b75-83cc-95d690aa66b6 req-fcb8f450-bf25-4e44-b1bd-fc3dc9b92d97 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.444307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7da3c581-6551-4b75-83cc-95d690aa66b6 req-fcb8f450-bf25-4e44-b1bd-fc3dc9b92d97 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.452348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.454152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.455090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.457066 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7da3c581-6551-4b75-83cc-95d690aa66b6 req-fcb8f450-bf25-4e44-b1bd-fc3dc9b92d97 service nova] Creating event network-vif-deleted:51d03947-ece9-475c-b20e-71c5f2dcc21b for instance 97e7bb8a-f42c-415a-9898-3cb84f34e2ee on nch1-master-1 Oct 29 21:08:20.457703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.458905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.460571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.464111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7da3c581-6551-4b75-83cc-95d690aa66b6 req-fcb8f450-bf25-4e44-b1bd-fc3dc9b92d97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042171 Oct 29 21:08:20.474571 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2457/5020] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:20.495955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.497528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.498118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.510868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:20.526761 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c5c8789d-acb0-4c98-b097-b960db735cf6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 204 len: 0 microversion: 2.26 time: 0.126569 Oct 29 21:08:20.532145 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2564/5021] 10.222.0.36 () {60 vars in 1295 bytes} [Sat Oct 29 21:08:20 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 21:08:20.540200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1709760d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:20.554522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.555393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.556003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.556763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:20.564147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.565480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.566080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.566948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.568253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.569001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.602860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.603553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.604153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.615560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.616523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.617113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.684670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:20.703465 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-57edbab2-0359-4c83-862e-7e36aef8ebb0 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-114762990" status: 201 len: 0 microversion: 2.26 time: 0.168123 Oct 29 21:08:20.709843 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2458/5022] 10.222.0.36 () {62 vars in 1377 bytes} [Sat Oct 29 21:08:20 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-114762990 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 21:08:20.714357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa17172b040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:20.731424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.731947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.732381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.732888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:20.743407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.743999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.744336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.745384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.745905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.746300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.794396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.796183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.797591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.813488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.814011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.814460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.850232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:20.873296 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34bb13bb-a2de-4657-be73-8189548d3e56 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-1409265459" status: 201 len: 0 microversion: 2.26 time: 0.162993 Oct 29 21:08:20.874438 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2565/5023] 10.222.0.36 () {62 vars in 1380 bytes} [Sat Oct 29 21:08:20 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags/tempest-tag-1409265459 => generated 0 bytes in 165 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 29 21:08:20.887407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Action: 'update_all', calling method: .version_select at 0x7fa170a17280>, body: {"tags": ["tempest-tag-1789530674", "tempest-tag-1588318950"]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:20.899342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.899757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.900196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.900674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:20.907154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.907674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.908111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.909866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.910330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.910761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.937038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:20.937827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:20.938419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:20.954656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:20.969059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:21.001230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:21.007267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:21.034763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.037812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.040376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.042316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.043852 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbefe194-4d9a-43bb-88ba-26cdaf6a16dd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 200 len: 62 microversion: 2.26 time: 0.160651 Oct 29 21:08:21.044543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.045154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.054782 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2459/5024] 10.222.0.36 () {62 vars in 1312 bytes} [Sat Oct 29 21:08:20 2022] PUT /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 62 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:21.070498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b79833c4-e4f1-4cf5-b81a-a8a2069b09be tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa1709fd5e0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:21.093710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b79833c4-e4f1-4cf5-b81a-a8a2069b09be tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.094231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b79833c4-e4f1-4cf5-b81a-a8a2069b09be tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.094689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b79833c4-e4f1-4cf5-b81a-a8a2069b09be tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.120901 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b79833c4-e4f1-4cf5-b81a-a8a2069b09be tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 200 len: 62 microversion: 2.26 time: 0.063028 Oct 29 21:08:21.122080 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2460/5025] 10.222.0.36 () {60 vars in 1292 bytes} [Sat Oct 29 21:08:21 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 62 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:21.134090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '.version_select at 0x7fa170976160>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:21.146550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.147624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.148304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.149606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:21.155706 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-789ebe64-1939-4bc2-8070-b5c01317772e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.164721 Oct 29 21:08:21.156840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2566/5026] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:20 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 21:08:21.158316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.160015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.160700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.161845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.162705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.163353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.195845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.196587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.197242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.241635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'flavor' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:21.265810 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d813323f-94fb-4a45-aa28-82bc051a55bd tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags" status: 204 len: 0 microversion: 2.26 time: 0.136219 Oct 29 21:08:21.266751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2461/5027] 10.222.0.36 () {60 vars in 1295 bytes} [Sat Oct 29 21:08:21 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64/tags => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:21.277863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:21.278481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:21.288485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.290587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.291353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.292311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.292958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.293844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.340038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:08:21.452418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:21.453061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:21.465884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.466211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.466665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.486311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.486924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.490849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.526791 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf72526a-7532-4c8e-8fef-d37ce11930b6 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 204 len: 0 microversion: 2.26 time: 0.253652 Oct 29 21:08:21.527908 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2567/5028] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:08:21 2022] DELETE /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:08:21.537329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:21.540918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:21.555796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.558421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.558842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.562940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:21.563789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:21.564011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:21.930320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:21.947006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2d5664c5-ebbc-461d-be48-022f1747eec9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1677 microversion: 2.1 time: 0.500264 Oct 29 21:08:21.950459 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2462/5029] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:21 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1677 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:21.955671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:21.975431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:21.977051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:21.979927 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2dd290ab-e58c-46e9-8094-d360fe9848f2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1551 microversion: 2.26 time: 0.447018 Oct 29 21:08:21.981896 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2568/5030] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:21 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1551 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:08:22.178836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:22.182999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:22.203761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:22.204550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:22.216142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:22.216959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:22.217490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:22.218457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:22.298085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fb775760-7e66-4060-88e2-ad399fc526a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.132826 Oct 29 21:08:22.302422 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2463/5031] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:22 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:22.977896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:22.977896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:22.987677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:22.988449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:22.993105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:22.993909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:22.994349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:22.997124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:23.008901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:23.009785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:23.027339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:23.027858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:23.028373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:23.029089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:23.034698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:23.035236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:23.406649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:23.419067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b8604c1c-afd3-4ee2-9b85-246a9dc3e5d0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1677 microversion: 2.1 time: 0.448777 Oct 29 21:08:23.419976 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2569/5032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:22 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1677 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:23.437984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:23.440532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:23.461276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:23.464237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:23.465833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:23.468013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:23.475367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:23.475367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:23.491870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:23.510748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:23.513931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:23.514982 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ba9eede-7ec7-480b-9edf-d4928cfbb191 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1551 microversion: 2.26 time: 0.510547 Oct 29 21:08:23.515563 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2464/5033] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:23 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1551 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:08:23.517203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:RELEASE=3,nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:23.597004 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1fddc364-9019-4b65-ae6a-8be7b75bb425 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 14 microversion: 2.1 time: 0.175203 Oct 29 21:08:23.600451 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2570/5034] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:23 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:08:24.446627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:24.447251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:24.465249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:24.465716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:24.466216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:24.466947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:24.468730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:24.469468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:24.547455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:24.548744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:24.576332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:24.576838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:24.577287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:24.590740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:24.591253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:24.591706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:24.973704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:25.000943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4bc9c07-b17b-4bd8-a91b-e74f39beb274 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1677 microversion: 2.1 time: 0.560143 Oct 29 21:08:25.002671 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2465/5035] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:24 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1677 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:25.009588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:25.012556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:25.020391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:25.021143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:25.022045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:25.023083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:25.024116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:25.025031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:25.126250 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-168ede4b-a1e8-4e32-95da-4f3bd0cbb04f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action" status: 200 len: 8207 microversion: 2.1 time: 0.121040 Oct 29 21:08:25.132348 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2466/5036] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:25 2022] POST /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9/action => generated 8207 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:25.134631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:25.139027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:25.143466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:25.151054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:25.156021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:25.157850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:25.158221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:25.159343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:25.160024 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7369ca89-e0fb-42d4-b495-60f1b391ba21 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1551 microversion: 2.26 time: 0.617358 Oct 29 21:08:25.160807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:25.161608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:25.161851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2571/5037] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:24 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1551 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:08:25.162649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:25.720854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:25.729783 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff5cdd95-6e42-472f-a37e-8b48ce23a279 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.595615 Oct 29 21:08:25.742581 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2467/5038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:25 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:25.770757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:25.771560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:25.782397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:25.783816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:25.784643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:25.786009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:25.787433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:25.788118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:25.995298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-178f5eeb-7fbe-4092-b13c-4540698ef983 req-b9dcecc9-184b-47b8-a56e-03e898991f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cac2c229-9a05-4448-820f-7fb7940d7f64", "name": "network-vif-deleted", "tag": "199a5f5d-8714-4226-96ea-035293fc0b41"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:26.009996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-178f5eeb-7fbe-4092-b13c-4540698ef983 req-b9dcecc9-184b-47b8-a56e-03e898991f50 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:26.013541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-178f5eeb-7fbe-4092-b13c-4540698ef983 req-b9dcecc9-184b-47b8-a56e-03e898991f50 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:26.014459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-178f5eeb-7fbe-4092-b13c-4540698ef983 req-b9dcecc9-184b-47b8-a56e-03e898991f50 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:26.037850 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-178f5eeb-7fbe-4092-b13c-4540698ef983 req-b9dcecc9-184b-47b8-a56e-03e898991f50 service nova] Creating event network-vif-deleted:199a5f5d-8714-4226-96ea-035293fc0b41 for instance cac2c229-9a05-4448-820f-7fb7940d7f64 on nch2-master-1 Oct 29 21:08:26.050001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-178f5eeb-7fbe-4092-b13c-4540698ef983 req-b9dcecc9-184b-47b8-a56e-03e898991f50 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060183 Oct 29 21:08:26.057609 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2468/5039] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:26.069933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:26.070984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:26.077568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:26.078312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:26.078946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:26.091459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:26.092261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:26.094095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:26.808487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:26.824649 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0837758-0111-43dd-84b1-4829f9a1021d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.060394 Oct 29 21:08:26.827015 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2572/5040] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:25 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:26.834589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:26.847150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:26.859284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:26.859671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:26.862453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:26.863247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:26.863728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:26.865296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:26.950508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:26.958506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:26.959374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:26.960071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lazy-loading 'fault' on Instance uuid cac2c229-9a05-4448-820f-7fb7940d7f64 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:08:26.982025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:26.997373 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2bffd11-8ea6-434e-a954-91b93e509d57 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1677 microversion: 2.1 time: 0.938003 Oct 29 21:08:27.001327 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2469/5041] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:26 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1677 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:27.006868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:27.012461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:27.018908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:27.020045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:27.020750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:27.021714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:27.022390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:27.023035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:27.101241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:27.118376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:27.127672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b138e34a1c534b4da85766be38220e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1428735000841b98c5a859956a09b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:27.129554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e0d67c95-215d-495a-9650-768e8f0f47cc tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 200 len: 1352 microversion: 2.26 time: 0.299381 Oct 29 21:08:27.130414 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2573/5042] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:26 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 1352 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:27.485561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:27.512147 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64c7db34-4ed9-4d0f-b18e-190e3f003080 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.503527 Oct 29 21:08:27.514640 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2470/5043] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:27 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:27.547090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:27.548360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:27.577830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:27.578910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:27.579027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:27.579722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:27.580224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:27.581078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:28.022954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:28.024648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:28.045495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:28.046193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:28.049092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:28.050091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:28.050983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:28.052344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:28.926396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:28.935871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d216a3b0-5bf3-46df-bce7-60e2b3a10888 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.393322 Oct 29 21:08:28.941135 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2574/5044] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:27 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:28.950832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:28.954644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] [instance: cac2c229-9a05-4448-820f-7fb7940d7f64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:28.971938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:28.975259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:28.975940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:28.976915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:28.988032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:28.988840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.006068 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] HTTP exception thrown: Instance cac2c229-9a05-4448-820f-7fb7940d7f64 could not be found. Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Request method failure captured: Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 HTTP/1.1 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZYuBWE0X7atm7Qo7lhbry7k5bAEw4mczR42BrrpLBQ-sNaTqKpXmkZntpO1k-dvAu7QAlKo9TZhK6DPG89zlE-43cPunAUx0xlgUoeMWZ1RgUEYeVChb2KwhNlpP-jjt3AkDieL8-RrNLnTc5tukD8Z3ryxQ8av7ZkZ4p3FLzljdHo Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.26 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: f1428735000841b98c5a859956a09b15 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerTagsTestJSON-701678251 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f1428735000841b98c5a859956a09b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f1428735000841b98c5a859956a09b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f1428735000841b98c5a859956a09b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f1428735000841b98c5a859956a09b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerTagsTestJSON-701678251 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: f1428735000841b98c5a859956a09b15 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerTagsTestJSON-701678251 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerTagsTestJSON-701678251-project Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b138e34a1c534b4da85766be38220e20 Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerTagsTestJSON-701678251-project Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance cac2c229-9a05-4448-820f-7fb7940d7f64 could not be found. Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'cac2c229-9a05-4448-820f-7fb7940d7f64'} Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac2c229-9a05-4448-820f-7fb7940d7f64 could not be found. Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac2c229-9a05-4448-820f-7fb7940d7f64 could not be found. Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:29.022850 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac2c229-9a05-4448-820f-7fb7940d7f64 could not be found. Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:29.030559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] Returning 404 to user: Instance cac2c229-9a05-4448-820f-7fb7940d7f64 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:29.032258 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-342f3415-9a4d-4d26-9cb2-728d449552e2 tempest-ServerTagsTestJSON-701678251 tempest-ServerTagsTestJSON-701678251-project] 10.222.0.36 "GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64" status: 404 len: 111 microversion: 2.26 time: 0.089754 Oct 29 21:08:29.037664 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2575/5045] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:28 2022] GET /compute/v2.1/servers/cac2c229-9a05-4448-820f-7fb7940d7f64 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:08:29.043737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:29.044548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:29.054252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.055208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.055865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.056818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.057741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.058384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.125351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Locking {{(pid=138885) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 29 21:08:29.224328 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-959e5c9f-e3fd-464f-b470-720fc0bef18f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.185159 Oct 29 21:08:29.225565 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2576/5046] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:29 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:29.234689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:29.235479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:29.251190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.252700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.253252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.254304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.254893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.255508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.256020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:29.275945 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e51189c-6c9b-45a2-b572-bff8bbc67ee8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1654 microversion: 2.1 time: 1.256038 Oct 29 21:08:29.289481 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2471/5047] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:28 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1654 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:29.300200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d2669456-21b8-408d-92ba-cafb2de76a60 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:29.309227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2669456-21b8-408d-92ba-cafb2de76a60 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.309752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2669456-21b8-408d-92ba-cafb2de76a60 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.310201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d2669456-21b8-408d-92ba-cafb2de76a60 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.339810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d2669456-21b8-408d-92ba-cafb2de76a60 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Going to try to start instance {{(pid=138884) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 21:08:29.456800 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d2669456-21b8-408d-92ba-cafb2de76a60 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action" status: 202 len: 0 microversion: 2.1 time: 0.160290 Oct 29 21:08:29.460371 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2472/5048] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:29 2022] POST /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:29.467521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:29.469935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:29.482627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.483521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.484052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.485111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:29.485870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:29.486601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:29.948750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:29.970948 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb941a15-ca6c-428f-863d-0e35892488bb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.741227 Oct 29 21:08:29.971555 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2577/5049] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:29 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:30.001825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:30.011872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:30.016665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:30.019465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:30.090532 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] HTTP exception thrown: Instance 881df71f-2007-45b8-9d62-f57352acca7c is locked Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Request method failure captured: Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action HTTP/1.1 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 15 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUo8-WqZDPiLwXg471XrzvsGc2L0XmF2F-L41Hh4OC0NtgIQdq1-LOvbJrhqd-KjADK1hUNlISzKTaNNj-DIpeKvdTLeHVQGSIHO7fZpq3W-Agl3seLWOsM1Aj98HNHjCcNsuQ820EjwSgXA7gtrSGTYNNCuqnI_g9cjwPH53pOr-g Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c35b0dd86eb14cbbab1732cc96ab2573 Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: {"os-stop": {}} Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 881df71f-2007-45b8-9d62-f57352acca7c is locked Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '881df71f-2007-45b8-9d62-f57352acca7c', 'body': {'os-stop': {}}} Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 881df71f-2007-45b8-9d62-f57352acca7c is locked Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 881df71f-2007-45b8-9d62-f57352acca7c is locked Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881df71f-2007-45b8-9d62-f57352acca7c is locked Oct 29 21:08:30.092872 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:08:30.101301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Returning 409 to user: Instance 881df71f-2007-45b8-9d62-f57352acca7c is locked {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:08:30.102550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1ffabe23-e1c1-4347-ad60-f18448c6adf9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 409 len: 107 microversion: 2.1 time: 0.106825 Oct 29 21:08:30.103866 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2578/5050] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:29 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 107 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 21:08:30.121659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:30.124360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:30.148554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:30.149825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:30.152251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:30.153260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:30.156976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:30.159014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:30.180554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:30.213432 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04e1af54-653a-4000-8e34-23965d443320 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1663 microversion: 2.1 time: 0.751117 Oct 29 21:08:30.218131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2473/5051] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:29 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1663 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:30.264625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Unlocking {{(pid=138885) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 21:08:30.380170 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a61df76-8bea-465c-a421-0e2cc06ee2d2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.271076 Oct 29 21:08:30.380899 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2579/5052] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:30 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:30.389537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1019b0d-abac-4dd9-aa2c-34b44b7b0a40 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:30.403313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1019b0d-abac-4dd9-aa2c-34b44b7b0a40 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:30.403812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1019b0d-abac-4dd9-aa2c-34b44b7b0a40 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:30.404262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1019b0d-abac-4dd9-aa2c-34b44b7b0a40 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:30.452134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a1019b0d-abac-4dd9-aa2c-34b44b7b0a40 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Going to try to stop instance {{(pid=138884) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:08:30.504388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:30.522501 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a1019b0d-abac-4dd9-aa2c-34b44b7b0a40 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.136767 Oct 29 21:08:30.526230 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2474/5053] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:30 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:30.538137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:30.538797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:30.552009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:30.552527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:30.553242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:30.554159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:30.554631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:30.555654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:31.174310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:31.185152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7119e06d-8ec1-40fb-a67c-003606f3bfd3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.657183 Oct 29 21:08:31.194065 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2580/5054] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:30 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:31.264632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:31.267349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:31.295008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:31.303716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:31.305199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:31.308979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:31.310947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:31.316313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:32.152147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:32.166869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1663 microversion: 2.1 time: 0.921423 Oct 29 21:08:32.169363 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2475/5055] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:31 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1663 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:32.230102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:32.231680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:32.247496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:32.247998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:32.248441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:32.249152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:32.253170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:32.253712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:32.662317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:32.663915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-063f40b1-4953-47a4-950e-dda0bd7eb607 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002023 Oct 29 21:08:32.664589 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2476/5056] 10.222.0.36 () {56 vars in 886 bytes} [Sat Oct 29 21:08:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 21:08:33.061750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:33.109364 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da223876-8b2f-4c5c-9fc6-7afdca02749c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.883644 Oct 29 21:08:33.122219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2581/5057] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:32 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:33.195416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:33.196629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:33.213815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:33.214708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:33.215336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:33.216250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:33.216880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:33.217508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:33.670138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:33.701659 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20c1fe4d-e520-42fb-bcee-ecee5fd23b59 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1667 microversion: 2.1 time: 0.495988 Oct 29 21:08:33.702741 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2477/5058] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:33 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1667 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:34.137206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:34.137947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:34.147726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:34.148524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:34.150008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:34.151177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:34.151918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:34.152567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:34.543858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:34.561707 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d51cbf7-c5f7-4aa4-8205-f683fe08c0d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.427792 Oct 29 21:08:34.562833 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2582/5059] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:34 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:35.590836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:35.591470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:35.602956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:35.603451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:35.605923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:35.606872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:35.607519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:35.609785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:36.034963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:36.053436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2391db10-556f-461c-860b-a234416925d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.466052 Oct 29 21:08:36.056065 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2478/5060] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:35 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:37.566782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:37.568034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:37.577439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:37.608000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:37.610166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:37.614227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:37.615901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:37.616707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:37.732053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:38.088030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:38.112489 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7557caef-fc6a-4611-aa16-e58cd878db21 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 1.035974 Oct 29 21:08:38.115755 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2583/5061] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:37 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:39.139006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:39.139755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:39.147204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:39.147709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:39.148158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:39.148892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:39.149362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:39.170832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:39.508493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:39.530709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffb70b76-562d-4867-9e4b-8628c3d13e3d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.395334 Oct 29 21:08:39.550460 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2479/5062] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:39 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:40.564160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:40.565962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:40.586745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:40.587713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:40.589740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:40.591122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:40.593245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:40.594948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:41.111410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:41.134287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96525b61-d199-4966-b53b-bd45b2e3e738 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.576925 Oct 29 21:08:41.140006 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2584/5063] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:40 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:42.174081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:42.174826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:42.184823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:42.185336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:42.185841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:42.186563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:42.187030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:42.196488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:42.582728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:42.602602 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f5aa479-ab73-436d-a36e-dbaea8ad1f95 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1656 microversion: 2.1 time: 0.437752 Oct 29 21:08:42.615995 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2585/5064] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:42 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1656 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:42.637802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb8b444c-09b3-4f7d-99a0-cec27aa15f2e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:42.651054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8b444c-09b3-4f7d-99a0-cec27aa15f2e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:42.651553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8b444c-09b3-4f7d-99a0-cec27aa15f2e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:42.658741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8b444c-09b3-4f7d-99a0-cec27aa15f2e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:42.743919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eb8b444c-09b3-4f7d-99a0-cec27aa15f2e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Going to try to start instance {{(pid=138885) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 21:08:42.886341 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb8b444c-09b3-4f7d-99a0-cec27aa15f2e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.253245 Oct 29 21:08:42.889784 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2586/5065] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:42 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:08:42.899193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:42.899997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:42.935195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:42.935703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:42.936149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:42.937088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:42.937872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:42.947762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:43.174169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-917796720", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1b4c2a20-6cc0-48d9-aa4e-45f3072f6309"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:43.231372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:43.315730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] validate_networks() for [('1b4c2a20-6cc0-48d9-aa4e-45f3072f6309', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:08:43.695727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:43.710100 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6f3170e9-2ed4-45af-8feb-c20ea7d1fa39 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1665 microversion: 2.1 time: 0.818075 Oct 29 21:08:43.710701 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2587/5066] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:42 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1665 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:44.739284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:44.740592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:44.756657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:44.757342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:44.759967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:44.760932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:44.761629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:44.766430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:46.087371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:08:46.087905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:08:46.093754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:08:46.094302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:08:46.094814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:08:46.123515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:46.127451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:46.132683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:46.134429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:46.138402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:46.143283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:46.186721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Getting quotas for project bb24a08f49a84b02b7931b4cac105bad. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:08:46.193738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Getting quotas for user bd17cd4d96b84042bb3e8181efc15429 and project bb24a08f49a84b02b7931b4cac105bad. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:08:46.209249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:08:46.211755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:08:46.298345 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-727375ab-7600-46c0-a8b8-11b7513a1e8b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.173964 Oct 29 21:08:46.300781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2480/5067] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:08:46.329135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4cf1405f-b650-4d2f-8465-5ffd2998e723 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:46.333002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4cf1405f-b650-4d2f-8465-5ffd2998e723 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:46.598119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:46.611236 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7db8eac6-c21a-4e2e-8085-9c3525b1834f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1665 microversion: 2.1 time: 1.876613 Oct 29 21:08:46.616596 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2588/5068] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:44 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1665 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:46.690444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4cf1405f-b650-4d2f-8465-5ffd2998e723 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:46.700647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4cf1405f-b650-4d2f-8465-5ffd2998e723 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1216 microversion: 2.1 time: 0.392362 Oct 29 21:08:46.701274 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2481/5069] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:46 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1216 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:47.658658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:47.659546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:47.675545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:47.679651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:47.680227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:47.681118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:47.683081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:47.684347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:47.727076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:47.727703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:47.740450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:47.740960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:47.741410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:47.742221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:47.750197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:47.750666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:48.529086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:48.539215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27f1d6fa-638a-4292-810b-5ee3057e72a1 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1220 microversion: 2.1 time: 0.816072 Oct 29 21:08:48.542052 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2482/5070] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:47 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1220 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:49.032637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:49.063748 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6bc072a2-ac68-475a-8f5b-d382045159f4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.425337 Oct 29 21:08:49.074379 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2589/5071] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:47 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:49.093418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:49.094232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:49.113642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:49.114155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:49.114609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:49.115341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:49.115812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:49.116251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:49.577533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:49.585867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:49.593211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:49.599023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-040b2c73-3bfb-4190-a951-33d78aec6a63 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.509195 Oct 29 21:08:49.614394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2483/5072] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:49.625660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:49.629375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:49.631516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:49.631855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:49.633337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:49.634405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:49.636778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:49.640655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:49.646525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:49.647039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:49.650647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:49.652577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:49.653260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:49.656008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:49.816439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:49.820674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Unlocking {{(pid=138884) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 21:08:49.827861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5da0e15-973a-481c-adb2-5ed32d25983d tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1274 microversion: 2.1 time: 0.261207 Oct 29 21:08:49.828649 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2590/5073] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:49 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1274 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:49.993626 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d8da724-f407-4566-8c20-2c920f09b8e6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.369825 Oct 29 21:08:49.995000 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2484/5074] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:49 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:08:50.004569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:50.005615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:50.007962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:50.018199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:50.021938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:50.022760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:50.023801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:50.027468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:50.028240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:50.814573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:50.824241 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c283cb0e-6738-471f-ab6f-4b9c0202c2d7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.823624 Oct 29 21:08:50.832545 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2591/5075] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:50.860033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:50.861296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:50.862430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:50.863302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:50.880245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:50.880876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:50.881226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:50.881876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:50.882755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:50.883239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:50.883561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:50.884148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:50.885254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:50.887691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:50.888316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:50.888849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:51.967756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:51.992808 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6bbd04da-d79b-43ab-9a2a-72ffd5bda4fb tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1316 microversion: 2.1 time: 1.134882 Oct 29 21:08:52.005726 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2485/5076] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:50 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1316 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:52.427615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:52.448363 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-80b331f3-955f-4aa3-b045-e514bdf01c7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.591179 Oct 29 21:08:52.467651 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2592/5077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:50 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:52.489371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:52.491144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:52.515984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:52.519861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:52.520997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:52.522201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:52.526523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:52.527334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:52.549399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22d2fbbb-521c-46ba-9619-59271ec35ee2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'create', calling method: .version_select at 0x7fa1762a7e50>, body: {"keypair": {"name": "tempest-keypair-1539010666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1S12VeVSmDX8fJjsZLfruxwfup8pFsjBrbVVLfSVTSLODwImwl7oXusjyXXLlSnSNLqZkKdU9d1qCo5FmuDyFCC0PawC8Ees/VMmr0ooFeeKEneAxghh5cGwT9dQdw3g=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:52.599828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-22d2fbbb-521c-46ba-9619-59271ec35ee2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for project fad443ad0828409d8aada4cf90bfc696. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:08:52.608026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-22d2fbbb-521c-46ba-9619-59271ec35ee2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for user 2c6db5dbdaf2447d8c158f1a8076b290 and project fad443ad0828409d8aada4cf90bfc696. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:08:52.653083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22d2fbbb-521c-46ba-9619-59271ec35ee2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.645904 Oct 29 21:08:52.660169 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2486/5078] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 21:08:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 648 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 21:08:52.667313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e3dd6cdb-8c7c-4a6b-855c-7c5745c43d22 req-4f03c608-5778-42e4-80d5-6e4556b8f6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de51a82-3f40-4d2a-8774-e6ebcbe5afea", "tag": "bdd2cba4-3f03-473e-8155-7563845e45d0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:52.682242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e3dd6cdb-8c7c-4a6b-855c-7c5745c43d22 req-4f03c608-5778-42e4-80d5-6e4556b8f6d5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:52.682796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e3dd6cdb-8c7c-4a6b-855c-7c5745c43d22 req-4f03c608-5778-42e4-80d5-6e4556b8f6d5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:52.683447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e3dd6cdb-8c7c-4a6b-855c-7c5745c43d22 req-4f03c608-5778-42e4-80d5-6e4556b8f6d5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:52.696317 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e3dd6cdb-8c7c-4a6b-855c-7c5745c43d22 req-4f03c608-5778-42e4-80d5-6e4556b8f6d5 service nova] Creating event network-changed:bdd2cba4-3f03-473e-8155-7563845e45d0 for instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea on nch2-master-1 Oct 29 21:08:52.706692 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e3dd6cdb-8c7c-4a6b-855c-7c5745c43d22 req-4f03c608-5778-42e4-80d5-6e4556b8f6d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050741 Oct 29 21:08:52.707320 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2487/5079] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:08:53.024378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:53.025305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:53.039722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:53.042266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:53.042851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:53.052224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:53.054004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:53.056495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:53.223620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:53.234158 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c1c5b12-7858-4fa8-adfa-348b7ad91a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.759935 Oct 29 21:08:53.254540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2593/5080] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:52 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:53.277427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:53.278567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:53.302480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:53.321242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:53.322108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:53.323557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:53.324224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:53.325274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:53.523077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2fb19b79-72fc-46ce-9532-035881720a0c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.250248 Oct 29 21:08:53.530675 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2594/5081] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:53 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:08:53.555882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:53.556870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:53.572040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:53.572672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:53.573300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:53.574298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:53.574919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:53.581321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:53.720253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:53.747194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ceba937-82dd-4066-9d86-f2b3bc808eb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1316 microversion: 2.1 time: 0.731980 Oct 29 21:08:53.749987 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2488/5082] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:53 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:54.408876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:54.422351 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c26e50a-3b7c-4602-8e98-9b018b552db0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1674 microversion: 2.1 time: 0.890294 Oct 29 21:08:54.424831 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2595/5083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:53 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1674 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:54.774293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:54.775653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:54.789105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:54.792432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:54.792938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:54.793947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:54.795111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:54.798069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:55.452680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:55.453301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:55.469040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:55.477915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:55.479313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:55.480234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:55.482062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:55.484797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:56.108243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:56.130238 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1c1831f5-c33d-4104-bbae-022220887441 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1316 microversion: 2.1 time: 1.353691 Oct 29 21:08:56.145696 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2489/5084] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:54 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1316 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:57.018996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1726675954", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "723f8bfe-b9ea-4cc8-b804-09161edbeffe"}], "security_groups": [{"name": "tempest-securitygroup--1349397435"}], "key_name": "tempest-keypair-1539010666", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:57.043273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:57.406864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:57.441724 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c4cdbb76-4dcc-450b-b706-c6f1ba3231dd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1654 microversion: 2.1 time: 1.993352 Oct 29 21:08:57.444639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2596/5085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:55 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1654 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:08:57.462107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:57.473439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:57.486565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:57.487745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:57.489306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:57.491422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:57.492128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:57.492767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:57.610160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] validate_networks() for [('723f8bfe-b9ea-4cc8-b804-09161edbeffe', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:08:58.202564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:58.202564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:08:58.215912 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07c3f828-de52-4507-a476-7be20d45d531 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1316 microversion: 2.1 time: 0.768635 Oct 29 21:08:58.238370 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2597/5086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:57 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1316 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:58.262963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:58.264475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:58.294892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:58.297171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:58.300315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:58.302654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:58.304811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:58.306418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:58.515420 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4010c580-502f-447c-854a-e09baf3aa778 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.274554 Oct 29 21:08:58.519785 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2598/5087] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:08:58 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:08:58.549156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:58.550203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:58.578418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:58.579939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:58.582717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:58.596937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:58.598275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:58.601262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:59.396173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:08:59.396645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:08:59.397250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:08:59.398126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:08:59.398568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:08:59.421635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:59.422120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:59.422575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:59.427317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:59.428019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:59.428725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:59.473043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for project fad443ad0828409d8aada4cf90bfc696. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:08:59.492112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for user 2c6db5dbdaf2447d8c158f1a8076b290 and project fad443ad0828409d8aada4cf90bfc696. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:08:59.493281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:59.514652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:08:59.514884 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3dbc42c9-fdab-463a-8724-2c180c301095 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1661 microversion: 2.1 time: 0.988839 Oct 29 21:08:59.518407 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2599/5088] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:58 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1661 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:08:59.520592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:08:59.527123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:59.528228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:59.551633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:59.554375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:59.555232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:59.557736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:59.559182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:59.560643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:08:59.649292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-886d74ac-388d-4802-a23c-e09885fcddea tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.635684 Oct 29 21:08:59.653320 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2490/5089] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:08:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 21:08:59.673914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c28652b-943b-4c8b-83fc-a64236b00014 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:08:59.674586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c28652b-943b-4c8b-83fc-a64236b00014 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:08:59.876154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c28652b-943b-4c8b-83fc-a64236b00014 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:59.896872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c28652b-943b-4c8b-83fc-a64236b00014 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:59.900950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c28652b-943b-4c8b-83fc-a64236b00014 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:08:59.904345 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c28652b-943b-4c8b-83fc-a64236b00014 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1282 microversion: 2.20 time: 0.243237 Oct 29 21:08:59.905963 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2491/5090] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:08:59 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1282 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:08:59.965040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-702ef5b6-9102-4742-b045-069efd6d9666 req-b4dca5ee-f83e-4fb4-bf36-75c5f551686c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de51a82-3f40-4d2a-8774-e6ebcbe5afea", "name": "network-vif-plugged", "status": "completed", "tag": "bdd2cba4-3f03-473e-8155-7563845e45d0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:08:59.986289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-702ef5b6-9102-4742-b045-069efd6d9666 req-b4dca5ee-f83e-4fb4-bf36-75c5f551686c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:08:59.986952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-702ef5b6-9102-4742-b045-069efd6d9666 req-b4dca5ee-f83e-4fb4-bf36-75c5f551686c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:08:59.987401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-702ef5b6-9102-4742-b045-069efd6d9666 req-b4dca5ee-f83e-4fb4-bf36-75c5f551686c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:00.003308 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-702ef5b6-9102-4742-b045-069efd6d9666 req-b4dca5ee-f83e-4fb4-bf36-75c5f551686c service nova] Creating event network-vif-plugged:bdd2cba4-3f03-473e-8155-7563845e45d0 for instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea on nch2-master-1 Oct 29 21:09:00.010998 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-702ef5b6-9102-4742-b045-069efd6d9666 req-b4dca5ee-f83e-4fb4-bf36-75c5f551686c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050496 Oct 29 21:09:00.016334 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2492/5091] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:09:00.219671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:00.230810 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3893852-07c9-47da-8197-cf72e6c46096 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1316 microversion: 2.1 time: 0.709118 Oct 29 21:09:00.231421 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2600/5092] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:08:59 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:00.551803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:00.554464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:00.576415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:00.580646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:00.582868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:00.587876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:00.590708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:00.591616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:00.932186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:00.933365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:00.947771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:00.948274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:00.953629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:00.954543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:00.955040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:00.955497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:01.092610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:01.113703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:01.116975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:01.118743 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-98824779-04d4-42ad-987a-66e4b5625d61 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1334 microversion: 2.20 time: 0.192026 Oct 29 21:09:01.127352 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2601/5093] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:00 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1334 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:01.229124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:01.240440 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cf601086-fcde-4ae4-994c-5cfa13f34c12 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.697019 Oct 29 21:09:01.255113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2493/5094] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:00 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:01.258619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:01.259449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:01.264536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:01.265726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:01.278751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:01.279292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:01.283335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:01.286192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:01.286703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:01.287272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:01.288159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:01.288963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:01.289284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:01.290070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:01.290911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:01.291516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:01.906917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:01.910406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:01.923916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c869297-1266-42ef-a9ae-297356cdc9b6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.662358 Oct 29 21:09:01.926644 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2494/5095] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:01 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:01.929814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:01.940166 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bdadd876-dba7-478d-87ee-42340810b800 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1316 microversion: 2.1 time: 0.687705 Oct 29 21:09:01.941625 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2602/5096] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:01 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:01.962546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:01.963479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:01.971883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:01.972939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:01.973601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:01.975084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:01.975799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:01.976827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:02.159752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:02.161413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:02.172572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:02.173354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:02.173910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:02.174882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:02.175429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:02.176199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:02.413308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:02.432966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:02.434814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:02.436489 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b6d1ce5-9ef5-433c-954e-d493fc607872 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1340 microversion: 2.20 time: 0.287390 Oct 29 21:09:02.437662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2603/5097] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:02 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1340 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:02.624660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:02.638312 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-92c2642c-bf2c-445c-b702-6fe3452b6192 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.684672 Oct 29 21:09:02.645921 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2495/5098] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:01 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:02.666301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:02.667247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:02.701525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:02.703621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:02.704502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:02.706466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:02.707850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:02.708690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:02.964673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:02.966176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:02.984526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:02.986396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:02.988866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:02.989855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:02.990346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:02.990797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.325405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:03.336963 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4eb75df-26d7-4440-8762-714862e79383 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.676484 Oct 29 21:09:03.345819 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2604/5099] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:02 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:03.372774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:03.375927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:03.383266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.384338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.385015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.385853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.386640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.387306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.602383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:03.622144 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1dd65141-04d8-4a19-874c-96c0a6d1cbc8 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1504 microversion: 2.1 time: 0.661613 Oct 29 21:09:03.623095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2496/5100] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:02 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1504 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:03.628161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:03.631627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:03.639451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.640340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.641059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.641977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.642518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.643238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.854250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:03.856226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:03.863527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:03.865399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:03.869175 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61a50b0d-c59d-48e7-abac-3fd65bf574f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1340 microversion: 2.20 time: 0.244818 Oct 29 21:09:03.889829 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2497/5101] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:03 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1340 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:03.895217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-248f443c-9ca9-4439-b408-3707e7405f02 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.537371 Oct 29 21:09:03.911117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:03.917543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2605/5102] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:03 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:03.922609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:03.923370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:03.926512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:03.935088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.935593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.939690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.940191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.940627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.941343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.941832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.942483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.943423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:03.944055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:03.944646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:03.948133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:04.005839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:04.007081 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad959451-1184-4e37-a597-1f0c0ca47323 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea/os-instance-actions/req-727375ab-7600-46c0-a8b8-11b7513a1e8b" status: 200 len: 313 microversion: 2.1 time: 0.115938 Oct 29 21:09:04.007456 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2498/5103] 10.222.0.36 () {58 vars in 1419 bytes} [Sat Oct 29 21:09:03 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea/os-instance-actions/req-727375ab-7600-46c0-a8b8-11b7513a1e8b => generated 313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:04.021665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:04.024396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:04.030295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:04.031183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:04.032024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:04.033688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:04.034213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:04.034860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:04.170591 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c8527eca-f104-4bf2-92c2-ee5387cdff8a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "POST /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea/action" status: 202 len: 0 microversion: 2.1 time: 0.153059 Oct 29 21:09:04.173902 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2499/5104] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:09:04 2022] POST /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:09:04.187903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:04.189186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:04.199824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:04.200649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:04.201098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:04.204953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:04.205756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:04.206211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:04.559652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:04.572617 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de6bbda1-27fe-4863-a5c9-b1cdd8f21637 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.653806 Oct 29 21:09:04.578292 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2606/5105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:03 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:04.902820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:04.903770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:04.913245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:04.913881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:04.914799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:04.915724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:04.916555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:04.917172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:05.080314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:05.092502 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8387477e-7063-4a36-b471-e879450a0ce7 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1506 microversion: 2.1 time: 0.912330 Oct 29 21:09:05.093756 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2500/5106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:04 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:05.119895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:05.134932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:05.153922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:05.155429 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4df6199-4422-4d60-be7b-d880775bb401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1340 microversion: 2.20 time: 0.257132 Oct 29 21:09:05.162323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2607/5107] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:04 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1340 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:09:06.117979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:06.119938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:06.129738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:06.130731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:06.132402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:06.133508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:06.134552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:06.135121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:06.190230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:06.190852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:06.202335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:06.203026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:06.203648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:06.205299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:06.205967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:06.206564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:07.046752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:07.067545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:07.069242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:07.070633 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.884337 Oct 29 21:09:07.088028 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2608/5108] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:06 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:07.138049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:07.147118 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-97f1b18d-bf6c-41c3-b01d-891ba0286b75 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1506 microversion: 2.1 time: 1.034588 Oct 29 21:09:07.158545 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2501/5109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:06 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1506 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:07.236066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:07.237129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7627a6de-9070-4fea-a5d4-8ea9d09e6359 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002433 Oct 29 21:09:07.237772 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2609/5110] 10.222.0.36 () {56 vars in 886 bytes} [Sat Oct 29 21:09:07 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 21:09:08.037595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-31ddae7f-b475-4749-8a1d-4b18d9d26df3 req-e5272c14-7610-44da-bc2b-9bd7eed1a090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:08.058144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-31ddae7f-b475-4749-8a1d-4b18d9d26df3 req-e5272c14-7610-44da-bc2b-9bd7eed1a090 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.060738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-31ddae7f-b475-4749-8a1d-4b18d9d26df3 req-e5272c14-7610-44da-bc2b-9bd7eed1a090 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.061549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-31ddae7f-b475-4749-8a1d-4b18d9d26df3 req-e5272c14-7610-44da-bc2b-9bd7eed1a090 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.084361 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-31ddae7f-b475-4749-8a1d-4b18d9d26df3 req-e5272c14-7610-44da-bc2b-9bd7eed1a090 service nova] Creating event network-changed:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch1-master-1 Oct 29 21:09:08.095909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:08.097123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:08.105518 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-31ddae7f-b475-4749-8a1d-4b18d9d26df3 req-e5272c14-7610-44da-bc2b-9bd7eed1a090 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071463 Oct 29 21:09:08.108678 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2502/5111] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:09:08.109572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.110244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.111215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.112733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.114077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.116115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.186192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:08.186916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:08.213774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.214295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.216615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.218806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.219464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.222311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.447995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:08.461370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:08.468080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:08.470078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d104e6a9-d25a-476a-a34b-843195979b8b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.378328 Oct 29 21:09:08.471264 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2610/5112] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:08 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:08.522120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:08.533176 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-512ebccd-ef7b-4085-8879-a5346ecb92e2 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1504 microversion: 2.1 time: 0.351207 Oct 29 21:09:08.547658 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2503/5113] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:08 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:08.562736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '.version_select at 0x7fa171125670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:08.564339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:08.574431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.577390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.578621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.579614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.580421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.581017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.605728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:08.609334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:08.616432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.617156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.618392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.619325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.620228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.620827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.702928 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ffd3c03-893e-4d9a-adaa-fc9dfc4d243a tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.143395 Oct 29 21:09:08.705721 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0a11556-8af4-4d4c-99cb-c8a85096fda0 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100156 Oct 29 21:09:08.706675 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2504/5114] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:09:08 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 21:09:08.724305 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2611/5115] 10.222.0.36 () {58 vars in 1296 bytes} [Sat Oct 29 21:09:08 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea/os-instance-actions => generated 611 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:08.726954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:08.727543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:08.743661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.744172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.744808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.745917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.746557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.747305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.810042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:09:08.832516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:08.833302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:08.840188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.841042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.842673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.843560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:08.844192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:08.845329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:08.875138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:09:09.026487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:09.028566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:09.064931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7966d3ef-2b9a-4fca-b206-409ca218adb3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 204 len: 0 microversion: 2.1 time: 0.337566 Oct 29 21:09:09.067779 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2505/5116] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:09:08 2022] DELETE /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:09:09.092576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:09.101047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:09.111813 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6e5dff0-68a1-4d92-9234-a11bba24360d tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 204 len: 0 microversion: 2.1 time: 0.282566 Oct 29 21:09:09.114076 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2612/5117] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:09:08 2022] DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:09:09.127350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:09.128985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:09.130193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:09.131238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:09.133121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:09.134659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:09.138386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:09.140470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:09.149401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:09.150853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:09.152688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:09.153830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:09.155375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:09.158899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:09.447766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:09.574059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:09.590576 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4dccb02c-d89c-4187-8b45-e002c01e06d3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1510 microversion: 2.1 time: 0.515940 Oct 29 21:09:09.594130 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2506/5118] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:09 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:09.599769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:09.609144 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0c3b86d8-b994-44c3-b041-04e3b8f4d080 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1673 microversion: 2.1 time: 0.489311 Oct 29 21:09:09.609993 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2613/5119] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:09 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1673 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:09.623694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:09.625648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:09.637320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:09.638144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:09.638810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:09.639710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:09.640194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:09.640629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:09.854044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:09.877499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:09.879177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:09.880367 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e0720a6-1464-4ff9-bcc4-97cff6c0af5d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.272432 Oct 29 21:09:09.895228 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2507/5120] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:09 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:10.623256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:10.623902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:10.652235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:10.653805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:10.663603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:10.664686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=20 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:10.667656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:10.668309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:10.671880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:10.672381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:10.673062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:10.675180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:10.677164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:10.677845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:10.680330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:10.682204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:10.682819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:11.053268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:11.074279 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5651c953-1e67-407f-aa5c-df6a9b0edc71 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1510 microversion: 2.1 time: 0.456781 Oct 29 21:09:11.075076 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2614/5121] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:10 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:11.094460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2138267640", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:11.152922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:11.165156 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd382c2f-3628-47e1-a149-d4b6049a0839 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1673 microversion: 2.1 time: 0.530221 Oct 29 21:09:11.187117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2508/5122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:10 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1673 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:11.196706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:11.197352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:11.220464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] validate_networks() for None {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:09:11.222394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:11.222936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:11.223396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:11.224136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:11.224602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:11.227578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:11.255503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:12.057023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:12.066162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:12.067864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:12.069315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c784ea6-ac93-441a-84b9-a583ba766718 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.879633 Oct 29 21:09:12.082386 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2509/5123] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:11 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:12.099917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:12.113250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:12.134370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:12.138904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:12.141163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:12.142922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:12.145935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:12.146606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:12.765392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:09:12.765910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:09:12.766386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:09:12.767514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:09:12.768114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:09:12.778804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:12.779721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:12.780476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:12.781608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:12.782812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:12.783427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:12.805780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Getting quotas for project 12180c0f6b864b1fb51205b953d21b33. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:09:12.812329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Getting quotas for user f017a1dc8dac4441940528d0e939f05c and project 12180c0f6b864b1fb51205b953d21b33. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:09:12.827771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:09:12.831663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:09:12.916780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf48cca2-20d6-4fc9-b2c3-8a7debec2980 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839043 Oct 29 21:09:12.917891 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2615/5124] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:09:12.927300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:12.929276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:12.936417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:12.936987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:12.937552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:12.938342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:12.938917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:12.939438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:13.344880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:13.353752 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-815f521b-1a1c-49df-800c-75d2eebe63f0 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1510 microversion: 2.1 time: 1.259790 Oct 29 21:09:13.373135 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2510/5125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:12 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1510 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:13.391363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-15999012-e69e-4142-b942-c6c8f29dd17d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:13.403631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-15999012-e69e-4142-b942-c6c8f29dd17d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:13.804397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:13.813200 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc4d299d-76d1-4775-9e0c-a47674e3eaa9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1673 microversion: 2.1 time: 0.893076 Oct 29 21:09:13.818113 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2616/5126] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:12 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1673 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:13.846836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:13.848849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:13.881883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:13.883201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:13.884180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:13.885166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:13.886203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:13.886887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:14.164511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-15999012-e69e-4142-b942-c6c8f29dd17d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:14.179612 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-15999012-e69e-4142-b942-c6c8f29dd17d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1215 microversion: 2.1 time: 0.804674 Oct 29 21:09:14.183985 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2511/5127] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:13 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1215 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:14.381516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:14.382315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:14.391351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:14.392420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:14.392820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:14.400620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:14.401150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:14.401639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:15.004574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:15.022214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:15.024420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:15.026264 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f2b2f2d-9a89-49d8-b1c9-4ca5f7ddfcbe tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 1.206877 Oct 29 21:09:15.038080 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2617/5128] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:13 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:15.052459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:15.053680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:15.067350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:15.067824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:15.068484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:15.069516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:15.070266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:15.070875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:15.279133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:15.294483 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce163452-41ce-4303-a06f-13acb648163a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1606 microversion: 2.1 time: 0.255122 Oct 29 21:09:15.295121 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2618/5129] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:15 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1606 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:15.300545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:15.301873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:15.308568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:15.309073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:15.309592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:15.310310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:15.310957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:15.311544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:15.404755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:15.432556 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec813821-10ee-49a3-98bd-a957b1fec4b3 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1510 microversion: 2.1 time: 1.055524 Oct 29 21:09:15.435817 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2512/5130] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:14 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1510 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:15.479842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:15.493757 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed2c6a7b-3f26-4e96-be52-8af7502aa758 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1273 microversion: 2.1 time: 0.196829 Oct 29 21:09:15.496119 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2619/5131] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:15 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:15.564079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-43bc93b1-1319-40fa-bdc0-4e1d9a21b579 req-a2821e82-9ccb-4167-9865-e75f6bdb48db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799d00cc-130b-4a02-b9ed-0fdb136dad85", "name": "network-vif-deleted", "tag": "1e445f51-367e-4d35-a04a-828db8ff7b10"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:15.585600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-43bc93b1-1319-40fa-bdc0-4e1d9a21b579 req-a2821e82-9ccb-4167-9865-e75f6bdb48db service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:15.587283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-43bc93b1-1319-40fa-bdc0-4e1d9a21b579 req-a2821e82-9ccb-4167-9865-e75f6bdb48db service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:15.589769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-43bc93b1-1319-40fa-bdc0-4e1d9a21b579 req-a2821e82-9ccb-4167-9865-e75f6bdb48db service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:15.644439 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-43bc93b1-1319-40fa-bdc0-4e1d9a21b579 req-a2821e82-9ccb-4167-9865-e75f6bdb48db service nova] Creating event network-vif-deleted:1e445f51-367e-4d35-a04a-828db8ff7b10 for instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 on nch2-master-1 Oct 29 21:09:15.658674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-43bc93b1-1319-40fa-bdc0-4e1d9a21b579 req-a2821e82-9ccb-4167-9865-e75f6bdb48db service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100088 Oct 29 21:09:15.661234 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2513/5132] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:15.964251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-dc78463e-b165-4294-8c30-5b81de80bac4 req-60f02ea1-33f7-4f06-86e3-131745b1b3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de51a82-3f40-4d2a-8774-e6ebcbe5afea", "name": "network-vif-deleted", "tag": "bdd2cba4-3f03-473e-8155-7563845e45d0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:15.988222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dc78463e-b165-4294-8c30-5b81de80bac4 req-60f02ea1-33f7-4f06-86e3-131745b1b3e3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:15.995025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dc78463e-b165-4294-8c30-5b81de80bac4 req-60f02ea1-33f7-4f06-86e3-131745b1b3e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:15.997022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dc78463e-b165-4294-8c30-5b81de80bac4 req-60f02ea1-33f7-4f06-86e3-131745b1b3e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.042312 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-dc78463e-b165-4294-8c30-5b81de80bac4 req-60f02ea1-33f7-4f06-86e3-131745b1b3e3 service nova] Creating event network-vif-deleted:bdd2cba4-3f03-473e-8155-7563845e45d0 for instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea on nch2-master-1 Oct 29 21:09:16.055325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:16.056005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:16.064237 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-dc78463e-b165-4294-8c30-5b81de80bac4 req-60f02ea1-33f7-4f06-86e3-131745b1b3e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102947 Oct 29 21:09:16.066976 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2620/5133] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:16.073675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.081424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.083926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.089800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.090657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.092736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.324435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:16.326123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:16.348513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.349367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.351271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.361995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.364547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.366640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.378581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:16.410548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:16.420290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:16.424745 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-586bf3aa-a491-479c-a07d-b6ac8f215f5e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.370880 Oct 29 21:09:16.427298 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2514/5134] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:16 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:16.443724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.444229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.444986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.445690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lazy-loading 'fault' on Instance uuid 799d00cc-130b-4a02-b9ed-0fdb136dad85 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:09:16.458693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:16.459469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:16.474194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.475055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.475676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.484712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.486207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.487787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.509734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:16.521962 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55363f83-dde3-4047-88af-b5e0d701677a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 200 len: 1327 microversion: 2.1 time: 0.202522 Oct 29 21:09:16.538901 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2621/5135] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:16 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 1327 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:16.547000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:16.549146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:16.557033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.557803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.559491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.560399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.561145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.561905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.616495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:16.621920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:16.622176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:16.622660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lazy-loading 'fault' on Instance uuid 5de51a82-3f40-4d2a-8774-e6ebcbe5afea {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:09:16.651765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:16.666839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a9f394d-5932-408d-a2be-3e062eb34318 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1273 microversion: 2.1 time: 0.125767 Oct 29 21:09:16.667813 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2622/5136] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:16 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:16.710497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17cd4d96b84042bb3e8181efc15429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24a08f49a84b02b7931b4cac105bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:16.748366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-036e68c6-84b0-4da4-84f7-3f9945ca884b tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 200 len: 1306 microversion: 2.1 time: 0.291851 Oct 29 21:09:16.753994 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2515/5137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:16 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 1306 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:17.382041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3086ae77-ff70-4195-a6cc-2c907c298583 req-bf824b07-5d9b-48e5-adcf-9348cbc68ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "name": "network-vif-plugged", "status": "completed", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:17.401137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3086ae77-ff70-4195-a6cc-2c907c298583 req-bf824b07-5d9b-48e5-adcf-9348cbc68ff7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.401654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3086ae77-ff70-4195-a6cc-2c907c298583 req-bf824b07-5d9b-48e5-adcf-9348cbc68ff7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.402100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3086ae77-ff70-4195-a6cc-2c907c298583 req-bf824b07-5d9b-48e5-adcf-9348cbc68ff7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:17.431869 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3086ae77-ff70-4195-a6cc-2c907c298583 req-bf824b07-5d9b-48e5-adcf-9348cbc68ff7 service nova] Creating event network-vif-plugged:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch1-master-1 Oct 29 21:09:17.440188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3086ae77-ff70-4195-a6cc-2c907c298583 req-bf824b07-5d9b-48e5-adcf-9348cbc68ff7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060411 Oct 29 21:09:17.442775 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2623/5138] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:17.453523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:17.455141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:17.471368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.472206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.473850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:17.476690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.478470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.479416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:17.558953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:17.571929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:17.597329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.598397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.599272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:17.600450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.601188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.601887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:17.661626 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] HTTP exception thrown: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Request method failure captured: Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 HTTP/1.1 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZW5BUekbZBplNz2bihbYnwYWaYWl0GZXAqgmPcpb8Ctcb3DUTngYc2gIIcJJL0ZMuoatGh8mGN2AvlZHGd4VqldpcvtinQDO6Kb-CZXdjrzUf7CSNkAbP-fITqF5Hj-abg-WOIR4pv5bRAUiWshNEjd9m6nYBsbC2udQ6EUiWyGQ3k Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 04d3c643e9c245eeaa6328d22184bc00 Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '799d00cc-130b-4a02-b9ed-0fdb136dad85'} Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:09:17.679891 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:09:17.685191 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:17.689735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Returning 404 to user: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:09:17.690681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96d98ca4-421a-4df9-a46f-35d43c6290ed tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 404 len: 111 microversion: 2.1 time: 0.142309 Oct 29 21:09:17.695006 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2624/5139] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:17 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:09:17.715082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:17.716492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:17.737068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.739582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.740881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:17.745239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:17.746902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:17.747787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:18.073417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:18.084180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:18.086824 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-910f84e2-47c7-42d0-9ac7-6a610ea39147 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.388449 Oct 29 21:09:18.101432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2625/5140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:17 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:18.101721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d453bcb0-6c65-417b-a2a0-f1a5afcab232 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '.version_select at 0x7fa171125940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:18.118145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:18.119790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:18.121627 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7821341-7e53-46af-82b1-ed33fcbdc57b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.672996 Oct 29 21:09:18.122877 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2516/5141] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:17 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:18.145427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:18.146433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] [instance: 5de51a82-3f40-4d2a-8774-e6ebcbe5afea] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:18.152094 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d453bcb0-6c65-417b-a2a0-f1a5afcab232 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958703509" status: 202 len: 0 microversion: 2.1 time: 0.063187 Oct 29 21:09:18.153151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:18.153751 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2626/5142] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958703509 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:09:18.154246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:18.154903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:18.155878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:18.156691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:18.157717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:18.178243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] HTTP exception thrown: Instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea could not be found. Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Request method failure captured: Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea HTTP/1.1 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZZZpWNV_08AOMoGbM-cgj6WuiqeWir3z6SFzBFCbm7-vfQh5O6OH4KtG5EJncm_FATFlx7S-1ZWQ7Fsh7K_0tZUqU7S8PZFd_LgsqYaWHWSmMromDDNKjAsHoWU9-KkVa_kA_Jp2J-Se-gNqhWEF2_0un60hP6fxAkPiiWsyPM9I0w Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bb24a08f49a84b02b7931b4cac105bad Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-InstanceActionsTestJSON-2017721616 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb24a08f49a84b02b7931b4cac105bad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb24a08f49a84b02b7931b4cac105bad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb24a08f49a84b02b7931b4cac105bad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb24a08f49a84b02b7931b4cac105bad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-InstanceActionsTestJSON-2017721616 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bb24a08f49a84b02b7931b4cac105bad Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2017721616 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-InstanceActionsTestJSON-2017721616-project Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: bd17cd4d96b84042bb3e8181efc15429 Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-InstanceActionsTestJSON-2017721616-project Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea could not be found. Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '5de51a82-3f40-4d2a-8774-e6ebcbe5afea'} Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea could not be found. Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea could not be found. Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:09:18.180786 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea could not be found. Oct 29 21:09:18.185115 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:09:18.201715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] Returning 404 to user: Instance 5de51a82-3f40-4d2a-8774-e6ebcbe5afea could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:09:18.203932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9061ffd2-d004-4513-b20e-82b03d541039 tempest-InstanceActionsTestJSON-2017721616 tempest-InstanceActionsTestJSON-2017721616-project] 10.222.0.36 "GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea" status: 404 len: 111 microversion: 2.1 time: 0.078930 Oct 29 21:09:18.206774 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2517/5143] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:18 2022] GET /compute/v2.1/servers/5de51a82-3f40-4d2a-8774-e6ebcbe5afea => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:09:18.562516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d31bcf49-41a5-4159-bb38-bd70de781030 tempest-ExtensionsTest-506240252 tempest-ExtensionsTest-506240252-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:18.571173 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d31bcf49-41a5-4159-bb38-bd70de781030 tempest-ExtensionsTest-506240252 tempest-ExtensionsTest-506240252-project] 10.222.0.36 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.416055 Oct 29 21:09:18.572379 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2627/5144] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 21:09:18 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:18.583612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dbd36a12-5422-42f0-b2aa-6e70b31f3bb5 tempest-ExtensionsTest-506240252 tempest-ExtensionsTest-506240252-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:18.586728 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dbd36a12-5422-42f0-b2aa-6e70b31f3bb5 tempest-ExtensionsTest-506240252 tempest-ExtensionsTest-506240252-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009308 Oct 29 21:09:18.587948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2518/5145] 10.222.0.36 () {58 vars in 1134 bytes} [Sat Oct 29 21:09:18 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:09:19.116035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:19.116979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:19.127043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:19.127924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:19.128607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:19.129808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:19.130495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:19.131146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:19.155939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:19.157223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:19.174218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:19.187763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:19.191900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:19.192950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:19.193433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:19.193900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:19.758392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:19.770638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:19.780020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:19.784220 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ceea07a-2672-455e-8b2b-fc66f37e1998 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.671860 Oct 29 21:09:19.785035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2628/5146] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:19 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:19.787249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:19.790410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-69e07dbe-2931-41a7-852c-daf3471bc7da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1408 microversion: 2.20 time: 0.639246 Oct 29 21:09:19.792426 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2519/5147] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:19 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1408 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:20.475504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b89dc3dd-5f2b-44da-a5df-c51c129645c8 req-6753fb45-c8ad-41c9-8387-539dbb991e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8513d315-39a1-4702-b576-e2f4fa69dbb6", "tag": "5405c03b-a0f9-4561-9bbe-b0388aa4c15c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:20.510102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:20.524429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b89dc3dd-5f2b-44da-a5df-c51c129645c8 req-6753fb45-c8ad-41c9-8387-539dbb991e17 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:20.527320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b89dc3dd-5f2b-44da-a5df-c51c129645c8 req-6753fb45-c8ad-41c9-8387-539dbb991e17 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:20.529359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b89dc3dd-5f2b-44da-a5df-c51c129645c8 req-6753fb45-c8ad-41c9-8387-539dbb991e17 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:20.564876 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b89dc3dd-5f2b-44da-a5df-c51c129645c8 req-6753fb45-c8ad-41c9-8387-539dbb991e17 service nova] Creating event network-changed:5405c03b-a0f9-4561-9bbe-b0388aa4c15c for instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 on nch1-master-1 Oct 29 21:09:20.581527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b89dc3dd-5f2b-44da-a5df-c51c129645c8 req-6753fb45-c8ad-41c9-8387-539dbb991e17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110925 Oct 29 21:09:20.582715 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2629/5148] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:20.817056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:20.817902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:20.841504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:20.845392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:20.878316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:20.878827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:20.881421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:20.881960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:20.882412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:20.885863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:20.887033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:20.887536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:20.888012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:20.892923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:20.895646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:20.906123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:21.471373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:21.492771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:21.494419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:21.495672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8426d4b-e636-47a7-bd5d-5bde46e16638 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1601 microversion: 2.20 time: 0.669877 Oct 29 21:09:21.496238 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2630/5149] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:20 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1601 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:21.508331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55d1aafe-16cc-4d6d-ae8b-435cd8e6e943 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: .version_select at 0x7fa17115c9d0>, body: {"keypair": {"name": "tempest-keypair-736719338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs+5V/oy5kZULWONCKjR9mjjq5pH0gb0wC3zYNEGIt8mgzqvqA7wMqv0GuODZe3uRDNxX1R7T2XChOLVeLJz4SKVQeT66zecQhbuBlG3/KtCp+c1444FKPsXkmyHObDkw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:21.517205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:21.525788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcdf254a-4853-4bce-9424-ad22dff3987b tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.716779 Oct 29 21:09:21.526987 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2520/5150] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:20 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:21.541203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:21.542409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:21.558097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:21.559492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:21.560190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:21.561634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:21.562486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:21.563077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-55d1aafe-16cc-4d6d-ae8b-435cd8e6e943 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for project 208de26bb7304ee793bac715fb73fbdc. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:09:21.563505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:21.592743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-55d1aafe-16cc-4d6d-ae8b-435cd8e6e943 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for user 04d3c643e9c245eeaa6328d22184bc00 and project 208de26bb7304ee793bac715fb73fbdc. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:09:21.657821 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55d1aafe-16cc-4d6d-ae8b-435cd8e6e943 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154124 Oct 29 21:09:21.658795 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2631/5151] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:09:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:21.760475 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1897c6ee-3e5d-49da-9f93-991d376534c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.232099 Oct 29 21:09:21.761075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2521/5152] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 21:09:21 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:09:22.554888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:22.555824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:22.565846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:22.566860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:22.567531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:22.568504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:22.569367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:22.570332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:22.793724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:22.977660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:22.988264 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aebfd241-f0e3-454a-b901-8fcc1b6cf786 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.439445 Oct 29 21:09:22.988862 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2632/5153] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:22 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:24.012650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:24.013286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:24.021112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:24.021658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:24.022112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:24.022868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:24.023337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:24.023778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:24.169368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:24.226262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8b5975fa-b627-457c-8fd9-f87c1e07fb35 req-c7333ea9-073f-4cd7-b4be-91bb0bcda9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:24.247668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b5975fa-b627-457c-8fd9-f87c1e07fb35 req-c7333ea9-073f-4cd7-b4be-91bb0bcda9e5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:24.248453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b5975fa-b627-457c-8fd9-f87c1e07fb35 req-c7333ea9-073f-4cd7-b4be-91bb0bcda9e5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:24.250104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8b5975fa-b627-457c-8fd9-f87c1e07fb35 req-c7333ea9-073f-4cd7-b4be-91bb0bcda9e5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:24.278603 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8b5975fa-b627-457c-8fd9-f87c1e07fb35 req-c7333ea9-073f-4cd7-b4be-91bb0bcda9e5 service nova] Creating event network-changed:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch1-master-1 Oct 29 21:09:24.300620 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8b5975fa-b627-457c-8fd9-f87c1e07fb35 req-c7333ea9-073f-4cd7-b4be-91bb0bcda9e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078894 Oct 29 21:09:24.301862 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2633/5154] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:09:25.105328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:25.128296 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9e2a99b-d7ed-477a-b6f9-fc3bd496974d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 1.117358 Oct 29 21:09:25.144210 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2522/5155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:24 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:26.159984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:26.160839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:26.176479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:26.177821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:26.180441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:26.181564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:26.182344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:26.182786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:26.564257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:26.574960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f7d0a90-2ed6-4eb0-b7b4-8691d0bf20f9 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.420773 Oct 29 21:09:26.585416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2634/5156] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:26 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:27.368937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:27.377482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:27.399568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:27.401791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:27.402261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:27.404662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:27.407930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:27.408832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:27.602878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:27.606701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:27.632822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:27.638016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:27.639579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:27.640604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:27.642453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:27.642730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aeeb7d06-c685-4720-93f3-19841f165c80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.279040 Oct 29 21:09:27.644730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:27.652553 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2523/5157] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:09:27 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:09:27.665565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:27.666778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:27.677527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:27.678387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:27.679932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:27.680923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:27.681709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:27.682349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:28.405301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:28.424185 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07887de7-0b4b-429e-8626-366141c072d1 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.821486 Oct 29 21:09:28.439341 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2635/5158] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:27 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:28.451341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-759280257", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d09707fa-b151-4dfb-b463-3c54e9612bf6"}], "security_groups": [{"name": "tempest-securitygroup--1674297132"}], "key_name": "tempest-keypair-736719338", "user_data": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:28.612735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:28.625698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-58847a0e-545b-43cf-b8a2-e69f73117d09 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1671 microversion: 2.1 time: 0.966278 Oct 29 21:09:28.626357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2524/5159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:27 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1671 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:28.808105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] validate_networks() for [('d09707fa-b151-4dfb-b463-3c54e9612bf6', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:09:29.229124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4ba32924-c47d-489d-8d20-390615f7fff5 req-b0c9f99a-eb92-4176-82f1-1e2aa33902c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8513d315-39a1-4702-b576-e2f4fa69dbb6", "name": "network-vif-plugged", "status": "completed", "tag": "5405c03b-a0f9-4561-9bbe-b0388aa4c15c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:29.244739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4ba32924-c47d-489d-8d20-390615f7fff5 req-b0c9f99a-eb92-4176-82f1-1e2aa33902c1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:29.245243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4ba32924-c47d-489d-8d20-390615f7fff5 req-b0c9f99a-eb92-4176-82f1-1e2aa33902c1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:29.252173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4ba32924-c47d-489d-8d20-390615f7fff5 req-b0c9f99a-eb92-4176-82f1-1e2aa33902c1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:29.277023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4ba32924-c47d-489d-8d20-390615f7fff5 req-b0c9f99a-eb92-4176-82f1-1e2aa33902c1 service nova] Creating event network-vif-plugged:5405c03b-a0f9-4561-9bbe-b0388aa4c15c for instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 on nch1-master-1 Oct 29 21:09:29.291063 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4ba32924-c47d-489d-8d20-390615f7fff5 req-b0c9f99a-eb92-4176-82f1-1e2aa33902c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066359 Oct 29 21:09:29.293607 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2525/5160] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:29.453059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:29.454341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:29.475538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:29.476406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:29.476851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:29.477607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:29.478073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:29.478509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:30.005268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:30.015016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1421b1fa-4878-448a-8b39-151cb89ddbfa tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.567227 Oct 29 21:09:30.021540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2526/5161] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:29 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:30.031883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:30.033275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:30.047196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:30.049385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:30.052223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:30.053587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:30.059795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:30.061086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:30.404113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:30.434704 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-210eceb8-ff98-4f5c-8723-e5da849ffa5a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1671 microversion: 2.1 time: 0.411754 Oct 29 21:09:30.438397 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2527/5162] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:30 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:30.804358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:09:30.805930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:09:30.807361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:09:30.810289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:09:30.811270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:09:30.839580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:30.840355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:30.840930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:30.842254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:30.843110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:30.843870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:30.857893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:30.876226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for project 208de26bb7304ee793bac715fb73fbdc. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:09:30.883763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Getting quotas for user 04d3c643e9c245eeaa6328d22184bc00 and project 208de26bb7304ee793bac715fb73fbdc. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:09:30.900544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:09:30.904400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:09:31.003623 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd2bc7c8-28b7-45e9-97a2-ca0e20152aa2 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.561974 Oct 29 21:09:31.004404 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2636/5163] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:09:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:09:31.017857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc08e5d9-8dfa-4ad7-b1f5-27af02405ef5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:31.019421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc08e5d9-8dfa-4ad7-b1f5-27af02405ef5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:31.048569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:31.050156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:31.079344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:31.083830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:31.084398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:31.086717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:31.092507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:31.093054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:31.142640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc08e5d9-8dfa-4ad7-b1f5-27af02405ef5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:31.151476 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc08e5d9-8dfa-4ad7-b1f5-27af02405ef5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1236 microversion: 2.1 time: 0.139026 Oct 29 21:09:31.153746 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2528/5164] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:31 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1236 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:31.373256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:31.392294 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49620f9d-a4b7-483c-bc12-6a0ba2a0a45f tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1315 microversion: 2.1 time: 0.349421 Oct 29 21:09:31.393033 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2637/5165] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:31 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:31.471357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:31.471357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:31.478635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:31.479441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:31.480097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:31.480836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:31.481303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:31.481775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:31.710875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:31.722315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ceb7fc7e-9186-43e3-9431-2813295f8b77 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.261238 Oct 29 21:09:31.727799 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2529/5166] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:31 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:32.025972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1112923049", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": "none"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:32.117823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:09:32.118896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:09:32.119612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:09:32.120578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:09:32.121411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:09:32.134432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.135471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.136408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.138743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.140002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.140695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.181006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:32.182835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:32.184823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Getting quotas for project 0851940aa6b64fe6bca875b22210f122. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:09:32.197126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Getting quotas for user 830851042c0b4ec282bf145d0440d989 and project 0851940aa6b64fe6bca875b22210f122. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:09:32.207105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.207621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.212672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.213539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.214416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.214873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.216324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:09:32.220182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:09:32.259259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:32.288796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6520d89e-6777-40c5-9140-67ea3b679db9 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.501289 Oct 29 21:09:32.290997 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2638/5167] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 21:09:32.302945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5cfb0616-e477-44ec-b658-b1e7ec75a3ec tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:32.303834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5cfb0616-e477-44ec-b658-b1e7ec75a3ec tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:32.443632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:32.447479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5cfb0616-e477-44ec-b658-b1e7ec75a3ec tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:32.453072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60c5eb70-6769-4af1-9d26-1f21f90ae133 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1288 microversion: 2.1 time: 0.276856 Oct 29 21:09:32.465747 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2530/5168] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:32 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1288 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:32.466041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5cfb0616-e477-44ec-b658-b1e7ec75a3ec tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:32.469376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5cfb0616-e477-44ec-b658-b1e7ec75a3ec tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:32.473088 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5cfb0616-e477-44ec-b658-b1e7ec75a3ec tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1278 microversion: 2.57 time: 0.175658 Oct 29 21:09:32.476736 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2639/5169] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:32 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:32.477414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:32.478504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:32.486734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.487528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.488413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.489336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.490020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.491609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.744469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:32.755072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7883250e-57fc-411d-9539-d0429d904070 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1464 microversion: 2.1 time: 0.287458 Oct 29 21:09:32.756184 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2531/5170] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:32 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1464 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:32.835432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:32.836004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:32.852010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.853819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.856617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.859768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:32.862207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:32.864292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:32.976750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:09:33.162267 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4dabae69-e2f7-4525-918b-67c660df7707 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 204 len: 0 microversion: 2.1 time: 0.329255 Oct 29 21:09:33.168543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2640/5171] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:09:32 2022] DELETE /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:09:33.173337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:33.174470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:33.191536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:33.192165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:33.197140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:33.203003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:33.204555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:33.206215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:33.495241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:33.496252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:33.512880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:33.544141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:33.544141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:33.544141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:33.544141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:33.544141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:33.700581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:33.719021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1af6172f-f0c2-483c-9d48-f065841a6cb4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1294 microversion: 2.1 time: 0.229157 Oct 29 21:09:33.720056 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2641/5172] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:33 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1294 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:33.725586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:33.726207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:33.739110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:33.742254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:33.742751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:33.743494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:33.748418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:33.749163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:33.869524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:33.884641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:33.887240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:33.889588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:33.891172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54431514-00ef-456f-b41b-756297e00786 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1330 microversion: 2.57 time: 0.169766 Oct 29 21:09:33.895569 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2642/5173] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:33 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1330 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:33.907969 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8b058c7-55d8-47db-9125-d74d5f33c887 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1470 microversion: 2.1 time: 0.739692 Oct 29 21:09:33.924824 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2532/5174] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:33 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1470 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:34.744956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:34.745623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:34.778423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:34.778933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:34.779379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:34.780111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:34.780572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:34.784708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:34.924466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:34.925374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:34.938785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:34.939771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:34.940455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:34.941849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:34.942699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:34.943326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:35.346222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:35.360354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:35.362814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:35.364219 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb312425-a2f0-4c15-960d-93da2c112888 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1336 microversion: 2.57 time: 0.446475 Oct 29 21:09:35.365908 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2533/5175] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:34 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1336 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:35.371308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:35.372124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:35.379730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:35.380669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:35.381505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:35.383116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:35.383758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:35.384363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:35.624365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:35.637426 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae3edd75-c024-4158-a06f-aaede3f709c8 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.894797 Oct 29 21:09:35.641989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2643/5176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:34 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:36.028241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:36.038725 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c3d0d54-4b43-4d96-b340-1b252cd2b693 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1470 microversion: 2.1 time: 0.671455 Oct 29 21:09:36.042739 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2534/5177] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:35 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1470 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:36.397475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:36.398663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:36.429262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:36.431477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:36.433155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:36.433959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:36.442237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:36.444299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:36.668860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:36.669513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:36.687382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:36.688808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:36.689476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:36.690422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:36.691105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:36.691752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:36.720961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:36.744962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:36.746656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:36.758929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bbf77b7e-b953-409b-acbc-bbbb225d9e43 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1336 microversion: 2.57 time: 0.368981 Oct 29 21:09:36.774147 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2644/5178] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:36 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1336 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:37.005993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9c8d7d1b-bff4-4236-be56-eda4ee68baf9 req-eab7b46c-a55f-4291-888c-68da5994a6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8513d315-39a1-4702-b576-e2f4fa69dbb6", "name": "network-vif-deleted", "tag": "5405c03b-a0f9-4561-9bbe-b0388aa4c15c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:37.031907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9c8d7d1b-bff4-4236-be56-eda4ee68baf9 req-eab7b46c-a55f-4291-888c-68da5994a6d1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:37.032484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9c8d7d1b-bff4-4236-be56-eda4ee68baf9 req-eab7b46c-a55f-4291-888c-68da5994a6d1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:37.032858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9c8d7d1b-bff4-4236-be56-eda4ee68baf9 req-eab7b46c-a55f-4291-888c-68da5994a6d1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:37.059368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9c8d7d1b-bff4-4236-be56-eda4ee68baf9 req-eab7b46c-a55f-4291-888c-68da5994a6d1 service nova] Creating event network-vif-deleted:5405c03b-a0f9-4561-9bbe-b0388aa4c15c for instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 on nch1-master-1 Oct 29 21:09:37.065347 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9c8d7d1b-bff4-4236-be56-eda4ee68baf9 req-eab7b46c-a55f-4291-888c-68da5994a6d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063079 Oct 29 21:09:37.067413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2645/5179] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:09:37.218573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:37.226095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:37.227094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:37.238510 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-392f90b5-6f2e-4d32-a90b-2ecd12431d3e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.573445 Oct 29 21:09:37.242542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2535/5180] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:36 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:37.243879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:37.244628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:37.245377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:37.246347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:37.247025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:37.247685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:37.301993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:37.302746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:37.303406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:37.304081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lazy-loading 'fault' on Instance uuid 8513d315-39a1-4702-b576-e2f4fa69dbb6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:09:37.376835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f017a1dc8dac4441940528d0e939f05c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12180c0f6b864b1fb51205b953d21b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:37.385446 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b7241fb-8bf2-4719-9c21-678f838ca509 tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 200 len: 1305 microversion: 2.1 time: 0.169977 Oct 29 21:09:37.387878 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2646/5181] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:37 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:37.789261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:37.790917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:37.800492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:37.803130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:37.803758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:37.807871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:37.808670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:37.809389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:37.957145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:37.985425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:37.986935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:37.988175 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95d38020-c8ae-4715-b464-64e8519b0486 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1357 microversion: 2.57 time: 0.203115 Oct 29 21:09:37.998131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2536/5182] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:37 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:38.025489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:38.028596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:38.044416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.044994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.045534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.046753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.049590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.050180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.244772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:09:38.249290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:09:38.250370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:09:38.251591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:09:38.253077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:09:38.270238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:38.271567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:38.280681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.283261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.283710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.285182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.287766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.290318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.435600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:38.450013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.454689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.455679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.456621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.458083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.459343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.534034 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6858e0c-1ca7-42a6-9518-556d7a704a42 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "POST /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d/action" status: 202 len: 1138 microversion: 2.57 time: 0.512486 Oct 29 21:09:38.536269 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2647/5183] 10.222.0.36 () {62 vars in 1320 bytes} [Sat Oct 29 21:09:38 2022] POST /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d/action => generated 1138 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 29 21:09:38.549650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:38.552196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] [instance: 8513d315-39a1-4702-b576-e2f4fa69dbb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:38.574605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.575643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.576610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.590814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.596152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.599595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.652922 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] HTTP exception thrown: Instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 could not be found. Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Request method failure captured: Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 HTTP/1.1 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZZ0NugSqxKw4Z69Y6nY8OtvvFp5ceuG_tQQd32wz3k7qDTWtj_L9HFlCWsE-XhLmmkUiZMdws4S08Mu8ReA5m6Lv4KAATui4B79j1ju4m8j8iNg67dvpbW5El5tO3vJsHZ53ceekgTC-KNQPGESUpJ8O1lIgDjO5jqsd3S7w2cX0pI Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 12180c0f6b864b1fb51205b953d21b33 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesNegativeTest-231078002 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12180c0f6b864b1fb51205b953d21b33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_12180c0f6b864b1fb51205b953d21b33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12180c0f6b864b1fb51205b953d21b33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/12180c0f6b864b1fb51205b953d21b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesNegativeTest-231078002 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 12180c0f6b864b1fb51205b953d21b33 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesNegativeTest-231078002 Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesNegativeTest-231078002-project Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f017a1dc8dac4441940528d0e939f05c Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesNegativeTest-231078002-project Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 could not be found. Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8513d315-39a1-4702-b576-e2f4fa69dbb6'} Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 could not be found. Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 could not be found. Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:09:38.655243 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 could not be found. Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:09:38.661309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] Returning 404 to user: Instance 8513d315-39a1-4702-b576-e2f4fa69dbb6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:09:38.663199 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aac16d51-f328-401e-bd15-ecbe92f9899d tempest-VolumesNegativeTest-231078002 tempest-VolumesNegativeTest-231078002-project] 10.222.0.36 "GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6" status: 404 len: 111 microversion: 2.1 time: 0.125526 Oct 29 21:09:38.675895 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2648/5184] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:38 2022] GET /compute/v2.1/servers/8513d315-39a1-4702-b576-e2f4fa69dbb6 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:09:38.693898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:38.713108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:38.731126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.740265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.743006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:38.744894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:38.746435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:38.748734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:39.008771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:39.022719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:39.030703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:39.033399 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0c583f9a-5598-422f-99ed-566c9f42ce1d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.345276 Oct 29 21:09:39.034379 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2649/5185] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:38 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:39.086861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-427e2756-ce3c-4cd0-a9d0-fc26b86acd28 req-1a93bfd4-4007-4cbf-8941-cad75e7100e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7403d66e-f24b-4a6b-b079-5bc9a9e05907", "tag": "00e52040-e17d-45fd-ae4f-28a122578d91"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:39.109644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-427e2756-ce3c-4cd0-a9d0-fc26b86acd28 req-1a93bfd4-4007-4cbf-8941-cad75e7100e2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:39.110076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-427e2756-ce3c-4cd0-a9d0-fc26b86acd28 req-1a93bfd4-4007-4cbf-8941-cad75e7100e2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:39.115154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-427e2756-ce3c-4cd0-a9d0-fc26b86acd28 req-1a93bfd4-4007-4cbf-8941-cad75e7100e2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:39.147455 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-427e2756-ce3c-4cd0-a9d0-fc26b86acd28 req-1a93bfd4-4007-4cbf-8941-cad75e7100e2 service nova] Creating event network-changed:00e52040-e17d-45fd-ae4f-28a122578d91 for instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 on nch2-master-1 Oct 29 21:09:39.163076 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-427e2756-ce3c-4cd0-a9d0-fc26b86acd28 req-1a93bfd4-4007-4cbf-8941-cad75e7100e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079665 Oct 29 21:09:39.168480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2650/5186] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:39.214215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:39.226925 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-63ed25fa-a43d-436e-9e8a-c39e9d1b6652 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.960535 Oct 29 21:09:39.229304 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2537/5187] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:38 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:40.066913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:40.067649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:40.084622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:40.087336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:40.088819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:40.089657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:40.098777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:40.099477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:40.255492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:40.256244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:40.262616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=70 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:40.314719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:40.319623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:40.333431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:40.335056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:40.338301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:40.339352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:40.349813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:40.384372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:40.388859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:40.393348 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68a02f6d-5b02-4d7b-b11e-9ab1ff949a7f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.332909 Oct 29 21:09:40.402222 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2651/5188] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:40 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:40.925155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:40.950646 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a55d3eac-fa40-44cb-8d69-577eb9fc9a9b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.702150 Oct 29 21:09:40.954250 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2538/5189] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:40 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:41.430562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:41.431342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:41.436344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:41.461144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:41.465784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:41.466559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:41.467648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:41.470737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:41.472722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:41.725041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:41.745120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:41.748988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:41.752164 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5bb83bd-0d64-4d89-b50a-518c962f3251 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.327629 Oct 29 21:09:41.778452 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2652/5190] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:41 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:41.978171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:41.978919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:41.990132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:41.995658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:41.997339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:41.999284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:42.002958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:42.003679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:42.004339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:42.699592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:42.710197 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d908577-45f2-47c2-9a35-d6269f6b94bd tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.736633 Oct 29 21:09:42.715506 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2539/5191] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:41 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:42.791638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:42.792210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:42.802159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:42.805629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=24 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:42.808904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:42.811580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:42.811802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:42.813732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:42.817389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:42.818525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:42.835634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:42.995859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:43.007429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:43.008899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:43.014313 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4194f45-b7d3-454d-9f94-abedacaf59dc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.234540 Oct 29 21:09:43.020093 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2653/5192] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:42 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:43.738616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:43.741448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:43.761448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:43.762741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:43.763734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:43.766327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:43.767004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:43.768301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:44.046310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:44.046868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:44.063796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:44.067679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:44.068190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:44.068960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:44.069444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:44.069913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:44.358941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:44.376703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:44.377365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:44.385020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:44.390076 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2280a755-2fc3-4ce0-974c-b7c9b7e6ccca tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.347404 Oct 29 21:09:44.394132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2654/5193] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:44 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:44.397544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a751bc1c-451f-42ed-bb18-3f203578b813 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.657904 Oct 29 21:09:44.398520 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2540/5194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:43 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:45.421701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:45.423077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:45.427761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:45.428594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:45.438160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:45.438826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:45.439276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:45.442289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:45.442891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:45.443378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:45.445751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:45.446924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:45.451121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:45.452264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:45.453226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:45.461480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:45.746105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:45.761144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:45.768000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:45.769775 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-82d4501e-101a-4587-9b01-d8620e1ff601 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.353517 Oct 29 21:09:45.774181 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2655/5195] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:45 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:46.102115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:46.114115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20a5678d-60c6-4b9f-a6d3-50b6cede9adc tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.691644 Oct 29 21:09:46.115033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2541/5196] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:45 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:46.812347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:46.815305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:46.831913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:46.835875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:46.837147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:46.838242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:46.840352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:46.841757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:46.956846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:46.972169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:46.974244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:46.975929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-206c07d4-6fa3-4a22-9c2d-b95151cb20a5 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.172838 Oct 29 21:09:46.995909 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2656/5197] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:46 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:47.141579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:47.142282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:47.153806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:47.154545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:47.155225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:47.156256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:47.157786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:47.158632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:47.393623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:47.403674 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec3acb24-f8ec-45a4-b13d-71b347ba38d3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.267009 Oct 29 21:09:47.404908 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2542/5198] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:47 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:47.584498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9e291761-e243-4496-80bc-c2b84541f6f1 req-2ea40b8c-1bec-4a71-af37-627b7060c191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7403d66e-f24b-4a6b-b079-5bc9a9e05907", "name": "network-vif-plugged", "status": "completed", "tag": "00e52040-e17d-45fd-ae4f-28a122578d91"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:47.601633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e291761-e243-4496-80bc-c2b84541f6f1 req-2ea40b8c-1bec-4a71-af37-627b7060c191 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:47.602631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e291761-e243-4496-80bc-c2b84541f6f1 req-2ea40b8c-1bec-4a71-af37-627b7060c191 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:47.605197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9e291761-e243-4496-80bc-c2b84541f6f1 req-2ea40b8c-1bec-4a71-af37-627b7060c191 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:47.656705 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9e291761-e243-4496-80bc-c2b84541f6f1 req-2ea40b8c-1bec-4a71-af37-627b7060c191 service nova] Creating event network-vif-plugged:00e52040-e17d-45fd-ae4f-28a122578d91 for instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 on nch2-master-1 Oct 29 21:09:47.674797 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9e291761-e243-4496-80bc-c2b84541f6f1 req-2ea40b8c-1bec-4a71-af37-627b7060c191 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099321 Oct 29 21:09:47.677714 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2657/5199] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:48.016597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:48.018745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:48.036066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:48.036755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:48.037203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:48.038077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:48.039894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:48.040409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:48.435618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:48.436408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:48.458059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:48.458563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:48.460725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:48.463065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:48.465038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:48.466173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:48.491580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:48.503041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:48.516511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:48.524221 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-506684b7-d9f0-434c-b0de-f9a878d65c79 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.511486 Oct 29 21:09:48.524776 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2543/5200] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:48 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:48.713970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:48.731246 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-165afdff-08cc-40d9-88f5-0057a646eff1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1362 microversion: 2.1 time: 0.300210 Oct 29 21:09:48.731862 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2658/5201] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:48 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:09:49.552863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:49.554655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:49.563408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:49.564892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:49.566043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:49.570519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:49.576283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:49.577062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:49.722462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:49.759360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:49.761600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:49.785310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:49.786703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:49.787232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:49.787696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:49.788440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:49.789305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:49.789530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:49.790132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:49.792044 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2862a1ff-2e2f-4f4d-a952-c4cc8a4f99d8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.244271 Oct 29 21:09:49.815122 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2544/5202] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:49 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:50.045430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:50.061340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8669f39-3ebd-46d2-b31f-3c8d0e7b5e85 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1549 microversion: 2.1 time: 0.308534 Oct 29 21:09:50.065003 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2659/5203] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:09:49 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1549 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:09:50.088529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:50.089392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:50.097432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:50.098255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:50.099383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:50.100297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:50.101066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:50.101735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:50.227943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53141dec-3aa2-4dff-aa7c-fe9804386ce9 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143977 Oct 29 21:09:50.236725 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2545/5204] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:09:50 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:50.825032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:50.826330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:50.838363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:50.841472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:50.842273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:50.843218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:50.844130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:50.847717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:51.032268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:51.046637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:51.051867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:51.055367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9df834ff-1d67-45df-9bee-499ad3bef493 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.233677 Oct 29 21:09:51.070706 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2660/5205] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:50 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:52.085174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:52.087388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:52.099857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:52.100631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:52.102593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:52.103330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:52.103799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:52.106103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:52.296044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:52.312188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:52.317865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:52.319588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-296c6d77-6652-490d-8fa3-28d6b32746c6 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.239319 Oct 29 21:09:52.320672 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2546/5206] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:52 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:52.644939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-40a92632-8daf-4ed7-bf7a-f6861df694dc req-0d86bc12-78f1-4891-ab81-00d4084697ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7403d66e-f24b-4a6b-b079-5bc9a9e05907", "tag": "00e52040-e17d-45fd-ae4f-28a122578d91"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:09:52.683492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-40a92632-8daf-4ed7-bf7a-f6861df694dc req-0d86bc12-78f1-4891-ab81-00d4084697ba service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:52.684117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-40a92632-8daf-4ed7-bf7a-f6861df694dc req-0d86bc12-78f1-4891-ab81-00d4084697ba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:52.684578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-40a92632-8daf-4ed7-bf7a-f6861df694dc req-0d86bc12-78f1-4891-ab81-00d4084697ba service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:52.719321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-40a92632-8daf-4ed7-bf7a-f6861df694dc req-0d86bc12-78f1-4891-ab81-00d4084697ba service nova] Creating event network-changed:00e52040-e17d-45fd-ae4f-28a122578d91 for instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 on nch2-master-1 Oct 29 21:09:52.741907 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-40a92632-8daf-4ed7-bf7a-f6861df694dc req-0d86bc12-78f1-4891-ab81-00d4084697ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102406 Oct 29 21:09:52.751815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2661/5207] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:09:53.358590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:53.360408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:53.380001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:53.381061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:53.383370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:53.384871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:53.386462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:53.387225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:53.412733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:09:53.765930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:53.782454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:53.787574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:53.790415 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4afe8da-9387-47ce-90cf-3b68257f897a tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.441279 Oct 29 21:09:53.792396 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2547/5208] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:53 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:54.825754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:54.827107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:54.855387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:54.857216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:54.857876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:54.859135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:54.860496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:54.863753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:55.042251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:55.062433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:55.065483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:55.067019 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5c6878cd-aad5-4ed6-b9d8-c28de4a8a232 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.246647 Oct 29 21:09:55.069957 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2662/5209] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:54 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:56.100337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:56.101737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:56.114825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:56.115859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:56.116964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:56.118063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:56.119081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:56.121076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:56.319641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:56.329999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:56.334470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:56.337100 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8800baed-c608-44f5-a2e1-73e6e462cb71 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.240582 Oct 29 21:09:56.349905 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2548/5210] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:56 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:57.365524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:57.366989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:57.378213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:57.379006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:57.380061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:57.381013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:57.381797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:57.382529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:57.514604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:57.527151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:57.528947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:57.530594 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9d584e6-76bb-4d47-b440-394e27ff6540 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.171500 Oct 29 21:09:57.534832 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2663/5211] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:57 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:58.571002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:58.572274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:58.607238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:58.610883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:58.611753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:58.616555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:58.617610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:58.619338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:58.872765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:58.886863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:58.891854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:09:58.893226 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8cfdb11-35e2-4aa3-afe3-cb482c79a5ee tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.328477 Oct 29 21:09:58.895596 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2549/5212] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:58 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:09:59.928965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:09:59.930888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:09:59.945409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:59.948932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:59.952164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:09:59.955067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:09:59.955795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:09:59.957057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:00.066581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:00.081443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:00.084072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:00.086395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb8c76ae-9037-47d4-95cb-f486ea9e911c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.164496 Oct 29 21:10:00.087696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2664/5213] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:09:59 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:01.112632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:01.113272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:01.123984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:01.124478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:01.129482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:01.130306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:01.133861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:01.134325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:01.282447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:01.296641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:01.300232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:01.303422 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55cfc37e-67b7-454d-9247-205e608c631c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.195309 Oct 29 21:10:01.305092 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2550/5214] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:01 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:02.337532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:02.339226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:02.355409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:02.356102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:02.357098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:02.360393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:02.361438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:02.363546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:02.506998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:02.517722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:02.519182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:02.537138 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba025a14-d519-43e6-a596-43a4e5cd411f tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.194882 Oct 29 21:10:02.539752 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2665/5215] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:02 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:03.565842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:03.567347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:03.580983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:03.582861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:03.584479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:03.585989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:03.586739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:03.588564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:04.073681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:04.091906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:04.095655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:04.104652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f056925-2215-45f8-8007-d5e38b370d61 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.541488 Oct 29 21:10:04.105258 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2551/5216] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:03 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:04.521059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:04.521699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:04.530631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:04.532047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:04.533668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:04.534669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:04.535096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:04.535695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:04.785686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:04.797361 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20d87572-231d-4747-9dd4-bacfd6d130c5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.280081 Oct 29 21:10:04.824268 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2666/5217] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:04 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:04.830705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:04.831834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:04.852661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:04.853337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:04.854129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:04.855215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:04.859034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:04.859757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.107239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:05.118503 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74b8e68b-28c7-4675-b2d5-47d9bfd925e0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.295437 Oct 29 21:10:05.119239 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2552/5218] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:04 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:05.133952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:05.134965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:05.143276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:05.149369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:05.149975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.150858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:05.151797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:05.152423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:05.154351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:05.155024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.168741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:05.169232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:05.173976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.174918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:05.176205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:05.177142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.308602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:05.318324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:05.334091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:05.336036 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aa8696fc-dce9-4fcc-a7d2-092c7c14605d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.207108 Oct 29 21:10:05.351187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2667/5219] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:05 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:05.452007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:05.458042 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2cabd85d-6df0-4852-992d-1caabb1b5557 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.312860 Oct 29 21:10:05.458923 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2553/5220] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:05 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:10:05.482258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:05.482947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:05.491168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:05.491675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:05.492112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.493092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:05.494176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:05.494824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:05.740733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:05.753759 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-54f8d22a-b02b-4844-8c9e-767543013d24 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.275636 Oct 29 21:10:05.754674 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2668/5221] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:05 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:10:06.098275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-873677891", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1afe3e15-ddc2-4d60-825a-7983ed3bd0c7"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:06.165943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] validate_networks() for [('1afe3e15-ddc2-4d60-825a-7983ed3bd0c7', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:10:06.367940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:06.369107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:06.378087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:06.379680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:06.380433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:06.382022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:06.382880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:06.383605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:06.555777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:06.569148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:06.575799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:06.576969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2ef318b-140b-48a4-a317-bfbb3a927e6c tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.215878 Oct 29 21:10:06.577575 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2669/5222] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:06 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:07.213424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:10:07.214031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:10:07.214714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:10:07.215321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:10:07.215755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:10:07.232767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:07.235477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:07.236395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:07.237624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:07.238528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:07.239209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:07.280391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:10:07.290493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for user c35b0dd86eb14cbbab1732cc96ab2573 and project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:10:07.316966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:10:07.321800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:10:07.427077 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08772cb8-dfd0-49e1-a845-b86cbb267bb1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330724 Oct 29 21:10:07.430468 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2554/5223] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:10:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:10:07.443036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30c7e53a-883f-48fb-aefe-3fd6b6dc7116 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:07.444314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30c7e53a-883f-48fb-aefe-3fd6b6dc7116 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:07.574477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-30c7e53a-883f-48fb-aefe-3fd6b6dc7116 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:07.595031 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30c7e53a-883f-48fb-aefe-3fd6b6dc7116 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1214 microversion: 2.1 time: 0.155838 Oct 29 21:10:07.597923 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2670/5224] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:07 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:07.620439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:07.622049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:07.634627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:07.636795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:07.638457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:07.639581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:07.640976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:07.644246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:07.892066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:07.916101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:07.918042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:07.919520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aa52d523-4f4d-44e0-b0d1-f2d8b4b04146 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.306269 Oct 29 21:10:07.920577 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2555/5225] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:07 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:08.625303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:08.628554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:08.638317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:08.642254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:08.642768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:08.645891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:08.646532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:08.647256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:08.906799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:08.917953 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4fb72bd3-8837-4c9c-9fd6-d2c7607669e1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1210 microversion: 2.1 time: 0.297304 Oct 29 21:10:08.918560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2671/5226] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:08 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1210 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:08.957974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:08.958902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:08.966764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:08.967658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:08.969044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:08.971291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:08.972253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:08.973210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:09.111436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:09.124917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:09.129216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:09.136170 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91781345-cf40-4619-8ffb-b979d557f806 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.181268 Oct 29 21:10:09.137585 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2556/5227] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:08 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:09.953881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:09.955789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:09.971164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:09.997904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:10.002444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:10.006430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:10.012042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:10.013208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:10.034843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:10.183281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:10.185436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:10.196762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:10.197261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:10.197759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:10.198956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:10.207318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:10.207782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:10.216154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:10.241040 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-74a46c75-feef-4644-9a3e-1d61c5fc7927 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1210 microversion: 2.1 time: 0.295516 Oct 29 21:10:10.241950 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2672/5228] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:09 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1210 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:10.345115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:10.354832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:10.356438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:10.357899 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b0a5086-669e-4d58-af6a-00006eb40461 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1366 microversion: 2.57 time: 0.180585 Oct 29 21:10:10.360021 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2557/5229] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:10 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:11.266393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:11.267977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:11.284720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:11.287167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:11.289187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:11.291571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:11.292162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:11.294411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:11.386067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:11.386804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:11.395272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:11.428059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:11.429348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:11.430493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:11.431988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:11.434366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:11.438535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:11.451682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:11.464608 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8043a8f4-a3a6-4008-8d84-143a3553a26f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1272 microversion: 2.1 time: 0.204182 Oct 29 21:10:11.468016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2673/5230] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:11 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:11.713336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:11.737937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:11.742991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:11.748082 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aa054020-2e96-47ba-b8d2-4216e18e91a1 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1372 microversion: 2.57 time: 0.366177 Oct 29 21:10:11.754735 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2558/5231] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:11 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1372 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:12.495849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:12.497593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:12.506129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=46 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:12.509585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:12.513751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:12.514739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:12.516424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:12.520182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:12.525362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:12.743653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:12.755957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9372ff3b-3caa-459b-9b79-26bd80a79690 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1272 microversion: 2.1 time: 0.264941 Oct 29 21:10:12.757522 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2674/5232] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:12 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:12.789279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:12.790581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:12.799939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:12.800671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:12.801564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:12.802487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:12.803274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:12.803875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:12.941346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:12.955850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:12.962727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:12.965181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05bfa9fb-906e-48fd-8ad6-c197f2a5d0bc tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1372 microversion: 2.57 time: 0.182949 Oct 29 21:10:12.967754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2559/5233] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:12 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:13.784891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:13.785555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:13.792963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:13.793844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:13.794618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:13.795554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:13.796558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:13.797202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:13.993731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:14.010202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:14.069408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:14.070518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:14.071156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:14.072529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:14.073178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:14.073898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:14.256940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.271097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.272658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.273990 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d7c8e774-4275-48db-bd2b-1211d877225e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1357 microversion: 2.57 time: 0.285579 Oct 29 21:10:14.274564 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2560/5234] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:13 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:14.308261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:14.309141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:14.320337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:14.321095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:14.322265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:14.328729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:14.329744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:14.330361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:14.346952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.361720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38f550a0-269c-40bf-a3ae-7e8f8eac6d82 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.581674 Oct 29 21:10:14.379447 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2675/5235] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:13 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:14.389159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:10:14.566319 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25f716a7-bb61-420e-9d14-8489ad746cb2 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 204 len: 0 microversion: 2.57 time: 0.261571 Oct 29 21:10:14.569220 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2561/5236] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:10:14 2022] DELETE /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 21:10:14.578765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:14.579455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:14.590402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:14.590913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:14.591360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:14.595262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:14.595759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:14.596210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:14.789218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.814381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.817550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:14.818310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7557bfcf-af3b-48a6-98b6-c17141724f4d tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1363 microversion: 2.57 time: 0.243900 Oct 29 21:10:14.835803 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2676/5237] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:14 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:15.386169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:15.386997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:15.402788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:15.404381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:15.405131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:15.406978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:15.407808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:15.408928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:15.849142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:15.849993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:15.865714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:15.866978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:15.869254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:15.871091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:15.872179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:15.875003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:16.349531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:16.359648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:16.361339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:16.363160 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-85f8340d-7e78-425b-bc2d-4ad06ce3780e tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1363 microversion: 2.57 time: 0.517479 Oct 29 21:10:16.364097 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2677/5238] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:15 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:16.560449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:16.578387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:16.594365 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2e68eeb-fc22-46d5-b1d9-313777bb95b3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 1.209742 Oct 29 21:10:16.614826 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2562/5239] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:15 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:16.653224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-242b8b86-2c08-487b-9f2a-ce701a699646 req-3b533453-e239-406a-b6c8-b01c2e019455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0021e58-6abb-4fff-938a-75caf0360bee", "tag": "99947c6a-8767-48e3-b8a1-400d772b4b73"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:16.679466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-242b8b86-2c08-487b-9f2a-ce701a699646 req-3b533453-e239-406a-b6c8-b01c2e019455 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:16.680371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-242b8b86-2c08-487b-9f2a-ce701a699646 req-3b533453-e239-406a-b6c8-b01c2e019455 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:16.681046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-242b8b86-2c08-487b-9f2a-ce701a699646 req-3b533453-e239-406a-b6c8-b01c2e019455 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:16.698784 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-242b8b86-2c08-487b-9f2a-ce701a699646 req-3b533453-e239-406a-b6c8-b01c2e019455 service nova] Creating event network-changed:99947c6a-8767-48e3-b8a1-400d772b4b73 for instance b0021e58-6abb-4fff-938a-75caf0360bee on nch1-master-1 Oct 29 21:10:16.704260 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-242b8b86-2c08-487b-9f2a-ce701a699646 req-3b533453-e239-406a-b6c8-b01c2e019455 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054875 Oct 29 21:10:16.705262 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2678/5240] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:17.395659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:17.397290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:17.401681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:17.406651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:17.471545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:17.472175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:17.472636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:17.480717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:17.482521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:17.483164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:17.596237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:17.597478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:17.599136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:17.602103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lazy-loading 'fault' on Instance uuid f6c1f0a9-9df2-40ee-8b51-621830c01b2d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:10:17.627413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:17.629063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:17.639842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:17.645026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:17.647188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:17.648193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:17.650612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:17.651952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:17.652865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:17.824526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:17.840591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:17.848479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '830851042c0b4ec282bf145d0440d989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851940aa6b64fe6bca875b22210f122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:17.850103 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3df35360-ccca-4ac4-85d0-c9280ff3fbe8 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 200 len: 1368 microversion: 2.57 time: 0.461385 Oct 29 21:10:17.872541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2563/5241] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:17 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 1368 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:18.284229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:18.298920 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f279454c-f490-469c-8390-76b3e7e8817b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.680876 Oct 29 21:10:18.303109 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2679/5242] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:17 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:18.881078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:18.881666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] [instance: f6c1f0a9-9df2-40ee-8b51-621830c01b2d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:18.900043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:18.900779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:18.903453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:18.904461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:18.908414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:18.909865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:18.958946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] HTTP exception thrown: Instance f6c1f0a9-9df2-40ee-8b51-621830c01b2d could not be found. Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Request method failure captured: Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d HTTP/1.1 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZaLi2o2luAxFHH3uPq0dF7AqnjbjaRUZpIYjRnFyp687J3nz6Jwl596HgPzGB-bbCaH87MlmGsoUgeqK_QeYUyJGj91eLvKM4FfN9N5jSlRkNNXB1aba4lwZ_U2PuiTAhX0ABUJxOlP-WyEwpBsmLtI7j5ccuQBmkXk-S-iOzXozks Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.57 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 0851940aa6b64fe6bca875b22210f122 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerShowV257Test-703393549 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0851940aa6b64fe6bca875b22210f122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0851940aa6b64fe6bca875b22210f122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0851940aa6b64fe6bca875b22210f122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0851940aa6b64fe6bca875b22210f122"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerShowV257Test-703393549 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 0851940aa6b64fe6bca875b22210f122 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerShowV257Test-703393549 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerShowV257Test-703393549-project Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 830851042c0b4ec282bf145d0440d989 Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerShowV257Test-703393549-project Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f6c1f0a9-9df2-40ee-8b51-621830c01b2d could not be found. Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f6c1f0a9-9df2-40ee-8b51-621830c01b2d'} Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c1f0a9-9df2-40ee-8b51-621830c01b2d could not be found. Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c1f0a9-9df2-40ee-8b51-621830c01b2d could not be found. Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:10:18.967792 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c1f0a9-9df2-40ee-8b51-621830c01b2d could not be found. Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] Returning 404 to user: Instance f6c1f0a9-9df2-40ee-8b51-621830c01b2d could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:10:18.972567 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61b91f0e-0565-449c-85b4-5aa895035997 tempest-ServerShowV257Test-703393549 tempest-ServerShowV257Test-703393549-project] 10.222.0.36 "GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d" status: 404 len: 111 microversion: 2.57 time: 0.092303 Oct 29 21:10:18.976071 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2564/5243] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:18 2022] GET /compute/v2.1/servers/f6c1f0a9-9df2-40ee-8b51-621830c01b2d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:10:19.324944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:19.326268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:19.340659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:19.344127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:19.344677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:19.346069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:19.348616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:19.349899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:19.753684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:19.791123 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f782c28a-2989-49d7-a4ab-599cc3594560 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.470373 Oct 29 21:10:19.810234 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2680/5244] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:19 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:20.824829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:20.827020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:20.838211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:20.852655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:20.852989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:20.853893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:20.854288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:20.854740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:21.459930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:21.468657 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3581b1e8-d037-4e56-843e-d2069d103517 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.654296 Oct 29 21:10:21.472326 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2565/5245] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:20 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:22.498937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:22.500793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:22.507984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:22.508599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:22.509317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:22.513012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:22.513807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:22.514469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:23.110071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:23.131637 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97d84578-5364-44ed-991f-e2a2621e3929 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.625201 Oct 29 21:10:23.140446 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2681/5246] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:22 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:24.158788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:24.160062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:24.173611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:24.175786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:24.176651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:24.177743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:24.180468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:24.181052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:24.761878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:24.773542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db72e0d7-9a8b-418a-9588-f0815179f6da tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.618622 Oct 29 21:10:24.774123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2566/5247] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:24 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:25.800771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:25.802401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:25.812734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:25.817571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:25.819222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:25.820234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:25.821767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:25.822847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:25.919304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a4dcf78-fcab-43ef-80a2-1f1c98a8b07c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'create', calling method: .version_select at 0x7fa171e8f5e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1736691823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUrjSL276bR5Dn55YXf5AnHE/VoVUiYSQTWeij8NR2WTPKeEnLFspad6InrBgF6KLf4gRt3qdtx4X56IdvoJXWOvFyzSNm4NvvZPLDkHMm/DehEf7mZYGI75YK69KIE9Q=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:25.966005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1a4dcf78-fcab-43ef-80a2-1f1c98a8b07c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for project a7c7f9a81492476983b30fd4984ba3db. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:10:25.978228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1a4dcf78-fcab-43ef-80a2-1f1c98a8b07c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for user ce0a47b4b8bc40178dbfe6545060c467 and project a7c7f9a81492476983b30fd4984ba3db. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:10:26.028695 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a4dcf78-fcab-43ef-80a2-1f1c98a8b07c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.114884 Oct 29 21:10:26.029661 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2567/5248] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:10:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:10:26.558773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5099755e-87ea-4464-8bb2-0d105623887d req-eb226d92-77dd-4060-8413-3062a89aad1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0021e58-6abb-4fff-938a-75caf0360bee", "name": "network-vif-plugged", "status": "completed", "tag": "99947c6a-8767-48e3-b8a1-400d772b4b73"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:26.581328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5099755e-87ea-4464-8bb2-0d105623887d req-eb226d92-77dd-4060-8413-3062a89aad1c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:26.581859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5099755e-87ea-4464-8bb2-0d105623887d req-eb226d92-77dd-4060-8413-3062a89aad1c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:26.582303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5099755e-87ea-4464-8bb2-0d105623887d req-eb226d92-77dd-4060-8413-3062a89aad1c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:26.599582 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5099755e-87ea-4464-8bb2-0d105623887d req-eb226d92-77dd-4060-8413-3062a89aad1c service nova] Creating event network-vif-plugged:99947c6a-8767-48e3-b8a1-400d772b4b73 for instance b0021e58-6abb-4fff-938a-75caf0360bee on nch1-master-1 Oct 29 21:10:26.605006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5099755e-87ea-4464-8bb2-0d105623887d req-eb226d92-77dd-4060-8413-3062a89aad1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049961 Oct 29 21:10:26.606447 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2568/5249] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:26.617221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:26.630253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e4b92913-c88c-4309-a00b-62880a2e0808 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 0.834112 Oct 29 21:10:26.631629 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2682/5250] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:25 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:27.661867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:27.663020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:27.693924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:27.695068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:27.705425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:27.706783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:27.708943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:27.710771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:27.913753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:27.915657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:27.973278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:27.975803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:27.977369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:27.979497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:27.980705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:27.982628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:28.053778 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad269e76-ae9f-40c9-a04f-937defdcb128 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/ips" status: 200 len: 146 microversion: 2.1 time: 0.145776 Oct 29 21:10:28.054403 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2683/5251] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:10:27 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/ips => generated 146 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:28.579339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-491233708", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "6e9ce61e-1ac7-4176-9825-d7071e6270ab"}], "key_name": "tempest-TestNetworkBasicOps-1736691823", "security_groups": [{"name": "tempest-secgroup-smoke-1299693368"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:29.357635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:29.369034 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d38a7bbb-b5f2-4f72-ad90-dc885c67b54f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1314 microversion: 2.1 time: 1.714125 Oct 29 21:10:29.381493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2569/5252] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:27 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1314 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:29.431528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] validate_networks() for [('6e9ce61e-1ac7-4176-9825-d7071e6270ab', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:10:29.517949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:29.518833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:29.526351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:29.527239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:29.527947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:29.528888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:29.529631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:29.530325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:29.588766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b410363-d15d-4761-919d-0ab153eda321 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/ips" status: 200 len: 153 microversion: 2.20 time: 0.075546 Oct 29 21:10:29.603321 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2570/5253] 10.222.0.36 () {60 vars in 1289 bytes} [Sat Oct 29 21:10:29 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/ips => generated 153 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:10:29.997101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c70004a7-678b-41f5-81b6-131c2e4d9d74"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:30.000392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:30.023146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:30.023657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:30.024104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:30.024829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:30.035525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:30.035525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:30.627542 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12b968cd-3572-470f-8bf6-b624620b212b tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634401 Oct 29 21:10:30.634363 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2571/5254] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:10:29 2022] POST /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:10:30.637848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:30.645795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:30.672126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:30.681248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:30.682597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:30.683999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:30.685043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:30.685521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:31.238657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:10:31.239191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:10:31.239570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:10:31.239979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:10:31.240391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:10:31.256052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:31.256556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:31.256991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:31.257756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:31.258212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:31.258642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:31.283995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:31.299093 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0aad3c75-d4af-4575-9a84-18d578295cb3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1500 microversion: 2.1 time: 0.669605 Oct 29 21:10:31.299704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2572/5255] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:30 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1500 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:31.316252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for project a7c7f9a81492476983b30fd4984ba3db. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:10:31.333107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:31.333727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:31.352277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for user ce0a47b4b8bc40178dbfe6545060c467 and project a7c7f9a81492476983b30fd4984ba3db. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:10:31.355533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:31.356050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:31.356501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:31.361571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:31.362063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:31.362509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:31.397833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:10:31.405871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:10:31.557435 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ae39d3d-9e4d-4f0e-a330-94bd0e4b1377 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.982984 Oct 29 21:10:31.558818 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2684/5256] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:10:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:10:31.574958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38298d4a-8817-43df-906d-3cc29345fc9c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:31.576012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38298d4a-8817-43df-906d-3cc29345fc9c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:31.698299 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.network.security_group_api [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Removing security group 4d153d49-2d82-4f8e-a748-a44e3f0ae4c8 from port 99947c6a-8767-48e3-b8a1-400d772b4b73 Oct 29 21:10:31.825330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-38298d4a-8817-43df-906d-3cc29345fc9c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:31.836984 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38298d4a-8817-43df-906d-3cc29345fc9c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1248 microversion: 2.1 time: 0.268788 Oct 29 21:10:31.838226 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2685/5257] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:31 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1248 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:32.375582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:32.376253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:32.397018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:32.404205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:32.411355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:32.413223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:32.415605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:32.418521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:32.525602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lazy-loading 'flavor' on Instance uuid 01b200c4-ac17-4bbe-957c-2b52a946ffc6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:10:32.598244 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c5b45487-2724-4d17-b764-cdcc60f6e38d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee/action" status: 202 len: 0 microversion: 2.1 time: 1.276702 Oct 29 21:10:32.599238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2573/5258] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:10:31 2022] POST /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee/action => generated 0 bytes in 1279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:10:32.607870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:32.609030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:32.633821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:32.634875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:32.635360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:32.636122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:32.636594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:32.637032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:32.913708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:32.929379 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c9b9c32-a470-4f3f-b54d-8e4ca43c406e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1458 microversion: 2.1 time: 0.325874 Oct 29 21:10:32.956497 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2574/5259] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:32 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1458 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:32.963373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4c8e7f61-fc46-4ba4-8c66-e112f3c30001 req-fa950eec-e426-4163-a560-1035a1b36d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0021e58-6abb-4fff-938a-75caf0360bee", "tag": "99947c6a-8767-48e3-b8a1-400d772b4b73"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:32.975330 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f22b9589-315d-4554-b54c-eb98caf3eee1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/action" status: 202 len: 0 microversion: 2.20 time: 0.603934 Oct 29 21:10:32.976678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2686/5260] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 21:10:32 2022] POST /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:10:32.986595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:32.989995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:33.009008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.014864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.015344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.019601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4c8e7f61-fc46-4ba4-8c66-e112f3c30001 req-fa950eec-e426-4163-a560-1035a1b36d7e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.021256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.023100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.023496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.024088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4c8e7f61-fc46-4ba4-8c66-e112f3c30001 req-fa950eec-e426-4163-a560-1035a1b36d7e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.025300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4c8e7f61-fc46-4ba4-8c66-e112f3c30001 req-fa950eec-e426-4163-a560-1035a1b36d7e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.059325 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4c8e7f61-fc46-4ba4-8c66-e112f3c30001 req-fa950eec-e426-4163-a560-1035a1b36d7e service nova] Creating event network-changed:99947c6a-8767-48e3-b8a1-400d772b4b73 for instance b0021e58-6abb-4fff-938a-75caf0360bee on nch1-master-1 Oct 29 21:10:33.066966 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4c8e7f61-fc46-4ba4-8c66-e112f3c30001 req-fa950eec-e426-4163-a560-1035a1b36d7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108949 Oct 29 21:10:33.067963 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2575/5261] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:33.088023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:33.089079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:33.100012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.100743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.101377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.102974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.103969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.104565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.268814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:33.291966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a3f42844-d941-4f7d-870b-5a872b251793 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1244 microversion: 2.1 time: 0.305444 Oct 29 21:10:33.292847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2687/5262] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:32 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1244 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:33.307285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:33.312852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:33.357804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.358926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.362855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.363818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:33.364297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:33.364734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:33.950911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:33.966967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:33.969448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:33.970928 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-75384a77-7f3d-47d0-bfdc-9aaddf93724e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.670065 Oct 29 21:10:33.982270 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2688/5263] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:33 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:34.012773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:34.037953 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d991970-a640-4cd8-8be1-b434b6ac5f15 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.962698 Oct 29 21:10:34.038980 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2576/5264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:33 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:34.064163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:34.065767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:34.081380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:34.083027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:34.085630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:34.086656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:34.087829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:34.089337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:34.146885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:34.319665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:34.320553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:34.340336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:34.340904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:34.344470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:34.345543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:34.346043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:34.347274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:34.762754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:34.808408 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-199f9ae4-7e55-48ec-8e05-1550e520de64 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1300 microversion: 2.1 time: 0.493972 Oct 29 21:10:34.812619 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2577/5265] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:34 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1300 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:10:34.908675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:34.938531 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a5d2ca7-0c18-44cb-b0a5-c5aa570af112 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.878862 Oct 29 21:10:34.939817 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2689/5266] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:34 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:34.962868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:34.963500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:34.973010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:34.973780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:34.975983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:34.976970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:34.982208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:34.990490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:35.011723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:35.012615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:35.032010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:35.034737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:35.035968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:35.036748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:35.038959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:35.039419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:35.974413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:35.993257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:36.001117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:36.007441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:36.008696 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bfdc30e7-adf4-4f32-870c-3f16dd6113f9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 1.001349 Oct 29 21:10:36.014607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2690/5267] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:35 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:36.022756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:36.025620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:36.033012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.033543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.033983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.035416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.043852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:36.047809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.048112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.058021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d204239-f0fa-4231-acd0-b7d07121264e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.098953 Oct 29 21:10:36.081140 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2578/5268] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:34 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:36.088586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:36.089232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:36.107749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.109109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.110521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.111454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.114290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.114936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.171711 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b46a215b-86fd-4d1e-82fe-aff380fabc40 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152401 Oct 29 21:10:36.172301 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2691/5269] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:10:36 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:36.181010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:36.185861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:36.199432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.201040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.201516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.206698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.207189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.207636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.252272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:36.262697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29fed952-94f7-445c-b4d9-f28695a142d5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1306 microversion: 2.1 time: 0.180234 Oct 29 21:10:36.265015 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2579/5270] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:36 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:36.295021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:36.295457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:36.317966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.319030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.319684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.320661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:36.321076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:36.321552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:36.398641 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a6dbb82-6aaa-4462-ab7e-c74c27c9a3af tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/c70004a7-678b-41f5-81b6-131c2e4d9d74" status: 200 len: 194 microversion: 2.1 time: 0.111954 Oct 29 21:10:36.399351 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2580/5271] 10.222.0.36 () {58 vars in 1413 bytes} [Sat Oct 29 21:10:36 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/c70004a7-678b-41f5-81b6-131c2e4d9d74 => generated 194 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:36.771644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:36.785763 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f7abb915-0b0c-48ee-838b-3525bca15686 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.608280 Oct 29 21:10:36.787480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2692/5272] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:36 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:37.042158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:37.042831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:37.052505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1617529093", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "1afe3e15-ddc2-4d60-825a-7983ed3bd0c7"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:37.059744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:37.060254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:37.069942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:37.079062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:37.079824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:37.080485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:37.145537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:37.146923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] validate_networks() for [('1afe3e15-ddc2-4d60-825a-7983ed3bd0c7', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:10:38.035502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:38.052531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:38.058405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:38.066322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d04ea9eb-9e9d-4bc2-93d4-75b34e21464f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 1.031874 Oct 29 21:10:38.082519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2581/5273] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:37 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:38.090027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:38.090951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:38.103882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:38.104666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:38.105316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:38.106252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:38.106892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:38.107506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:38.627189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:38.638944 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c818c92-c80b-4d64-94d9-568a51c2348d tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.555200 Oct 29 21:10:38.657090 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2582/5274] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:38 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:38.671670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eed2fcb-75eb-49b5-94a6-487c9edfd8fb"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:38.676136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:38.694578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:38.695367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:38.696009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:38.696919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:38.697603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:38.698214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.077955 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-939b9177-b20d-43ab-981b-3cb8a79e847a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "POST /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418944 Oct 29 21:10:39.079359 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2583/5275] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:10:38 2022] POST /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:39.107483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:39.109143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:39.119239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:39.120039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:39.120683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.122323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:39.124413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:39.125042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.431851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:10:39.432431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:10:39.433163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:10:39.433814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:10:39.434425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:10:39.455010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:39.455797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:39.456256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.460209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:39.460934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:39.461662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.508256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:10:39.518445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Getting quotas for user c35b0dd86eb14cbbab1732cc96ab2573 and project 4f4156e1510a489d9f81db09d4b5a404. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:10:39.534491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:39.564664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:39.570577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:39.572292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-251813d6-2ac2-4126-afd0-bb066fff897d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.475987 Oct 29 21:10:39.580289 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2584/5276] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:39 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:39.593638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:10:39.599293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:10:39.664315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:39.664942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:39.681603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:39.682326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:39.682978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.683896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:39.684787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:39.686020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:39.694750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0e5f3f7f-4643-4e51-bc82-c4403ac305e8 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.646267 Oct 29 21:10:39.702025 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2693/5277] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:10:39.709415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca2011b5-cacc-4b81-a86c-ed7ed6f54eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:39.712758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca2011b5-cacc-4b81-a86c-ed7ed6f54eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:40.160201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca2011b5-cacc-4b81-a86c-ed7ed6f54eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:40.179769 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca2011b5-cacc-4b81-a86c-ed7ed6f54eb4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1215 microversion: 2.1 time: 0.472733 Oct 29 21:10:40.182311 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2694/5278] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:39 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1215 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:40.511182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:40.523612 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6172cdb4-acc9-43ba-80d1-fc168e97940a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.863110 Oct 29 21:10:40.532051 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2585/5279] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:39 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:40.611264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:40.612624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:40.628389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:40.630820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:40.631544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:40.634400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:40.635993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:40.637535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:41.220090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:41.221881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:41.234423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:41.239823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:41.240336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:41.240785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:41.244814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:41.246824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:41.248148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-558b2a5f-c63e-4a44-8b51-535fe01a901e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.641343 Oct 29 21:10:41.257498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2695/5280] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:40 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:41.265390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:41.266147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:41.266610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:41.316083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c9ca3f70-dd5f-4314-ac15-4a73eb223e3b req-ef351a85-8680-450e-8933-cf72ea9e207a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f013e213-017a-4b53-8627-b50553dd28bd", "tag": "45d74181-136a-4dd4-9bf0-5816939ceea2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:41.347716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c9ca3f70-dd5f-4314-ac15-4a73eb223e3b req-ef351a85-8680-450e-8933-cf72ea9e207a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:41.348230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c9ca3f70-dd5f-4314-ac15-4a73eb223e3b req-ef351a85-8680-450e-8933-cf72ea9e207a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:41.352251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c9ca3f70-dd5f-4314-ac15-4a73eb223e3b req-ef351a85-8680-450e-8933-cf72ea9e207a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:41.400040 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c9ca3f70-dd5f-4314-ac15-4a73eb223e3b req-ef351a85-8680-450e-8933-cf72ea9e207a service nova] Creating event network-changed:45d74181-136a-4dd4-9bf0-5816939ceea2 for instance f013e213-017a-4b53-8627-b50553dd28bd on nch2-master-1 Oct 29 21:10:41.425155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c9ca3f70-dd5f-4314-ac15-4a73eb223e3b req-ef351a85-8680-450e-8933-cf72ea9e207a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109681 Oct 29 21:10:41.428602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2696/5281] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:41.557191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:41.558390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:41.579852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:41.584035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:41.585071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:41.586673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:41.587862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:41.589187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:42.082473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:42.097469 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c6f2eba-8924-4731-a66d-f523c47a9e98 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1267 microversion: 2.1 time: 0.891726 Oct 29 21:10:42.098727 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2586/5282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:41 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1267 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:42.280739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:42.281572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:42.314877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:42.322518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:42.323967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:42.324441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:42.328525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:42.329025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:42.332102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:42.616671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:42.643635 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc746218-c648-4c60-a4ae-00463413683a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 1.091289 Oct 29 21:10:42.656097 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2697/5283] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:41 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:42.911125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:42.930467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:42.932767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:42.934581 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-324787d4-b204-4373-a2f5-123435f8ddd0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.660694 Oct 29 21:10:42.942313 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2587/5284] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:42 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:43.122780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:43.123401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:43.127191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:43.146719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:43.147217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:43.147745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:43.148517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:43.149233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:43.149608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:43.682314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:43.683207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:43.691225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:43.691735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:43.692188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:43.693215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:43.693727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:43.694172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:43.694950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:43.705016 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8afadbf0-44d4-43f0-8c9b-65633804f37c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1273 microversion: 2.1 time: 0.586354 Oct 29 21:10:43.709254 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2698/5285] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:43 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1273 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:43.902898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:43.906009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:43.923566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:43.924084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:43.924678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:43.925856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:43.926832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:43.927501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:44.010053 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-abf81bb4-314c-4990-a359-7e654308df17 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.111077 Oct 29 21:10:44.015542 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2699/5286] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:10:43 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:44.022058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:44.025319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:44.032686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:44.038215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:44.038781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:44.042378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:44.043176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:44.050004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:44.610694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:44.624410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-adc2b071-5306-47f3-b00d-0d2409f3f8e4 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.945414 Oct 29 21:10:44.630753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2588/5287] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:43 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:10:44.641392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:44.644619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:44.662056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:44.664909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:44.665687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:44.669761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:44.671780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:44.672251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:44.791148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4d16f3d-b148-433f-8146-7746b3957f77 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/c70004a7-678b-41f5-81b6-131c2e4d9d74" status: 200 len: 194 microversion: 2.1 time: 0.157682 Oct 29 21:10:44.795116 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2589/5288] 10.222.0.36 () {58 vars in 1413 bytes} [Sat Oct 29 21:10:44 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/c70004a7-678b-41f5-81b6-131c2e4d9d74 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:44.803471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:44.807764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:44.821806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:44.825209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:44.828045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:44.829047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:44.829748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:44.831880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:45.669746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:45.670183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:45.687583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:45.690932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-414d55f2-f1c4-45f8-94ed-dc5d7933184e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1273 microversion: 2.1 time: 0.894166 Oct 29 21:10:45.691642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:45.694520 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ffded81-1c97-4f1d-9050-6cccc5b22c23 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 1.677503 Oct 29 21:10:45.696682 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2590/5289] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:44 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1273 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:45.697841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2700/5290] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:44 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:45.703107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:45.703871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:45.709017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:45.709680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:45.712371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:45.713135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:45.713770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:45.714640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:45.715255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:45.715839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:45.735481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:45.736746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:45.737365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:45.738983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:45.739662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:45.740426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:45.900069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lazy-loading 'services' on Instance uuid 7403d66e-f24b-4a6b-b079-5bc9a9e05907 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:10:46.036016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc625576-e0b2-4e23-b770-e19dc27774e4 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/c70004a7-678b-41f5-81b6-131c2e4d9d74" status: 202 len: 0 microversion: 2.1 time: 0.337766 Oct 29 21:10:46.054198 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2591/5291] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:10:45 2022] DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/c70004a7-678b-41f5-81b6-131c2e4d9d74 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:10:46.726393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:46.727303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:46.743579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:46.746528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:46.748081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:46.749937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:46.751881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:46.752826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:46.969111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:46.971273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:46.978438 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec5b95ce-a135-4ab0-b489-bac0788fb47e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 1.279380 Oct 29 21:10:46.982330 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1153e6e3-b70f-4865-9049-0ad7475b3382 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1273 microversion: 2.1 time: 0.260920 Oct 29 21:10:46.986599 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2701/5292] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:45 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:46.987043 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2592/5293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:46 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:46.993285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:46.998494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:47.017778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:47.018647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:47.019312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:47.020266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:47.020946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:47.022565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:47.955215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:47.968460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:47.970631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:47.972115 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8b8f1705-f345-43c5-95b0-3a1208e7ee89 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.983986 Oct 29 21:10:47.972635 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2702/5294] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:46 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:48.011875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:48.013123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:48.013297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:48.013857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:48.024321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:48.024681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:48.025620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:48.026491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:48.027397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:48.028040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:48.032859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:48.038382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:48.039211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:48.040150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:48.040797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:48.041442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:48.821563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:48.832091 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4558c88-51d5-4e9a-9049-96e36cabbdc0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.826098 Oct 29 21:10:48.833636 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2593/5295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:48 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:48.861790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:48.863239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:48.863787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:48.884390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90d444fa-8639-4bc8-a73a-d0582e026af9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.871720 Oct 29 21:10:48.905807 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2703/5296] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:48 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:48.911229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:48.912628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:48.913098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:48.916497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:48.916979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:48.917424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:48.987163 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e33889ae-8672-49fa-be96-ba097b4a2679 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/8eed2fcb-75eb-49b5-94a6-487c9edfd8fb" status: 200 len: 194 microversion: 2.1 time: 0.150012 Oct 29 21:10:48.988091 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2594/5297] 10.222.0.36 () {58 vars in 1413 bytes} [Sat Oct 29 21:10:48 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/8eed2fcb-75eb-49b5-94a6-487c9edfd8fb => generated 194 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:49.000489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:49.001836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:49.004889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:49.008511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:49.019071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:49.019682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:49.020148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:49.020619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:49.021098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:49.021195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:49.021343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:49.021566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:49.022485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:49.023116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:49.023716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:49.024098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:49.163131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lazy-loading 'services' on Instance uuid 7403d66e-f24b-4a6b-b079-5bc9a9e05907 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:10:49.314123 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/8eed2fcb-75eb-49b5-94a6-487c9edfd8fb" status: 202 len: 0 microversion: 2.1 time: 0.318475 Oct 29 21:10:49.316165 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2704/5298] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:10:48 2022] DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments/8eed2fcb-75eb-49b5-94a6-487c9edfd8fb => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:10:49.860272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:49.861300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:49.867325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:49.870202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:49.871105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:49.871936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:49.873232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:49.874989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:49.875817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.169865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=16 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:50.388030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:50.398866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:50.401366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:50.402940 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4866fa4b-0255-428c-ab30-55c6134dd2f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 1.407562 Oct 29 21:10:50.404232 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2595/5299] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:48 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:50.425814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:50.428603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:50.444446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:50.445816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:50.446863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.448397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:50.449222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:50.450347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.482725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:50.667303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:50.678588 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c97adfcd-765d-468f-b308-1bfa43d85c5e tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.823065 Oct 29 21:10:50.679608 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2705/5300] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:49 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:10:50.686654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:50.689212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:50.696673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:50.697307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:50.697955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.698767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:50.699345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:50.699871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.757893 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0da1e964-bf6b-4a3d-a49e-a9c65994992a tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077112 Oct 29 21:10:50.766315 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2706/5301] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:10:50 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:10:50.912331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:50.915101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:50.922429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:50.923175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:50.923799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.924747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:50.925576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:50.926156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:50.958057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:10:50.961438 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c5d322b-4c26-4feb-aecc-da0dd6831426 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053153 Oct 29 21:10:50.969200 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2707/5302] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:10:50 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:10:51.048218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:51.049576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:51.058537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.059768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.060878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.062539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.063176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.063776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.068876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:51.079321 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-140e1615-5362-42e7-bb5d-873650139afd tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.673669 Oct 29 21:10:51.094384 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2596/5303] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:50 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:51.105704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:10:51.226400 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a6620a3-7336-4b66-a738-1073aa982dda tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 204 len: 0 microversion: 2.1 time: 0.183689 Oct 29 21:10:51.233505 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2708/5304] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:10:51 2022] DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:10:51.237908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:51.238541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:51.249296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.251192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.251991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.253077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.254140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.254805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.430474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:51.431190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:51.447612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.447893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.448536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.449449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.450714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.452527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.486642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:51.495661 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ef55575-ac75-450f-b412-912d1351d2b3 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1673 microversion: 2.1 time: 0.262326 Oct 29 21:10:51.496268 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2597/5305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:51 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1673 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:51.700777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:51.701417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:51.723035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.726112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.727163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.728438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.729447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.734319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.904852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:51.916298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:51.919075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:51.925196 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-79f33abb-8b9c-4a87-a93d-1edbcf3622ad tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1747 microversion: 2.20 time: 0.497171 Oct 29 21:10:51.926314 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2709/5306] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:51 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1747 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:51.935341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8eae1e32-4de6-4a18-884c-c53bc0dbf51b req-9b695507-0ab5-4425-ac13-3afd0e3334a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f013e213-017a-4b53-8627-b50553dd28bd", "name": "network-vif-plugged", "status": "completed", "tag": "45d74181-136a-4dd4-9bf0-5816939ceea2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:51.958535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8eae1e32-4de6-4a18-884c-c53bc0dbf51b req-9b695507-0ab5-4425-ac13-3afd0e3334a8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:51.960515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8eae1e32-4de6-4a18-884c-c53bc0dbf51b req-9b695507-0ab5-4425-ac13-3afd0e3334a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:51.961251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8eae1e32-4de6-4a18-884c-c53bc0dbf51b req-9b695507-0ab5-4425-ac13-3afd0e3334a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:51.988597 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8eae1e32-4de6-4a18-884c-c53bc0dbf51b req-9b695507-0ab5-4425-ac13-3afd0e3334a8 service nova] Creating event network-vif-plugged:45d74181-136a-4dd4-9bf0-5816939ceea2 for instance f013e213-017a-4b53-8627-b50553dd28bd on nch2-master-1 Oct 29 21:10:52.002031 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8eae1e32-4de6-4a18-884c-c53bc0dbf51b req-9b695507-0ab5-4425-ac13-3afd0e3334a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073868 Oct 29 21:10:52.002678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2710/5307] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:52.105148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:52.106528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:52.119364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.123626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.124282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:52.128815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.129563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.131013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:52.502190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:52.517096 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8fbab96-c622-4186-8b6d-b9b8257e94e7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.820127 Oct 29 21:10:52.518601 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2598/5308] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:51 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:52.524559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-11ffec09-e21b-424f-81d6-b257a08dd5d1 req-d8b314b5-7a8f-445b-ac87-c50d5de57276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10082bb-f333-4d6e-a4d3-7648013c7abf", "tag": "73fe1a07-bcf7-4e70-8167-bfd8df3366aa"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:52.545108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-11ffec09-e21b-424f-81d6-b257a08dd5d1 req-d8b314b5-7a8f-445b-ac87-c50d5de57276 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.546722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-11ffec09-e21b-424f-81d6-b257a08dd5d1 req-d8b314b5-7a8f-445b-ac87-c50d5de57276 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.548741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-11ffec09-e21b-424f-81d6-b257a08dd5d1 req-d8b314b5-7a8f-445b-ac87-c50d5de57276 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:52.570029 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-11ffec09-e21b-424f-81d6-b257a08dd5d1 req-d8b314b5-7a8f-445b-ac87-c50d5de57276 service nova] Creating event network-changed:73fe1a07-bcf7-4e70-8167-bfd8df3366aa for instance c10082bb-f333-4d6e-a4d3-7648013c7abf on nch1-master-1 Oct 29 21:10:52.580988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-11ffec09-e21b-424f-81d6-b257a08dd5d1 req-d8b314b5-7a8f-445b-ac87-c50d5de57276 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060112 Oct 29 21:10:52.582393 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2599/5309] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:52.589019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:52.591347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:52.616720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.617403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.618476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:52.620612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.621742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.623197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:52.915279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:52.925764 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26bbaa54-4b0f-413f-8abf-2ca5fc5428f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.825485 Oct 29 21:10:52.928397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2711/5310] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:52 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:52.957845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:52.959318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:52.968471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.969071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.969595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:52.970322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:52.971946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:52.972401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:53.780302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:53.800405 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c766308-b723-4361-872f-c78f839cf832 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1673 microversion: 2.1 time: 1.216424 Oct 29 21:10:53.801006 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2600/5311] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:52 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1673 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:53.809444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:53.810376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:53.820885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:53.821972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:53.822615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:53.824483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:53.825859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:53.827669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:54.105894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:54.125781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:54.128778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:54.130246 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86a86913-9115-4df3-ae5b-7604266f022c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1747 microversion: 2.20 time: 1.177777 Oct 29 21:10:54.131281 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2712/5312] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:52 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1747 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:54.139752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:54.140787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:54.156684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:54.157482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:54.158125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:54.159314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:54.160090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:54.160698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:54.421194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:54.432398 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a17c2e82-fe6e-4824-ba58-3024dd7fac26 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.629580 Oct 29 21:10:54.480627 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2601/5313] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:53 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:54.492869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ab48c72d-46ee-49c6-a33f-d3aef1e802e6 req-ddd90517-44da-4f28-b969-03af431c9196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "name": "network-vif-plugged", "status": "completed", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:54.532303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ab48c72d-46ee-49c6-a33f-d3aef1e802e6 req-ddd90517-44da-4f28-b969-03af431c9196 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:54.533080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ab48c72d-46ee-49c6-a33f-d3aef1e802e6 req-ddd90517-44da-4f28-b969-03af431c9196 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:54.533718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ab48c72d-46ee-49c6-a33f-d3aef1e802e6 req-ddd90517-44da-4f28-b969-03af431c9196 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:54.553059 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ab48c72d-46ee-49c6-a33f-d3aef1e802e6 req-ddd90517-44da-4f28-b969-03af431c9196 service nova] Creating event network-vif-plugged:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch1-master-1 Oct 29 21:10:54.567332 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ab48c72d-46ee-49c6-a33f-d3aef1e802e6 req-ddd90517-44da-4f28-b969-03af431c9196 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085385 Oct 29 21:10:54.569541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2602/5314] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:10:54.593155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:54.608227 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-855c50f5-5f48-407a-90a4-a0a1de9c4bbc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1374 microversion: 2.1 time: 0.475551 Oct 29 21:10:54.612444 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2713/5315] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:54 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1374 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:54.829728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:54.830457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:54.842817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:54.843324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:54.843775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:54.847314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:54.847806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:54.848243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:55.051823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:55.078558 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c23a40ef-5e01-4497-916a-23c1aa4a6e86 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1673 microversion: 2.1 time: 0.253558 Oct 29 21:10:55.083833 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2603/5316] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:54 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:55.160437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:55.161150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:55.173735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:55.175015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:55.175467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:55.176196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:55.181173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:55.183873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:55.457508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:55.458922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:55.469156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:55.469923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:55.470541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:55.472131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:55.479737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:55.480422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:55.554665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:55.591277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:55.605419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:55.608379 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-57882dcf-c0a1-4255-ad43-a9f5ddd73438 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1747 microversion: 2.20 time: 0.453472 Oct 29 21:10:55.613171 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2714/5317] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:55 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1747 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:10:55.640296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:55.640920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:55.653336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:55.654133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:55.655580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:55.656565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:55.657218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:55.657848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.079484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:56.095838 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-84e1125b-0210-4af9-bfd6-5eedd4d777ae tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.643412 Oct 29 21:10:56.109343 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2604/5318] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:55 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:56.116210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:56.117245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:56.141038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:56.141600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:56.142293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.143045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:56.143896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:56.146076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.305076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:56.330966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab96f6e4-3f25-4761-b6e4-1a2411452be3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1544 microversion: 2.1 time: 0.697803 Oct 29 21:10:56.331871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2715/5319] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:55 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1544 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:10:56.345391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:56.356765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:56.358258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:56.360101 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cda34c71-82ef-47db-9c60-32c599759f91 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1605 microversion: 2.1 time: 0.255151 Oct 29 21:10:56.360841 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2605/5320] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:56 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:56.370134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:56.374790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:56.376860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.378982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:56.379494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:56.382658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.648465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:56.649098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:56.661447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:56.662193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:56.662813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.663754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:56.664395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:56.664998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:56.737700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:56.765727 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f20c64aa-5934-4015-b839-1a99b546f431 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1544 microversion: 2.1 time: 0.412657 Oct 29 21:10:56.769348 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2716/5321] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:56 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1544 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:57.054957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-df0f1df2-dea4-4a6e-aa15-c206a02d149f req-5163dc5c-5701-4ae3-9078-1a80ee9e8279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7403d66e-f24b-4a6b-b079-5bc9a9e05907", "name": "network-vif-deleted", "tag": "00e52040-e17d-45fd-ae4f-28a122578d91"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:10:57.088837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-df0f1df2-dea4-4a6e-aa15-c206a02d149f req-5163dc5c-5701-4ae3-9078-1a80ee9e8279 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:57.089277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-df0f1df2-dea4-4a6e-aa15-c206a02d149f req-5163dc5c-5701-4ae3-9078-1a80ee9e8279 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:57.089747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-df0f1df2-dea4-4a6e-aa15-c206a02d149f req-5163dc5c-5701-4ae3-9078-1a80ee9e8279 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:57.123617 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-df0f1df2-dea4-4a6e-aa15-c206a02d149f req-5163dc5c-5701-4ae3-9078-1a80ee9e8279 service nova] Creating event network-vif-deleted:00e52040-e17d-45fd-ae4f-28a122578d91 for instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 on nch2-master-1 Oct 29 21:10:57.137754 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-df0f1df2-dea4-4a6e-aa15-c206a02d149f req-5163dc5c-5701-4ae3-9078-1a80ee9e8279 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089564 Oct 29 21:10:57.139546 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2717/5322] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:10:57.145074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:57.150705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:57.169123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:57.169986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:57.170696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:57.171637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:57.172280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:57.172891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:57.690960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:57.710361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:57.712188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:57.713648 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a45ad75e-a356-4328-ba54-cd117e929c0a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1747 microversion: 2.20 time: 1.069341 Oct 29 21:10:57.714394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2606/5323] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:56 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1747 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:10:57.719612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:57.723330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:57.737982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:57.740418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:57.741079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:57.743695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:57.744376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:57.746769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:57.869165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:57.869823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:57.870159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:57.870640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lazy-loading 'fault' on Instance uuid 7403d66e-f24b-4a6b-b079-5bc9a9e05907 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:10:58.095731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d3c643e9c245eeaa6328d22184bc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208de26bb7304ee793bac715fb73fbdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:58.118390 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c6c327ea-106e-4d6d-b0ee-2f7c628fed5e tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 200 len: 1326 microversion: 2.1 time: 0.393902 Oct 29 21:10:58.120664 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2607/5324] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:57 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 1326 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:58.317413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:10:58.327690 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae64757a-2d15-4ec9-a1b0-324f2ab91722 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 1.186715 Oct 29 21:10:58.330644 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2718/5325] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:57 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:10:58.746193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:58.747537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:58.757142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:58.760337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:58.761988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:58.768053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:58.768896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:58.769630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:59.148827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:59.150113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:59.181764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:59.182342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:59.183317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:59.193134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:59.194292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:59.195499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:59.230352 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] HTTP exception thrown: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Request method failure captured: Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 HTTP/1.1 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZW5BUekbZBplNz2bihbYnwYWaYWl0GZXAqgmPcpb8Ctcb3DUTngYc2gIIcJJL0ZMuoatGh8mGN2AvlZHGd4VqldpcvtinQDO6Kb-CZXdjrzUf7CSNkAbP-fITqF5Hj-abg-WOIR4pv5bRAUiWshNEjd9m6nYBsbC2udQ6EUiWyGQ3k Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 04d3c643e9c245eeaa6328d22184bc00 Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '7403d66e-f24b-4a6b-b079-5bc9a9e05907'} Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:10:59.236549 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:10:59.242151 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:10:59.246348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Returning 404 to user: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:10:59.254305 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0423c969-93e9-41af-bc64-ccb2e325b109 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 404 len: 111 microversion: 2.1 time: 0.110528 Oct 29 21:10:59.255535 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2719/5326] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:59 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:10:59.266552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f53f15cf-68df-40b2-a54a-5ef984199962 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '.version_select at 0x7fa1710a6820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:59.322655 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f53f15cf-68df-40b2-a54a-5ef984199962 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736719338" status: 202 len: 0 microversion: 2.1 time: 0.062615 Oct 29 21:10:59.325030 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2720/5327] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:10:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736719338 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:10:59.359470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:10:59.360380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:10:59.382426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:59.390706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:59.392492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:10:59.394593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:10:59.395466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:10:59.396547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:00.033605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:00.043307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:00.044827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:00.046152 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b05f02cc-8340-4fb3-89ec-bd0e00a9b908 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 1.305850 Oct 29 21:11:00.046781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2608/5328] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:10:58 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:00.730775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-836835994", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "9536f5b8-e241-4b0b-a8aa-d6dc8014d709"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:00.902149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] validate_networks() for [('9536f5b8-e241-4b0b-a8aa-d6dc8014d709', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:11:02.097271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:02.112658 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf0ef333-8474-42ce-90d9-1c8573ed7a71 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 2.755730 Oct 29 21:11:02.114377 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2721/5329] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:10:59 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 2763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:02.119551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:02.130103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:02.140831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:02.145382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:02.146365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:02.147384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:02.150083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:02.152106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:02.561145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:02.581350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:02.599479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:02.600750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ff27df5-fc1c-4b6d-8929-9b00c4b30129 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.485037 Oct 29 21:11:02.601351 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2722/5330] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:02 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:03.136243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:03.137751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:03.147997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:03.150638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:03.152219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:03.154778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:03.155603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:03.158271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:04.102099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:04.118692 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-44704313-52b1-43d5-a2f7-49c26cd9e7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.985413 Oct 29 21:11:04.132055 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2723/5331] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:03 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:04.142587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:04.144874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:04.164597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:04.166470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:04.168773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:04.170791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:04.172749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:04.174904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:04.195725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:11:04.198827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:11:04.199572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:11:04.200173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:11:04.200801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:11:04.238206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:04.246681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:04.247419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:04.250005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:04.250683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:04.251327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:04.278223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Getting quotas for project d81bd0a7cd22412996ad7f69da7699c8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:11:04.284662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Getting quotas for user fbc010766bcc4eb4a6a17958d576ac08 and project d81bd0a7cd22412996ad7f69da7699c8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:11:04.312641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:11:04.324998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:11:04.455102 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0937284-9510-41d8-be5d-2a5ef2eeb1ab tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.407167 Oct 29 21:11:04.466278 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2609/5332] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:11:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:11:04.472517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ad5464c-641e-4bd7-abd4-894c62690299 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:04.477634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ad5464c-641e-4bd7-abd4-894c62690299 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:05.034813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ad5464c-641e-4bd7-abd4-894c62690299 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:05.069935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ad5464c-641e-4bd7-abd4-894c62690299 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1227 microversion: 2.1 time: 0.601564 Oct 29 21:11:05.097293 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2610/5333] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:04 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1227 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:05.169640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:05.177412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:05.198291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:05.199506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:05.200233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:05.201162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:05.212124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:05.214267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:05.496721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:05.509756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:05.522899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:05.528820 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d433c719-038c-47f5-86af-535e591c795c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 1.395307 Oct 29 21:11:05.530959 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2724/5334] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:04 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:05.660329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-adba1859-7b13-4c70-9303-ab23491322f0 req-a8d29e8d-6215-4d96-91a1-c2785c516a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10082bb-f333-4d6e-a4d3-7648013c7abf", "name": "network-vif-plugged", "status": "completed", "tag": "73fe1a07-bcf7-4e70-8167-bfd8df3366aa"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:05.698694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-adba1859-7b13-4c70-9303-ab23491322f0 req-a8d29e8d-6215-4d96-91a1-c2785c516a45 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:05.702483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-adba1859-7b13-4c70-9303-ab23491322f0 req-a8d29e8d-6215-4d96-91a1-c2785c516a45 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:05.706845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-adba1859-7b13-4c70-9303-ab23491322f0 req-a8d29e8d-6215-4d96-91a1-c2785c516a45 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:05.768353 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-adba1859-7b13-4c70-9303-ab23491322f0 req-a8d29e8d-6215-4d96-91a1-c2785c516a45 service nova] Creating event network-vif-plugged:73fe1a07-bcf7-4e70-8167-bfd8df3366aa for instance c10082bb-f333-4d6e-a4d3-7648013c7abf on nch1-master-1 Oct 29 21:11:05.788139 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-adba1859-7b13-4c70-9303-ab23491322f0 req-a8d29e8d-6215-4d96-91a1-c2785c516a45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130988 Oct 29 21:11:05.790464 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2725/5335] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:06.104338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:06.116222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:06.119110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:06.134164 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2d06c88f-d618-4966-9999-05c80c7d3572 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 0.991570 Oct 29 21:11:06.140657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.142522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.143714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.144743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.146716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.150115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.150742 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2611/5336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:05 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:06.232245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:06.407056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:06.420679 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9d6c63b-6ac0-4750-b487-50fc308e5d8a tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1279 microversion: 2.1 time: 0.313741 Oct 29 21:11:06.434801 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2726/5337] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:06 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:06.562780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:06.563461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:06.565341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:06.565967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:06.589025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.589685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.590412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.592515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.592715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.593378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.598682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.600966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.601987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.604167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.605698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.607047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.692776 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] HTTP exception thrown: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Request method failure captured: Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 HTTP/1.1 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZW5BUekbZBplNz2bihbYnwYWaYWl0GZXAqgmPcpb8Ctcb3DUTngYc2gIIcJJL0ZMuoatGh8mGN2AvlZHGd4VqldpcvtinQDO6Kb-CZXdjrzUf7CSNkAbP-fITqF5Hj-abg-WOIR4pv5bRAUiWshNEjd9m6nYBsbC2udQ6EUiWyGQ3k Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 04d3c643e9c245eeaa6328d22184bc00 Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7403d66e-f24b-4a6b-b079-5bc9a9e05907'} Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:06.702797 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Returning 404 to user: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:06.711287 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-864438dd-f872-42e8-bef1-76a026bb5495 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 404 len: 111 microversion: 2.1 time: 0.157937 Oct 29 21:11:06.713214 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2612/5338] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:11:06 2022] DELETE /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:11:06.726913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:06.731191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 7403d66e-f24b-4a6b-b079-5bc9a9e05907] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:06.753969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.757218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.758494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.759696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:06.761650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:06.762381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:06.793520 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] HTTP exception thrown: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Request method failure captured: Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 HTTP/1.1 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZW5BUekbZBplNz2bihbYnwYWaYWl0GZXAqgmPcpb8Ctcb3DUTngYc2gIIcJJL0ZMuoatGh8mGN2AvlZHGd4VqldpcvtinQDO6Kb-CZXdjrzUf7CSNkAbP-fITqF5Hj-abg-WOIR4pv5bRAUiWshNEjd9m6nYBsbC2udQ6EUiWyGQ3k Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 04d3c643e9c245eeaa6328d22184bc00 Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7403d66e-f24b-4a6b-b079-5bc9a9e05907'} Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:06.797555 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. Oct 29 21:11:06.802385 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:06.819531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Returning 404 to user: Instance 7403d66e-f24b-4a6b-b079-5bc9a9e05907 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:06.820951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d17b098f-10e9-46c8-b1e3-093d738069bf tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907" status: 404 len: 111 microversion: 2.1 time: 0.106644 Oct 29 21:11:06.824259 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2613/5339] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:06 2022] GET /compute/v2.1/servers/7403d66e-f24b-4a6b-b079-5bc9a9e05907 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:11:07.164015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:07.164944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:07.179664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:07.182213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:07.187229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:07.188211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:07.188862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:07.189621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:07.977334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:07.992167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:07.996787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:08.003441 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a29aa75-979c-4d34-87aa-39b12072f2a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 1.449381 Oct 29 21:11:08.030962 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2727/5340] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:06 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:08.064213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:08.065698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:08.079807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.080772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.082228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.083426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.085566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.086414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.448752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:08.453996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:08.468454 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d84d14a-f598-4810-9f0e-e93babd82cdc tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1285 microversion: 2.1 time: 0.436058 Oct 29 21:11:08.481479 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2728/5341] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:08 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1285 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:08.481479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:08.481479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:08.481934 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-09701180-94f5-4610-ae2c-4e5d2923fd83 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1315 microversion: 2.1 time: 1.314028 Oct 29 21:11:08.481934 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2614/5342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:07 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1315 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:08.493255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.494327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.495836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.499585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.500244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.500891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.532656 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] HTTP exception thrown: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Request method failure captured: Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 HTTP/1.1 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZW5BUekbZBplNz2bihbYnwYWaYWl0GZXAqgmPcpb8Ctcb3DUTngYc2gIIcJJL0ZMuoatGh8mGN2AvlZHGd4VqldpcvtinQDO6Kb-CZXdjrzUf7CSNkAbP-fITqF5Hj-abg-WOIR4pv5bRAUiWshNEjd9m6nYBsbC2udQ6EUiWyGQ3k Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 04d3c643e9c245eeaa6328d22184bc00 Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '799d00cc-130b-4a02-b9ed-0fdb136dad85'} Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:08.536717 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.542030 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.546234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Returning 404 to user: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:08.547377 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-29a3faa7-8a7a-4f8e-b2be-5667e8d87cb1 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 404 len: 111 microversion: 2.1 time: 0.076663 Oct 29 21:11:08.548083 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2729/5343] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:11:08 2022] DELETE /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:11:08.557497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:08.558465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] [instance: 799d00cc-130b-4a02-b9ed-0fdb136dad85] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:08.568985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.569677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.570155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.571011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.571568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.572014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.609985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] HTTP exception thrown: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Request method failure captured: Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 HTTP/1.1 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZW5BUekbZBplNz2bihbYnwYWaYWl0GZXAqgmPcpb8Ctcb3DUTngYc2gIIcJJL0ZMuoatGh8mGN2AvlZHGd4VqldpcvtinQDO6Kb-CZXdjrzUf7CSNkAbP-fITqF5Hj-abg-WOIR4pv5bRAUiWshNEjd9m6nYBsbC2udQ6EUiWyGQ3k Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/208de26bb7304ee793bac715fb73fbdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 208de26bb7304ee793bac715fb73fbdc Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984626347 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 04d3c643e9c245eeaa6328d22184bc00 Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeTestJSON-984626347-project Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '799d00cc-130b-4a02-b9ed-0fdb136dad85'} Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:08.612669 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] Returning 404 to user: Instance 799d00cc-130b-4a02-b9ed-0fdb136dad85 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:08.617949 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c50ae25b-6182-492c-ad1c-581c6b452fc5 tempest-AttachVolumeTestJSON-984626347 tempest-AttachVolumeTestJSON-984626347-project] 10.222.0.36 "GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85" status: 404 len: 111 microversion: 2.1 time: 0.062900 Oct 29 21:11:08.620626 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2615/5344] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:08 2022] GET /compute/v2.1/servers/799d00cc-130b-4a02-b9ed-0fdb136dad85 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:11:08.839995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ce59e532-28b5-4785-86c4-88755ef68cde req-59db6f69-959d-4f53-97fa-83e39ae2dd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f013e213-017a-4b53-8627-b50553dd28bd", "tag": "45d74181-136a-4dd4-9bf0-5816939ceea2"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:08.853827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ce59e532-28b5-4785-86c4-88755ef68cde req-59db6f69-959d-4f53-97fa-83e39ae2dd9d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:08.855729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ce59e532-28b5-4785-86c4-88755ef68cde req-59db6f69-959d-4f53-97fa-83e39ae2dd9d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:08.856496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ce59e532-28b5-4785-86c4-88755ef68cde req-59db6f69-959d-4f53-97fa-83e39ae2dd9d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:08.875189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ce59e532-28b5-4785-86c4-88755ef68cde req-59db6f69-959d-4f53-97fa-83e39ae2dd9d service nova] Creating event network-changed:45d74181-136a-4dd4-9bf0-5816939ceea2 for instance f013e213-017a-4b53-8627-b50553dd28bd on nch2-master-1 Oct 29 21:11:08.889386 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ce59e532-28b5-4785-86c4-88755ef68cde req-59db6f69-959d-4f53-97fa-83e39ae2dd9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056281 Oct 29 21:11:08.906989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2730/5345] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:09.048642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:09.050036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:09.094930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:09.095794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:09.097139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:09.098705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:09.106280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:09.106798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:09.496766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:09.500001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:09.518711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:09.524227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:09.524797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:09.526152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:09.526900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:09.527418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:09.614174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:09.624635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:09.626554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:09.627781 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1c3271b5-0bde-4295-a520-2fdc17399f13 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.589328 Oct 29 21:11:09.628850 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2616/5346] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:09 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:09.634658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:09.635438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:09.646307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:09.655010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:09.656249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:09.656802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:09.657814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:09.659191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:09.659715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:09.660981 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41edb3df-e23c-4cc9-8051-71f1eaabe491 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1285 microversion: 2.1 time: 0.169096 Oct 29 21:11:09.668191 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2731/5347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:09 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:09.683173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:10.287108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:10.326031 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-63d88614-4a9a-4540-86ec-f23d4b0d818d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1501 microversion: 2.1 time: 0.695817 Oct 29 21:11:10.330435 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2617/5348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:09 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1501 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:10.353875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:10.354592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:10.363722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:10.374260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:10.374824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:10.375671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:10.376224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:10.376732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:10.518074 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41234469-82f6-4eb4-8bc5-399d396aa949 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf/action" status: 202 len: 0 microversion: 2.1 time: 0.167390 Oct 29 21:11:10.521059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2732/5349] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:11:10 2022] POST /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:11:10.530738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:10.531730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:10.545741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:10.546677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:10.547491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:10.548505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:10.551366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:10.552312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:10.657727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:10.658693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:10.671608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:10.675279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:10.679196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:10.680168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:10.680820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:10.681487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:11.309201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:11.321819 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e92c3558-0c46-459c-b2e6-5d3d94caab28 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1506 microversion: 2.1 time: 0.794801 Oct 29 21:11:11.322432 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2618/5350] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:10 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:11.353527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:11.367318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:11.367940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:11.368584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:11.375947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:11.377600 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3d695746-512a-46c2-8b85-96f74d6fff7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.726629 Oct 29 21:11:11.390246 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2733/5351] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:10 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:11.396762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:11.403165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:11.406810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:11.408041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:11.412447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:11.413183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:11.584234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:11.594438 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-41b218d4-1a3d-4f85-9666-7e75f7229150 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1285 microversion: 2.1 time: 0.243636 Oct 29 21:11:11.600509 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2619/5352] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:11 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1285 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:12.348947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:12.350432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:12.362734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:12.367230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:12.367949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:12.368915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:12.371720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:12.372388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:12.409723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:12.411162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:12.423869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:12.427936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:12.429083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:12.429577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:12.430327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:12.430801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:12.431243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:13.022036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:13.037298 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3dd8322-059c-40d8-9f82-b9abbbef726b tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1486 microversion: 2.1 time: 0.687765 Oct 29 21:11:13.042541 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2734/5353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:12 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1486 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:13.063470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:13.067343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:13.084588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:13.088634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:13.089094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:13.089887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:13.098548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:13.102525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:13.131851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:13.141211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:13.142828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:13.144045 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1871927-fada-49fa-88ed-17b0da5a2af9 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.738369 Oct 29 21:11:13.165797 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2620/5354] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:12 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:11:13.173962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:13.177211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:13.199252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:13.204918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:13.207475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:13.210519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:13.212784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:13.214791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:13.308329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lazy-loading 'flavor' on Instance uuid c10082bb-f333-4d6e-a4d3-7648013c7abf {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:11:13.742267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:13.797649 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-66f9f2b4-8801-4d7a-954c-adae8904a0c5 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.746191 Oct 29 21:11:13.804155 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89c459d5-7e85-4d94-b782-aa3c6ce396fa tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf/action" status: 202 len: 0 microversion: 2.1 time: 0.648432 Oct 29 21:11:13.804976 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2621/5355] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:11:13 2022] POST /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:11:13.825647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:13.826364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:13.828118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2735/5356] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:13 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:13.847565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:13.848085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:13.848534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:13.854290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:13.855683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:13.856313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:14.187402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:14.188376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:14.201590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:14.205908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:14.206478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:14.207080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:14.207670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:14.219039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:14.220296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:14.262057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:14.675706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:14.692633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-61a68e23-8a41-4f3f-aaf6-aa64e59321ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1492 microversion: 2.1 time: 0.876681 Oct 29 21:11:14.698750 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2622/5357] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:13 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1492 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:14.830094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:14.831269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:14.848847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:14.850057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:14.851738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:14.854148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:14.856116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:14.856847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:15.056805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:15.071543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:15.081122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:15.092644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:15.094772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86646845-a089-4f80-b6af-fa3a6aa3391d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.919490 Oct 29 21:11:15.095920 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2736/5358] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:14 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:15.448878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:15.462893 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4077e0bc-1e7b-4b19-9f91-be621d3bb0da tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.639122 Oct 29 21:11:15.466155 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2623/5359] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:14 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:15.722233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:15.723263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:15.751578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:15.753252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:15.754471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:15.755492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:15.757134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:15.757874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:16.187211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:16.187875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:16.199777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:16.204224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:16.205404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:16.206407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:16.212071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:16.212868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:16.356192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:16.383410 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48ce8eee-7fc4-4156-b130-a512a8eed7b9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1513 microversion: 2.1 time: 0.665556 Oct 29 21:11:16.386914 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2737/5360] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:15 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1513 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:16.492061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:16.492888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:16.507186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:16.511995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:16.515270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:16.517324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:16.520234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:16.524344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:16.732094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:16.764076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:16.766383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:16.774439 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0d7ef513-3867-454f-8cd2-ed80dcc854fd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.611402 Oct 29 21:11:16.775068 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2624/5361] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:16 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:16.990657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:17.005554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d074bb9-2a43-4181-b6da-80f65757949d tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.517933 Oct 29 21:11:17.024141 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2738/5362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:16 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:17.408333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:17.409702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:17.422681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:17.423363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:17.423675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:17.424537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:17.425060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:17.425535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:17.566674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-570a4fba-c3a2-469e-94ba-da899cd0ea12 req-24e6c821-80ca-4f25-bdee-ae18d176074d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae35491-4674-4e2f-a405-af934e2016a2", "tag": "41a5563a-363c-410f-855a-154d3413cea1"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:17.585623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-570a4fba-c3a2-469e-94ba-da899cd0ea12 req-24e6c821-80ca-4f25-bdee-ae18d176074d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:17.586114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-570a4fba-c3a2-469e-94ba-da899cd0ea12 req-24e6c821-80ca-4f25-bdee-ae18d176074d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:17.590903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-570a4fba-c3a2-469e-94ba-da899cd0ea12 req-24e6c821-80ca-4f25-bdee-ae18d176074d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:17.614152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-570a4fba-c3a2-469e-94ba-da899cd0ea12 req-24e6c821-80ca-4f25-bdee-ae18d176074d service nova] Creating event network-changed:41a5563a-363c-410f-855a-154d3413cea1 for instance 7ae35491-4674-4e2f-a405-af934e2016a2 on nch2-master-1 Oct 29 21:11:17.634014 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-570a4fba-c3a2-469e-94ba-da899cd0ea12 req-24e6c821-80ca-4f25-bdee-ae18d176074d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072486 Oct 29 21:11:17.635236 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2739/5363] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:17.751107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:17.788639 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2051c19f-dd54-48b5-b2b6-4e0a70a526d9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1513 microversion: 2.1 time: 0.383367 Oct 29 21:11:17.789271 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2625/5364] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:17 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:17.807156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:17.807871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:17.821000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:17.821565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:17.822002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:17.823013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:17.823693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:17.824302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:18.038704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:18.039364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:18.064870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:18.065648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:18.067251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:18.068209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:18.073761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:18.074480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:18.637222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:18.648771 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-688c35ac-4e47-4a13-986f-3095f5232146 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.614275 Oct 29 21:11:18.652645 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2626/5365] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:18 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:18.778115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:18.792995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:18.798237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:18.803959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-868d927c-7051-48ee-b528-8429b548206f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.998716 Oct 29 21:11:18.830993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:18.832056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:18.836919 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2740/5366] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:17 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:18.842443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:18.843231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:18.843910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:18.845048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:18.845782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:18.847072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:19.676485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:19.677329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:19.691247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:19.697792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:19.701099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:19.708376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:19.711515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:19.713669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:19.899970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:19.913402 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82e75699-c9dc-472f-a97a-4b329dc51727 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1513 microversion: 2.1 time: 1.092477 Oct 29 21:11:19.929569 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2627/5367] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:18 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1513 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:19.944793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:19.945912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:19.968535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:19.969733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:19.978189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:19.981062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:19.982108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:19.985377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:20.411751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:20.428899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:20.439269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:20.448401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-265e541f-6718-4995-a45f-19f22e10ce97 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.525918 Oct 29 21:11:20.467614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:20.469850 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2628/5368] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:19 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:20.477638 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4727c450-f0c4-42eb-995c-865e83f38fa4 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.805298 Oct 29 21:11:20.505441 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2741/5369] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:19 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:20.960401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:20.961192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:20.985956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:20.991250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:20.995165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:21.003249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:21.005470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:21.006449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:21.488115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:21.491480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:21.522560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:21.526381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:21.530046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:21.531877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:21.535511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:21.537992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:21.723149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:21.744543 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b120440-100d-42d8-86e1-4b4cb28635ca tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.791949 Oct 29 21:11:21.751876 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2629/5370] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:20 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:21.775381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:21.783144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:21.809822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:21.810382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:21.810836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:21.811588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:21.812041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:21.833865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:22.656639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:22.745292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:22.757968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:22.761392 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db7b89d5-60ad-44b1-a0c2-2e28c39b7b67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 1.280393 Oct 29 21:11:22.792585 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2742/5371] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:21 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:22.869260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-982f4765-cbf1-428b-8869-5b4cac6049d4 req-36565ac3-69d1-4d8e-b03e-e8d35ccfa246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10082bb-f333-4d6e-a4d3-7648013c7abf", "name": "network-vif-plugged", "status": "completed", "tag": "73fe1a07-bcf7-4e70-8167-bfd8df3366aa"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:22.899136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:22.923739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-982f4765-cbf1-428b-8869-5b4cac6049d4 req-36565ac3-69d1-4d8e-b03e-e8d35ccfa246 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:22.924276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-982f4765-cbf1-428b-8869-5b4cac6049d4 req-36565ac3-69d1-4d8e-b03e-e8d35ccfa246 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:22.924722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-982f4765-cbf1-428b-8869-5b4cac6049d4 req-36565ac3-69d1-4d8e-b03e-e8d35ccfa246 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:22.925885 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3592db1b-ce3a-4a07-8be2-b9ee2b8e4f24 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 1.169850 Oct 29 21:11:22.929691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2630/5372] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:21 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:22.948272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:22.954673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:22.991736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:22.992694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:22.993504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:22.994437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:22.995310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:22.995914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:23.011826 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-982f4765-cbf1-428b-8869-5b4cac6049d4 req-36565ac3-69d1-4d8e-b03e-e8d35ccfa246 service nova] Creating event network-vif-plugged:73fe1a07-bcf7-4e70-8167-bfd8df3366aa for instance c10082bb-f333-4d6e-a4d3-7648013c7abf on nch1-master-1 Oct 29 21:11:23.037091 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-982f4765-cbf1-428b-8869-5b4cac6049d4 req-36565ac3-69d1-4d8e-b03e-e8d35ccfa246 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234696 Oct 29 21:11:23.052796 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2743/5373] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:23.089486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:23.102266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:23.172494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:23.188751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:23.195172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:23.200068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:23.204941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:23.214921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:23.381899 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43ef4f87-bd42-4760-a571-83001b9a6cb5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd/action" status: 200 len: 24557 microversion: 2.1 time: 0.323204 Oct 29 21:11:23.382613 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2744/5374] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:11:23 2022] POST /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd/action => generated 24557 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:11:23.400342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:23.422979 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-631a9bbb-cc61-48a3-8456-847ec6475285 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.482852 Oct 29 21:11:23.427915 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2631/5375] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:22 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:23.817803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:23.822152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:23.845549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:23.846952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:23.847813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:23.852810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:23.854360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:23.856666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:23.870325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:23.962155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:23.963071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:23.979075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:23.979591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:23.980046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:23.980778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:23.981250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:23.981738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:24.054517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:24.087825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:24.100589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:24.102406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:24.104048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e1681358-1b12-4141-b1c6-34f765f10434 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.311931 Oct 29 21:11:24.127257 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2745/5376] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:23 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:24.453751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:24.454661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:24.466116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:24.470741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:24.472001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:24.473035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:24.474917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:24.475588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:24.491285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:24.503792 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee272653-2595-4f35-b509-134f3e5d1ca8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.550367 Oct 29 21:11:24.512264 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2632/5377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:23 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:24.832183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:24.848776 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-683f2338-e16d-4216-81d0-574958b55862 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.398838 Oct 29 21:11:24.867132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2746/5378] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:24 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:25.150634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:25.152096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:25.176344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:25.184018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:25.187105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:25.189322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:25.191663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:25.195876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:25.535326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:25.536090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:25.565926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:25.576838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:25.581367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:25.587834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:25.588661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:25.589899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:26.155854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:26.171566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:26.174690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:26.178113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:26.186715 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-692b8b87-184b-474f-af3f-d6f20c897020 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 1.055249 Oct 29 21:11:26.192205 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2633/5379] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:25 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:26.201324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-fbaed0dd-fb3b-4094-b1b2-22db86685595 req-429ab794-365d-4986-a6ef-25fb826827d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae35491-4674-4e2f-a405-af934e2016a2", "name": "network-vif-plugged", "status": "completed", "tag": "41a5563a-363c-410f-855a-154d3413cea1"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:26.201615 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-39a845eb-5c65-4576-9bf7-1685f0875e63 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.670189 Oct 29 21:11:26.207780 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2747/5380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:25 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:26.225123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fbaed0dd-fb3b-4094-b1b2-22db86685595 req-429ab794-365d-4986-a6ef-25fb826827d3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:26.229074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fbaed0dd-fb3b-4094-b1b2-22db86685595 req-429ab794-365d-4986-a6ef-25fb826827d3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:26.230896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fbaed0dd-fb3b-4094-b1b2-22db86685595 req-429ab794-365d-4986-a6ef-25fb826827d3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:26.249675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:26.250487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:26.270204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-fbaed0dd-fb3b-4094-b1b2-22db86685595 req-429ab794-365d-4986-a6ef-25fb826827d3 service nova] Creating event network-vif-plugged:41a5563a-363c-410f-855a-154d3413cea1 for instance 7ae35491-4674-4e2f-a405-af934e2016a2 on nch2-master-1 Oct 29 21:11:26.284411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:26.285931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-fbaed0dd-fb3b-4094-b1b2-22db86685595 req-429ab794-365d-4986-a6ef-25fb826827d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091554 Oct 29 21:11:26.287599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:26.288771 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2634/5381] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:26.292494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:26.294029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:26.324226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:26.334320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:26.781848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:26.794178 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-120ecbb2-eaad-40b0-831d-470974477039 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.568261 Oct 29 21:11:26.796965 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2748/5382] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:26 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:27.221120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:27.221892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:27.230995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:27.231895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:27.233107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:27.240929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:27.242791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:27.253035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:27.253863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:27.255458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:27.261319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:27.263920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:27.265005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:27.266166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:27.270989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:27.271743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:27.829318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:27.839862 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-17f8d8ab-2ec8-415e-b10c-3d67efd9bfda tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1327 microversion: 2.1 time: 0.604259 Oct 29 21:11:27.847008 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2749/5383] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:27 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1327 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:27.852148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:27.862229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:27.869789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:27.870780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:27.871499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:27.872482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:27.873209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:27.873898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:27.992716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:28.010054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:28.016768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:28.018169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3fd1a4b-9ba9-43cd-ae8c-915c9655dbb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1742 microversion: 2.20 time: 0.802427 Oct 29 21:11:28.026234 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2635/5384] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:27 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1742 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:28.269599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:28.284621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23310995-d2ee-464e-b610-2bba4bab35bd tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.436267 Oct 29 21:11:28.285218 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2750/5385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:27 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:28.869213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:28.869871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:28.886562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:28.887337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:28.899679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:28.905329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:28.907018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:28.907667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:29.056107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:29.056759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:29.068992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:29.069992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:29.071955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:29.072885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:29.076943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:29.077626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:29.820793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:29.836951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4bc72266-7516-4b78-bf3c-68d98a677c21 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1527 microversion: 2.1 time: 0.971024 Oct 29 21:11:29.856425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:29.859061 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2636/5386] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:28 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1527 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:29.864336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:29.867124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:29.890684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:29.894559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:29.895257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:29.897703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:29.900134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:29.901141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:29.902358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:29.904165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:29.908816 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a14c18e6-2cdb-4840-953f-1eccedf064c8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1724 microversion: 2.20 time: 0.854419 Oct 29 21:11:29.914605 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2751/5387] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:29 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1724 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:11:29.941658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:29.943175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:29.962112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:29.963062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:29.964485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:29.967963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:29.969703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:29.971491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:30.365241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:30.377561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fbab400b-6e1c-49e2-9903-558deeef7ef8 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1527 microversion: 2.1 time: 0.457433 Oct 29 21:11:30.378553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2752/5388] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:29 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1527 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:30.668011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:30.700610 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab682933-f7d3-4dc8-b085-887b0ded2f6f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.840290 Oct 29 21:11:30.701380 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2637/5389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:29 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:30.854023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:30.854777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:30.865506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:30.866288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:30.866861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:30.867988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:30.874919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:30.876928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:30.940369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:30.945642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:30.959655 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] HTTP exception thrown: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:30.962604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Request method failure captured: Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 HTTP/1.1 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZbj84i8A9lTcC3twBZbeXZMO530nWZ6btRpWiZb_MQFFTipeGw_gnGewc0WUmExF2eRF2MRQnljBoZgDlFe7GrVx38kwEiFxJEBj_JBtonpk7xvsWz1kFDKncD1gNw9wZQ7v9L5qJxUi1yHUQ3scH9_YZh9iYZH20Gf-LGYO2EcPwc Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d616f3dfd0a46b4ba4b75393ed68c2c Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2115528903 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2115528903 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d616f3dfd0a46b4ba4b75393ed68c2c Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2115528903 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2115528903-project Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e079062ff041480e881f5eb838541b61 Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2115528903-project Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '7ae35491-4674-4e2f-a405-af934e2016a2'} Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:30.963313 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:30.969806 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:30.974883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Returning 404 to user: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:30.976046 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8b8a8649-1236-42d1-9ba5-a37937a50fa0 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 404 len: 111 microversion: 2.1 time: 0.574801 Oct 29 21:11:30.976636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:30.977410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2753/5390] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:11:30 2022] DELETE /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 111 bytes in 577 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:11:30.978280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:30.984627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:30.989669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:30.990276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:30.992743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:30.995342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:31.010597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.013939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.014648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.015664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.016477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.017213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.546978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:31.566934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6472186-d913-48fa-aa04-c23c611a2618 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1527 microversion: 2.1 time: 0.582842 Oct 29 21:11:31.567532 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2754/5391] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:30 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1527 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:31.583219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:31.593166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Action: 'update', calling method: >, body: {"server": {"name": "7ae35491-4674-4e2f-a405-af934e2016a2_new"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:31.597207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:31.608587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:31.615903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.616451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.616910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.617301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:31.617707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.618172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.618606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.619931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4a86d852-6268-4a4a-9e14-7edb5538a880 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1724 microversion: 2.20 time: 0.683510 Oct 29 21:11:31.643450 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2638/5392] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:30 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1724 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:31.664829 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] HTTP exception thrown: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Request method failure captured: Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: request: PUT /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 HTTP/1.1 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 64 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZbj84i8A9lTcC3twBZbeXZMO530nWZ6btRpWiZb_MQFFTipeGw_gnGewc0WUmExF2eRF2MRQnljBoZgDlFe7GrVx38kwEiFxJEBj_JBtonpk7xvsWz1kFDKncD1gNw9wZQ7v9L5qJxUi1yHUQ3scH9_YZh9iYZH20Gf-LGYO2EcPwc Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 0d616f3dfd0a46b4ba4b75393ed68c2c Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2115528903 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d616f3dfd0a46b4ba4b75393ed68c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2115528903 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 0d616f3dfd0a46b4ba4b75393ed68c2c Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2115528903 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2115528903-project Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: e079062ff041480e881f5eb838541b61 Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2115528903-project Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: {"server": {"name": "7ae35491-4674-4e2f-a405-af934e2016a2_new"}} Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '7ae35491-4674-4e2f-a405-af934e2016a2', 'body': {'server': {'name': '7ae35491-4674-4e2f-a405-af934e2016a2_new'}}} Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:11:31.666588 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] Returning 404 to user: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:31.673333 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15181385-dd24-42b8-add5-08cf5cbd71c1 tempest-ServersNegativeTestMultiTenantJSON-2115528903 tempest-ServersNegativeTestMultiTenantJSON-2115528903-project] 10.222.0.36 "PUT /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 404 len: 111 microversion: 2.1 time: 0.079657 Oct 29 21:11:31.675380 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2755/5393] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:11:31 2022] PUT /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:11:31.679768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:31.680282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:31.721606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.721606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.721606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.728807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:31.729431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:31.745137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.745906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.746501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.751857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.752396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.752921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.754498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:31.755048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:31.755468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:31.851709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:11:31.996261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00cfc5e1-7e3b-4e4d-b46c-493481230d81 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 204 len: 0 microversion: 2.1 time: 0.320908 Oct 29 21:11:31.997255 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2639/5394] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:11:31 2022] DELETE /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:11:32.003970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-baa42985-17b9-4952-96fb-348dd9e64f05 req-d64dba7c-e02b-4b4b-a89c-a2bcdfce2dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "name": "network-vif-unplugged", "status": "completed", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:32.019810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-baa42985-17b9-4952-96fb-348dd9e64f05 req-d64dba7c-e02b-4b4b-a89c-a2bcdfce2dcd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:32.020908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-baa42985-17b9-4952-96fb-348dd9e64f05 req-d64dba7c-e02b-4b4b-a89c-a2bcdfce2dcd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:32.021560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-baa42985-17b9-4952-96fb-348dd9e64f05 req-d64dba7c-e02b-4b4b-a89c-a2bcdfce2dcd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:32.035819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.server_external_events [req-baa42985-17b9-4952-96fb-348dd9e64f05 req-d64dba7c-e02b-4b4b-a89c-a2bcdfce2dcd service nova] Unable to find a host for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6. Dropping event network-vif-unplugged {{(pid=138884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 21:11:32.036764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-baa42985-17b9-4952-96fb-348dd9e64f05 req-d64dba7c-e02b-4b4b-a89c-a2bcdfce2dcd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037942 Oct 29 21:11:32.037892 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2640/5395] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 21:11:32.049468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:32.050498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:32.061201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:32.063283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:32.064917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:32.066063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:32.068108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:32.069312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:32.442839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:32.462033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:32.468561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-494d3b17-b6c8-4522-bd25-d77573727bf2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.745571 Oct 29 21:11:32.471808 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2756/5396] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:31 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:32.485898 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d47aeafc-f0c4-4589-a83d-1f741d6e85d2 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1533 microversion: 2.1 time: 0.446722 Oct 29 21:11:32.486740 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2641/5397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:32 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1533 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:32.657268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:32.658427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:32.666775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:32.667741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:32.668563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:32.670932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:32.671658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:32.672388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:33.292310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:33.319109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:33.324230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:33.345192 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-99dbf3c2-8316-42e2-ac65-a0fab811451d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1667 microversion: 2.20 time: 0.674371 Oct 29 21:11:33.359446 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2757/5398] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:32 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1667 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:33.375043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7628d78-193e-456e-ab22-7607b628008d"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:33.380031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:33.402364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:33.404976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:33.405717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:33.406655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:33.410312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:33.411114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:33.496300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:33.496924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:33.515805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:33.526712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:33.527708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:33.542686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:33.543511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:33.545002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:34.111473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-403b8c2c-6efe-451b-844e-70964e9f4e42 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.743036 Oct 29 21:11:34.123707 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2642/5399] 10.222.0.36 () {62 vars in 1364 bytes} [Sat Oct 29 21:11:33 2022] POST /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments => generated 188 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:11:34.128799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:34.129291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:34.171001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:34.171870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:34.178539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:34.190119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63c5628f-7a34-41da-a18f-49a39d993bd9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.698483 Oct 29 21:11:34.190944 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2758/5400] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:33 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:34.193922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:34.194805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:34.201409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:34.201908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:34.468668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:34.472395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:34.481329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:34.483061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:34.483734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:34.484686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:34.486026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:34.489244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:34.568024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138885) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 21:11:34.735894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/action" status: 202 len: 0 microversion: 2.20 time: 0.271292 Oct 29 21:11:34.736865 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2759/5401] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 21:11:34 2022] POST /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:11:34.748490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:34.749434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:34.757274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:34.758015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:34.758460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:34.759571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:34.760106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:34.760648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:35.039490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:35.055880 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-daddf605-30bd-41af-9ed2-88c272e7cf79 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1533 microversion: 2.1 time: 0.925088 Oct 29 21:11:35.056722 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2643/5402] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:34 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1533 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:35.224959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:35.225703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:35.238120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:35.239314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:35.241038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:35.242267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:35.266022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:35.267028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:36.299329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:36.313522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:36.319004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:36.320981 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e1bd9aca-4d19-429f-9719-e83c23457b63 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1753 microversion: 2.20 time: 1.579270 Oct 29 21:11:36.322695 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2760/5403] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:34 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1753 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:11:36.330169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-dec00f62-8054-4863-9991-3e6ce90964f2 req-71b9f4fe-ed32-4eaf-b7a3-6a36122e0f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae35491-4674-4e2f-a405-af934e2016a2", "name": "network-vif-deleted", "tag": "41a5563a-363c-410f-855a-154d3413cea1"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:36.381212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dec00f62-8054-4863-9991-3e6ce90964f2 req-71b9f4fe-ed32-4eaf-b7a3-6a36122e0f8d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:36.386215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dec00f62-8054-4863-9991-3e6ce90964f2 req-71b9f4fe-ed32-4eaf-b7a3-6a36122e0f8d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:36.386887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-dec00f62-8054-4863-9991-3e6ce90964f2 req-71b9f4fe-ed32-4eaf-b7a3-6a36122e0f8d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:36.427557 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-dec00f62-8054-4863-9991-3e6ce90964f2 req-71b9f4fe-ed32-4eaf-b7a3-6a36122e0f8d service nova] Creating event network-vif-deleted:41a5563a-363c-410f-855a-154d3413cea1 for instance 7ae35491-4674-4e2f-a405-af934e2016a2 on nch2-master-1 Oct 29 21:11:36.461888 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-dec00f62-8054-4863-9991-3e6ce90964f2 req-71b9f4fe-ed32-4eaf-b7a3-6a36122e0f8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134899 Oct 29 21:11:36.469807 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2761/5404] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:36.500983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:36.516038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:36.552200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:36.560718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:36.577922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:36.584698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:36.591700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:36.601648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:36.698666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:36.701190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:36.702200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:36.704295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lazy-loading 'fault' on Instance uuid 7ae35491-4674-4e2f-a405-af934e2016a2 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:11:36.714824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:36.860832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:36.876768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c11c09b7-e3fd-4b2e-844a-6d0ebfc36099 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 1.657376 Oct 29 21:11:36.877437 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2644/5405] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:35 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:36.940394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc010766bcc4eb4a6a17958d576ac08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81bd0a7cd22412996ad7f69da7699c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:36.948148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb0109c6-2232-4b21-80d5-c3095a69e129 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 200 len: 1317 microversion: 2.1 time: 0.470102 Oct 29 21:11:36.948752 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2762/5406] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:36 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:37.350890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:37.351528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:37.363261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:37.363770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:37.364226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:37.364961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:37.365426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:37.365893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:37.908890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:37.909549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:37.921133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:37.922173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:37.923367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:37.924422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:37.932279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:37.932950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:38.423631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:38.432446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:38.439416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:38.443835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:38.465597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3893b881-1fc4-4cd8-a008-fd428729626f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1755 microversion: 2.20 time: 1.111296 Oct 29 21:11:38.466790 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2645/5407] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:37 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1755 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:38.471917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:38.475828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] [instance: 7ae35491-4674-4e2f-a405-af934e2016a2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:38.503491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:38.506098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:38.506645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:38.510233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:38.513213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:38.516204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:38.549941 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] HTTP exception thrown: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Request method failure captured: Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 HTTP/1.1 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZbN8Y1afjPsBbU8-uVnB_vGVCdfGQnYKm_5D4N5l_Eo8xI1oYWICFJbY1x19lZ7hTB8AP6PF8t9BLb7_7Jowe3smO700sPMS99f2yTTgylCMVO0EeIfg7PCMccN9U09wNz3TsyZD9ByOGfIBS5uzW9c71-vkqHP9Rz5ubf4zUCi-A8 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: d81bd0a7cd22412996ad7f69da7699c8 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2043832772 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d81bd0a7cd22412996ad7f69da7699c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d81bd0a7cd22412996ad7f69da7699c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d81bd0a7cd22412996ad7f69da7699c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d81bd0a7cd22412996ad7f69da7699c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2043832772 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: d81bd0a7cd22412996ad7f69da7699c8 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2043832772 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2043832772-project Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: fbc010766bcc4eb4a6a17958d576ac08 Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2043832772-project Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '7ae35491-4674-4e2f-a405-af934e2016a2'} Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:38.553946 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. Oct 29 21:11:38.560903 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:11:38.564010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] Returning 404 to user: Instance 7ae35491-4674-4e2f-a405-af934e2016a2 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:11:38.565178 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f552904-2ec0-455b-9428-8518c9546105 tempest-ServersNegativeTestMultiTenantJSON-2043832772 tempest-ServersNegativeTestMultiTenantJSON-2043832772-project] 10.222.0.36 "GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2" status: 404 len: 111 microversion: 2.1 time: 0.097033 Oct 29 21:11:38.565948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2646/5408] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:38 2022] GET /compute/v2.1/servers/7ae35491-4674-4e2f-a405-af934e2016a2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:11:38.807521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:38.824742 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f53921ba-7950-4be1-82c2-2810ef2566a1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.916754 Oct 29 21:11:38.828114 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2763/5409] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:37 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:39.493967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:39.495160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:39.512995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:39.517861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:39.519420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:39.523446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:39.529620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:39.532426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:39.851844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:39.852481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:39.867295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:39.867809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:39.868264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:39.869002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:39.869480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:39.885775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:40.200879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:40.217787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:40.219680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:40.223481 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-462a2fad-ca01-46de-84cc-c582b2a46b3b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1755 microversion: 2.20 time: 0.734868 Oct 29 21:11:40.227518 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2647/5410] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:39 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1755 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:40.512243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:40.526721 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-713beda1-4de4-426a-8ee8-0d529771e8cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.678624 Oct 29 21:11:40.531098 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2764/5411] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:39 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:41.262857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:41.266521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:41.305757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:41.307072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:41.349934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:41.351490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:41.359322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:41.364141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:41.555581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:41.562151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:41.576746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:41.577479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:41.587517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:41.588570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:41.589375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:41.590012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:42.592036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:42.608742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:42.610526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:42.616951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95721f66-aac6-4210-9a22-d34732a26917 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 1.360014 Oct 29 21:11:42.640687 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2648/5412] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:41 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:42.662525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:42.679095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86be7d2c-9b91-4686-837e-9652dc4fe9d4 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 1.127581 Oct 29 21:11:42.682454 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2765/5413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:41 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:43.192859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-976b03a8-a1c8-4889-b717-9a2ef753faba tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'create', calling method: .version_select at 0x7fa171a39700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1567238403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjtf9C6UV9QnMXWGpTk7pumVGL63vEgBXOxq3AAdn7D6O5V4y1p9Eb126B7kRDWZkr/adBepRlacISs0PN0Ly3UyApF4UbrwUWfHe7cSc2dtsTChoYro2q8IHKRNHFFTA=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:43.251486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:43.303970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-976b03a8-a1c8-4889-b717-9a2ef753faba tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for project a7c7f9a81492476983b30fd4984ba3db. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:11:43.311657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-976b03a8-a1c8-4889-b717-9a2ef753faba tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for user ce0a47b4b8bc40178dbfe6545060c467 and project a7c7f9a81492476983b30fd4984ba3db. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:11:43.359016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-976b03a8-a1c8-4889-b717-9a2ef753faba tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.186442 Oct 29 21:11:43.360001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2649/5414] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:11:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:43.648304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:43.655318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:43.710165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:43.711470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:43.721138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:43.722477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:43.723189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:43.724954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:43.727889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:43.728804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:43.730613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:43.731132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:43.731810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:43.735527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:43.736232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:43.736888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:45.174514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:45.187212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:45.197425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:45.199257 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2095a154-bf26-4d0c-a8cd-4b35c34aab67 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 1.555263 Oct 29 21:11:45.203745 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2766/5415] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:43 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:45.209750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e2f2f567-8a4c-4c06-b884-a7752003ec85 req-0956beec-bd59-49e3-988c-09ac810dfd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:45.239145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:45.244435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e2f2f567-8a4c-4c06-b884-a7752003ec85 req-0956beec-bd59-49e3-988c-09ac810dfd56 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:45.245892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e2f2f567-8a4c-4c06-b884-a7752003ec85 req-0956beec-bd59-49e3-988c-09ac810dfd56 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:45.249158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e2f2f567-8a4c-4c06-b884-a7752003ec85 req-0956beec-bd59-49e3-988c-09ac810dfd56 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:45.288310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e2f2f567-8a4c-4c06-b884-a7752003ec85 req-0956beec-bd59-49e3-988c-09ac810dfd56 service nova] Creating event network-changed:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch2-master-1 Oct 29 21:11:45.307321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e2f2f567-8a4c-4c06-b884-a7752003ec85 req-0956beec-bd59-49e3-988c-09ac810dfd56 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101997 Oct 29 21:11:45.309240 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2767/5416] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:46.052374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:46.062643 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10205713-cd27-4fc5-a949-b22106e74710 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 2.359369 Oct 29 21:11:46.063242 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2650/5417] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:43 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:46.230638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:46.231347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:46.254615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:46.256515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:46.257072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:46.257851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:46.258319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:46.258755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:46.753390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:46.769937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:46.771413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:46.772877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c8eb0931-452b-42ff-90a8-1cc4cd55579e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.546492 Oct 29 21:11:46.774020 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2768/5418] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:46 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:47.087572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:47.088371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:47.104509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:47.104993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:47.105444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:47.114499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:47.114998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:47.119953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:47.804188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:47.804821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:47.823063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:47.824390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:47.824852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:47.830121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:47.830808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:47.831422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:47.920996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:47.937027 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23723bfd-a5aa-48b2-ad40-e2f72def8222 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.851416 Oct 29 21:11:47.938348 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2651/5419] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:47 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:48.682684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:48.705695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:48.711342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:48.714593 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-13e8c533-c85d-43f5-93c4-0801b30a5603 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.915175 Oct 29 21:11:48.716417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2769/5420] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:47 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:11:48.968357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:48.969235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:48.988611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:48.992567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:48.995767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:48.997908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:49.007565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:49.010415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:49.744447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:49.746020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:49.759627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:49.762156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:49.763532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:49.766861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:49.767635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:49.768935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:50.865859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:50.885366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:50.891352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:50.895705 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e83c2cfb-8ace-4445-8dff-ba8b8b54a945 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 1.155458 Oct 29 21:11:50.913693 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2770/5421] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:49 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:50.931712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:50.945217 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35b21431-4bab-4ded-8381-c37de4b6460d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1505 microversion: 2.1 time: 1.984399 Oct 29 21:11:50.949584 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2652/5422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:48 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1505 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:51.927079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:51.928135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:51.953525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:51.954919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:51.957365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:51.967083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:51.968452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:51.969883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:52.367870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c61b5820-4b66-4d9e-ab85-2942d9771cb4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: .version_select at 0x7fa17025d310>, body: {"keypair": {"name": "tempest-keypair-895914995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM8DMK7vAwZNneafDLesziNlUVywMLClX70sFrOXXZXNr7vSZgaE20eDzH/xjzRzKT59b++B5E8TymstsuUplmjLMFSSXD2Fbi4miHOL8XuNmb1+utKVIGntIlBdi5JoA=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:52.462794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c61b5820-4b66-4d9e-ab85-2942d9771cb4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:11:52.490002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c61b5820-4b66-4d9e-ab85-2942d9771cb4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:11:52.594489 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c61b5820-4b66-4d9e-ab85-2942d9771cb4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.054620 Oct 29 21:11:52.603999 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2771/5423] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:11:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:52.612906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:52.620792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:52.620792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:52.651598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:52.659223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:52.661670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:52.663357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:52.665190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:52.666085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:52.666582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:52.667033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:52.667169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b9368db-3ca5-4d26-a1c4-8baaf2923036 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.746122 Oct 29 21:11:52.672135 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2653/5424] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:51 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:53.021200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4e68eb0d-402e-464a-b975-8cbfa89fb3f6 req-96bc9422-c9a7-4dc8-a0bf-dbaa1af16f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10082bb-f333-4d6e-a4d3-7648013c7abf", "name": "network-vif-unplugged", "status": "completed", "tag": "73fe1a07-bcf7-4e70-8167-bfd8df3366aa"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:53.061066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4e68eb0d-402e-464a-b975-8cbfa89fb3f6 req-96bc9422-c9a7-4dc8-a0bf-dbaa1af16f2c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:53.064167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4e68eb0d-402e-464a-b975-8cbfa89fb3f6 req-96bc9422-c9a7-4dc8-a0bf-dbaa1af16f2c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:53.065026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4e68eb0d-402e-464a-b975-8cbfa89fb3f6 req-96bc9422-c9a7-4dc8-a0bf-dbaa1af16f2c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:53.105655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4e68eb0d-402e-464a-b975-8cbfa89fb3f6 req-96bc9422-c9a7-4dc8-a0bf-dbaa1af16f2c service nova] Creating event network-vif-unplugged:73fe1a07-bcf7-4e70-8167-bfd8df3366aa for instance c10082bb-f333-4d6e-a4d3-7648013c7abf on nch1-master-1 Oct 29 21:11:53.125000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4e68eb0d-402e-464a-b975-8cbfa89fb3f6 req-96bc9422-c9a7-4dc8-a0bf-dbaa1af16f2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108357 Oct 29 21:11:53.126554 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2654/5425] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:11:53.394470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:53.414334 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b21172f-ff55-42b1-9385-0f6fb50e0c5f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1505 microversion: 2.1 time: 0.810656 Oct 29 21:11:53.442587 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2772/5426] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:52 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1505 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:53.697707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:11:53.703754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:53.705244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:53.738616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:53.739538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:53.742855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:53.745681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:53.748140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:53.749118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:54.448569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:54.449201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:54.466910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:54.472310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:54.473003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:54.476355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:54.477013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:54.479551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:54.515166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:54.532930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:54.542894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:54.545512 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fb41d9ee-cdc8-45ba-ae0d-5bc9b6858925 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.848084 Oct 29 21:11:54.552470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2655/5427] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:53 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:55.150854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:55.164340 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5a2f7dd-0488-490f-814c-754d3155ba50 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 200 len: 1508 microversion: 2.1 time: 0.719629 Oct 29 21:11:55.167160 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2773/5428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:54 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 1508 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:55.200596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:55.202537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:55.213767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:55.217963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:55.219519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:55.222313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:55.224129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:55.226599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:55.365694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-45937923", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "4ac198ba-de2f-4fcf-83dd-b8a972db80f2"}], "key_name": "tempest-TestNetworkBasicOps-1567238403", "security_groups": [{"name": "tempest-secgroup-smoke-1141270625"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:55.881597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] validate_networks() for [('4ac198ba-de2f-4fcf-83dd-b8a972db80f2', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:11:56.122074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:56.138845 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c03f20a3-1bc9-4931-bd76-1d059b38b437 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.944040 Oct 29 21:11:56.206686 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2656/5429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:55 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:56.221420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:56.222198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:56.248046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:56.248883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:56.253091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:56.254127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:56.260825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:56.261563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:56.824690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:56.846599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:56.851988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:56.855812 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f9a3541-24a7-49f1-aec1-97b874eaf0ec tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.647936 Oct 29 21:11:56.858950 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2657/5430] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:56 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:56.870537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:56.873167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:56.894125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:56.895733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:56.897569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:56.899777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:56.902479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:56.903795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:57.309051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:57.327751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12c64e20-7ad7-41b8-bada-ba342f8c8cda tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.466996 Oct 29 21:11:57.330930 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2658/5431] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:56 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:57.355405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:57.358204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:57.373823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:57.374600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:57.375216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:57.376543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:57.377616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:57.378229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:57.935338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:57.958996 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-593d70b5-5763-4ed4-aceb-4170d52e974d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.605964 Oct 29 21:11:57.961883 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2659/5432] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:57 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:11:57.975118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:57.980516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:58.003086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:58.006494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:58.010296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:58.018527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:58.022154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:58.022894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:58.071428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:11:58.072715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:11:58.073731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:11:58.074457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:11:58.076366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:11:58.105416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:58.109577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:58.111332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:58.112876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:58.117058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:58.117631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:58.179831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for project a7c7f9a81492476983b30fd4984ba3db. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:11:58.195557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for user ce0a47b4b8bc40178dbfe6545060c467 and project a7c7f9a81492476983b30fd4984ba3db. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:11:58.271564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:11:58.275831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:11:58.465152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ee664e3-28a7-4f6e-9962-a71ec62b9787 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.108207 Oct 29 21:11:58.477939 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2774/5433] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:11:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:11:58.503047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:58.521030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:58.549708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:58.550586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:58.551276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:58.553122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:58.553945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:58.554884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:58.687047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:58.717498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:58.719005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:58.720255 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-625c49a4-b83f-4567-87a0-3661e6e444c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.756030 Oct 29 21:11:58.720835 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2660/5434] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:57 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:11:58.744256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-49e256e8-6f5d-41e8-8952-9d058d1fe773 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:58.744877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-49e256e8-6f5d-41e8-8952-9d058d1fe773 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:59.075405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-49e256e8-6f5d-41e8-8952-9d058d1fe773 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:59.091714 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-49e256e8-6f5d-41e8-8952-9d058d1fe773 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1247 microversion: 2.1 time: 0.369211 Oct 29 21:11:59.105540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2661/5435] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:58 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1247 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:59.340075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:11:59.352527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-220d19c8-32f7-4c5e-8674-d33c7e932fb6 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.872914 Oct 29 21:11:59.359220 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2775/5436] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:58 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:11:59.387383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e241f40f-c9f9-41a5-bc03-107491c8a8d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:11:59.418710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e241f40f-c9f9-41a5-bc03-107491c8a8d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:59.422644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e241f40f-c9f9-41a5-bc03-107491c8a8d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:59.425725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e241f40f-c9f9-41a5-bc03-107491c8a8d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:59.555411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e241f40f-c9f9-41a5-bc03-107491c8a8d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Going to try to stop instance {{(pid=138884) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:11:59.754770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:59.755531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:59.758972 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e241f40f-c9f9-41a5-bc03-107491c8a8d3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.361840 Oct 29 21:11:59.765939 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2662/5437] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:11:59 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:11:59.768671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:59.769186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:59.769673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:59.788300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:59.788562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:11:59.788812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:59.789327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:59.790106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:11:59.810732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:59.811954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:59.815543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:11:59.819725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:11:59.820352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:11:59.821162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:00.946684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:00.959173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:00.970530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:00.979396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1c3e9e3-c832-4a60-ac5a-d2463ffb7eba tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 1.234129 Oct 29 21:12:00.984312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:00.988802 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2776/5438] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:11:59 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:00.999436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b1fbe4c-4d67-4549-8f2f-c730a575e458 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 1.224149 Oct 29 21:12:01.007090 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2663/5439] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:11:59 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:01.011085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:01.012328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:01.064739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:01.069779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:01.072918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:01.074271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:01.076161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:01.078589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:02.022638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:02.024631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:02.038473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:02.039240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:02.041353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:02.042485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:02.045386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:02.046782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:02.336399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:02.349786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-347d6ca4-06ac-4fa9-a885-0b71b0381b48 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1307 microversion: 2.1 time: 1.352576 Oct 29 21:12:02.352045 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2777/5440] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:00 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1307 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:02.363100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:02.368387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:02.382636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:02.384168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:02.385782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:02.388846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:02.389631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:02.390295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:02.897769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:02.900735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:02.921164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:02.924634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:02.931579 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b91832d6-87d2-49d0-99dd-2a5fa8489afd tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.912531 Oct 29 21:12:02.947263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2664/5441] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:02 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:03.116157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-42632513", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae54bd00-7b0d-4e16-bca3-cda80b70e755"}], "security_groups": [{"name": "tempest-securitygroup--2049013528"}], "key_name": "tempest-keypair-895914995", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:03.164463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:03.178481 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6157da5-e1b7-40e9-95e4-fc057faa3035 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.824068 Oct 29 21:12:03.180428 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2778/5442] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:02 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:03.376171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:03.377353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:03.386758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:03.395197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:03.395708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:03.397213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:03.397876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:03.398462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:03.792711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:03.803024 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93639076-3d8b-462c-8e07-3aad42f22955 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1305 microversion: 2.1 time: 0.432107 Oct 29 21:12:03.804039 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2779/5443] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:03 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1305 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:03.938326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] validate_networks() for [('ae54bd00-7b0d-4e16-bca3-cda80b70e755', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:12:03.962984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:03.963602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:03.974952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:03.975852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:03.976487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:03.977527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:03.978290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:03.978799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:04.489766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:04.503965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:04.505944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:04.508251 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7de29052-6bcd-4b9b-ba85-29230562619e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.549229 Oct 29 21:12:04.509652 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2780/5444] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:03 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:04.530887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:04.530887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:04.545416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:04.550647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:04.551122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:04.552140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:04.552779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:04.553054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:04.584246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:05.134512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:05.155927 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cef41c74-7ce9-4324-9688-3d4ae7321ef9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.640312 Oct 29 21:12:05.159495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2781/5445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:04 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:05.171281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:05.172133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:05.192115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:05.198400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:05.199115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:05.201868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:05.204205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:05.204850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:05.503971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:12:05.504926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:12:05.505713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:12:05.506271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:12:05.506993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:12:05.522120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:05.524714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:05.525371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:05.526345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:05.527209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:05.530383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:05.588409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:12:05.611623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:12:05.647052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:12:05.650910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:12:05.730637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:05.745308 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b6e7d8e-145f-4832-8403-ffc3b8cd067a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 0.582874 Oct 29 21:12:05.745979 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2782/5446] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:05 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:05.754623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:05.755589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:05.774745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:05.776368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:05.776980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:05.778779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:05.781115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:05.783474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:05.800988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d33abcd-8548-4e0d-8c14-519d7dba96f4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.699494 Oct 29 21:12:05.801778 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2665/5447] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:12:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:12:05.816219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f3294184-8432-46c3-a1fa-6c5908fa11fb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:05.816880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f3294184-8432-46c3-a1fa-6c5908fa11fb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:06.028564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3294184-8432-46c3-a1fa-6c5908fa11fb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:06.040798 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f3294184-8432-46c3-a1fa-6c5908fa11fb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1239 microversion: 2.1 time: 0.225865 Oct 29 21:12:06.041434 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2666/5448] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:05 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1239 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:06.185362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:06.186262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:06.199492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:06.201020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:06.206601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:06.208331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:06.210872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:06.215051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:06.935150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:06.952052 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8554891-4756-45ac-bed0-2de9ca0c1cce tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.769808 Oct 29 21:12:06.958249 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2667/5449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:06 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:06.966839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:06.970074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:06.987641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:06.988447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:06.990162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:06.992930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:06.993663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:06.997269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:07.009245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:07.050983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:07.057172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:07.064780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-957c1d4f-0d89-4ace-aeae-25a6e4e61029 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 1.315558 Oct 29 21:12:07.067440 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2783/5450] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:05 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:07.087989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:07.093656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:07.120549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:07.121546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:07.122177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:07.123126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:07.126803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:07.127455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:07.363488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:07.373887 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aff1584f-994b-4a4e-b071-90a9312cad5f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1291 microversion: 2.1 time: 0.301315 Oct 29 21:12:07.375631 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2784/5451] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:07 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1291 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:07.592572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:07.611336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32bd20a3-99c4-4df4-913b-dda237552589 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 0.648142 Oct 29 21:12:07.614170 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2668/5452] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:06 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:07.833250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-de91152b-7c05-4c4f-832b-671454cb2195 req-df7d0f6e-234c-4bb7-9278-6d5b9e599f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7897ff-e84d-4e68-892c-8d499525bbc4", "tag": "2f2fa565-cdb3-4970-92e1-f611c8a08051"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:07.855469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-de91152b-7c05-4c4f-832b-671454cb2195 req-df7d0f6e-234c-4bb7-9278-6d5b9e599f39 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:07.855951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-de91152b-7c05-4c4f-832b-671454cb2195 req-df7d0f6e-234c-4bb7-9278-6d5b9e599f39 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:07.857993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-de91152b-7c05-4c4f-832b-671454cb2195 req-df7d0f6e-234c-4bb7-9278-6d5b9e599f39 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:07.887003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-de91152b-7c05-4c4f-832b-671454cb2195 req-df7d0f6e-234c-4bb7-9278-6d5b9e599f39 service nova] Creating event network-changed:2f2fa565-cdb3-4970-92e1-f611c8a08051 for instance df7897ff-e84d-4e68-892c-8d499525bbc4 on nch1-master-1 Oct 29 21:12:07.894233 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-de91152b-7c05-4c4f-832b-671454cb2195 req-df7d0f6e-234c-4bb7-9278-6d5b9e599f39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064472 Oct 29 21:12:07.895922 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2785/5453] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:07.987947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:07.990344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:08.009616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.012957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.016937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.018303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.018798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.019387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.099078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:08.100310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:08.116661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.118581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.119494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.122427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.126342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.127001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.172475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:08.226367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:08.432434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:08.441718 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9419331d-2c3e-480b-b65d-38ae86e7f8ef tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.469096 Oct 29 21:12:08.442796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2669/5454] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:07 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:08.450024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:08.450954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:08.458711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.459419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.460484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.461602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.462320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.462958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.726742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:08.736438 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-15f405f5-9242-438b-bc16-5c8b5c445304 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1297 microversion: 2.1 time: 0.292099 Oct 29 21:12:08.756622 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2670/5455] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:08 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1297 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:08.756622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:08.756622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:08.765390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:08.765818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.766332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.766782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.768579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:08.768579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:08.768579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:08.779968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:08.781948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:08.783646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e8788b3b-c919-48c3-9135-39c922319b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.690313 Oct 29 21:12:08.784906 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2786/5456] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:08 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:12:09.405821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:09.415856 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ebee0894-4933-4488-8017-208f1316e59f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 0.672496 Oct 29 21:12:09.419481 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2671/5457] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:08 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:09.468980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:09.469819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:09.493767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:09.494576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:09.495277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:09.496219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:09.497553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:09.498587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:09.718513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:09.734672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6cd3d4f1-3d43-464a-9b43-b13f07adc667 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1679 microversion: 2.1 time: 0.269607 Oct 29 21:12:09.735277 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2787/5458] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:09 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1679 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:09.766422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:09.774253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:09.782876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:09.783685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:09.784347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:09.785884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:09.786623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:09.787287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:09.813727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:09.816458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:09.835102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:09.838113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:09.838889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:09.841812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:09.843202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:09.845418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:10.215140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:10.226752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:10.229599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:10.232218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-88a9f263-4d47-4cfa-a66d-8844912006fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.422946 Oct 29 21:12:10.233855 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2788/5459] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:09 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:12:10.245133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:10.259636 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9aef333-6cd0-4f56-b511-deb07a8ebfda tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.498936 Oct 29 21:12:10.270129 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2672/5460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:09 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:10.270293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0f278d4d-0dc3-49d7-876c-f9a378ebcfbf req-62ee29f2-af83-4973-b4ad-87dfafb82c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "name": "network-vif-plugged", "status": "completed", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:10.287195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0f278d4d-0dc3-49d7-876c-f9a378ebcfbf req-62ee29f2-af83-4973-b4ad-87dfafb82c9a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:10.287685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0f278d4d-0dc3-49d7-876c-f9a378ebcfbf req-62ee29f2-af83-4973-b4ad-87dfafb82c9a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:10.288398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0f278d4d-0dc3-49d7-876c-f9a378ebcfbf req-62ee29f2-af83-4973-b4ad-87dfafb82c9a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:10.312497 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0f278d4d-0dc3-49d7-876c-f9a378ebcfbf req-62ee29f2-af83-4973-b4ad-87dfafb82c9a service nova] Creating event network-vif-plugged:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch2-master-1 Oct 29 21:12:10.318924 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0f278d4d-0dc3-49d7-876c-f9a378ebcfbf req-62ee29f2-af83-4973-b4ad-87dfafb82c9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082629 Oct 29 21:12:10.320423 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2789/5461] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:10.446607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:10.448494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:10.458368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:10.459333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:10.460002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:10.461060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:10.462587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:10.463313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:10.762724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:10.764254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:10.771466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:10.771967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:10.772414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:10.773131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:10.773654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:10.774107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:10.820544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:10.832443 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-09a0144a-3aa2-4798-85e7-9b1f3b63a451 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 0.391241 Oct 29 21:12:10.834021 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2673/5462] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:10 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:11.259896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:11.260757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:11.275676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:11.279166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:11.279908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:11.282898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:11.283544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:11.284370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:11.640804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:11.650915 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b6e8142-ade9-4559-8458-3fd6dab581cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1656 microversion: 2.1 time: 0.892956 Oct 29 21:12:11.667059 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2790/5463] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:10 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1656 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:11.685523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:11.686473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:11.699087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:11.703356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:11.704108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:11.706569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:11.707454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:11.708237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:12.022743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:12.037022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:12.038998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:12.040615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e48f850-2644-454c-9be2-194c49c53b1c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.785522 Oct 29 21:12:12.041627 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2674/5464] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:11 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:12:12.048358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27ebf4d6-9a75-4bf4-9f97-0eb31ec5236a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:12.086412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27ebf4d6-9a75-4bf4-9f97-0eb31ec5236a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:12.088795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27ebf4d6-9a75-4bf4-9f97-0eb31ec5236a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:12.090156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27ebf4d6-9a75-4bf4-9f97-0eb31ec5236a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:12.132704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27ebf4d6-9a75-4bf4-9f97-0eb31ec5236a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Going to try to start instance {{(pid=138884) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 21:12:12.261985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27ebf4d6-9a75-4bf4-9f97-0eb31ec5236a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.216820 Oct 29 21:12:12.264459 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2675/5465] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:12:12 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:12:12.277955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:12.280051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:12.316627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:12.317413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:12.345385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:12.351995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:12.354034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:12.366128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:12.377607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:12.384242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bd79705-9cc0-482e-b7fd-3080e287007e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.706159 Oct 29 21:12:12.390540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2791/5466] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:11 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:12.409679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:12.410577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:12.418595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:12.419340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:12.419929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:12.421159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:12.422218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:12.423261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:13.156357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:13.176730 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb9187ea-8c39-4ddb-8847-d9287e602bd7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1665 microversion: 2.1 time: 0.780031 Oct 29 21:12:13.177889 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2792/5467] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:12 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1665 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:13.212173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:13.212814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:13.229336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:13.235377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:13.236465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:13.248621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:13.249725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:13.253325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:13.292386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:13.330160 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ba62faf3-0f69-4fb1-9ec9-f2cc6619be5c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 1.064373 Oct 29 21:12:13.330781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2676/5468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:12 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:13.359982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bcf53cb2-7917-49dd-a3a3-3f882b42eec9 req-6c25c205-24e3-4d4e-bb2e-fa5f2261ddb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e09e57-1dc6-4020-9eb4-494248d61866", "tag": "911ade1f-40a7-4bc1-88b1-5b3d9b924130"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:13.391453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:13.411542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bcf53cb2-7917-49dd-a3a3-3f882b42eec9 req-6c25c205-24e3-4d4e-bb2e-fa5f2261ddb7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:13.412035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bcf53cb2-7917-49dd-a3a3-3f882b42eec9 req-6c25c205-24e3-4d4e-bb2e-fa5f2261ddb7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:13.412474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bcf53cb2-7917-49dd-a3a3-3f882b42eec9 req-6c25c205-24e3-4d4e-bb2e-fa5f2261ddb7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:13.443184 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bcf53cb2-7917-49dd-a3a3-3f882b42eec9 req-6c25c205-24e3-4d4e-bb2e-fa5f2261ddb7 service nova] Creating event network-changed:911ade1f-40a7-4bc1-88b1-5b3d9b924130 for instance 45e09e57-1dc6-4020-9eb4-494248d61866 on nch2-master-1 Oct 29 21:12:13.454090 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bcf53cb2-7917-49dd-a3a3-3f882b42eec9 req-6c25c205-24e3-4d4e-bb2e-fa5f2261ddb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106147 Oct 29 21:12:13.455317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2677/5469] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:13.463042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:13.464337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:13.474594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:13.475325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:13.475963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:13.478464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:13.479540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:13.480380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:14.097284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:14.110647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:14.112153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:14.113681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-09f7fc0a-664f-43df-8961-018e9a78508f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1811 microversion: 2.20 time: 0.912184 Oct 29 21:12:14.125935 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2793/5470] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:13 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1811 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:14.221207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:14.223513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:14.235000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:14.243734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:14.246007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:14.248591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:14.251788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:14.255518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:14.275799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:14.284026 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1eff550d-fa2a-400d-9e4b-5dc48e7bbdcc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.826440 Oct 29 21:12:14.287885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2678/5471] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:13 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:14.361634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:14.363039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:14.380563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:14.381061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:14.381594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:14.382247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:14.382707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:14.383144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:15.008244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:15.016705 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2351e257-f603-4253-8b35-fe16376cd250 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 0.662535 Oct 29 21:12:15.017539 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2679/5472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:14 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:15.127329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:15.139956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:15.140575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:15.145765 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2dc40af3-d1e6-4ef6-b7d8-0f933f5c8dbe tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1665 microversion: 2.1 time: 0.929615 Oct 29 21:12:15.152165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:15.154529 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2794/5473] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:14 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1665 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:15.159123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:15.159591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:15.160349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:15.160813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:15.161245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:15.325895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:15.327178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:15.339494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:15.342394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:15.343161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:15.343969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:15.344956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:15.345667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:15.346312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:15.553418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:15.683205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:15.698889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:15.701056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:15.702549 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5a6eec92-ac87-487b-b733-810877895232 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1798 microversion: 2.20 time: 0.566544 Oct 29 21:12:15.703137 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2680/5474] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:15 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1798 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:12:15.718335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:15.727589 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-52a6df04-be75-4ab5-a000-01cdac592fa9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.420219 Oct 29 21:12:15.728188 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2795/5475] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:15 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:16.040533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:16.041051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:16.048512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=10 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:16.051744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:16.053945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:16.066195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:16.067192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:16.067826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:16.068664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:16.179294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:16.180506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:16.202116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:16.203070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:16.203769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:16.208566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:16.214040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:16.214755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:17.024616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:17.038039 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-41ff01d8-1e48-4684-bcdd-f88e7213fce3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 1.001365 Oct 29 21:12:17.058132 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2681/5476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:16 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:17.065725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-354f5b3a-48da-4c39-b9ce-3d33fed38df3 req-236f2def-3b8e-4b62-8b47-e2a22d4c38c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7897ff-e84d-4e68-892c-8d499525bbc4", "name": "network-vif-plugged", "status": "completed", "tag": "2f2fa565-cdb3-4970-92e1-f611c8a08051"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:17.087931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-354f5b3a-48da-4c39-b9ce-3d33fed38df3 req-236f2def-3b8e-4b62-8b47-e2a22d4c38c2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:17.094178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-354f5b3a-48da-4c39-b9ce-3d33fed38df3 req-236f2def-3b8e-4b62-8b47-e2a22d4c38c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:17.094788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-354f5b3a-48da-4c39-b9ce-3d33fed38df3 req-236f2def-3b8e-4b62-8b47-e2a22d4c38c2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:17.117898 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-354f5b3a-48da-4c39-b9ce-3d33fed38df3 req-236f2def-3b8e-4b62-8b47-e2a22d4c38c2 service nova] Creating event network-vif-plugged:2f2fa565-cdb3-4970-92e1-f611c8a08051 for instance df7897ff-e84d-4e68-892c-8d499525bbc4 on nch1-master-1 Oct 29 21:12:17.129669 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-354f5b3a-48da-4c39-b9ce-3d33fed38df3 req-236f2def-3b8e-4b62-8b47-e2a22d4c38c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069788 Oct 29 21:12:17.138279 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2682/5477] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:17.146949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:17.147710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:17.160686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:17.161192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:17.161683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:17.162409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:17.162875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:17.163314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:17.202145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:17.353494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:17.372712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee37dfd9-6100-4a96-b977-0100a7d01e1a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1665 microversion: 2.1 time: 1.197004 Oct 29 21:12:17.384016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2796/5478] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:16 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1665 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:17.542014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:17.552517 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afd172ad-be63-43ee-b460-1a2dd03e7875 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.412458 Oct 29 21:12:17.553307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2683/5479] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:17 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:17.679623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-862861433", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "27046042-bb28-4532-bca5-459daec2d26b"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:17.760487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] validate_networks() for [('27046042-bb28-4532-bca5-459daec2d26b', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:12:18.066191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:18.067293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:18.089708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.094719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.095206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.095965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.096449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.096893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.412451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:18.426811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca2841b3-0400-4f2c-965d-c7618cefd63a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1373 microversion: 2.1 time: 0.364166 Oct 29 21:12:18.428441 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2684/5480] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:18 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1373 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:18.435346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:18.436404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:18.457681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.458723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.461603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.462649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.463342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.463992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.656919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:12:18.658129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:12:18.661413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:12:18.662248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:12:18.664457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:12:18.682165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.683540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.684458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.685640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.687193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.688415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.698634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:18.708527 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b590dae8-4cc7-47f4-9dbf-fa1724e99dd5 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.277674 Oct 29 21:12:18.718034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Getting quotas for project b0a2789446244c589351c0d306ed44d2. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:12:18.725564 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2685/5481] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:18 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:18.731392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:18.732038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:18.739842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Getting quotas for user f00c811597ab424484feb813fb22d530 and project b0a2789446244c589351c0d306ed44d2. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:12:18.741503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.742469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.743233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.744232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.745073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.745771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.785360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:12:18.790018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:12:18.858580 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5fcd558c-25de-48ad-b164-928bf9e5a46d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472972 Oct 29 21:12:18.859618 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2797/5482] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:12:18.874216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:18.876608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:18.905441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.906555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.911703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:18.912838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:18.916689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:18.918243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.186260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:19.203597 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d19cd92b-713b-4734-b2c0-95bdb729660c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.476222 Oct 29 21:12:19.205766 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2686/5483] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:18 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:19.217612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd371719-65ea-4133-af31-e0bd2d42f834 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.220946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd371719-65ea-4133-af31-e0bd2d42f834 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:19.281973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:19.292766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.431581 Oct 29 21:12:19.310516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2798/5484] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:18 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:19.312435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.317258 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63deca2a-2221-4101-8c4d-3dc74bf42a4a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005070 Oct 29 21:12:19.318170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2799/5485] 10.222.0.36 () {56 vars in 886 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 21:12:19.323175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.323969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:19.331281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.332076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.332725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.333754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.334422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.335103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.413653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd371719-65ea-4133-af31-e0bd2d42f834 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:19.422427 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd371719-65ea-4133-af31-e0bd2d42f834 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1213 microversion: 2.1 time: 0.211927 Oct 29 21:12:19.438181 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2687/5486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1213 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:19.440794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd371719-65ea-4133-af31-e0bd2d42f834 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.460594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd371719-65ea-4133-af31-e0bd2d42f834 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.009655 Oct 29 21:12:19.469259 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2688/5487] 10.222.0.36 () {54 vars in 1035 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2/ => generated 379 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 29 21:12:19.474836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.475739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:19.485077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.485867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.486568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.487524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.488203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.488847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.777838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:19.782480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:19.785861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.466341 Oct 29 21:12:19.786446 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2800/5488] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:19.799437 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1546 microversion: 2.1 time: 0.328750 Oct 29 21:12:19.800361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2689/5489] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:19.809938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.810987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-69220235-2436-4fa3-a2df-ff2942864ea9 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002092 Oct 29 21:12:19.811409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2801/5490] 10.222.0.36 () {54 vars in 1041 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:19.824840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.825716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:19.825967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.827031 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2260c54-3ae8-424f-94e4-ea6205e66b4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001475 Oct 29 21:12:19.827394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2690/5491] 10.222.0.36 () {56 vars in 886 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 21:12:19.846998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.847840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.848568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.849533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.850216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.850847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.855000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:19.857063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:19.858886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:19.880461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.881193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.882027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:19.898476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:19.899013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:19.899473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.266834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:20.276073 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9202664-58e1-48d5-ace1-e3f88c062592 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.463707 Oct 29 21:12:20.278522 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2802/5492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:20.306261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a4ad5194-83a6-4b89-899d-1199fa868390 req-e85be982-a1c9-4cc7-b93f-6f46730ee4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e09e57-1dc6-4020-9eb4-494248d61866", "name": "network-vif-plugged", "status": "completed", "tag": "911ade1f-40a7-4bc1-88b1-5b3d9b924130"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:20.320292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:20.332648 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f593859c-1cb2-45eb-8b17-e9c1e2ff21f3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1546 microversion: 2.1 time: 0.501960 Oct 29 21:12:20.333644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4ad5194-83a6-4b89-899d-1199fa868390 req-e85be982-a1c9-4cc7-b93f-6f46730ee4a3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.334213 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2691/5493] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:19 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1546 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:20.336927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4ad5194-83a6-4b89-899d-1199fa868390 req-e85be982-a1c9-4cc7-b93f-6f46730ee4a3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.337485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4ad5194-83a6-4b89-899d-1199fa868390 req-e85be982-a1c9-4cc7-b93f-6f46730ee4a3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.344831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:20.345565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:20.357500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.360163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.362064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.364897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.366002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.366679 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a4ad5194-83a6-4b89-899d-1199fa868390 req-e85be982-a1c9-4cc7-b93f-6f46730ee4a3 service nova] Creating event network-vif-plugged:911ade1f-40a7-4bc1-88b1-5b3d9b924130 for instance 45e09e57-1dc6-4020-9eb4-494248d61866 on nch2-master-1 Oct 29 21:12:20.370592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.380541 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a4ad5194-83a6-4b89-899d-1199fa868390 req-e85be982-a1c9-4cc7-b93f-6f46730ee4a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080839 Oct 29 21:12:20.381878 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2803/5494] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:20.396195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:20.397754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:20.412395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.414128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.418241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.419258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.419916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.422570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.788398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:20.803317 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40d661ad-2be1-4414-ad26-256e6585b1f0 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.419862 Oct 29 21:12:20.803640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:20.804312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2804/5495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:20 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:20.811234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:20.811858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:20.816152 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f63af80-e38b-43b8-adcd-eadad2595b1a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.479472 Oct 29 21:12:20.834381 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2692/5496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:20 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:20.840963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:20.841886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:20.848209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.848855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.849263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.850229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.850660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.851136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.865594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.866104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.866544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.869092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:20.869842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:20.870524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:20.885564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lazy-loading 'flavor' on Instance uuid 881df71f-2007-45b8-9d62-f57352acca7c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:12:21.015929 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0348e8a1-cbef-48d5-a318-35be9062e597 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.179883 Oct 29 21:12:21.017225 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2693/5497] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:12:20 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:12:21.031493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:21.035149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:21.046294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:21.047034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:21.047655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:21.048722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:21.049334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:21.050085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:21.084735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:21.096614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d7bf8c4-cdd9-4c61-bf5c-fd1af4f44989 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1273 microversion: 2.1 time: 0.290904 Oct 29 21:12:21.098551 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2805/5498] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:20 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:21.501061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:21.514985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d98fe1a0-95d9-4838-8a36-6bf10a11b907 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1677 microversion: 2.1 time: 0.493179 Oct 29 21:12:21.516799 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2694/5499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:21 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1677 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:21.842402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:21.843662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:21.867354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:21.868879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:21.870910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:21.873807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:21.875078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:21.876625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:22.123966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:22.124813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:22.147465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:22.148358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:22.149309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:22.150315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:22.151023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:22.151714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:22.455697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:22.470260 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3758877-0745-4a96-a54d-0b058f57cab7 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1271 microversion: 2.1 time: 0.352224 Oct 29 21:12:22.471934 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2695/5500] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:22 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:22.540481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:22.541260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:22.554139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:22.554862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:22.557139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:22.558204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:22.564305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:22.565005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:22.592436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:22.608634 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5430f6b1-7d12-45a4-b34f-a7f70cc7f28c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1365 microversion: 2.1 time: 0.770234 Oct 29 21:12:22.611074 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2806/5501] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:21 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1365 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:23.338681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:23.348720 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-49ed89a0-31da-4f68-83d6-b0764a328406 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1660 microversion: 2.1 time: 0.812366 Oct 29 21:12:23.350768 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2696/5502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:22 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1660 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:23.377745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:23.378388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:23.388716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:23.395185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:23.396108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:23.399197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:23.399881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:23.401326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:23.495217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:23.496143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:23.517969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:23.518670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:23.519132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:23.519866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:23.520333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:23.529495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:23.626873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5b0d516-6c74-4ce0-8f06-bf6207b56626 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action" status: 202 len: 0 microversion: 2.1 time: 0.255601 Oct 29 21:12:23.631284 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2807/5503] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:12:23 2022] POST /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:12:23.659539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:23.661269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:23.688054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:23.689920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:23.691439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:23.692958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:23.693684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:23.699272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:24.264540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:24.275127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8c3d2484-887a-4983-a6c7-dcb9ed812b9a tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.784682 Oct 29 21:12:24.278631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:24.290986 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c50c8b7a-67d0-4566-9bcf-5c400b196b89 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1555 microversion: 2.1 time: 0.657852 Oct 29 21:12:24.294559 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2808/5504] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:23 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1555 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:24.295020 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2697/5505] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:23 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:24.320468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:24.326452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:24.328290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:24.329412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:24.346379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:24.348695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:24.351033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:24.353670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:24.355548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:24.357777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:24.365772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:24.372671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:24.373230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:24.376192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:24.376939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:24.377593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:24.737398 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a8218f82-13b0-4158-9de0-f3290be4a2b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.415392 Oct 29 21:12:24.738033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2698/5506] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:12:24 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-interface => generated 285 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:24.974457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:24.985608 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8d9019b-6cf2-4458-bbb6-1685efc1b71c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1666 microversion: 2.1 time: 0.689394 Oct 29 21:12:24.986387 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2809/5507] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:24 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1666 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:25.299202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:25.299833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:25.308153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:25.311880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:25.312338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:25.313077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:25.317723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:25.318224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:25.857119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:25.879696 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45b384c1-2d54-4cf4-991d-c0a59adfc7c9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.584344 Oct 29 21:12:25.888812 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2699/5508] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:25 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:26.016102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:26.016747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:26.035443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:26.036909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:26.037373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:26.038141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:26.056623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:26.057091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:26.578170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6c39d8cf-14ee-44af-b3b0-119263621012 req-1e5cd1e0-9d15-40c5-9ca9-77b49239a2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d260077-ebdd-42a1-bd73-a3737f9ea290", "tag": "3f49046f-5baa-4be4-89e9-bb3f9cb47d93"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:26.604398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6c39d8cf-14ee-44af-b3b0-119263621012 req-1e5cd1e0-9d15-40c5-9ca9-77b49239a2c6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:26.605143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6c39d8cf-14ee-44af-b3b0-119263621012 req-1e5cd1e0-9d15-40c5-9ca9-77b49239a2c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:26.606333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6c39d8cf-14ee-44af-b3b0-119263621012 req-1e5cd1e0-9d15-40c5-9ca9-77b49239a2c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:26.630732 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6c39d8cf-14ee-44af-b3b0-119263621012 req-1e5cd1e0-9d15-40c5-9ca9-77b49239a2c6 service nova] Creating event network-changed:3f49046f-5baa-4be4-89e9-bb3f9cb47d93 for instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 on nch1-master-1 Oct 29 21:12:26.636610 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6c39d8cf-14ee-44af-b3b0-119263621012 req-1e5cd1e0-9d15-40c5-9ca9-77b49239a2c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062554 Oct 29 21:12:26.646136 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2700/5509] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:12:26.710190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:26.722099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-987c029d-aa9d-43d4-aac0-5b0f2c8e4316 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1666 microversion: 2.1 time: 0.710770 Oct 29 21:12:26.743272 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2810/5510] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:26 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1666 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:26.912943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:26.913992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:26.927962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:26.930053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:26.931487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:26.934074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:26.934811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:26.936559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:27.600406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:27.617125 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be1a8b43-12a1-44ad-ae36-6c10a368c4db tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.710747 Oct 29 21:12:27.628166 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2701/5511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:26 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:27.653891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-11b45d7f-7509-40ff-90f1-ef0c8a5ebe3a req-1489f33b-b6be-4587-97aa-d02ee9aa81d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e09e57-1dc6-4020-9eb4-494248d61866", "tag": "911ade1f-40a7-4bc1-88b1-5b3d9b924130"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:27.676817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-11b45d7f-7509-40ff-90f1-ef0c8a5ebe3a req-1489f33b-b6be-4587-97aa-d02ee9aa81d7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:27.682789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-11b45d7f-7509-40ff-90f1-ef0c8a5ebe3a req-1489f33b-b6be-4587-97aa-d02ee9aa81d7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:27.686482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-11b45d7f-7509-40ff-90f1-ef0c8a5ebe3a req-1489f33b-b6be-4587-97aa-d02ee9aa81d7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:27.715412 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-11b45d7f-7509-40ff-90f1-ef0c8a5ebe3a req-1489f33b-b6be-4587-97aa-d02ee9aa81d7 service nova] Creating event network-changed:911ade1f-40a7-4bc1-88b1-5b3d9b924130 for instance 45e09e57-1dc6-4020-9eb4-494248d61866 on nch2-master-1 Oct 29 21:12:27.724611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-11b45d7f-7509-40ff-90f1-ef0c8a5ebe3a req-1489f33b-b6be-4587-97aa-d02ee9aa81d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076104 Oct 29 21:12:27.734900 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2811/5512] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:27.751984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:27.753231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:27.767366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:27.768156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:27.768774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:27.769833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:27.770699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:27.771288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:27.819099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:28.416950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:28.432341 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26d7cffd-5408-42cd-a64a-94a4b2082f16 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 0.684596 Oct 29 21:12:28.455059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2702/5513] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:27 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:28.460161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:28.460920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:28.473296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:28.473940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:28.474520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:28.475338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:28.476039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:28.476699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:28.643552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:28.644362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:28.663927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:28.665016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:28.667525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:28.668539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:28.670704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:28.675649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:28.706274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:28.759866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:29.422269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:29.798008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:29.807096 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25a23972-0016-427c-9061-a967f4903d59 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1669 microversion: 2.1 time: 1.352382 Oct 29 21:12:29.813684 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2812/5514] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:28 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1669 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:29.839390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:29.840182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:29.847079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:29.847833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:29.848434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:29.849509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:29.850123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:29.850699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:29.905569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:29.921789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2736120e-3a27-40ef-a792-b012f6b93b87 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 1.281733 Oct 29 21:12:29.943538 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2703/5515] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:28 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:29.954947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:29.977122 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.api [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Working on deleting snapshot 62e74ae2-4ad4-4069-9d3e-86d13b12007d from shelved instance... Oct 29 21:12:30.953525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:30.956563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:30.969309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:30.976116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:30.977028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:30.979727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:30.983403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:30.984289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:31.359964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Doing local delete in cell cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5(cell1) {{(pid=138885) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 21:12:31.362783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:31.363666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:31.364517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:31.365998 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.api [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 21:12:31.374569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] deallocate_for_instance() {{(pid=138885) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 21:12:31.508288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:31.519420 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3526c4c3-9bda-4aa5-bfcb-e0222bd63ed9 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.576274 Oct 29 21:12:31.540105 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2704/5516] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:30 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:32.544986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:32.545816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:32.557166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:32.567244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:32.568786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:32.570585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:32.572355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:32.579353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:32.592314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Updating instance_info_cache with network_info: [] {{(pid=138885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 21:12:33.104601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:33.118747 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74443e24-0cf3-460f-ad52-fd950d675c01 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.578232 Oct 29 21:12:33.122914 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2705/5517] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:32 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:33.142762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b490c138-95ca-4e7c-96cb-4b73d5e19084 req-a7072034-b820-4c44-bfbf-1fdc6dc10604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10082bb-f333-4d6e-a4d3-7648013c7abf", "name": "network-vif-deleted", "tag": "73fe1a07-bcf7-4e70-8167-bfd8df3366aa"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:33.189716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b490c138-95ca-4e7c-96cb-4b73d5e19084 req-a7072034-b820-4c44-bfbf-1fdc6dc10604 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.190443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b490c138-95ca-4e7c-96cb-4b73d5e19084 req-a7072034-b820-4c44-bfbf-1fdc6dc10604 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.191090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b490c138-95ca-4e7c-96cb-4b73d5e19084 req-a7072034-b820-4c44-bfbf-1fdc6dc10604 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:33.218960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.server_external_events [req-b490c138-95ca-4e7c-96cb-4b73d5e19084 req-a7072034-b820-4c44-bfbf-1fdc6dc10604 service nova] Unable to find a host for instance c10082bb-f333-4d6e-a4d3-7648013c7abf. Dropping event network-vif-deleted {{(pid=138884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 21:12:33.230336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b490c138-95ca-4e7c-96cb-4b73d5e19084 req-a7072034-b820-4c44-bfbf-1fdc6dc10604 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091439 Oct 29 21:12:33.231754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2706/5518] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 112 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 21:12:33.308104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:33.321038 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38a9f6c4-b85f-4022-b33c-3ee8dccd85e2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 204 len: 0 microversion: 2.1 time: 3.486633 Oct 29 21:12:33.324721 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2813/5519] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:12:29 2022] DELETE /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 0 bytes in 3491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:12:33.332818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:33.333677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: c10082bb-f333-4d6e-a4d3-7648013c7abf] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:33.347172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.347729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.348790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:33.354991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.356243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.358726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:33.457734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] HTTP exception thrown: Instance c10082bb-f333-4d6e-a4d3-7648013c7abf could not be found. Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Request method failure captured: Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf HTTP/1.1 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUo8-WqZDPiLwXg471XrzvsGc2L0XmF2F-L41Hh4OC0NtgIQdq1-LOvbJrhqd-KjADK1hUNlISzKTaNNj-DIpeKvdTLeHVQGSIHO7fZpq3W-Agl3seLWOsM1Aj98HNHjCcNsuQ820EjwSgXA7gtrSGTYNNCuqnI_g9cjwPH53pOr-g Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c35b0dd86eb14cbbab1732cc96ab2573 Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance c10082bb-f333-4d6e-a4d3-7648013c7abf could not be found. Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c10082bb-f333-4d6e-a4d3-7648013c7abf'} Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10082bb-f333-4d6e-a4d3-7648013c7abf could not be found. Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10082bb-f333-4d6e-a4d3-7648013c7abf could not be found. Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:33.459721 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10082bb-f333-4d6e-a4d3-7648013c7abf could not be found. Oct 29 21:12:33.464347 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:33.469066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Returning 404 to user: Instance c10082bb-f333-4d6e-a4d3-7648013c7abf could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:33.469964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4839823c-31a8-458b-a8b5-5341ec99fe80 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf" status: 404 len: 111 microversion: 2.1 time: 0.141173 Oct 29 21:12:33.470557 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2707/5520] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:33 2022] GET /compute/v2.1/servers/c10082bb-f333-4d6e-a4d3-7648013c7abf => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:12:33.487249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:33.488281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:33.520640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.521613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.522334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:33.523297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.524649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.525439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:33.601400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:33.743119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36ef9968-575f-4ece-b64b-93c4609d0e96 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 204 len: 0 microversion: 2.1 time: 0.267712 Oct 29 21:12:33.748430 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2814/5521] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:12:33 2022] DELETE /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:12:33.752703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:33.753977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:33.772972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.774355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.775167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:33.776073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:33.776693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:33.777344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:34.018281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:34.028213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ade0406-4564-43ce-babf-718dd1385b7c tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1464 microversion: 2.1 time: 0.278936 Oct 29 21:12:34.043220 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2708/5522] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:33 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1464 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:34.147840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:34.148729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:34.158776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:34.159276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:34.159717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:34.160435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:34.160895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:34.161324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:34.434822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:34.445607 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-401abc55-1c52-47d0-af01-d1c3d2bf4718 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.304517 Oct 29 21:12:34.457480 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2815/5523] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:34 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:35.056132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:35.056769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:35.072785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:35.073304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:35.073778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:35.074547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:35.078876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:35.079346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:35.241839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:35.250544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a5824e62-c3cb-4ea1-86d2-343433f3e4f2 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1464 microversion: 2.1 time: 0.198823 Oct 29 21:12:35.251142 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2709/5524] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:35 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1464 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:35.474655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:35.475740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:35.484788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:35.485291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:35.491517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:35.493744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:35.496352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:35.496976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:35.812412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:35.821157 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb8924c4-028e-4e61-b48d-af73efed9507 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.350975 Oct 29 21:12:35.826001 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2816/5525] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:35 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:36.282075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:36.282625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-024a934c-ecbe-4c6e-903c-28c07c95a175 req-ff2cb578-1597-47a9-933b-609dadee5541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0021e58-6abb-4fff-938a-75caf0360bee", "name": "network-vif-deleted", "tag": "99947c6a-8767-48e3-b8a1-400d772b4b73"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:36.283843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:36.297312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:36.298997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:36.302464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:36.303848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:36.304521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-024a934c-ecbe-4c6e-903c-28c07c95a175 req-ff2cb578-1597-47a9-933b-609dadee5541 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:36.305730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-024a934c-ecbe-4c6e-903c-28c07c95a175 req-ff2cb578-1597-47a9-933b-609dadee5541 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:36.305952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:36.306700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:36.307370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-024a934c-ecbe-4c6e-903c-28c07c95a175 req-ff2cb578-1597-47a9-933b-609dadee5541 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:36.342849 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-024a934c-ecbe-4c6e-903c-28c07c95a175 req-ff2cb578-1597-47a9-933b-609dadee5541 service nova] Creating event network-vif-deleted:99947c6a-8767-48e3-b8a1-400d772b4b73 for instance b0021e58-6abb-4fff-938a-75caf0360bee on nch1-master-1 Oct 29 21:12:36.348718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-024a934c-ecbe-4c6e-903c-28c07c95a175 req-ff2cb578-1597-47a9-933b-609dadee5541 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071358 Oct 29 21:12:36.351442 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2817/5526] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:12:36.531508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:36.539763 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ee8f490-3315-4898-844c-654784bcda51 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 200 len: 1299 microversion: 2.1 time: 0.267304 Oct 29 21:12:36.540367 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2710/5527] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:36 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 1299 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:36.717425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-47b0adda-f1a5-415e-af78-3afd78b2c92b req-e5fb5185-79b4-41e8-bccb-b3d3111373d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d260077-ebdd-42a1-bd73-a3737f9ea290", "name": "network-vif-plugged", "status": "completed", "tag": "3f49046f-5baa-4be4-89e9-bb3f9cb47d93"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:36.743002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-47b0adda-f1a5-415e-af78-3afd78b2c92b req-e5fb5185-79b4-41e8-bccb-b3d3111373d7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:36.743838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-47b0adda-f1a5-415e-af78-3afd78b2c92b req-e5fb5185-79b4-41e8-bccb-b3d3111373d7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:36.745090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-47b0adda-f1a5-415e-af78-3afd78b2c92b req-e5fb5185-79b4-41e8-bccb-b3d3111373d7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:36.764676 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-47b0adda-f1a5-415e-af78-3afd78b2c92b req-e5fb5185-79b4-41e8-bccb-b3d3111373d7 service nova] Creating event network-vif-plugged:3f49046f-5baa-4be4-89e9-bb3f9cb47d93 for instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 on nch1-master-1 Oct 29 21:12:36.799959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-47b0adda-f1a5-415e-af78-3afd78b2c92b req-e5fb5185-79b4-41e8-bccb-b3d3111373d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092415 Oct 29 21:12:36.801528 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2818/5528] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:36.854060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:36.854707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:36.866859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:36.871356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:36.872027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:36.872991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:36.875051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:36.876054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:37.323393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:37.350712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3126c3af-1de3-4ee5-a7d2-627854b5cf45 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.500399 Oct 29 21:12:37.352616 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2711/5529] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:36 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:37.568113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:37.568917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b0021e58-6abb-4fff-938a-75caf0360bee] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:37.577874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:37.581330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:37.581896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:37.582836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:37.583953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:37.584544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:37.602039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] HTTP exception thrown: Instance b0021e58-6abb-4fff-938a-75caf0360bee could not be found. Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Request method failure captured: Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee HTTP/1.1 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZUo8-WqZDPiLwXg471XrzvsGc2L0XmF2F-L41Hh4OC0NtgIQdq1-LOvbJrhqd-KjADK1hUNlISzKTaNNj-DIpeKvdTLeHVQGSIHO7fZpq3W-Agl3seLWOsM1Aj98HNHjCcNsuQ820EjwSgXA7gtrSGTYNNCuqnI_g9cjwPH53pOr-g Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c35b0dd86eb14cbbab1732cc96ab2573 Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b0021e58-6abb-4fff-938a-75caf0360bee could not be found. Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b0021e58-6abb-4fff-938a-75caf0360bee'} Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0021e58-6abb-4fff-938a-75caf0360bee could not be found. Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0021e58-6abb-4fff-938a-75caf0360bee could not be found. Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:37.603949 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0021e58-6abb-4fff-938a-75caf0360bee could not be found. Oct 29 21:12:37.611402 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:37.615173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Returning 404 to user: Instance b0021e58-6abb-4fff-938a-75caf0360bee could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:37.616271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63601405-d79d-4a04-b363-6a0e9bc84af3 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee" status: 404 len: 111 microversion: 2.1 time: 0.052691 Oct 29 21:12:37.617323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2819/5530] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:37 2022] GET /compute/v2.1/servers/b0021e58-6abb-4fff-938a-75caf0360bee => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:12:37.626353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:37.627167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:37.634502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:37.635312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:37.635970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:37.636909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:37.638047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:37.638875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:37.675415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:37.801202 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f4398cf-ead2-4c5e-8b01-f468e4689dec tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 204 len: 0 microversion: 2.1 time: 0.178363 Oct 29 21:12:37.806504 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2712/5531] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:12:37 2022] DELETE /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:12:37.811498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:37.812651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:37.828653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:37.831659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:37.833169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:37.834166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:37.836200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:37.838185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:38.176088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:38.190271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf8a9a81-ee81-46b3-8ff6-5fa3bab99b9f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1505 microversion: 2.1 time: 0.382763 Oct 29 21:12:38.199100 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2820/5532] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:37 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:38.377106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:38.378671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:38.388406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:38.388979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:38.389662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:38.390568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:38.391217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:38.391734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:38.782299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:38.795290 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6e842af-9d8a-4a10-87ab-75b0604fe603 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1313 microversion: 2.1 time: 0.422068 Oct 29 21:12:38.796672 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2713/5533] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:38 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:39.217670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:39.219792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:39.239330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:39.239834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:39.240273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:39.241145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:39.254833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:39.256310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:39.558067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:39.571590 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10e98355-1a13-4aa4-8d98-11bf9b784859 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1505 microversion: 2.1 time: 0.356806 Oct 29 21:12:39.575384 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2821/5534] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:39 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:39.837006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:39.837715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:39.860617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:39.861961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:39.863979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:39.865811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:39.867053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:39.867850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:40.123979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:40.133712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b3528bb6-1278-4d6f-b20b-a0e2252abc2d tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1498 microversion: 2.1 time: 0.303307 Oct 29 21:12:40.146486 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2714/5535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:39 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1498 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:40.606994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:40.608543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:40.617362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:40.618608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:40.619251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:40.622824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:40.623506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:40.624156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:41.179126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:41.190892 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e30a001c-c8d4-4627-a139-a4ae5114e2b1 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1505 microversion: 2.1 time: 0.590657 Oct 29 21:12:41.205571 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2822/5536] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:40 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:41.657288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-67f223cc-60e0-4d52-9628-372777bc4b0b req-cf250088-ae37-47b7-a1b7-98e00890d11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b140d99d-dddc-4190-9cb9-daede056c5d9", "name": "network-vif-deleted", "tag": "771dcf6d-287d-49aa-bdc8-b7a12e4c6218"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:41.702365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-67f223cc-60e0-4d52-9628-372777bc4b0b req-cf250088-ae37-47b7-a1b7-98e00890d11f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:41.703755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-67f223cc-60e0-4d52-9628-372777bc4b0b req-cf250088-ae37-47b7-a1b7-98e00890d11f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:41.708883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-67f223cc-60e0-4d52-9628-372777bc4b0b req-cf250088-ae37-47b7-a1b7-98e00890d11f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:41.740947 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-67f223cc-60e0-4d52-9628-372777bc4b0b req-cf250088-ae37-47b7-a1b7-98e00890d11f service nova] Creating event network-vif-deleted:771dcf6d-287d-49aa-bdc8-b7a12e4c6218 for instance b140d99d-dddc-4190-9cb9-daede056c5d9 on nch1-master-1 Oct 29 21:12:41.748939 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-67f223cc-60e0-4d52-9628-372777bc4b0b req-cf250088-ae37-47b7-a1b7-98e00890d11f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096288 Oct 29 21:12:41.752458 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2715/5537] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:42.216506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:42.217841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:42.236119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:42.238874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:42.239566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:42.243174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:42.244594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:42.245431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:42.345825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:42.349946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:42.351717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:42.354709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lazy-loading 'fault' on Instance uuid b140d99d-dddc-4190-9cb9-daede056c5d9 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:12:42.487350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:42.499555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5eb5db50-4840-4340-9b92-3c40954c371a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 200 len: 1303 microversion: 2.1 time: 0.285456 Oct 29 21:12:42.501784 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2823/5538] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:42 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:43.189952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:43.191171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:43.200652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.201147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.201627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.202390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.208514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.209279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.249183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:43.343261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04aa5050-808c-4c43-8fe3-0a37cc2bd748 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 204 len: 0 microversion: 2.1 time: 0.157517 Oct 29 21:12:43.344470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2716/5539] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:12:43 2022] DELETE /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:12:43.353507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:43.354740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:43.363465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.364141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.364756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.365802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.366410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.366995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.526084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:43.528834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: b140d99d-dddc-4190-9cb9-daede056c5d9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:43.545705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:43.547672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.548794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.548794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.549340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.553412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.553902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.582020 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] HTTP exception thrown: Instance b140d99d-dddc-4190-9cb9-daede056c5d9 could not be found. Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Request method failure captured: Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 HTTP/1.1 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUo8-WqZDPiLwXg471XrzvsGc2L0XmF2F-L41Hh4OC0NtgIQdq1-LOvbJrhqd-KjADK1hUNlISzKTaNNj-DIpeKvdTLeHVQGSIHO7fZpq3W-Agl3seLWOsM1Aj98HNHjCcNsuQ820EjwSgXA7gtrSGTYNNCuqnI_g9cjwPH53pOr-g Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c35b0dd86eb14cbbab1732cc96ab2573 Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b140d99d-dddc-4190-9cb9-daede056c5d9 could not be found. Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b140d99d-dddc-4190-9cb9-daede056c5d9'} Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b140d99d-dddc-4190-9cb9-daede056c5d9 could not be found. Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b140d99d-dddc-4190-9cb9-daede056c5d9 could not be found. Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:43.590218 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b140d99d-dddc-4190-9cb9-daede056c5d9 could not be found. Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Returning 404 to user: Instance b140d99d-dddc-4190-9cb9-daede056c5d9 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:43.593709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afe1c51a-f27e-494b-a6c4-648691404479 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9" status: 404 len: 111 microversion: 2.1 time: 0.072666 Oct 29 21:12:43.599041 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2717/5540] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:43 2022] GET /compute/v2.1/servers/b140d99d-dddc-4190-9cb9-daede056c5d9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:12:43.612593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:43.615593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:43.626599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.629075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.631129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.633044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.644198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.644772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.688238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:43.699508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:43.711556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:43.719428 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b76d8b10-3287-4ef2-b0d9-9c5c0106fd05 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1504 microversion: 2.1 time: 0.370664 Oct 29 21:12:43.720021 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2824/5541] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:43 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:43.847506 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5fef9214-9a3f-4783-91e7-a38f4198ce00 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 204 len: 0 microversion: 2.1 time: 0.246570 Oct 29 21:12:43.848276 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2718/5542] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:12:43 2022] DELETE /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:12:43.859223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:43.860041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:43.870088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.870897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.871493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:43.872788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:43.873612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:43.874302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:44.065875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:44.077308 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b5ca4e55-b1b1-4992-8448-32446af72cc7 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1494 microversion: 2.1 time: 0.224599 Oct 29 21:12:44.078062 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2825/5543] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:43 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1494 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:12:44.745783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:44.747466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:44.762077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:44.767457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:44.768258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:44.769191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:44.769588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:44.770495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:45.039263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-93569b27-c12f-41eb-be6c-b04e1b05f94c req-215c194c-d5bd-41d6-8c66-005878bfa471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafab2fe-44ea-428b-95ab-85c953df9675", "name": "network-vif-deleted", "tag": "0aefd86a-8ed6-4932-871d-0aa364162209"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:45.066009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-93569b27-c12f-41eb-be6c-b04e1b05f94c req-215c194c-d5bd-41d6-8c66-005878bfa471 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:45.066736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-93569b27-c12f-41eb-be6c-b04e1b05f94c req-215c194c-d5bd-41d6-8c66-005878bfa471 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:45.068772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-93569b27-c12f-41eb-be6c-b04e1b05f94c req-215c194c-d5bd-41d6-8c66-005878bfa471 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:45.121503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-93569b27-c12f-41eb-be6c-b04e1b05f94c req-215c194c-d5bd-41d6-8c66-005878bfa471 service nova] Creating event network-vif-deleted:0aefd86a-8ed6-4932-871d-0aa364162209 for instance fafab2fe-44ea-428b-95ab-85c953df9675 on nch2-master-1 Oct 29 21:12:45.132865 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-93569b27-c12f-41eb-be6c-b04e1b05f94c req-215c194c-d5bd-41d6-8c66-005878bfa471 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095233 Oct 29 21:12:45.135006 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2826/5544] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:45.143186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:45.144058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:45.156857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:45.157642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:45.158412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:45.159358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:45.160027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:45.160668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:45.452482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:45.465784 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6e9b895-da2f-4d05-be5a-4de866f4c917 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 200 len: 1286 microversion: 2.1 time: 0.329122 Oct 29 21:12:45.466859 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2827/5545] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:45 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 1286 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:45.622575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:45.632932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-70dc8754-49e7-4137-9a87-7373d19d1bb1 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1504 microversion: 2.1 time: 0.891713 Oct 29 21:12:45.634913 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2719/5546] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:44 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:46.250199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0387794c-1fa5-4dc8-a926-f21fc77a69a9 req-e24df36e-2372-4c37-8961-3b97cb7b5b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d260077-ebdd-42a1-bd73-a3737f9ea290", "name": "network-vif-deleted", "tag": "3f49046f-5baa-4be4-89e9-bb3f9cb47d93"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:46.265689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:46.311372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0387794c-1fa5-4dc8-a926-f21fc77a69a9 req-e24df36e-2372-4c37-8961-3b97cb7b5b5c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.313195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0387794c-1fa5-4dc8-a926-f21fc77a69a9 req-e24df36e-2372-4c37-8961-3b97cb7b5b5c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.314562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0387794c-1fa5-4dc8-a926-f21fc77a69a9 req-e24df36e-2372-4c37-8961-3b97cb7b5b5c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.377605 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0387794c-1fa5-4dc8-a926-f21fc77a69a9 req-e24df36e-2372-4c37-8961-3b97cb7b5b5c service nova] Creating event network-vif-deleted:3f49046f-5baa-4be4-89e9-bb3f9cb47d93 for instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 on nch1-master-1 Oct 29 21:12:46.392738 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0387794c-1fa5-4dc8-a926-f21fc77a69a9 req-e24df36e-2372-4c37-8961-3b97cb7b5b5c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146535 Oct 29 21:12:46.399528 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2828/5547] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:46.494386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:46.495157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: fafab2fe-44ea-428b-95ab-85c953df9675] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:46.512572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.513065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.525109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.526219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.528314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.531071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.570702 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] HTTP exception thrown: Instance fafab2fe-44ea-428b-95ab-85c953df9675 could not be found. Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Request method failure captured: Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 HTTP/1.1 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUo8-WqZDPiLwXg471XrzvsGc2L0XmF2F-L41Hh4OC0NtgIQdq1-LOvbJrhqd-KjADK1hUNlISzKTaNNj-DIpeKvdTLeHVQGSIHO7fZpq3W-Agl3seLWOsM1Aj98HNHjCcNsuQ820EjwSgXA7gtrSGTYNNCuqnI_g9cjwPH53pOr-g Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c35b0dd86eb14cbbab1732cc96ab2573 Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance fafab2fe-44ea-428b-95ab-85c953df9675 could not be found. Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'fafab2fe-44ea-428b-95ab-85c953df9675'} Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafab2fe-44ea-428b-95ab-85c953df9675 could not be found. Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafab2fe-44ea-428b-95ab-85c953df9675 could not be found. Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:46.574095 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafab2fe-44ea-428b-95ab-85c953df9675 could not be found. Oct 29 21:12:46.577599 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:46.580779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Returning 404 to user: Instance fafab2fe-44ea-428b-95ab-85c953df9675 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:46.584308 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2f08451-e508-4bee-bc88-3285dddf2f0a tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675" status: 404 len: 111 microversion: 2.1 time: 0.093815 Oct 29 21:12:46.585431 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2720/5548] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:46 2022] GET /compute/v2.1/servers/fafab2fe-44ea-428b-95ab-85c953df9675 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:12:46.595331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:46.596188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:46.610437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.611151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.613888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.614850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.617521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.618355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.657759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:46.658857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:46.675812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.676987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.677950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.679101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.679767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.680399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.716457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:46.788642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.790935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.791607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:46.792232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lazy-loading 'fault' on Instance uuid 4d260077-ebdd-42a1-bd73-a3737f9ea290 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:12:46.851852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:12:46.872012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f00c811597ab424484feb813fb22d530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a2789446244c589351c0d306ed44d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:46.881545 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe98261a-f91a-4ede-aa43-2b72349d1918 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 200 len: 1303 microversion: 2.1 time: 0.228431 Oct 29 21:12:46.882482 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2721/5549] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:46 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:46.972086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9e1f46d-6ce6-4bf9-9dab-56072a128c0f tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 204 len: 0 microversion: 2.1 time: 0.379946 Oct 29 21:12:46.972709 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2829/5550] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:12:46 2022] DELETE /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:12:46.982334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:46.984539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:46.997387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:46.998320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:46.999909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:47.002316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:47.004320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:47.005814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:47.290802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:47.309235 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5bc45f69-b59b-4203-afa1-7c39ad3a9199 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1675 microversion: 2.1 time: 0.331980 Oct 29 21:12:47.310424 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2722/5551] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:46 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1675 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:47.908135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:47.908863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] [instance: 4d260077-ebdd-42a1-bd73-a3737f9ea290] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:47.921292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:47.921830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:47.922287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:47.923019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:47.923489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:47.923926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:47.969949 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] HTTP exception thrown: Instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 could not be found. Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Request method failure captured: Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 HTTP/1.1 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZcrfBpFeE0o0UlaKAgWRxYv2o1ORfgEwt4DX_ivNrxqOIKJFqeuZPM9rrYkQuBp5fLgWeZcbWQoQnNNpTsLK9GY-NkojUJNFNepY5sIYaHyYr4J8l6NhRVkq2Vn_Srh9pOe6gHPqaQftXci2e5XCkOTAKPLLYMObfOYrVO-MUWI_nU Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b0a2789446244c589351c0d306ed44d2 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesActionsTest-726015298 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0a2789446244c589351c0d306ed44d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b0a2789446244c589351c0d306ed44d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b0a2789446244c589351c0d306ed44d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b0a2789446244c589351c0d306ed44d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesActionsTest-726015298 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b0a2789446244c589351c0d306ed44d2 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesActionsTest-726015298 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesActionsTest-726015298-project Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f00c811597ab424484feb813fb22d530 Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesActionsTest-726015298-project Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 could not be found. Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '4d260077-ebdd-42a1-bd73-a3737f9ea290'} Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 could not be found. Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 could not be found. Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:47.971768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 could not be found. Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] Returning 404 to user: Instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:47.975959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16a84bdb-ee79-4495-a77b-62976e7761a0 tempest-VolumesActionsTest-726015298 tempest-VolumesActionsTest-726015298-project] 10.222.0.36 "GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290" status: 404 len: 111 microversion: 2.1 time: 0.069792 Oct 29 21:12:47.980679 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2830/5552] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:47 2022] GET /compute/v2.1/servers/4d260077-ebdd-42a1-bd73-a3737f9ea290 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:12:48.336515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:48.337812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:48.357657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:48.361310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:48.363017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:48.364987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:48.367189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:48.368791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:48.537834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:48.538474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:48.562580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:48.567885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:48.569434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:48.570438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:48.570995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:48.571510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:48.637650 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-34c00bc2-272c-4a86-9965-f8c85b4dca76 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments/e7628d78-193e-456e-ab22-7607b628008d" status: 200 len: 194 microversion: 2.20 time: 0.104977 Oct 29 21:12:48.650250 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2831/5553] 10.222.0.36 () {60 vars in 1454 bytes} [Sat Oct 29 21:12:48 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments/e7628d78-193e-456e-ab22-7607b628008d => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 21:12:48.668027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:48.678587 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab1fa7e0-fed2-4718-ae94-c937c2fb94cc tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1675 microversion: 2.1 time: 0.348301 Oct 29 21:12:48.695281 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2723/5554] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:48 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1675 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:48.781368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:48.782008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:48.789251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:48.789955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:48.790628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:48.791538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:48.792146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:48.795449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:48.974802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lazy-loading 'services' on Instance uuid 01b200c4-ac17-4bbe-957c-2b52a946ffc6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:12:49.116859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments/e7628d78-193e-456e-ab22-7607b628008d" status: 202 len: 0 microversion: 2.20 time: 0.339889 Oct 29 21:12:49.117791 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2832/5555] 10.222.0.36 () {60 vars in 1457 bytes} [Sat Oct 29 21:12:48 2022] DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments/e7628d78-193e-456e-ab22-7607b628008d => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:12:49.128023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:49.131782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:49.142733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:49.143799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:49.157353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:49.159054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:49.159879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:49.161502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:49.238060 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1dedc9de-0811-4ae0-9603-1c00807ae2e5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112027 Oct 29 21:12:49.239781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2724/5556] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 29 21:12:49 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:12:49.708613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:49.709326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:49.727777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:49.728294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:49.728740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:49.729488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:49.732637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:49.733097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:50.253586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:50.256647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:50.274017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:50.274840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:50.276894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:50.277953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:50.278434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:50.295436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:50.406895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ddd10d30-69a4-477a-b537-2d1fdda70e79 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.156914 Oct 29 21:12:50.408641 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2725/5557] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 29 21:12:50 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:50.531249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:50.532165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:50.544683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:50.548550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:50.550588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:50.552604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:50.556843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:50.560605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:50.609841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:12:50.781869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:50.790144 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-94fe5241-1e84-42b9-a347-614fb7e32a49 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 204 len: 0 microversion: 2.20 time: 0.262781 Oct 29 21:12:50.794840 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2726/5558] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:12:50 2022] DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 21:12:50.797973 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a3e099c-d2af-4576-9b4a-1c07e7221058 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1675 microversion: 2.1 time: 1.091597 Oct 29 21:12:50.801435 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2833/5559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:49 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1675 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:50.816995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:50.817818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:50.841283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:50.844500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:50.845979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:50.846746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:50.847229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:50.847677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:51.438410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:51.451067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:51.452528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:51.454613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-083f588d-a5e3-498d-b467-c7916029a495 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.658008 Oct 29 21:12:51.455719 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2727/5560] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:50 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:51.663078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0ba08db6-9a5c-453b-be0d-53802b7d3cef req-98a6e90b-1eaa-46f6-a2a2-d75d80d4a20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881df71f-2007-45b8-9d62-f57352acca7c", "name": "network-vif-deleted", "tag": "6f0beb6b-b472-4d44-9df9-626a0fb5ec71"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:51.684908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0ba08db6-9a5c-453b-be0d-53802b7d3cef req-98a6e90b-1eaa-46f6-a2a2-d75d80d4a20c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:51.685393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0ba08db6-9a5c-453b-be0d-53802b7d3cef req-98a6e90b-1eaa-46f6-a2a2-d75d80d4a20c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:51.685942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0ba08db6-9a5c-453b-be0d-53802b7d3cef req-98a6e90b-1eaa-46f6-a2a2-d75d80d4a20c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:51.711733 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0ba08db6-9a5c-453b-be0d-53802b7d3cef req-98a6e90b-1eaa-46f6-a2a2-d75d80d4a20c service nova] Creating event network-vif-deleted:6f0beb6b-b472-4d44-9df9-626a0fb5ec71 for instance 881df71f-2007-45b8-9d62-f57352acca7c on nch2-master-1 Oct 29 21:12:51.735325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0ba08db6-9a5c-453b-be0d-53802b7d3cef req-98a6e90b-1eaa-46f6-a2a2-d75d80d4a20c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076107 Oct 29 21:12:51.735949 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2834/5561] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:51.824563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:51.825159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:51.838238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:51.839009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:51.839636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:51.840504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:51.841115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:51.841736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:51.992870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:52.011329 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce658c3c-109e-42fb-bf20-a90cfacb79fb tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1607 microversion: 2.1 time: 0.190718 Oct 29 21:12:52.012271 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2728/5562] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:51 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1607 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:52.482662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:52.483383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:52.493733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:52.494172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:52.494789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:52.495689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:52.496623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:52.497257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:53.039579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:53.040293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:53.053151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:53.055532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:53.056223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:53.057196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:53.058701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:53.059359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:53.151761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:53.162011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:53.172355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:53.175284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:53.178470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:53.180038 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f3fbb673-841b-471f-9688-7c4f5501c337 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1726 microversion: 2.20 time: 0.702440 Oct 29 21:12:53.181722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:53.182590 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2835/5563] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:52 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1726 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:53.185201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lazy-loading 'fault' on Instance uuid 881df71f-2007-45b8-9d62-f57352acca7c {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:12:53.345511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c35b0dd86eb14cbbab1732cc96ab2573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4156e1510a489d9f81db09d4b5a404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:53.367523 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b413d23-29f6-46ed-ac4a-b7b90749a747 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 200 len: 1328 microversion: 2.1 time: 0.332095 Oct 29 21:12:53.375336 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2729/5564] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:53 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 1328 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:12:54.218949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:54.222384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:54.241039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:54.246064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:54.252918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:54.256468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:54.258091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:54.259037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:54.401377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:54.402856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] [instance: 881df71f-2007-45b8-9d62-f57352acca7c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:54.418100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:54.418638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:54.422102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:54.423144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:54.423636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:54.424082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:54.489122 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] HTTP exception thrown: Instance 881df71f-2007-45b8-9d62-f57352acca7c could not be found. Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Request method failure captured: Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c HTTP/1.1 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZUo8-WqZDPiLwXg471XrzvsGc2L0XmF2F-L41Hh4OC0NtgIQdq1-LOvbJrhqd-KjADK1hUNlISzKTaNNj-DIpeKvdTLeHVQGSIHO7fZpq3W-Agl3seLWOsM1Aj98HNHjCcNsuQ820EjwSgXA7gtrSGTYNNCuqnI_g9cjwPH53pOr-g Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4f4156e1510a489d9f81db09d4b5a404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 4f4156e1510a489d9f81db09d4b5a404 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1437752161 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c35b0dd86eb14cbbab1732cc96ab2573 Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1437752161-project Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 881df71f-2007-45b8-9d62-f57352acca7c could not be found. Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '881df71f-2007-45b8-9d62-f57352acca7c'} Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881df71f-2007-45b8-9d62-f57352acca7c could not be found. Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881df71f-2007-45b8-9d62-f57352acca7c could not be found. Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:54.495067 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881df71f-2007-45b8-9d62-f57352acca7c could not be found. Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Returning 404 to user: Instance 881df71f-2007-45b8-9d62-f57352acca7c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:54.499180 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4da6071-5253-4ac1-a23e-90e5a281cf64 tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c" status: 404 len: 111 microversion: 2.1 time: 0.100876 Oct 29 21:12:54.504735 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2730/5565] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:12:54 2022] GET /compute/v2.1/servers/881df71f-2007-45b8-9d62-f57352acca7c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:12:54.528077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:54.531843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-31dd5360-84f6-4afb-af6b-815bd47a3b87 req-a8bdccbf-0c4d-47c0-b4ec-e24fb6646bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b200c4-ac17-4bbe-957c-2b52a946ffc6", "name": "network-vif-deleted", "tag": "be4d2fa6-f562-4c72-8c1d-5e2976325116"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:54.543120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:54.547290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:12:54.548555 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4465299-5ddf-494f-81cd-e30b243b8fd7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 200 len: 1658 microversion: 2.20 time: 0.336133 Oct 29 21:12:54.549613 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2836/5566] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:54 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 1658 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:12:54.555596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-31dd5360-84f6-4afb-af6b-815bd47a3b87 req-a8bdccbf-0c4d-47c0-b4ec-e24fb6646bd0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:54.559165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bbf95010-a37a-4c8c-b74f-d14137c26f1d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] Calling method '.version_select at 0x7fa1702bca60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:54.561229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-31dd5360-84f6-4afb-af6b-815bd47a3b87 req-a8bdccbf-0c4d-47c0-b4ec-e24fb6646bd0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:54.566116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-31dd5360-84f6-4afb-af6b-815bd47a3b87 req-a8bdccbf-0c4d-47c0-b4ec-e24fb6646bd0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:54.607997 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-31dd5360-84f6-4afb-af6b-815bd47a3b87 req-a8bdccbf-0c4d-47c0-b4ec-e24fb6646bd0 service nova] Creating event network-vif-deleted:be4d2fa6-f562-4c72-8c1d-5e2976325116 for instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 on nch2-master-1 Oct 29 21:12:54.618566 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-31dd5360-84f6-4afb-af6b-815bd47a3b87 req-a8bdccbf-0c4d-47c0-b4ec-e24fb6646bd0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111001 Oct 29 21:12:54.625111 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2731/5567] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:12:54.626728 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bbf95010-a37a-4c8c-b74f-d14137c26f1d tempest-ServerActionsTestJSON-1437752161 tempest-ServerActionsTestJSON-1437752161-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552241776" status: 202 len: 0 microversion: 2.1 time: 0.073906 Oct 29 21:12:54.627543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2837/5568] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552241776 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:12:55.579422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:55.580706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:12:55.599606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:55.600360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:55.600984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:55.601927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:12:55.602548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:12:55.603132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:12:55.641862 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] HTTP exception thrown: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Request method failure captured: Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 HTTP/1.1 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZZjK7hfuYZtMjnoWEpu4bRzUkfIRqmuHSWp-qgFoTdQC45JSgA6jhl6ZpYs4V-681yl0sOMVKRCfb7nelCJcoSV-vB38MUhy85B5259ZVnajiUMo3U9WHHVJjFjGic-z3laFwuucBkw-oiNSzx4Q6Lo1rkUU0pqSilWCe4XtS4ppPI Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 2c6db5dbdaf2447d8c158f1a8076b290 Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '01b200c4-ac17-4bbe-957c-2b52a946ffc6'} Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:55.644184 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:12:55.648513 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:12:55.649961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Returning 404 to user: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:12:55.650996 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74b16688-2682-4c26-afb7-2e852c2ca168 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 404 len: 111 microversion: 2.20 time: 0.076177 Oct 29 21:12:55.652590 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2732/5569] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:12:55 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:12:55.663556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d916a6f-04f2-4cf3-96a2-daac921e1faa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '.version_select at 0x7fa1701ea4c0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:12:55.724229 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d916a6f-04f2-4cf3-96a2-daac921e1faa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539010666" status: 204 len: 0 microversion: 2.20 time: 0.064901 Oct 29 21:12:55.725052 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2838/5570] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 21:12:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539010666 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:12:58.340535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-111346c2-ef3b-4e5a-afa9-a5d65f0d03c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'create', calling method: .version_select at 0x7fa170c29c10>, body: {"keypair": {"name": "tempest-keypair-1059847928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAaxT+haXUGjZ0PvXImjqCYF94CtIiheV9hjQNP0/wr2l7EudDoPtVJMKHemtR49KXXw5Wi7Oo3/k9znp3dDDsmnB8uXnxRQqsJvm9evI3P0s9/87xej1wp41G/Taq27g=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:12:58.368357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-111346c2-ef3b-4e5a-afa9-a5d65f0d03c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for project fad443ad0828409d8aada4cf90bfc696. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:12:58.376687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-111346c2-ef3b-4e5a-afa9-a5d65f0d03c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for user 2c6db5dbdaf2447d8c158f1a8076b290 and project fad443ad0828409d8aada4cf90bfc696. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:12:58.413346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-111346c2-ef3b-4e5a-afa9-a5d65f0d03c3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.078329 Oct 29 21:12:58.422671 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2733/5571] 10.222.0.36 () {62 vars in 1200 bytes} [Sat Oct 29 21:12:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 21:13:00.939473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:00.939990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:00.951058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:00.951573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:00.953094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:00.957489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:00.958706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:00.959424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:01.070329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:13:01.272563 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0ee00dcf-c0e7-4e65-a4d5-657c44b026db tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 204 len: 0 microversion: 2.1 time: 0.340128 Oct 29 21:13:01.273442 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2839/5572] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:13:00 2022] DELETE /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:13:01.283712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:01.284403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:01.293140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:01.293690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:01.294404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:01.295317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:01.295947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:01.296542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:02.290245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:02.304750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:02.311816 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-325b7a0c-19d5-48c7-8f34-530f644c4856 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1552 microversion: 2.1 time: 1.032688 Oct 29 21:13:02.331756 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2734/5573] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:01 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1552 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:02.345683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:02.347597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:02.363637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:02.364151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:02.371608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:02.372423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:02.375334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:02.375807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:02.459808 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-281b3f07-9edc-47ee-b778-0b00f44c65ae tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/ips" status: 200 len: 150 microversion: 2.1 time: 0.118401 Oct 29 21:13:02.474254 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2840/5574] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:13:02 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/ips => generated 150 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:03.340584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:03.341511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:03.364353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:03.364966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:03.367769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:03.368554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:03.369042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:03.375939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:03.525577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-204645590", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "723f8bfe-b9ea-4cc8-b804-09161edbeffe"}], "security_groups": [{"name": "tempest-securitygroup--2025435634"}], "key_name": "tempest-keypair-1059847928", "user_data": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:04.550359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] validate_networks() for [('723f8bfe-b9ea-4cc8-b804-09161edbeffe', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:13:04.902571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:04.922458 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-86d58894-372e-4c65-8bf3-f342dc088e4f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1552 microversion: 2.1 time: 1.586758 Oct 29 21:13:04.923057 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2735/5575] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:03 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1552 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:04.950618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93c37ec6-3084-4796-8e73-96d84a9ea40a"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:04.953412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:04.979465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:04.980561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:04.982235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:04.984759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:04.985263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:04.985740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:05.498312 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de8e3752-f0bc-486d-a1a6-064406f8ad0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573639 Oct 29 21:13:05.508959 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2736/5576] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:13:04 2022] POST /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:05.950029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:05.953523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:05.961367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:05.962169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:05.962764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:05.964695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:05.966121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:05.968422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:06.875267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:13:06.880911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:13:06.883303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:13:06.884364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:13:06.885175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:13:06.916356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:06.918178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:06.919026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:06.920401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:06.921304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:06.922009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:06.995240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for project fad443ad0828409d8aada4cf90bfc696. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:13:07.000437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:07.011640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Getting quotas for user 2c6db5dbdaf2447d8c158f1a8076b290 and project fad443ad0828409d8aada4cf90bfc696. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:13:07.023964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32aaeffa-be6e-4f7c-bcdc-e0fbdb8d14b3 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 200 len: 1552 microversion: 2.1 time: 1.081187 Oct 29 21:13:07.040038 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2737/5577] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:05 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 1552 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:13:07.084850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:13:07.095175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:13:07.238106 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4e14e7e-7097-416e-9e30-05dbd48e3545 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.707368 Oct 29 21:13:07.242142 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2841/5578] 10.222.0.36 () {62 vars in 1188 bytes} [Sat Oct 29 21:13:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3720 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 21:13:07.270398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8fa18f8-ea51-4df3-b965-ce3e541a911b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:07.271046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8fa18f8-ea51-4df3-b965-ce3e541a911b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:07.518317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-56227288-2f03-42e4-b892-30a8ea663129 req-141144cf-5394-45f5-9756-191a160d8426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7897ff-e84d-4e68-892c-8d499525bbc4", "name": "network-vif-deleted", "tag": "2f2fa565-cdb3-4970-92e1-f611c8a08051"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:07.540100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-56227288-2f03-42e4-b892-30a8ea663129 req-141144cf-5394-45f5-9756-191a160d8426 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:07.540588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-56227288-2f03-42e4-b892-30a8ea663129 req-141144cf-5394-45f5-9756-191a160d8426 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:07.541030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-56227288-2f03-42e4-b892-30a8ea663129 req-141144cf-5394-45f5-9756-191a160d8426 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:07.601738 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-56227288-2f03-42e4-b892-30a8ea663129 req-141144cf-5394-45f5-9756-191a160d8426 service nova] Creating event network-vif-deleted:2f2fa565-cdb3-4970-92e1-f611c8a08051 for instance df7897ff-e84d-4e68-892c-8d499525bbc4 on nch1-master-1 Oct 29 21:13:07.628970 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-56227288-2f03-42e4-b892-30a8ea663129 req-141144cf-5394-45f5-9756-191a160d8426 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583207 Oct 29 21:13:07.632285 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2738/5579] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:07.678350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8fa18f8-ea51-4df3-b965-ce3e541a911b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:07.693597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8fa18f8-ea51-4df3-b965-ce3e541a911b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:07.695222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8fa18f8-ea51-4df3-b965-ce3e541a911b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:07.701391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8fa18f8-ea51-4df3-b965-ce3e541a911b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1281 microversion: 2.20 time: 0.452073 Oct 29 21:13:07.704170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2842/5580] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:07 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1281 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:08.055926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:08.058503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: df7897ff-e84d-4e68-892c-8d499525bbc4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:08.073103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:08.075035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:08.075988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:08.077154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:08.077993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:08.078597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:08.100156 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] HTTP exception thrown: Instance df7897ff-e84d-4e68-892c-8d499525bbc4 could not be found. Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Request method failure captured: Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 HTTP/1.1 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZaw-pwKV7lx_vZ9MWWGNYMSfdxG0aUywVLABClCrFgFZMVTgDpjG0ZaWfSdGw_4pKOZa1x9YF6YVYHTraWkmfXE9tbuWDtA9md7M239zYF9Z3ko_LSmUU4f67HYPxZJU9DBKEtWybMFP5uZENdZ6dYRkEohA-9Svub3rGpBViQ1XpQ Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a7c7f9a81492476983b30fd4984ba3db Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestNetworkBasicOps-781597169 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestNetworkBasicOps-781597169 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a7c7f9a81492476983b30fd4984ba3db Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestNetworkBasicOps-781597169 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestNetworkBasicOps-781597169-project Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ce0a47b4b8bc40178dbfe6545060c467 Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestNetworkBasicOps-781597169-project Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance df7897ff-e84d-4e68-892c-8d499525bbc4 could not be found. Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'df7897ff-e84d-4e68-892c-8d499525bbc4'} Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df7897ff-e84d-4e68-892c-8d499525bbc4 could not be found. Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df7897ff-e84d-4e68-892c-8d499525bbc4 could not be found. Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:13:08.102905 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df7897ff-e84d-4e68-892c-8d499525bbc4 could not be found. Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:13:08.106501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Returning 404 to user: Instance df7897ff-e84d-4e68-892c-8d499525bbc4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:13:08.108500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ed45716-7811-4f44-910a-0cb7e675c97b tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4" status: 404 len: 111 microversion: 2.1 time: 0.058234 Oct 29 21:13:08.113318 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2739/5581] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:08 2022] GET /compute/v2.1/servers/df7897ff-e84d-4e68-892c-8d499525bbc4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:13:08.728611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c75c7418-8f93-426b-8b1b-13b1c43d85e1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:08.731020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c75c7418-8f93-426b-8b1b-13b1c43d85e1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:09.016591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c75c7418-8f93-426b-8b1b-13b1c43d85e1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:09.035132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c75c7418-8f93-426b-8b1b-13b1c43d85e1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:09.044688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c75c7418-8f93-426b-8b1b-13b1c43d85e1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:09.046874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c75c7418-8f93-426b-8b1b-13b1c43d85e1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1281 microversion: 2.20 time: 0.322159 Oct 29 21:13:09.051616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2843/5582] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:08 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:13:09.359346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48bcd8dc-af89-4fee-8823-72de623a8a68 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '.version_select at 0x7fa171e69e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:09.383924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:09.418918 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48bcd8dc-af89-4fee-8823-72de623a8a68 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1567238403" status: 202 len: 0 microversion: 2.1 time: 0.058176 Oct 29 21:13:09.420866 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2740/5583] 10.222.0.36 () {58 vars in 1257 bytes} [Sat Oct 29 21:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1567238403 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:13:10.082697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:10.083329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:10.121355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:10.123055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:10.123707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:10.127018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:10.127804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:10.131950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:10.406482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:10.425994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:10.430629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:10.435442 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f3c99daf-3ff3-45e6-bb3c-517babbfb4fc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1341 microversion: 2.20 time: 0.357935 Oct 29 21:13:10.439726 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2844/5584] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:10 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1341 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:10.857505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9e348020-de75-4061-b166-b270f2be1163 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: .version_select at 0x7fa1710709d0>, body: {"keypair": {"name": "tempest-keypair-310280807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH873/gEcVxZ4surbb1E1N3nEAUZVScQrmePyezQ1Tq39Jk1G5Gr8ppUQgclY4zDtPmW5O093t8kd7h3glpGL8ptuc7P9BNlRm0YYHEv4PthLmIA4IgOMaNxYFYih429EQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:10.877966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9e348020-de75-4061-b166-b270f2be1163 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:13:10.884291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-9e348020-de75-4061-b166-b270f2be1163 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:13:10.919633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9e348020-de75-4061-b166-b270f2be1163 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067123 Oct 29 21:13:10.927555 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2741/5585] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:13:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:11.478630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:11.480371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:11.506650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:11.507242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:11.507691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:11.514471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:11.514970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:11.515419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:11.784319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:11.805448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:11.808259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:11.810946 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-521fce9b-8a56-4df7-b596-dce53505b48f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1339 microversion: 2.20 time: 0.345165 Oct 29 21:13:11.813781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2845/5586] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:11 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1339 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:12.844340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:12.844967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:12.862357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:12.862357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:12.862357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:12.862357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:12.862357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:12.863961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:13.111948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:13.146042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:13.148696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:13.154429 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b1eaf754-ef20-4930-abb0-006dab2f52f5 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1339 microversion: 2.20 time: 0.311491 Oct 29 21:13:13.168912 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2742/5587] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:12 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1339 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:14.189092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:14.190933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:14.215892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:14.216082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:14.216692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:14.238373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:14.238917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:14.239368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:15.399088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:15.430581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:15.436476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:15.438119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e06cfa3-e53e-448b-a014-b80cd39f2bff tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 1.256986 Oct 29 21:13:15.444311 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2846/5588] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:14 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:16.477179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:16.479228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:16.493984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:16.502695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:16.504666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:16.506617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:16.508779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:16.511173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:16.513019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:17.882338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:17.899139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:17.901409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:17.903122 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fb74fcb5-803c-4804-ae54-84ff2748df7d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 1.433930 Oct 29 21:13:17.926138 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2743/5589] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:16 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:18.435818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-39defd05-d361-4580-a121-8a3a4bb2a4e4 req-05ebf1d3-135b-40a2-84b3-bd539c9a096a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f013e213-017a-4b53-8627-b50553dd28bd", "tag": "45d74181-136a-4dd4-9bf0-5816939ceea2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:18.439371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:18.440603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:18.458276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:18.458547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-39defd05-d361-4580-a121-8a3a4bb2a4e4 req-05ebf1d3-135b-40a2-84b3-bd539c9a096a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:18.459044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-39defd05-d361-4580-a121-8a3a4bb2a4e4 req-05ebf1d3-135b-40a2-84b3-bd539c9a096a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:18.459487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-39defd05-d361-4580-a121-8a3a4bb2a4e4 req-05ebf1d3-135b-40a2-84b3-bd539c9a096a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:18.460224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:18.464803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:18.466497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:18.468905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:18.470084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:18.473714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:18.474511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:18.479079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:18.484196 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-39defd05-d361-4580-a121-8a3a4bb2a4e4 req-05ebf1d3-135b-40a2-84b3-bd539c9a096a service nova] Creating event network-changed:45d74181-136a-4dd4-9bf0-5816939ceea2 for instance f013e213-017a-4b53-8627-b50553dd28bd on nch2-master-1 Oct 29 21:13:18.497170 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-39defd05-d361-4580-a121-8a3a4bb2a4e4 req-05ebf1d3-135b-40a2-84b3-bd539c9a096a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065213 Oct 29 21:13:18.498389 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2744/5590] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:18.586168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:13:18.868100 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-17face66-88b2-48a7-bdc5-bbcd986617b5 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 204 len: 0 microversion: 2.1 time: 0.444492 Oct 29 21:13:18.869167 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2847/5591] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:13:18 2022] DELETE /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:13:18.880658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:18.881717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:18.901576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:18.902539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1339943532", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae54bd00-7b0d-4e16-bca3-cda80b70e755"}], "security_groups": [{"name": "tempest-securitygroup--823883635"}], "key_name": "tempest-keypair-310280807", "user_data": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:18.911602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:18.912043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:18.919026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:18.919804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:18.920552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:19.030296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:19.515787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] validate_networks() for [('ae54bd00-7b0d-4e16-bca3-cda80b70e755', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:13:19.752207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:19.771201 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5e34820-3546-4f0f-8a9b-d483ee999ccc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1669 microversion: 2.1 time: 0.895889 Oct 29 21:13:19.772150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2745/5592] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:18 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1669 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:19.777771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:19.791286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:19.810376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:19.811122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:19.811850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:19.812775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:19.813576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:19.817217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:20.882991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:20.907060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:20.987903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:20.994087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:20.999215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f07f9050-5814-4f16-affa-7b792370817d tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 1.222062 Oct 29 21:13:21.004339 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2746/5593] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:19 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:21.024815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-906fd8ab-e1ac-459f-9196-33dd620dd530 req-7d31a69d-f844-438f-aa92-25419d62c136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:21.076238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-906fd8ab-e1ac-459f-9196-33dd620dd530 req-7d31a69d-f844-438f-aa92-25419d62c136 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:21.080871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-906fd8ab-e1ac-459f-9196-33dd620dd530 req-7d31a69d-f844-438f-aa92-25419d62c136 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:21.086488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-906fd8ab-e1ac-459f-9196-33dd620dd530 req-7d31a69d-f844-438f-aa92-25419d62c136 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:21.156344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-906fd8ab-e1ac-459f-9196-33dd620dd530 req-7d31a69d-f844-438f-aa92-25419d62c136 service nova] Creating event network-changed:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch1-master-1 Oct 29 21:13:21.168419 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-906fd8ab-e1ac-459f-9196-33dd620dd530 req-7d31a69d-f844-438f-aa92-25419d62c136 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162892 Oct 29 21:13:21.169196 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2747/5594] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:21.226717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:21.227677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:21.238679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:21.239544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:21.240551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:21.241225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:21.241839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:21.242543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:22.241204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:22.252782 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-40387a7f-b18b-4894-b552-7d5a251da483 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1550 microversion: 2.1 time: 1.064789 Oct 29 21:13:22.256687 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2748/5595] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:21 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1550 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:22.264194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:22.268786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:22.296190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:22.296984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:22.298698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:22.300864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:22.301534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:22.302659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:22.643754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:13:22.645795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:13:22.647149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:13:22.647797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:13:22.649544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:13:22.679050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:22.680159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:22.680941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:22.682148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:22.682930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:22.683654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:22.709973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:22.712553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:13:22.723260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:22.724759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:13:22.725079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:22.729099 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d3c96115-7181-4329-bbe6-eea48389e305 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 0.470936 Oct 29 21:13:22.732019 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2749/5596] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:22 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:22.763014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:13:22.766336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:13:22.866670 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2df3e1a0-fe49-4362-8cef-79a75a9a02cf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.971393 Oct 29 21:13:22.867493 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2848/5597] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:13:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 3974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:13:22.881205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cba01926-bdb1-4a9d-a0c1-ff5ff83b2d7e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:22.881867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cba01926-bdb1-4a9d-a0c1-ff5ff83b2d7e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:23.026371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cba01926-bdb1-4a9d-a0c1-ff5ff83b2d7e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:23.033917 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cba01926-bdb1-4a9d-a0c1-ff5ff83b2d7e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1241 microversion: 2.1 time: 0.156842 Oct 29 21:13:23.037594 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2750/5598] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:22 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:23.286438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:23.287273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:23.297543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:23.306627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:23.308654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:23.309448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:23.309942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:23.313906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:23.384345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b5435646-cd74-4262-9f84-2bd32eb63391 req-dca7ca22-de60-44b4-a48a-e69f3276ad07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f013e213-017a-4b53-8627-b50553dd28bd", "name": "network-vif-deleted", "tag": "45d74181-136a-4dd4-9bf0-5816939ceea2"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:23.457408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b5435646-cd74-4262-9f84-2bd32eb63391 req-dca7ca22-de60-44b4-a48a-e69f3276ad07 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:23.457408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b5435646-cd74-4262-9f84-2bd32eb63391 req-dca7ca22-de60-44b4-a48a-e69f3276ad07 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:23.457408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b5435646-cd74-4262-9f84-2bd32eb63391 req-dca7ca22-de60-44b4-a48a-e69f3276ad07 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:23.498749 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b5435646-cd74-4262-9f84-2bd32eb63391 req-dca7ca22-de60-44b4-a48a-e69f3276ad07 service nova] Creating event network-vif-deleted:45d74181-136a-4dd4-9bf0-5816939ceea2 for instance f013e213-017a-4b53-8627-b50553dd28bd on nch2-master-1 Oct 29 21:13:23.514246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b5435646-cd74-4262-9f84-2bd32eb63391 req-dca7ca22-de60-44b4-a48a-e69f3276ad07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135375 Oct 29 21:13:23.516381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:23.517005 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2751/5599] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:13:23.538776 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-671997c5-4873-48ff-84ae-95c06dca04da tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 200 len: 1482 microversion: 2.1 time: 0.249036 Oct 29 21:13:23.543134 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2849/5600] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:23 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 1482 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:23.762556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:23.764722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:23.784350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:23.785502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:23.786583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:23.788532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:23.790693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:23.794733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:24.059833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:24.061998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:24.089413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:24.090465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:24.091988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:24.098253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:24.098942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:24.099507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:24.288121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:24.300797 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9829319-25ad-48e9-9020-034dba5478d2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1245 microversion: 2.1 time: 0.244816 Oct 29 21:13:24.307469 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2850/5601] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:24 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1245 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:24.314156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:24.337972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:24.340837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:24.356833 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bbfbe1d6-2a8f-47f2-b5d0-7f631faaef7e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 0.601158 Oct 29 21:13:24.358180 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2752/5602] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:23 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:24.569411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:24.570575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: f013e213-017a-4b53-8627-b50553dd28bd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:24.586264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:24.588307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:24.592202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:24.594634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:24.596919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:24.597908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:24.637260 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] HTTP exception thrown: Instance f013e213-017a-4b53-8627-b50553dd28bd could not be found. Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Request method failure captured: Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd HTTP/1.1 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZaw-pwKV7lx_vZ9MWWGNYMSfdxG0aUywVLABClCrFgFZMVTgDpjG0ZaWfSdGw_4pKOZa1x9YF6YVYHTraWkmfXE9tbuWDtA9md7M239zYF9Z3ko_LSmUU4f67HYPxZJU9DBKEtWybMFP5uZENdZ6dYRkEohA-9Svub3rGpBViQ1XpQ Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: a7c7f9a81492476983b30fd4984ba3db Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkBasicOps-781597169 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkBasicOps-781597169 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: a7c7f9a81492476983b30fd4984ba3db Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkBasicOps-781597169 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkBasicOps-781597169-project Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ce0a47b4b8bc40178dbfe6545060c467 Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkBasicOps-781597169-project Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f013e213-017a-4b53-8627-b50553dd28bd could not be found. Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'f013e213-017a-4b53-8627-b50553dd28bd'} Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f013e213-017a-4b53-8627-b50553dd28bd could not be found. Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f013e213-017a-4b53-8627-b50553dd28bd could not be found. Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:13:24.645962 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f013e213-017a-4b53-8627-b50553dd28bd could not be found. Oct 29 21:13:24.650610 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:13:24.655866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Returning 404 to user: Instance f013e213-017a-4b53-8627-b50553dd28bd could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:13:24.659268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-409f9aa7-b736-4fcb-a851-36f866c6974f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd" status: 404 len: 111 microversion: 2.1 time: 0.095010 Oct 29 21:13:24.663308 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2851/5603] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:24 2022] GET /compute/v2.1/servers/f013e213-017a-4b53-8627-b50553dd28bd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:13:25.334926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:25.335552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:25.350496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:25.350845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:25.351297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:25.352023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:25.352487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:25.352924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:25.392201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:25.393627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:25.405104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:25.409478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:25.412951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:25.414982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:25.420672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:25.422097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:25.544515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:25.554138 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4bb0882f-2043-4b4c-95e1-e0d9d5eee37d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1293 microversion: 2.1 time: 0.223262 Oct 29 21:13:25.557725 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2753/5604] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:25 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1293 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:26.583957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:26.585813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:26.599724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:26.601092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:26.610834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:26.611817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:26.613917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:26.614691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:27.102108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:27.115262 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0dfa870e-330d-4a04-a9fd-9bc6f4251ced tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1299 microversion: 2.1 time: 0.535414 Oct 29 21:13:27.126807 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2754/5605] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:26 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1299 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:13:27.133894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b1cc4eb-6116-4322-b3bd-3c26a72b9442 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '.version_select at 0x7fa176354e50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:27.208995 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b1cc4eb-6116-4322-b3bd-3c26a72b9442 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1736691823" status: 202 len: 0 microversion: 2.1 time: 0.067129 Oct 29 21:13:27.216904 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2755/5606] 10.222.0.36 () {58 vars in 1257 bytes} [Sat Oct 29 21:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1736691823 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:13:27.267002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:27.279031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:27.286338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:27.287758 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73120426-c074-401c-8453-7e2192fa1b66 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 1.904746 Oct 29 21:13:27.301625 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2852/5607] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:25 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:28.155147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:28.156685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:28.174472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:28.177118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:28.177877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:28.178619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:28.179088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:28.179528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:28.326676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:28.329685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:28.342833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:28.343928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:28.345204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:28.346882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:28.348012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:28.348879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:28.453334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:28.481284 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-917813e8-7486-45c8-ba37-fc7eecbc5bee tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1299 microversion: 2.1 time: 0.331681 Oct 29 21:13:28.490673 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2756/5608] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:28 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1299 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:28.987082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:29.000297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:29.006185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:29.010992 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff050475-8874-41c1-8d04-e54c03bb1333 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 0.693648 Oct 29 21:13:29.014302 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2853/5609] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:28 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:13:29.523149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:29.526211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:29.535506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:29.536529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:29.537352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:29.538365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:29.539163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:29.540049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:29.563146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:29.719180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:29.730579 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c92e6c1-6237-433c-abcc-f5adbabcd57a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1299 microversion: 2.1 time: 0.211803 Oct 29 21:13:29.734889 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2757/5610] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:29 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:30.043126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:30.043934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:30.059624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:30.062153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:30.063241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:30.065096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:30.065885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:30.066572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:30.549253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:30.585371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:30.598086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:30.603021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9645815f-2bdf-4826-91e2-ac4ceb720916 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 0.566138 Oct 29 21:13:30.639494 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2854/5611] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:30 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:30.761561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:30.762196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:30.772044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:30.772701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:30.778476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:30.781107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:30.781975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:30.783209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:30.959384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ccf44852-f3a0-4b43-8b8f-64ad897fc0a5 req-91a6bad8-86e2-4742-b3fc-f2121f813773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "name": "network-vif-plugged", "status": "completed", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:31.004481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ccf44852-f3a0-4b43-8b8f-64ad897fc0a5 req-91a6bad8-86e2-4742-b3fc-f2121f813773 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:31.008148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ccf44852-f3a0-4b43-8b8f-64ad897fc0a5 req-91a6bad8-86e2-4742-b3fc-f2121f813773 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:31.009718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ccf44852-f3a0-4b43-8b8f-64ad897fc0a5 req-91a6bad8-86e2-4742-b3fc-f2121f813773 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:31.027488 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ccf44852-f3a0-4b43-8b8f-64ad897fc0a5 req-91a6bad8-86e2-4742-b3fc-f2121f813773 service nova] Creating event network-vif-plugged:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch1-master-1 Oct 29 21:13:31.054836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:31.063176 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ccf44852-f3a0-4b43-8b8f-64ad897fc0a5 req-91a6bad8-86e2-4742-b3fc-f2121f813773 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.434567 Oct 29 21:13:31.064693 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2758/5612] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:13:31.070146 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db03ca6a-97ea-4131-a610-4d0a1280bef9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 0.312380 Oct 29 21:13:31.072092 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2855/5613] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:30 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:13:31.647638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:31.648691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:31.670909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:31.671417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:31.671865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:31.676103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:31.678749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:31.686317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:32.111959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:32.114083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:32.136217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:32.137099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:32.137827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:32.138862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:32.139552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:32.140182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:32.415774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:32.487364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:32.491748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:32.498263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-99a77851-05cc-4e6c-bc36-a2a3f2aad780 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1407 microversion: 2.20 time: 0.869491 Oct 29 21:13:32.502928 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2759/5614] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:31 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1407 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:32.682635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:32.692203 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7fbe73f5-0e57-4318-b5a4-6cc10f324551 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 0.597726 Oct 29 21:13:32.693425 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2856/5615] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:32 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:33.455152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1380032702", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "a7848b15-50c3-4b4a-8274-0bbaf4eb118a"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:33.480300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:33.527331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] validate_networks() for [('a7848b15-50c3-4b4a-8274-0bbaf4eb118a', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:13:33.529332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:33.530024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:33.531922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:33.532603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:33.540029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:33.540774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:33.541360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:33.542696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:33.543752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:33.544417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:34.145103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:34.179006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:34.200569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:34.203274 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-daa83c22-dc6e-4038-952c-d56f24c01c9a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1599 microversion: 2.20 time: 0.679163 Oct 29 21:13:34.245833 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2857/5616] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:13:33 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1599 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:13:34.250828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:34.251456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:34.276444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:34.277220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:34.277398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:34.278190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:34.278652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:34.279099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:35.193841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:35.202419 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5b8a22e-5230-4efc-87fb-4c2056952708 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 0.955593 Oct 29 21:13:35.205614 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2858/5617] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:34 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:35.233708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:35.234440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:35.240830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:35.241618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:35.242194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:35.243034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:35.243640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:35.244216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:35.611592 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01d16b2d-9766-4084-b027-501007e844da tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.386011 Oct 29 21:13:35.624695 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2859/5618] 10.222.0.36 () {60 vars in 1316 bytes} [Sat Oct 29 21:13:35 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-interface => generated 284 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:13:35.630641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-05dc4bee-aec2-49de-8319-48232d830a0f req-ecec6dc5-fb03-4431-8104-ed043a005337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9d342d-50ec-49dc-81b7-29794698b5be", "tag": "be4668fc-43f2-469a-8b9b-030637a8b04b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:35.667350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-05dc4bee-aec2-49de-8319-48232d830a0f req-ecec6dc5-fb03-4431-8104-ed043a005337 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:35.671273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-05dc4bee-aec2-49de-8319-48232d830a0f req-ecec6dc5-fb03-4431-8104-ed043a005337 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:35.671914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-05dc4bee-aec2-49de-8319-48232d830a0f req-ecec6dc5-fb03-4431-8104-ed043a005337 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:35.705413 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-05dc4bee-aec2-49de-8319-48232d830a0f req-ecec6dc5-fb03-4431-8104-ed043a005337 service nova] Creating event network-changed:be4668fc-43f2-469a-8b9b-030637a8b04b for instance 9a9d342d-50ec-49dc-81b7-29794698b5be on nch2-master-1 Oct 29 21:13:35.722242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-05dc4bee-aec2-49de-8319-48232d830a0f req-ecec6dc5-fb03-4431-8104-ed043a005337 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095563 Oct 29 21:13:35.727674 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2860/5619] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:35.764030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:13:35.764571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:13:35.765326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:13:35.765888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:13:35.766515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:13:35.788958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:35.790565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:35.792426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:35.793431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:35.796431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:35.797164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:35.833378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Getting quotas for project 10601894adb44985b208c3ab7ffa22c8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:13:35.841330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Getting quotas for user 04bbe6295ba34150b3609466e42c8abd and project 10601894adb44985b208c3ab7ffa22c8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:13:35.861723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:13:35.866581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:13:36.021392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a7934496-a9ee-4c07-afcc-389f121980f4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.568089 Oct 29 21:13:36.025030 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2760/5620] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:13:36.041233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f0442b01-69b3-47f3-a99d-57a569d7fbc8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:36.043109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f0442b01-69b3-47f3-a99d-57a569d7fbc8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:36.142173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f0442b01-69b3-47f3-a99d-57a569d7fbc8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:36.160556 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f0442b01-69b3-47f3-a99d-57a569d7fbc8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1219 microversion: 2.1 time: 0.126435 Oct 29 21:13:36.162641 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2861/5621] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:36 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:36.241802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:36.242526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:36.262760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:36.265975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:36.267565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:36.271933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:36.273437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:36.276588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:36.948782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:36.990417 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a93d8f6c-605c-4368-8238-641f7e11a613 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 0.749902 Oct 29 21:13:37.009493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2761/5622] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:36 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:37.190856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:37.193155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:37.212237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:37.214496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:37.215129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:37.218789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:37.219401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:37.221217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:37.414216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:37.424573 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de447526-4fd7-4614-90e2-99d29b1e300f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1223 microversion: 2.1 time: 0.238951 Oct 29 21:13:37.425760 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2862/5623] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:37 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1223 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:38.021596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:38.023919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:38.045084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:38.048176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:38.050622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:38.051461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:38.053054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:38.054323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:38.452313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:38.453428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:38.472899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:38.475977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:38.478891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:38.481736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:38.483903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:38.486563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:39.099728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:39.111756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-33239aa6-10fd-4af6-877a-2715a5d1edbd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1289 microversion: 2.1 time: 0.664659 Oct 29 21:13:39.129654 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2863/5624] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:38 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1289 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:13:39.145179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:39.158763 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1cc45155-8962-4b44-b926-ed397cbfd260 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 1.145758 Oct 29 21:13:39.173625 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2762/5625] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:38 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:40.135802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:40.137266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:40.150358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:40.152204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:40.157352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:40.158313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:40.159411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:40.160876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:40.402455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:40.414602 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2946b790-ab4b-4ca0-b35b-5a962abc2b8b tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1277 microversion: 2.1 time: 0.283204 Oct 29 21:13:40.434315 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2763/5626] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:40 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:40.448806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:40.454506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:40.467823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:40.468635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:40.469990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:40.470919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:40.473284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:40.475250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:40.538932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8ccb83f4-51d4-4648-a828-3e70293a9876 req-0404cc88-a227-4480-84a9-855b0a1a4985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:40.566958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ccb83f4-51d4-4648-a828-3e70293a9876 req-0404cc88-a227-4480-84a9-855b0a1a4985 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:40.567839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ccb83f4-51d4-4648-a828-3e70293a9876 req-0404cc88-a227-4480-84a9-855b0a1a4985 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:40.568428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8ccb83f4-51d4-4648-a828-3e70293a9876 req-0404cc88-a227-4480-84a9-855b0a1a4985 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:40.603683 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8ccb83f4-51d4-4648-a828-3e70293a9876 req-0404cc88-a227-4480-84a9-855b0a1a4985 service nova] Creating event network-changed:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch1-master-1 Oct 29 21:13:40.621859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8ccb83f4-51d4-4648-a828-3e70293a9876 req-0404cc88-a227-4480-84a9-855b0a1a4985 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.714581 Oct 29 21:13:40.624474 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2864/5627] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:41.383192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6f199afe-bc4c-4b5b-932c-05620ec56016 req-15265239-d4bd-4b17-8e9d-6c0570f25a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9d342d-50ec-49dc-81b7-29794698b5be", "name": "network-vif-plugged", "status": "completed", "tag": "be4668fc-43f2-469a-8b9b-030637a8b04b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:41.418876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6f199afe-bc4c-4b5b-932c-05620ec56016 req-15265239-d4bd-4b17-8e9d-6c0570f25a9f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:41.420244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6f199afe-bc4c-4b5b-932c-05620ec56016 req-15265239-d4bd-4b17-8e9d-6c0570f25a9f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:41.424579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6f199afe-bc4c-4b5b-932c-05620ec56016 req-15265239-d4bd-4b17-8e9d-6c0570f25a9f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:41.469328 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6f199afe-bc4c-4b5b-932c-05620ec56016 req-15265239-d4bd-4b17-8e9d-6c0570f25a9f service nova] Creating event network-vif-plugged:be4668fc-43f2-469a-8b9b-030637a8b04b for instance 9a9d342d-50ec-49dc-81b7-29794698b5be on nch2-master-1 Oct 29 21:13:41.496502 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6f199afe-bc4c-4b5b-932c-05620ec56016 req-15265239-d4bd-4b17-8e9d-6c0570f25a9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123986 Oct 29 21:13:41.499614 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2865/5628] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 21:13:41.518684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:41.520874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:41.549950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:41.561279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:41.563694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:41.564539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:41.568272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:41.568895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:42.483373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:42.494106 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0fb2c002-e430-42ed-b758-f5d75ea4e951 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 2.058392 Oct 29 21:13:42.496250 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2764/5629] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:40 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:42.610282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:42.617766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:42.624171 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b2ebddf6-e6ac-4327-a29b-75d197ad8352 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 1.122999 Oct 29 21:13:42.624841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2866/5630] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:41 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:43.522988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:43.523618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:43.531831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:43.532323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:43.532767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:43.541871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:43.542693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:43.543298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:43.653581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:43.656474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:43.669305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:43.669908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:43.670588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:43.671494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:43.672174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:43.672841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:44.085741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:44.104193 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d1604ac3-0bef-4d94-90ec-0941d5ee6c2e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1366 microversion: 2.1 time: 0.585962 Oct 29 21:13:44.125681 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2765/5631] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:43 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:44.310437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:44.334859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ab4a4c6-04c1-4211-976d-0883d5afc2ac tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.681309 Oct 29 21:13:44.337049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2867/5632] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:43 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:45.131393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:45.132034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:45.144064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:45.144564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:45.145014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:45.145767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:45.146238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:45.146677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:45.366577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:45.367818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:45.384584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:45.389428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:45.390039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:45.391064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:45.391656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:45.399087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:45.817625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:45.851256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:46.029402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:46.051045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:46.065412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afba8f5c-ff71-4df7-9169-8c36966718ea tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1555 microversion: 2.1 time: 0.938349 Oct 29 21:13:46.069472 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8a11d5e-b928-45db-b6b6-d746ff00e32e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.707183 Oct 29 21:13:46.070863 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2868/5633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:45 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:13:46.083121 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2766/5634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:45 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1555 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:46.092597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-beb00b0a-96bb-43f5-b3e8-a73d5f028920 req-94427575-e77c-468d-b107-1818128504b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e25297-46fa-4c71-8331-b780a5ec40e1", "tag": "26456ce6-fce6-449a-b9eb-198d18699e1e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:46.101890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:46.103308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:46.119178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:46.121783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:46.124343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:46.127123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:46.127379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-beb00b0a-96bb-43f5-b3e8-a73d5f028920 req-94427575-e77c-468d-b107-1818128504b4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:46.127792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-beb00b0a-96bb-43f5-b3e8-a73d5f028920 req-94427575-e77c-468d-b107-1818128504b4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:46.128758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:46.130105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:46.139056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-beb00b0a-96bb-43f5-b3e8-a73d5f028920 req-94427575-e77c-468d-b107-1818128504b4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:46.167338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:46.184631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-beb00b0a-96bb-43f5-b3e8-a73d5f028920 req-94427575-e77c-468d-b107-1818128504b4 service nova] Creating event network-changed:26456ce6-fce6-449a-b9eb-198d18699e1e for instance c1e25297-46fa-4c71-8331-b780a5ec40e1 on nch1-master-1 Oct 29 21:13:46.214038 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-beb00b0a-96bb-43f5-b3e8-a73d5f028920 req-94427575-e77c-468d-b107-1818128504b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128535 Oct 29 21:13:46.217991 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2869/5635] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:46.349155 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b96f6c16-7674-4860-a8ac-3b62d5ce02d3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257737 Oct 29 21:13:46.358830 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2767/5636] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:13:46 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:47.097600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:47.098324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:47.111814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:47.112276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:47.112711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:47.116863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:47.117530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:47.118145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:48.392783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:48.401205 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc955447-5ba3-4cac-9cd0-bd084fdd3830 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 1.307763 Oct 29 21:13:48.410907 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2870/5637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:47 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:49.430492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:49.431200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:49.435215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:49.444541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:49.444732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:49.449174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:49.450103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:49.452101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:49.453683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:50.038494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:50.049026 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f9f52ed-7bd5-47e0-ad69-16f723bfac54 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.623269 Oct 29 21:13:50.054549 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2768/5638] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:49 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:50.435711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4f771606-55be-483a-913f-cb18298253a5 req-63baad90-c610-4a23-b962-75730595d7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9d342d-50ec-49dc-81b7-29794698b5be", "tag": "be4668fc-43f2-469a-8b9b-030637a8b04b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:50.449532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:50.459200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4f771606-55be-483a-913f-cb18298253a5 req-63baad90-c610-4a23-b962-75730595d7ad service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:50.459942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4f771606-55be-483a-913f-cb18298253a5 req-63baad90-c610-4a23-b962-75730595d7ad service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:50.461863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4f771606-55be-483a-913f-cb18298253a5 req-63baad90-c610-4a23-b962-75730595d7ad service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:50.491008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4f771606-55be-483a-913f-cb18298253a5 req-63baad90-c610-4a23-b962-75730595d7ad service nova] Creating event network-changed:be4668fc-43f2-469a-8b9b-030637a8b04b for instance 9a9d342d-50ec-49dc-81b7-29794698b5be on nch2-master-1 Oct 29 21:13:50.496858 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4f771606-55be-483a-913f-cb18298253a5 req-63baad90-c610-4a23-b962-75730595d7ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067316 Oct 29 21:13:50.497843 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2871/5639] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:51.083373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:51.084122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:51.104301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:51.106332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:51.106981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:51.109177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:51.112588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:51.118042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:51.299226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0c53ab79-3b80-45cd-9a15-c9c49cd8a93f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'create', calling method: .version_select at 0x7fa170216040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-363465932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4gzF2Z5g4JVvM3bxHS4CS4TxJXLEDXvZ9l+sdG34JqnO1lfX/PlIcENXBUXQUOvOzl46BuIcmJgkktg8s6q5knNJvr7VEKzLDseVUEhLPan1+YnpynfrbvlzCUMsoVRg=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:51.336934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0c53ab79-3b80-45cd-9a15-c9c49cd8a93f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for project a7c7f9a81492476983b30fd4984ba3db. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:13:51.357192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-0c53ab79-3b80-45cd-9a15-c9c49cd8a93f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for user ce0a47b4b8bc40178dbfe6545060c467 and project a7c7f9a81492476983b30fd4984ba3db. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:13:51.449393 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0c53ab79-3b80-45cd-9a15-c9c49cd8a93f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.155466 Oct 29 21:13:51.467626 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2872/5640] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:13:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:13:51.875293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:51.885533 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-78713896-f6cf-4ea2-aee5-5f5472821112 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.809696 Oct 29 21:13:51.891515 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2769/5641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:51 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:52.926229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:52.936788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:53.014191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:53.014940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:53.021834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:53.023772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:53.024507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:53.027636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:53.373918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:53.413159 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-611bc923-3fcb-44e3-9a9c-e9e563056fcf tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.499526 Oct 29 21:13:53.417593 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2873/5642] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:52 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:54.444440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:54.445898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:54.455002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:54.456576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:54.457204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:54.458510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:54.459216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:54.459892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:54.521958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1689858585", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "d713238a-5cf8-4f07-bd67-d5e6972cc7d7"}], "key_name": "tempest-TestNetworkBasicOps-363465932", "security_groups": [{"name": "tempest-secgroup-smoke-1823931884"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:54.799275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] validate_networks() for [('d713238a-5cf8-4f07-bd67-d5e6972cc7d7', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:13:54.956124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:54.976213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c758358a-ea55-4c5a-98bf-9f01be485d34 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.536835 Oct 29 21:13:54.977684 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2770/5643] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:54 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:55.526035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:13:55.527031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:13:55.528271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:13:55.529695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:13:55.530144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:13:55.556355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:55.557424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:55.558076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:55.559022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:55.560496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:55.561132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:55.594581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for project a7c7f9a81492476983b30fd4984ba3db. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:13:55.605884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Getting quotas for user ce0a47b4b8bc40178dbfe6545060c467 and project a7c7f9a81492476983b30fd4984ba3db. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:13:55.623768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:13:55.626215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:13:55.687618 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-152be382-4dc1-4043-8fce-7aca2fcf42d9 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.185786 Oct 29 21:13:55.688494 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2874/5644] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:13:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:13:55.700410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11a96059-c04c-4f51-8413-086e7a9570ed tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:55.701650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11a96059-c04c-4f51-8413-086e7a9570ed tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:55.828429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-11a96059-c04c-4f51-8413-086e7a9570ed tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:55.848352 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11a96059-c04c-4f51-8413-086e7a9570ed tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1248 microversion: 2.1 time: 0.152556 Oct 29 21:13:55.850466 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2771/5645] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:55 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1248 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:56.002649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:56.003791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:56.020881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:56.021749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:56.022405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:56.024573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:56.025721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:56.027789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:56.289657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:56.300463 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4a6fded-8b9d-4c0f-9193-3f7b4ab7ad47 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.301466 Oct 29 21:13:56.315315 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2875/5646] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:55 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:56.875163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:56.876457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:56.890549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:56.893615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:56.894195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:56.910381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:56.910997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:56.911455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:57.055782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:57.075388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fef9073f-f7b3-436b-85e5-178ab55ee22f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1300 microversion: 2.1 time: 0.204270 Oct 29 21:13:57.088492 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2772/5647] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:56 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:57.159246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3c8cd784-b58c-451e-b14e-358e76fc4ca1 req-02452b33-be35-41ad-8364-799fdba7b2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e25297-46fa-4c71-8331-b780a5ec40e1", "name": "network-vif-plugged", "status": "completed", "tag": "26456ce6-fce6-449a-b9eb-198d18699e1e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:57.178533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8cd784-b58c-451e-b14e-358e76fc4ca1 req-02452b33-be35-41ad-8364-799fdba7b2e3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:57.179179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8cd784-b58c-451e-b14e-358e76fc4ca1 req-02452b33-be35-41ad-8364-799fdba7b2e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:57.179622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8cd784-b58c-451e-b14e-358e76fc4ca1 req-02452b33-be35-41ad-8364-799fdba7b2e3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:57.202996 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3c8cd784-b58c-451e-b14e-358e76fc4ca1 req-02452b33-be35-41ad-8364-799fdba7b2e3 service nova] Creating event network-vif-plugged:26456ce6-fce6-449a-b9eb-198d18699e1e for instance c1e25297-46fa-4c71-8331-b780a5ec40e1 on nch1-master-1 Oct 29 21:13:57.229660 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3c8cd784-b58c-451e-b14e-358e76fc4ca1 req-02452b33-be35-41ad-8364-799fdba7b2e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072779 Oct 29 21:13:57.232900 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2876/5648] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:13:57.324430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:57.325066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:57.339111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:57.339623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:57.340071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:57.340804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:57.341354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:57.341744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:58.031464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:58.046254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25a74091-ef03-43ab-b5a8-74ecc22bc07c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.725516 Oct 29 21:13:58.050265 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2773/5649] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:57 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:58.099723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:58.100435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:58.111444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:58.112172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:58.112993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:58.114125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:58.114820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:58.115465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:58.269611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:58.292022 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a5c4a46-f79d-40d2-b448-cd39ecd6bc2f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1306 microversion: 2.1 time: 0.194629 Oct 29 21:13:58.308776 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2877/5650] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:58 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:59.072683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:59.074479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:59.087264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:59.087797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:59.088456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:59.089178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:59.089676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:59.090113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:59.318085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:13:59.319552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:13:59.326632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:59.327205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:59.327706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:59.328477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:59.329188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:59.329888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:59.363415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:59.381519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a8c7d0df-0cb0-4af8-95a6-89b07309d467 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1319 microversion: 2.1 time: 0.313809 Oct 29 21:13:59.382495 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2774/5651] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:59 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:13:59.559940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:13:59.573179 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b84aeac9-87e5-4c10-af67-ca3f2b951ccb tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1374 microversion: 2.1 time: 0.259806 Oct 29 21:13:59.573815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2878/5652] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:13:59 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1374 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:13:59.888509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b4af7184-d683-4fe1-959a-55991d75864a req-f11b1999-6474-4fb3-b51d-9d66cd023743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0e217e-37e2-4920-ada0-ffa546de6c75", "tag": "5fe05de8-ab57-438c-a393-cf01bce10244"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:13:59.918380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b4af7184-d683-4fe1-959a-55991d75864a req-f11b1999-6474-4fb3-b51d-9d66cd023743 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:13:59.918961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b4af7184-d683-4fe1-959a-55991d75864a req-f11b1999-6474-4fb3-b51d-9d66cd023743 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:13:59.920316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b4af7184-d683-4fe1-959a-55991d75864a req-f11b1999-6474-4fb3-b51d-9d66cd023743 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:13:59.938130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=90 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:13:59.940756 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b4af7184-d683-4fe1-959a-55991d75864a req-f11b1999-6474-4fb3-b51d-9d66cd023743 service nova] Creating event network-changed:5fe05de8-ab57-438c-a393-cf01bce10244 for instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 on nch2-master-1 Oct 29 21:13:59.959237 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b4af7184-d683-4fe1-959a-55991d75864a req-f11b1999-6474-4fb3-b51d-9d66cd023743 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064808 Oct 29 21:13:59.963153 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2775/5653] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:00.404256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:00.405920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:00.415598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:00.416134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:00.419657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:00.423305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:00.426412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:00.427394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:00.600339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:00.602666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:00.625245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:00.626432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:00.628767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:00.629995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:00.632577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:00.633788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:00.778334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:00.794814 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4057d7c7-6267-4d6a-868a-0238109adc6a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1509 microversion: 2.1 time: 0.394406 Oct 29 21:14:00.810202 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2879/5654] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:00 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:00.927285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:00.944709 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8788e89b-bff4-4ca7-8156-37d1e9bedb90 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1374 microversion: 2.1 time: 0.351619 Oct 29 21:14:00.946580 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2776/5655] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:00 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1374 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:01.970285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:01.971044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:01.983651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:01.984411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:01.984936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:01.987574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:01.988034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:01.989792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:02.335372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:02.346634 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4fc211a2-dec2-47ce-905a-022b6b2a4e9f tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1374 microversion: 2.1 time: 0.380273 Oct 29 21:14:02.347909 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2880/5656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:01 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1374 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:03.371621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:03.372936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:03.385821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:03.390545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:03.391870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:03.394925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:03.395565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:03.396176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:03.610657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:03.616164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6823076-879e-4467-9be0-aadbacfa9d45", "device": "/dev/sdb"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:03.624809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:03.630625 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af874e6b-4983-4374-8858-65137d1c59ac tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1374 microversion: 2.1 time: 0.262199 Oct 29 21:14:03.633502 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2777/5657] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:03 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1374 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:03.635550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:03.636280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:03.636959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:03.638340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:03.639030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:03.639691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:03.991437 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "POST /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381735 Oct 29 21:14:03.992223 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2881/5658] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:14:03 2022] POST /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:04.657167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:04.657841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:04.668592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:04.671362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:04.673170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:04.676144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:04.676923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:04.679030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:04.933373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-b080d338-6ac6-480f-8231-a8f27bfc08dd req-af3c4cb1-f29b-46d6-b489-7b1a1f5b439d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0e217e-37e2-4920-ada0-ffa546de6c75", "name": "network-vif-plugged", "status": "completed", "tag": "5fe05de8-ab57-438c-a393-cf01bce10244"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:04.959279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b080d338-6ac6-480f-8231-a8f27bfc08dd req-af3c4cb1-f29b-46d6-b489-7b1a1f5b439d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:04.962458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b080d338-6ac6-480f-8231-a8f27bfc08dd req-af3c4cb1-f29b-46d6-b489-7b1a1f5b439d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:04.964383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-b080d338-6ac6-480f-8231-a8f27bfc08dd req-af3c4cb1-f29b-46d6-b489-7b1a1f5b439d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:04.998686 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-b080d338-6ac6-480f-8231-a8f27bfc08dd req-af3c4cb1-f29b-46d6-b489-7b1a1f5b439d service nova] Creating event network-vif-plugged:5fe05de8-ab57-438c-a393-cf01bce10244 for instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 on nch2-master-1 Oct 29 21:14:05.010890 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-b080d338-6ac6-480f-8231-a8f27bfc08dd req-af3c4cb1-f29b-46d6-b489-7b1a1f5b439d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083920 Oct 29 21:14:05.013965 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2882/5659] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:05.126734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:05.148421 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3d3a064e-4359-4d76-b3cb-c47838ab7c20 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1374 microversion: 2.1 time: 0.485830 Oct 29 21:14:05.149117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2778/5660] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:04 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1374 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:06.173889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:06.174985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:06.180178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:06.181044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:06.195695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:06.198125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:06.198916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:06.200608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:06.201089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:06.204144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:06.494340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:06.503915 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-685ac063-5da2-41d3-b040-3598b0749d6c tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1374 microversion: 2.1 time: 0.332142 Oct 29 21:14:06.517618 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2883/5661] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:06 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1374 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:07.531911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:07.532479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:07.536333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:07.552877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:07.553705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:07.554361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:07.558447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:07.558973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:07.559449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:07.769861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:07.784430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-082a09d0-db6c-4e75-a615-b23054052376 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1545 microversion: 2.1 time: 0.258459 Oct 29 21:14:07.784960 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2779/5662] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:07 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1545 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:07.810031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:07.811596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:07.826696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:07.827425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:07.828519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:07.830745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:07.831417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:07.832090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:08.026529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:08.038189 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6d88943e-60da-47bb-a819-aa2ade7da0f1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1545 microversion: 2.1 time: 0.234053 Oct 29 21:14:08.039337 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2884/5663] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:07 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1545 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:11.479892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bdc124fe-bbcc-478f-b9dd-dc7c761c918f req-d976cb82-58af-4e4f-9218-b75d9913c077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0e217e-37e2-4920-ada0-ffa546de6c75", "tag": "5fe05de8-ab57-438c-a393-cf01bce10244"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:11.495509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bdc124fe-bbcc-478f-b9dd-dc7c761c918f req-d976cb82-58af-4e4f-9218-b75d9913c077 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:11.496617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bdc124fe-bbcc-478f-b9dd-dc7c761c918f req-d976cb82-58af-4e4f-9218-b75d9913c077 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:11.497068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bdc124fe-bbcc-478f-b9dd-dc7c761c918f req-d976cb82-58af-4e4f-9218-b75d9913c077 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:11.514954 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bdc124fe-bbcc-478f-b9dd-dc7c761c918f req-d976cb82-58af-4e4f-9218-b75d9913c077 service nova] Creating event network-changed:5fe05de8-ab57-438c-a393-cf01bce10244 for instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 on nch2-master-1 Oct 29 21:14:11.526872 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bdc124fe-bbcc-478f-b9dd-dc7c761c918f req-d976cb82-58af-4e4f-9218-b75d9913c077 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046373 Oct 29 21:14:11.528924 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2780/5664] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:23.124305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:23.126386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:23.130870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:23.132139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:23.151165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.152108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.152920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.153932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.154595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.155220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.208503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a56f0a5d-cd23-4f07-9e5a-593939bf0dfa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/ips" status: 200 len: 148 microversion: 2.1 time: 0.085557 Oct 29 21:14:23.209079 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2885/5665] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:14:23 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/ips => generated 148 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:23.225390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93c37ec6-3084-4796-8e73-96d84a9ea40a"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:23.227555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:23.235129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=27 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:23.235842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=27 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:23.246460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.248562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.250099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.251119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.252685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.253322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.369603 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Invalid volume: volume 93c37ec6-3084-4796-8e73-96d84a9ea40a is already attached to instances: 45e09e57-1dc6-4020-9eb4-494248d61866 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/os-volume_attachments HTTP/1.1 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 74 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: {"volumeAttachment": {"volumeId": "93c37ec6-3084-4796-8e73-96d84a9ea40a"}} Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: exception: Invalid volume: volume 93c37ec6-3084-4796-8e73-96d84a9ea40a is already attached to instances: 45e09e57-1dc6-4020-9eb4-494248d61866 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'server_id': '9a9d342d-50ec-49dc-81b7-29794698b5be', 'body': {'volumeAttachment': {'volumeId': '93c37ec6-3084-4796-8e73-96d84a9ea40a'}}} Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 93c37ec6-3084-4796-8e73-96d84a9ea40a is already attached to instances: 45e09e57-1dc6-4020-9eb4-494248d61866 Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:14:23.372378 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 93c37ec6-3084-4796-8e73-96d84a9ea40a is already attached to instances: 45e09e57-1dc6-4020-9eb4-494248d61866 Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 93c37ec6-3084-4796-8e73-96d84a9ea40a is already attached to instances: 45e09e57-1dc6-4020-9eb4-494248d61866 Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 400 to user: Invalid volume: volume 93c37ec6-3084-4796-8e73-96d84a9ea40a is already attached to instances: 45e09e57-1dc6-4020-9eb4-494248d61866 {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:14:23.376503 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cdc5d15d-4c7e-4ea4-8f9a-cad9df5609e4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.156020 Oct 29 21:14:23.380021 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2781/5666] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:14:23 2022] POST /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:14:23.388402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:23.388919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:23.395779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.396274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.396717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.397423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.405850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.407910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.479360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:14:23.647390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4e32606-faaf-45c6-94ab-615642ee9d4a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 204 len: 0 microversion: 2.1 time: 0.261458 Oct 29 21:14:23.648016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2886/5667] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:14:23 2022] DELETE /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:14:23.659392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:23.660612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:23.672899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.673864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.674605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.675655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:23.676841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:23.677576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:23.996097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:24.013819 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-08e87410-568c-4ade-bf9b-4f63548bd655 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1679 microversion: 2.1 time: 0.360549 Oct 29 21:14:24.015075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2782/5668] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:23 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1679 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:25.040072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:25.041205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:25.056427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:25.056929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:25.057387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:25.070247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:25.070752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:25.071201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:25.315745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:25.324608 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f94163e7-f432-4cc0-a35d-1ad6f564c39c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1679 microversion: 2.1 time: 0.290244 Oct 29 21:14:25.325800 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2887/5669] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:25 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1679 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:26.354868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:26.355501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:26.375063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:26.375568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:26.376501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:26.377625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:26.378117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:26.378535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:26.649048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:26.663707 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0d8b7fff-6e3e-474a-832c-b8af420a8666 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1679 microversion: 2.1 time: 0.313518 Oct 29 21:14:26.666302 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2783/5670] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:26 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1679 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:27.152744 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-344da75e-177d-41fa-9132-7a9abc9454c7 req-6cc40bfd-0677-4c84-bd61-5fefb29dba00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9d342d-50ec-49dc-81b7-29794698b5be", "name": "network-vif-deleted", "tag": "be4668fc-43f2-469a-8b9b-030637a8b04b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:27.170141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-344da75e-177d-41fa-9132-7a9abc9454c7 req-6cc40bfd-0677-4c84-bd61-5fefb29dba00 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:27.184697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-344da75e-177d-41fa-9132-7a9abc9454c7 req-6cc40bfd-0677-4c84-bd61-5fefb29dba00 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:27.187222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-344da75e-177d-41fa-9132-7a9abc9454c7 req-6cc40bfd-0677-4c84-bd61-5fefb29dba00 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:27.238249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-344da75e-177d-41fa-9132-7a9abc9454c7 req-6cc40bfd-0677-4c84-bd61-5fefb29dba00 service nova] Creating event network-vif-deleted:be4668fc-43f2-469a-8b9b-030637a8b04b for instance 9a9d342d-50ec-49dc-81b7-29794698b5be on nch2-master-1 Oct 29 21:14:27.258237 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-344da75e-177d-41fa-9132-7a9abc9454c7 req-6cc40bfd-0677-4c84-bd61-5fefb29dba00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109862 Oct 29 21:14:27.259863 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2888/5671] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:27.691999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:27.692644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:27.706864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:27.708525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:27.710525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:27.714791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:27.717220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:27.718003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:27.771457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:27.772530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:27.773416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:27.774101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lazy-loading 'fault' on Instance uuid 9a9d342d-50ec-49dc-81b7-29794698b5be {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:14:28.369603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:28.377654 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-280251bc-907a-401f-bb8d-7f63a9ed0878 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 200 len: 1331 microversion: 2.1 time: 0.690140 Oct 29 21:14:28.378265 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2784/5672] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:27 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 1331 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:28.573917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Calling method '.version_select at 0x7fa170371ee0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:28.575957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:28.576653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:28.577105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:28.619272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:28.619773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:28.620215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:28.644084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:28.644584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:28.648863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:28.658045 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6b0677c-ae3d-41af-af4c-4581b16cdc50 tempest-PortsAdminExtendedAttrsTestJSON-1117240629 tempest-PortsAdminExtendedAttrsTestJSON-1117240629-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.299974 Oct 29 21:14:28.659233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2889/5673] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 21:14:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:29.405789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:29.407087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:29.415960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:29.416839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:29.417621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:29.418641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:29.420757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:29.421438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:29.439307 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be HTTP/1.1 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9a9d342d-50ec-49dc-81b7-29794698b5be'} Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:29.441173 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14a8314e-75b1-4be2-8621-685ca88a020c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 404 len: 111 microversion: 2.1 time: 0.041326 Oct 29 21:14:29.444890 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2785/5674] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:29 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:14:29.454725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b92d55d-d320-484f-bbdd-5e7fb5828b0d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '.version_select at 0x7fa1701c9280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:29.482923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b92d55d-d320-484f-bbdd-5e7fb5828b0d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310280807" status: 202 len: 0 microversion: 2.1 time: 0.034660 Oct 29 21:14:29.484699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2890/5675] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310280807 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:14:30.753394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:30.754744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:30.762161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:30.762705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:30.763154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:30.764066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:30.764694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:30.765364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:30.874063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lazy-loading 'services' on Instance uuid 45e09e57-1dc6-4020-9eb4-494248d61866 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:14:30.966594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e7041b13-b9d6-49ad-a517-77c58702816f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments/93c37ec6-3084-4796-8e73-96d84a9ea40a" status: 202 len: 0 microversion: 2.1 time: 0.217980 Oct 29 21:14:30.967886 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2786/5676] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:14:30 2022] DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments/93c37ec6-3084-4796-8e73-96d84a9ea40a => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:14:30.977176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:30.980754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:30.997020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:31.000434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:31.000902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:31.001689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:31.005607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:31.006019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:31.078041 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8dd18f76-30e7-4a68-b2c6-efe54239aedd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105851 Oct 29 21:14:31.078888 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2891/5677] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:14:30 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:32.092318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:32.094736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:32.108837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:32.109852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:32.110462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:32.111514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:32.111985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:32.112416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:32.154217 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d14c1de6-677d-4fd1-be44-6ad9a5b8f2e9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067096 Oct 29 21:14:32.156974 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2787/5678] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:14:32 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:14:32.252118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:32.252118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:32.259549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:32.260509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:32.261239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:32.262131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:32.262751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:32.263289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:32.303189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:14:32.414075 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-177e4821-9147-4a07-975e-36fb92ab23fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 204 len: 0 microversion: 2.1 time: 0.168422 Oct 29 21:14:32.414684 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2892/5679] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:14:32 2022] DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:14:32.424579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:32.425233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:32.437724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:32.439078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:32.439931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:32.441253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:32.442330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:32.443023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:32.763185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:32.772362 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fcb52161-4a6f-4bb2-b606-dc07a74873b5 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1680 microversion: 2.1 time: 0.352035 Oct 29 21:14:32.774870 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2788/5680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:32 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1680 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:33.800512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:33.803449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:33.813472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:33.814389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:33.815086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:33.816937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:33.818175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:33.819078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:34.170390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:34.183083 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-28a66a2d-acd2-4717-828d-5cfc1774ffd9 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1680 microversion: 2.1 time: 0.387907 Oct 29 21:14:34.184594 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2893/5681] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:33 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1680 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:34.257361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:34.259864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:34.277272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:34.278058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:34.278693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:34.279619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:34.280256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:34.280690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:34.347801 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a541b77-9f1b-434d-92ce-20b5cadba5f6 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75/action" status: 200 len: 24567 microversion: 2.1 time: 0.094662 Oct 29 21:14:34.348465 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2789/5682] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:14:34 2022] POST /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75/action => generated 24567 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:14:35.210161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:35.211703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:35.229017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:35.230058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:35.230767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:35.231767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:35.232584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:35.234529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:35.537536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:35.546996 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83a3fae2-74f5-4986-a7f7-52d62bd02b0a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1612 microversion: 2.1 time: 0.342605 Oct 29 21:14:35.548149 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2894/5683] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:35 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1612 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:35.792599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0dabbe12-4492-4beb-b3c5-8462cac08d69 req-4f5b7ac1-ffe1-42ef-8bb2-d1e5b5e23522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e09e57-1dc6-4020-9eb4-494248d61866", "name": "network-vif-deleted", "tag": "911ade1f-40a7-4bc1-88b1-5b3d9b924130"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:35.811239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0dabbe12-4492-4beb-b3c5-8462cac08d69 req-4f5b7ac1-ffe1-42ef-8bb2-d1e5b5e23522 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:35.811732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0dabbe12-4492-4beb-b3c5-8462cac08d69 req-4f5b7ac1-ffe1-42ef-8bb2-d1e5b5e23522 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:35.812181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0dabbe12-4492-4beb-b3c5-8462cac08d69 req-4f5b7ac1-ffe1-42ef-8bb2-d1e5b5e23522 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:35.826935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0dabbe12-4492-4beb-b3c5-8462cac08d69 req-4f5b7ac1-ffe1-42ef-8bb2-d1e5b5e23522 service nova] Creating event network-vif-deleted:911ade1f-40a7-4bc1-88b1-5b3d9b924130 for instance 45e09e57-1dc6-4020-9eb4-494248d61866 on nch2-master-1 Oct 29 21:14:35.844289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0dabbe12-4492-4beb-b3c5-8462cac08d69 req-4f5b7ac1-ffe1-42ef-8bb2-d1e5b5e23522 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055683 Oct 29 21:14:35.858367 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2790/5684] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:36.574753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:36.575631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:36.596684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:36.606277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:36.606899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:36.610047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:36.610681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:36.614653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:36.708549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:36.710451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:36.711037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:36.713377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lazy-loading 'fault' on Instance uuid 45e09e57-1dc6-4020-9eb4-494248d61866 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:14:36.822235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:36.831044 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63a10c16-8a9c-4f20-bcfc-c00dbc565ecb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 200 len: 1329 microversion: 2.1 time: 0.263716 Oct 29 21:14:36.831631 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2895/5685] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:36 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 1329 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:37.859717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:37.861222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:37.869488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:37.870244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:37.870852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:37.871742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:37.872370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:37.872968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:37.888398 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 HTTP/1.1 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '45e09e57-1dc6-4020-9eb4-494248d61866'} Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:37.894267 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:14:37.898405 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f5a70f7d-d9f4-4ecd-a1db-695a4a861735 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 404 len: 111 microversion: 2.1 time: 0.040331 Oct 29 21:14:37.905209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-624e4387-888c-4dc2-87b9-4d318a697e10 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '.version_select at 0x7fa17111da60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:37.913400 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2791/5686] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:37 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:14:37.950979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-624e4387-888c-4dc2-87b9-4d318a697e10 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-895914995" status: 202 len: 0 microversion: 2.1 time: 0.049819 Oct 29 21:14:37.951602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2896/5687] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-895914995 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:14:40.020589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3dbbf6f5-d54f-4eca-97a6-c55d84206d3b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: .version_select at 0x7fa1762a1940>, body: {"keypair": {"name": "tempest-keypair-805296114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPHbLak7X4+ZnEx5n3JoEZaxMYzLRAQDKGR1sa+jrRDyw0Av4u8WDuI2l9UYiqdh/FsyLV8TpL903TPKdckGPQwtJCvCfb8btRnNvykNSDSXi1EndhHgH/ao/xh8XZi/Q=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:40.064705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-3dbbf6f5-d54f-4eca-97a6-c55d84206d3b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:14:40.085207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-3dbbf6f5-d54f-4eca-97a6-c55d84206d3b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:14:40.127341 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3dbbf6f5-d54f-4eca-97a6-c55d84206d3b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111447 Oct 29 21:14:40.128535 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2792/5688] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:14:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:41.908096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:41.909024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:41.932765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:41.934107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:41.936592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:41.937645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:41.939444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:41.940079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:42.004713 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6529a886-27a7-462e-9c7c-269877085726 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/ips" status: 200 len: 152 microversion: 2.20 time: 0.471590 Oct 29 21:14:42.011900 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2897/5689] 10.222.0.36 () {60 vars in 1289 bytes} [Sat Oct 29 21:14:41 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/ips => generated 152 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:14:42.675384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1261563090", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae54bd00-7b0d-4e16-bca3-cda80b70e755"}], "security_groups": [{"name": "tempest-securitygroup--2108737578"}], "key_name": "tempest-keypair-805296114", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:42.849951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] validate_networks() for [('ae54bd00-7b0d-4e16-bca3-cda80b70e755', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:14:43.467300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:14:43.468186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:14:43.469393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:14:43.469996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:14:43.470633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:14:43.497345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:43.498091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:43.498697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:43.499447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:43.500002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:43.500720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:43.521728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:14:43.527744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:14:43.541987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:14:43.544405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:14:43.597503 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a7117c8-db5d-4903-957c-a8eca9616e93 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.927669 Oct 29 21:14:43.598173 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2793/5690] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:14:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:14:43.611411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7dc942ab-2983-403a-bccf-3623ac2c7712 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:43.612388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7dc942ab-2983-403a-bccf-3623ac2c7712 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:43.772604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dc942ab-2983-403a-bccf-3623ac2c7712 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:43.805021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7dc942ab-2983-403a-bccf-3623ac2c7712 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1241 microversion: 2.1 time: 0.198126 Oct 29 21:14:43.806498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2898/5691] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:43 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:14:44.387800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:44.389057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:44.403711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:44.404251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:44.404700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:44.405836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:44.407897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:44.408516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:44.456458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lazy-loading 'flavor' on Instance uuid 803f923d-9ffa-416b-9eb2-6eb03cdefa47 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:14:44.803208 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d80e3485-2ae1-4a4f-8ae0-52bc2c4310a1 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/action" status: 202 len: 0 microversion: 2.20 time: 0.422369 Oct 29 21:14:44.803947 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2794/5692] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 21:14:44 2022] POST /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:14:44.813923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:44.814549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:44.830286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:44.832150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:44.834563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:44.837353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:44.841190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:44.845843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:44.846458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:44.848188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:44.854499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:44.859945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:44.865831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:44.866860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:44.871349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:44.875444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:45.354226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:45.364826 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91f702a3-2e9f-4320-8cf2-d1ae96b1e128 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1293 microversion: 2.1 time: 0.539742 Oct 29 21:14:45.365418 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2795/5693] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:44 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1293 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:14:45.474330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:45.476954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:45.492563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:45.495415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:45.496281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:45.498631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:45.502482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:45.503673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:45.526260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:45.537848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:45.546051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:45.550443 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5383122d-8484-4199-888a-d34febdfb6d8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.739835 Oct 29 21:14:45.551170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2899/5694] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:44 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:45.591687 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b3f754f1-5715-4dfb-aa10-52983b99259a tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "POST /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75/action" status: 200 len: 32644 microversion: 2.1 time: 0.122552 Oct 29 21:14:45.593977 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2796/5695] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:14:45 2022] POST /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75/action => generated 32644 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 21:14:46.394000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:46.395517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:46.412569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:46.426311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:46.426311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:46.426311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:46.426311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:46.426311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:46.568326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:46.580832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:46.581944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:46.592669 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-77c2f021-021e-418e-a0d6-d08d0e29aab2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1299 microversion: 2.1 time: 0.203715 Oct 29 21:14:46.597886 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2900/5696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:46 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:46.600235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:46.600735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:46.601188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:46.601931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:46.602944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:46.603376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:46.879449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:46.892729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:46.895398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:46.898562 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a52bdcc1-1847-4bd4-a591-ff15912c1eb0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.320735 Oct 29 21:14:46.900026 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2797/5697] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:46 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:47.617260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:47.618942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:47.635847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:47.636357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:47.636802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:47.637557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:47.638018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:47.638457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:47.915858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:47.924528 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-016220a2-49d6-4c87-b239-b9431997eb73 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 0.312119 Oct 29 21:14:47.926830 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2901/5698] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:47 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:47.933399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:47.934133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:47.961831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:47.962524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:47.963047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:47.963897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:47.964427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:47.964937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:48.190531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:48.194421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:48.220434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c9f9aa09-e201-4d55-af73-e36c54a5b790 req-1d207da7-67f3-4b6a-8fda-e01effb0b4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159937a6-f756-4d55-8fb8-f3f25abd05ed", "tag": "49360250-760c-408e-8e33-580b89bc56c7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:48.225079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:48.226889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:48.233543 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05dc7d34-380d-4daf-bfa2-063045da5bf4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.311605 Oct 29 21:14:48.234756 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2798/5699] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:47 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:14:48.240809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c9f9aa09-e201-4d55-af73-e36c54a5b790 req-1d207da7-67f3-4b6a-8fda-e01effb0b4df service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:48.241333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c9f9aa09-e201-4d55-af73-e36c54a5b790 req-1d207da7-67f3-4b6a-8fda-e01effb0b4df service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:48.243428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c9f9aa09-e201-4d55-af73-e36c54a5b790 req-1d207da7-67f3-4b6a-8fda-e01effb0b4df service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:48.253194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:48.270144 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c9f9aa09-e201-4d55-af73-e36c54a5b790 req-1d207da7-67f3-4b6a-8fda-e01effb0b4df service nova] Creating event network-changed:49360250-760c-408e-8e33-580b89bc56c7 for instance 159937a6-f756-4d55-8fb8-f3f25abd05ed on nch1-master-1 Oct 29 21:14:48.275688 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c9f9aa09-e201-4d55-af73-e36c54a5b790 req-1d207da7-67f3-4b6a-8fda-e01effb0b4df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059671 Oct 29 21:14:48.276881 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2902/5700] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:14:48.948618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:48.949980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:48.957153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:48.958025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:48.958732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:48.959680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:48.960368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:48.961024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.128314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:49.129480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:49.137086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.137873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.138480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.139353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.139964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.140555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.173285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:14:49.190072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:49.202181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe064e5c-95d4-4be9-9d76-9e2020bbbd81 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 0.257223 Oct 29 21:14:49.223691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2799/5701] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:48 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:49.229042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4f0bc685-62bb-4a2e-8745-adcef1f277f7 req-30d816c5-19c5-4220-a118-83c48fab28be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0e217e-37e2-4920-ada0-ffa546de6c75", "tag": "5fe05de8-ab57-438c-a393-cf01bce10244"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:49.265570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4f0bc685-62bb-4a2e-8745-adcef1f277f7 req-30d816c5-19c5-4220-a118-83c48fab28be service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.266065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4f0bc685-62bb-4a2e-8745-adcef1f277f7 req-30d816c5-19c5-4220-a118-83c48fab28be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.266511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4f0bc685-62bb-4a2e-8745-adcef1f277f7 req-30d816c5-19c5-4220-a118-83c48fab28be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.297111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4f0bc685-62bb-4a2e-8745-adcef1f277f7 req-30d816c5-19c5-4220-a118-83c48fab28be service nova] Creating event network-changed:5fe05de8-ab57-438c-a393-cf01bce10244 for instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 on nch2-master-1 Oct 29 21:14:49.307553 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4f0bc685-62bb-4a2e-8745-adcef1f277f7 req-30d816c5-19c5-4220-a118-83c48fab28be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082006 Oct 29 21:14:49.310605 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2800/5702] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:49.321945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:49.325421 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e79e042a-3e50-4500-af9f-1d84c51168a1 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 204 len: 0 microversion: 2.1 time: 0.202632 Oct 29 21:14:49.329996 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2903/5703] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:14:49 2022] DELETE /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:14:49.333432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:49.338570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:49.343516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:49.345278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.348867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.349570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.352409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.353251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.353987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.359509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.360193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.361116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.361894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:49.362419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:49.362796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:49.627139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:49.644975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:49.646899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:49.647948 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d3c1571c-240d-4c2b-b59b-e221968a87f8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.336201 Oct 29 21:14:49.648521 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2801/5704] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:49 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:49.716844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:49.730963 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc8fa8b2-1fed-4c8c-a25f-54260b51507e tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1670 microversion: 2.1 time: 0.399027 Oct 29 21:14:49.732108 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2904/5705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:49 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:50.225672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:50.226904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:50.244278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:50.245537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:50.247767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:50.249490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:50.250885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:50.251556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:50.596818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:50.621299 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-705660e9-dc53-4785-ab05-79638ee25ede tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 0.400741 Oct 29 21:14:50.624129 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2802/5706] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:50 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:50.680222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:50.680731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:50.692687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:50.698591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:50.699315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:50.704805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:50.705593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:50.706183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:50.764588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:50.765922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:50.773255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:50.774591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:50.775227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:50.776104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:50.776717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:50.777298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:51.671264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:51.691098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:51.700141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:51.702589 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b6bdedc-1ccd-4ea2-ba81-468b19bcb079 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 1.028290 Oct 29 21:14:51.703756 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2905/5707] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:50 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:51.709109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:51.710078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:51.731628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:51.733582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:51.734306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:51.735290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:51.739606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:51.740466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:51.936186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:51.964656 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3051e9ca-fe39-4ef6-ae74-641a5d162594 tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1670 microversion: 2.1 time: 1.204198 Oct 29 21:14:51.981554 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2803/5708] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:50 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1670 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:14:52.709167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:52.719848 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-770653b3-a0d1-4549-a17f-108b6d2dea4d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 1.014669 Oct 29 21:14:52.724108 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2906/5709] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:51 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:52.728631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:52.729261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:52.745714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:52.746293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:52.746765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:52.747563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:52.748209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:52.749705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:52.992478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:52.994065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:53.009799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:53.010843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:53.011736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:53.012695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:53.013611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:53.015052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:53.513291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:53.518574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:53.535927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:53.538606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:53.540260 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-85f4ccd5-ad4f-40fb-843f-12c771e39555 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.815788 Oct 29 21:14:53.541263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2804/5710] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:52 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:53.744820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0a47b4b8bc40178dbfe6545060c467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c7f9a81492476983b30fd4984ba3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:53.749636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=10 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:53.756732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c13cf4e5-5b53-44a1-b71a-7f2b3803feee tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 200 len: 1551 microversion: 2.1 time: 0.770305 Oct 29 21:14:53.761369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:53.761602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2907/5711] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:52 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 1551 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:14:53.762925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:53.766261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:53.803058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:53.804101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:53.805993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:53.815284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:53.818437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:53.819165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:53.898968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-90851818-9f0a-4caa-929f-dd3cd14b8cc9 req-a2399791-1a66-4051-be98-da2fb5d66b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0e217e-37e2-4920-ada0-ffa546de6c75", "name": "network-vif-deleted", "tag": "5fe05de8-ab57-438c-a393-cf01bce10244"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:53.909568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:53.912526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:14:53.924793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-90851818-9f0a-4caa-929f-dd3cd14b8cc9 req-a2399791-1a66-4051-be98-da2fb5d66b41 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:53.925308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-90851818-9f0a-4caa-929f-dd3cd14b8cc9 req-a2399791-1a66-4051-be98-da2fb5d66b41 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:53.929267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-90851818-9f0a-4caa-929f-dd3cd14b8cc9 req-a2399791-1a66-4051-be98-da2fb5d66b41 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:53.965944 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-90851818-9f0a-4caa-929f-dd3cd14b8cc9 req-a2399791-1a66-4051-be98-da2fb5d66b41 service nova] Creating event network-vif-deleted:5fe05de8-ab57-438c-a393-cf01bce10244 for instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 on nch2-master-1 Oct 29 21:14:53.979365 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-90851818-9f0a-4caa-929f-dd3cd14b8cc9 req-a2399791-1a66-4051-be98-da2fb5d66b41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085758 Oct 29 21:14:53.985334 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2908/5712] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:54.268451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:54.281753 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4759ca7c-9578-46b5-a554-ee6938ebda74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 0.534731 Oct 29 21:14:54.297113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2805/5713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:53 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:54.565982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:54.566700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:54.583844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:54.584350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:54.584792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:54.585537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:54.586174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:54.587316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:54.788031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:54.788982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] [instance: 4b0e217e-37e2-4920-ada0-ffa546de6c75] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:54.803115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:54.805892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:54.806633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:54.808497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:54.809323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:54.810062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:54.838394 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] HTTP exception thrown: Instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 could not be found. Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Request method failure captured: Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 HTTP/1.1 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZaw-pwKV7lx_vZ9MWWGNYMSfdxG0aUywVLABClCrFgFZMVTgDpjG0ZaWfSdGw_4pKOZa1x9YF6YVYHTraWkmfXE9tbuWDtA9md7M239zYF9Z3ko_LSmUU4f67HYPxZJU9DBKEtWybMFP5uZENdZ6dYRkEohA-9Svub3rGpBViQ1XpQ Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: a7c7f9a81492476983b30fd4984ba3db Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestNetworkBasicOps-781597169 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a7c7f9a81492476983b30fd4984ba3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestNetworkBasicOps-781597169 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: a7c7f9a81492476983b30fd4984ba3db Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestNetworkBasicOps-781597169 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestNetworkBasicOps-781597169-project Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ce0a47b4b8bc40178dbfe6545060c467 Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestNetworkBasicOps-781597169-project Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 could not be found. Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '4b0e217e-37e2-4920-ada0-ffa546de6c75'} Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 could not be found. Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 could not be found. Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:14:54.840401 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 could not be found. Oct 29 21:14:54.845329 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:14:54.846860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Returning 404 to user: Instance 4b0e217e-37e2-4920-ada0-ffa546de6c75 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:14:54.847975 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26529ff5-67be-4a8a-ab9a-83ad309030de tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75" status: 404 len: 111 microversion: 2.1 time: 0.069841 Oct 29 21:14:54.852207 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2806/5714] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:54 2022] GET /compute/v2.1/servers/4b0e217e-37e2-4920-ada0-ffa546de6c75 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:14:54.957326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:54.972066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:54.975534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:54.977009 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ea4e309-f5a0-40f4-8bd1-371abe71d72a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.415356 Oct 29 21:14:54.977616 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2909/5715] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:54 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:55.305947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:55.306829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:55.313939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:55.314627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:55.315249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:55.317233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:55.317910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:55.318531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:55.338701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53937725-3f20-4c7f-9254-ffd670edcabc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] Calling method '.version_select at 0x7fa1763aa9d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:55.372959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53937725-3f20-4c7f-9254-ffd670edcabc tempest-TestNetworkBasicOps-781597169 tempest-TestNetworkBasicOps-781597169-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-363465932" status: 202 len: 0 microversion: 2.1 time: 0.041761 Oct 29 21:14:55.375319 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2910/5716] 10.222.0.36 () {58 vars in 1254 bytes} [Sat Oct 29 21:14:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-363465932 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:14:55.386511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a9a746c7-ec95-4437-a355-797812f1c7d7 req-972ddf08-afc8-431c-8641-1db73266a700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159937a6-f756-4d55-8fb8-f3f25abd05ed", "name": "network-vif-plugged", "status": "completed", "tag": "49360250-760c-408e-8e33-580b89bc56c7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:14:55.418785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a9a746c7-ec95-4437-a355-797812f1c7d7 req-972ddf08-afc8-431c-8641-1db73266a700 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:55.419896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a9a746c7-ec95-4437-a355-797812f1c7d7 req-972ddf08-afc8-431c-8641-1db73266a700 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:55.420570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a9a746c7-ec95-4437-a355-797812f1c7d7 req-972ddf08-afc8-431c-8641-1db73266a700 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:55.452282 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a9a746c7-ec95-4437-a355-797812f1c7d7 req-972ddf08-afc8-431c-8641-1db73266a700 service nova] Creating event network-vif-plugged:49360250-760c-408e-8e33-580b89bc56c7 for instance 159937a6-f756-4d55-8fb8-f3f25abd05ed on nch1-master-1 Oct 29 21:14:55.458455 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a9a746c7-ec95-4437-a355-797812f1c7d7 req-972ddf08-afc8-431c-8641-1db73266a700 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081111 Oct 29 21:14:55.459662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2911/5717] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:14:56.005818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:56.006540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:56.025869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:56.026514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:56.027061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:56.028045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:56.028666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:56.029236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:56.319484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:56.344166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9a300cd0-c6b5-4656-ac1b-e3024576ffe1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 1.042426 Oct 29 21:14:56.345499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2807/5718] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:55 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:56.491314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:56.502159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:56.504332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:56.505932 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8057df22-c2a6-405c-afc5-549e4c068e46 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.505457 Oct 29 21:14:56.506801 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2912/5719] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:55 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:14:57.368060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:57.368841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:57.375608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:57.376311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:57.376920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:57.377837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:57.378440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:57.379018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:57.539003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:57.541495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:57.556392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:57.561173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:57.566329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:57.567123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:57.567631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:57.568069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:57.817246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:57.831213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f510be2d-84f7-4858-ae0f-b94c1eae3984 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1367 microversion: 2.1 time: 0.467072 Oct 29 21:14:57.832357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2808/5720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:57 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:57.982779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:58.001080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:58.002583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:58.004677 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b1f1b28-5e13-4b74-8b04-ec15f6a5ab78 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1745 microversion: 2.20 time: 0.474551 Oct 29 21:14:58.017994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2913/5721] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:57 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1745 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:14:58.861673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:58.863345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:58.874295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:58.875486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:58.876093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:58.877442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:58.879217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:58.880802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:59.032266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:59.032879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:59.040440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:59.041242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:59.041948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:59.042893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:59.043557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:59.044184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:59.323871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:59.341152 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b556d33-d6f1-4746-8125-8e5b5dc850f2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1557 microversion: 2.1 time: 0.485268 Oct 29 21:14:59.358385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2809/5722] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:14:58 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1557 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:14:59.375035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:14:59.377105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:14:59.385596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:59.386098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:59.386544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:59.387443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:14:59.387911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:14:59.388430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:14:59.412442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:59.425873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:59.435074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:14:59.436912 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d03267bb-41a6-4ca4-a061-102d0a1b269a tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1745 microversion: 2.20 time: 0.408428 Oct 29 21:14:59.438759 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2914/5723] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:14:59 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1745 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:14:59.606793 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27459662-15d8-442f-ad38-55fdba1cb344 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237836 Oct 29 21:14:59.610710 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2810/5724] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:14:59 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-interface => generated 285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:15:00.469384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:00.470243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:00.513857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:00.515674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:00.516363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:00.518092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:00.534100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:00.535501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:01.650895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:01.663310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:01.670039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:01.671304 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9158596-c665-4f1c-bf31-ed0a737cd914 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1745 microversion: 2.20 time: 1.207484 Oct 29 21:15:01.690350 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2915/5725] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:00 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1745 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:01.692863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-10786616-2414-4a89-bcd6-5c11dc9ee1f2 req-d5dabf3b-18d5-442a-80dc-f62b25022028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "name": "network-vif-plugged", "status": "completed", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:01.708775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-10786616-2414-4a89-bcd6-5c11dc9ee1f2 req-d5dabf3b-18d5-442a-80dc-f62b25022028 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:01.709894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-10786616-2414-4a89-bcd6-5c11dc9ee1f2 req-d5dabf3b-18d5-442a-80dc-f62b25022028 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:01.714424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-10786616-2414-4a89-bcd6-5c11dc9ee1f2 req-d5dabf3b-18d5-442a-80dc-f62b25022028 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:01.739171 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-10786616-2414-4a89-bcd6-5c11dc9ee1f2 req-d5dabf3b-18d5-442a-80dc-f62b25022028 service nova] Creating event network-vif-plugged:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch1-master-1 Oct 29 21:15:01.753306 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-10786616-2414-4a89-bcd6-5c11dc9ee1f2 req-d5dabf3b-18d5-442a-80dc-f62b25022028 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068430 Oct 29 21:15:01.753971 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2811/5726] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:15:02.717127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:02.718554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:02.738667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:02.744347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:02.745141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:02.750210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:02.750876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:02.751309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:03.202706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:03.253831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:03.261412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:03.272528 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8afe3924-8f91-4965-a383-ee619d76935c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.578006 Oct 29 21:15:03.274044 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2916/5727] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:02 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:15:03.800552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c8bd4560-79d8-483b-b05b-122fda026564 req-b440f637-abb6-45fd-904c-2eeced984f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159937a6-f756-4d55-8fb8-f3f25abd05ed", "tag": "49360250-760c-408e-8e33-580b89bc56c7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:03.848253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c8bd4560-79d8-483b-b05b-122fda026564 req-b440f637-abb6-45fd-904c-2eeced984f91 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:03.851839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c8bd4560-79d8-483b-b05b-122fda026564 req-b440f637-abb6-45fd-904c-2eeced984f91 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:03.854981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c8bd4560-79d8-483b-b05b-122fda026564 req-b440f637-abb6-45fd-904c-2eeced984f91 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:03.881892 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c8bd4560-79d8-483b-b05b-122fda026564 req-b440f637-abb6-45fd-904c-2eeced984f91 service nova] Creating event network-changed:49360250-760c-408e-8e33-580b89bc56c7 for instance 159937a6-f756-4d55-8fb8-f3f25abd05ed on nch1-master-1 Oct 29 21:15:03.892755 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c8bd4560-79d8-483b-b05b-122fda026564 req-b440f637-abb6-45fd-904c-2eeced984f91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105783 Oct 29 21:15:03.897673 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2812/5728] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:15:04.306795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:04.308207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:04.315306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:04.316399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:04.317069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:04.318070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:04.318747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:04.319399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:05.211474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:05.240203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:05.248970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:05.256241 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b8a7b6c-496b-4e8f-879c-470cdef6f650 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.956033 Oct 29 21:15:05.260351 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2917/5729] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:04 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:06.289041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:06.289818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:06.300285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:06.303765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:06.304228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:06.305010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:06.311290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:06.312008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:06.621590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:06.643102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:06.654210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:06.662089 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4d40a07-a003-475e-b2f6-821cfdbcf401 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.374685 Oct 29 21:15:06.684812 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2813/5730] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:06 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:07.694005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:07.694626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:07.710510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:07.710839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:07.711936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:07.718633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:07.719216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:07.719726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:08.281386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:08.306498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:08.308195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:08.309417 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94c89ae0-5f1e-43f5-9691-4cadaf90c245 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.619561 Oct 29 21:15:08.318027 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2918/5731] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:07 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:09.350251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:09.351093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:09.362698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:09.363210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:09.366827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:09.368206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:09.374303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:09.374779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:09.907693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:09.930616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:09.933844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:09.939019 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-113db37f-1e18-4dd4-a617-a3e2473b4449 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.593274 Oct 29 21:15:09.963211 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2814/5732] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:09 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:10.978198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:10.981368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:11.014041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:11.017353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:11.018402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:11.021696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:11.022514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:11.024265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:11.539565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:11.562649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:11.562649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:11.574941 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-76d04a78-9b0a-4049-b9b7-efccbbc5dcc3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.608527 Oct 29 21:15:11.579283 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2919/5733] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:10 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:12.609344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:12.610792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:12.620628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:12.621389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:12.622378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:12.624115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:12.624914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:12.626625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:13.218842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:13.231826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:13.235614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:13.238343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-327ddc7d-0a18-4b1e-b887-47e52c2ac02f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.635671 Oct 29 21:15:13.260574 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2815/5734] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:12 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:14.268130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:14.270491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:14.289794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:14.291633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:14.292367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:14.293564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:14.294127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:14.294779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:14.312280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:14.615213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:14.630912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:14.651410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:14.653282 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-05d21140-e5de-4af3-a393-705ef419040e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.389353 Oct 29 21:15:14.654356 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2920/5735] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:14 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:15.681166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:15.682360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:15.707392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:15.708755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:15.714313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:15.717995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:15.721621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:15.726245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:16.025059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:16.036315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:16.037888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:16.040350 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6cb654cc-44c3-4808-bcdf-bef9d3f21738 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.365325 Oct 29 21:15:16.041733 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2816/5736] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:15 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:17.075387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:17.076525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:17.101746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:17.102488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:17.103104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:17.108977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:17.109709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:17.111686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:17.474363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:17.484522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:17.499981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:17.501571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0765801b-562d-4179-af6e-e625e3008fb7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.434333 Oct 29 21:15:17.502803 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2921/5737] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:17 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:18.528713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:18.530395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:18.575805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:18.576606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:18.578190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:18.582543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:18.583244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:18.584310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:19.255143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:19.280422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:19.318750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:19.326632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:19.333684 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c781c52-7469-4401-9d4b-ee8b795c4a0b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.806044 Oct 29 21:15:19.340011 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2817/5738] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:18 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:20.365187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:20.365836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:20.379383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:20.379897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:20.380380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:20.382273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:20.384519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:20.387059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:20.956505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:20.965958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:20.968755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:20.975411 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cd3d353-09e7-4108-8110-8624e32312f7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.612355 Oct 29 21:15:20.997019 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2922/5739] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:20 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:22.021115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:22.021996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:22.046502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:22.048870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:22.049585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:22.051284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:22.054247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:22.055388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:22.668117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:22.682542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:22.684837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:22.688127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9a0e465-9f53-4a51-9215-3a106985b350 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.672375 Oct 29 21:15:22.705923 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2818/5740] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:22 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:23.715651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:23.716267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:23.732128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:23.732630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:23.733070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:23.733855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:23.734332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:23.734756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:24.026599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:24.037017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:24.040467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:24.042705 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06fed4dd-b592-4e62-bc1c-840f50923680 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1740 microversion: 2.20 time: 0.331008 Oct 29 21:15:24.044550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2923/5741] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:23 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1740 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:25.072807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:25.073428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:25.077171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=28 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:25.081903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:25.082616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:25.083215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:25.084093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:25.084704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:25.085198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:25.346998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:25.356480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:25.357970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:25.359199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f3c8aa74-c4b7-40e5-a123-e8cee3f660d2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1722 microversion: 2.20 time: 0.291027 Oct 29 21:15:25.373647 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2819/5742] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:25 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:26.384888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:26.387824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:26.390974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:26.401874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:26.406113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:26.406570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:26.416808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:26.417488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:26.418361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:27.151928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:27.163298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:27.169042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:27.171969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60fc83d9-3a97-4caa-99a7-dd0509397ba3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1722 microversion: 2.20 time: 0.791621 Oct 29 21:15:27.175216 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2924/5743] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:26 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1722 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:27.470684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5648d746-803c-4f10-bb58-d9e486ae0915 req-0829be15-0459-4b8a-952d-573d1f4bebe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "name": "network-vif-unplugged", "status": "completed", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:27.494775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5648d746-803c-4f10-bb58-d9e486ae0915 req-0829be15-0459-4b8a-952d-573d1f4bebe6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:27.496829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5648d746-803c-4f10-bb58-d9e486ae0915 req-0829be15-0459-4b8a-952d-573d1f4bebe6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:27.497974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5648d746-803c-4f10-bb58-d9e486ae0915 req-0829be15-0459-4b8a-952d-573d1f4bebe6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:27.519475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.compute.server_external_events [req-5648d746-803c-4f10-bb58-d9e486ae0915 req-0829be15-0459-4b8a-952d-573d1f4bebe6 service nova] Unable to find a host for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47. Dropping event network-vif-unplugged {{(pid=138884) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 21:15:27.524775 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5648d746-803c-4f10-bb58-d9e486ae0915 req-0829be15-0459-4b8a-952d-573d1f4bebe6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059306 Oct 29 21:15:27.530862 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2820/5744] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 21:15:28.205182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:28.206554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:28.217363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:28.218083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:28.218665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:28.219543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:28.220153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:28.220780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:28.490877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:28.514959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:28.523689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:28.525350 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e7b1a779-e1f0-4073-b5de-ee4263cbed68 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1665 microversion: 2.20 time: 0.324820 Oct 29 21:15:28.526692 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2925/5745] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:28 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1665 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:28.558787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08642dd9-e507-4301-87f6-062a368e0852"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:28.561289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:28.573494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:28.576257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:28.578571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:28.582369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:28.583078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:28.583684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:29.113895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d962471-3177-43a5-828d-859734b45871 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.559500 Oct 29 21:15:29.114875 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2821/5746] 10.222.0.36 () {62 vars in 1364 bytes} [Sat Oct 29 21:15:28 2022] POST /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-volume_attachments => generated 188 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:15:29.332680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:29.334510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:29.343251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:29.343992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:29.345373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:29.346291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:29.346905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:29.347502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:29.878396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a741331-e21f-4036-836d-bfbcd6dfebb3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-volume_attachments/08642dd9-e507-4301-87f6-062a368e0852" status: 202 len: 0 microversion: 2.20 time: 0.558125 Oct 29 21:15:29.879553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2926/5747] 10.222.0.36 () {60 vars in 1457 bytes} [Sat Oct 29 21:15:29 2022] DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-volume_attachments/08642dd9-e507-4301-87f6-062a368e0852 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:15:29.979774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:29.980645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:29.988564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:29.989309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:29.989941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:29.991399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:29.992623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:29.993231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:30.083197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138884) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 21:15:30.219235 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31d932d7-0a7c-46ec-83b9-af619a26a0c2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "POST /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/action" status: 202 len: 0 microversion: 2.20 time: 0.244343 Oct 29 21:15:30.222648 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2822/5748] 10.222.0.36 () {62 vars in 1319 bytes} [Sat Oct 29 21:15:29 2022] POST /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:15:30.231885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:30.232448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:30.248269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:30.250555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:30.254708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:30.255797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:30.256643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:30.257438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:30.719994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:30.750595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:30.753180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:30.758436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-729db23e-e4d0-4565-9939-e8a9ffeea854 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1673 microversion: 2.20 time: 0.530770 Oct 29 21:15:30.760435 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2927/5749] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:30 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1673 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 21:15:31.788982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:31.789928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:31.815050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:31.818581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:31.819155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:31.822339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:31.822918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:31.823683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:32.022052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:32.037069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:32.041013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:32.044573 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20c45177-fb8e-43f5-b590-ee123b9dfccb tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1675 microversion: 2.20 time: 0.259391 Oct 29 21:15:32.049819 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2823/5750] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:31 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1675 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:33.077349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:33.078748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:33.099244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:33.104989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:33.108914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:33.113380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:33.117149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:33.138017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:33.480483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:33.494633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:33.498392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:33.501304 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f250e5c3-50ce-4802-9bce-edfd2d6cef53 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.429252 Oct 29 21:15:33.505559 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2928/5751] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:33 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:34.532623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:34.533271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:34.543275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:34.544110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:34.544843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:34.546900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:34.547719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:34.548359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:34.921963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:34.959116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:34.963395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:34.964945 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-863949e2-11a8-4a8a-8671-d99bdbe20da6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.437469 Oct 29 21:15:34.966379 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2824/5752] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:34 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:35.329732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1ddd3b86-516c-4816-b840-9a2e6709f866 req-66502a91-b524-4b71-8600-d3fd1f0c412f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:35.345966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ddd3b86-516c-4816-b840-9a2e6709f866 req-66502a91-b524-4b71-8600-d3fd1f0c412f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:35.346741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ddd3b86-516c-4816-b840-9a2e6709f866 req-66502a91-b524-4b71-8600-d3fd1f0c412f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:35.347410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ddd3b86-516c-4816-b840-9a2e6709f866 req-66502a91-b524-4b71-8600-d3fd1f0c412f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:35.365505 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1ddd3b86-516c-4816-b840-9a2e6709f866 req-66502a91-b524-4b71-8600-d3fd1f0c412f service nova] Creating event network-changed:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch2-master-1 Oct 29 21:15:35.384739 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1ddd3b86-516c-4816-b840-9a2e6709f866 req-66502a91-b524-4b71-8600-d3fd1f0c412f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058721 Oct 29 21:15:35.385953 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2929/5753] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:15:35.996765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:35.998127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:36.008466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:36.014377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:36.015175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:36.016389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:36.016822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:36.019306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:36.465485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:36.477817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:36.481031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:36.483289 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93f2b093-5dee-4b3d-a616-7ecef966d134 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.489585 Oct 29 21:15:36.484385 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2825/5754] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:35 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:37.511024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:37.511800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:37.531533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:37.532435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:37.533090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:37.534058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:37.534722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:37.535945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:37.921080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:37.936595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:37.938239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:37.939569 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-057e99d8-8789-4e95-a596-4b500511b14e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.434385 Oct 29 21:15:37.940241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2930/5755] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:37 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:38.974641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:38.976885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:38.986983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:38.987950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:38.988882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:39.013735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:39.014658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:39.015333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:39.649056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:39.662244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:39.666975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:39.670784 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-121175f3-3841-4233-a64c-cad7e6e01c07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.702055 Oct 29 21:15:39.672361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2826/5756] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:38 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:40.699910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:40.700527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:40.718924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:40.722056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:40.725381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:40.726379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:40.727012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:40.727455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:41.234880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:41.252118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:41.255405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:41.259167 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e5e9867-8863-440b-98c9-a5a248d574b7 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.563145 Oct 29 21:15:41.292013 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2931/5757] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:40 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:42.317402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:42.322749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:42.344468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:42.345586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:42.350309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:42.352002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:42.362329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:42.365674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:42.760134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:42.771062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:42.773811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:42.775318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-735bf761-3ad1-4dee-b3d5-13a8ccbb0c00 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.467031 Oct 29 21:15:42.776822 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2827/5758] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:42 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:43.803934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:43.804801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:43.814816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:43.815764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:43.816019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:43.817036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:43.817887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:43.818753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:44.106150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:44.106992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:44.123963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:44.124560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:44.125076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:44.127726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:44.128303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:44.128796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:44.367408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lazy-loading 'services' on Instance uuid c1e25297-46fa-4c71-8331-b780a5ec40e1 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:15:44.416740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:44.420156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:44.444828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:44.448739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:44.450057 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b41406e-2f58-40ab-9c9a-d4738282b4f3 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.652399 Oct 29 21:15:44.465963 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2932/5759] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:43 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:44.542730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee16777c-0f8a-4957-a943-1e38222117bc tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1/os-volume_attachments/b6823076-879e-4467-9be0-aadbacfa9d45" status: 202 len: 0 microversion: 2.1 time: 0.441570 Oct 29 21:15:44.544177 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2828/5760] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:15:44 2022] DELETE /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1/os-volume_attachments/b6823076-879e-4467-9be0-aadbacfa9d45 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:15:45.477910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:45.479342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:45.503923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:45.504728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:45.505417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:45.506380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:45.512959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:45.514377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:45.820455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:45.821760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:45.850623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:45.851168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:45.851600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:45.852334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:45.852800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:45.861008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:45.951306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:15:46.045087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:46.062530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:46.101155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:46.106201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:46.108668 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c4ded71e-44b7-488d-b383-fa5967d1eb6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.635895 Oct 29 21:15:46.110552 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2933/5761] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:45 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:46.190633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7fe47e43-d6df-44c0-8926-cec564bf5b45 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 204 len: 0 microversion: 2.1 time: 0.379121 Oct 29 21:15:46.196280 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2829/5762] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:15:45 2022] DELETE /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:15:46.207527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:46.208224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:46.220228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:46.223693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:46.225403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:46.227103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:46.228071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:46.229409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:46.447460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:46.461709 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab5d0260-1f87-41c8-b8e9-0c9ac64a7400 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1515 microversion: 2.1 time: 0.259455 Oct 29 21:15:46.463327 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2934/5763] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:46 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:15:47.142535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:47.143252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:47.152603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:47.152977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:47.153363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:47.154083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:47.154548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:47.154983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:47.411802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:47.420966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:47.422457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:47.424701 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da30e9cd-82e2-417f-810d-54ec9a614a07 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.286659 Oct 29 21:15:47.430643 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2830/5764] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:47 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:47.488431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:47.489151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:47.506634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:47.508309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:47.508815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:47.509958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:47.510646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:47.511828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:47.787220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:47.799296 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db43edc9-eb1e-4eac-b388-51b63503a5b2 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1515 microversion: 2.1 time: 0.314886 Oct 29 21:15:47.799903 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2935/5765] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:47 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:15:48.453819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:48.454462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:48.472567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:48.474095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:48.474748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:48.476242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:48.477668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:48.478296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:48.729124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:48.741046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:48.745037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:48.747139 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da05fdfb-8d0e-4f49-beee-b833b98f7a6f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.299344 Oct 29 21:15:48.748852 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2831/5766] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:48 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:48.830848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:48.833132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:48.852359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:48.854494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:48.855496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:48.857065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:48.858001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:48.861915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:49.001383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:49.015039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c3e1430-8ed2-462d-8907-e22c9713c29c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 200 len: 1473 microversion: 2.1 time: 0.193497 Oct 29 21:15:49.016576 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2936/5767] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:48 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:15:49.067559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e2dd5722-c6e9-4fb0-b182-535b5a09911c req-27e9eb53-8256-4fc2-bda3-6d7e3efc3d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e25297-46fa-4c71-8331-b780a5ec40e1", "name": "network-vif-deleted", "tag": "26456ce6-fce6-449a-b9eb-198d18699e1e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:49.078726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e2dd5722-c6e9-4fb0-b182-535b5a09911c req-27e9eb53-8256-4fc2-bda3-6d7e3efc3d92 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:49.079519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e2dd5722-c6e9-4fb0-b182-535b5a09911c req-27e9eb53-8256-4fc2-bda3-6d7e3efc3d92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:49.080135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e2dd5722-c6e9-4fb0-b182-535b5a09911c req-27e9eb53-8256-4fc2-bda3-6d7e3efc3d92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:49.093906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e2dd5722-c6e9-4fb0-b182-535b5a09911c req-27e9eb53-8256-4fc2-bda3-6d7e3efc3d92 service nova] Creating event network-vif-deleted:26456ce6-fce6-449a-b9eb-198d18699e1e for instance c1e25297-46fa-4c71-8331-b780a5ec40e1 on nch1-master-1 Oct 29 21:15:49.099716 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e2dd5722-c6e9-4fb0-b182-535b5a09911c req-27e9eb53-8256-4fc2-bda3-6d7e3efc3d92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035855 Oct 29 21:15:49.101104 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2832/5768] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:15:49.777773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:49.778783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:49.793628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:49.795601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:49.796166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:49.797828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:49.798323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:49.802137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:50.041759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:50.042722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: c1e25297-46fa-4c71-8331-b780a5ec40e1] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:50.056797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:50.057653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:50.058295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:50.059235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:50.059857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:50.060462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:50.076076 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] HTTP exception thrown: Instance c1e25297-46fa-4c71-8331-b780a5ec40e1 could not be found. Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Request method failure captured: Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 HTTP/1.1 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZdiU0xX9yViS5d6eAYUnB6anpuJhp0UTZPS2FMyrRlaCARQnBCBCI6eHj1VRCXl0__BHP-X0UiuLcfte9RyZsacrmALgNm3J3aZqWZpl2frqRwgNmU4pUJ9qNwQshBiYmbomjOnvhJZuNwmTzJ9os1WYpnD3gq-zUbiJaI9i1yNr8s Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 10601894adb44985b208c3ab7ffa22c8 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1969201650 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesSnapshotTestJSON-1969201650 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 10601894adb44985b208c3ab7ffa22c8 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1969201650 Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesSnapshotTestJSON-1969201650-project Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 04bbe6295ba34150b3609466e42c8abd Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesSnapshotTestJSON-1969201650-project Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance c1e25297-46fa-4c71-8331-b780a5ec40e1 could not be found. Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'c1e25297-46fa-4c71-8331-b780a5ec40e1'} Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e25297-46fa-4c71-8331-b780a5ec40e1 could not be found. Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e25297-46fa-4c71-8331-b780a5ec40e1 could not be found. Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:15:50.088360 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e25297-46fa-4c71-8331-b780a5ec40e1 could not be found. Oct 29 21:15:50.094337 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:15:50.095585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:50.098926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Returning 404 to user: Instance c1e25297-46fa-4c71-8331-b780a5ec40e1 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:15:50.100148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b31b8c8c-7433-47d7-8f6b-da41dc99b46e tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1" status: 404 len: 111 microversion: 2.1 time: 0.064957 Oct 29 21:15:50.102807 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2833/5769] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:50 2022] GET /compute/v2.1/servers/c1e25297-46fa-4c71-8331-b780a5ec40e1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:15:50.111591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:50.113216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:50.115289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab60bf02-cec9-43fb-8623-5cf1aed67647 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.342236 Oct 29 21:15:50.127118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2937/5770] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:49 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:51.145408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:51.146850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:51.161439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:51.162904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:51.164051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:51.165206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:51.166021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:51.166763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:51.424954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a4639e67-8341-4c88-b6b4-9bc4d08acb5c req-8c7249b7-16b3-4f13-ab51-ec3e3b19fe34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "name": "network-vif-plugged", "status": "completed", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:51.472360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4639e67-8341-4c88-b6b4-9bc4d08acb5c req-8c7249b7-16b3-4f13-ab51-ec3e3b19fe34 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:51.472918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4639e67-8341-4c88-b6b4-9bc4d08acb5c req-8c7249b7-16b3-4f13-ab51-ec3e3b19fe34 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:51.476788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4639e67-8341-4c88-b6b4-9bc4d08acb5c req-8c7249b7-16b3-4f13-ab51-ec3e3b19fe34 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:51.537919 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a4639e67-8341-4c88-b6b4-9bc4d08acb5c req-8c7249b7-16b3-4f13-ab51-ec3e3b19fe34 service nova] Creating event network-vif-plugged:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch2-master-1 Oct 29 21:15:51.562561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a4639e67-8341-4c88-b6b4-9bc4d08acb5c req-8c7249b7-16b3-4f13-ab51-ec3e3b19fe34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143360 Oct 29 21:15:51.572039 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2938/5771] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:15:51.706079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:51.717313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:51.719154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:51.720676 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c5d5957-8a74-4089-a581-4636d7262adc tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.581232 Oct 29 21:15:51.737937 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2834/5772] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:51 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:52.750536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:52.751958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:52.774484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:52.775739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:52.776414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:52.777382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:52.778131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:52.779533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:53.332369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:53.348255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:53.349749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:53.351498 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60bb7f6e-d0a5-42ab-a60f-4916e3b3b6b2 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.606649 Oct 29 21:15:53.352077 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2939/5773] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:52 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:54.381546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:54.382279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:54.393799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:54.398635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:54.401134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:54.402639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:54.404742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:54.405384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:54.870433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:54.880719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:54.885070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:54.889102 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-412cf9f3-2f44-4a66-b53a-cdadcd464897 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1731 microversion: 2.20 time: 0.512505 Oct 29 21:15:54.909825 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2835/5774] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:54 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1731 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:55.582505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-744145841", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "a7848b15-50c3-4b4a-8274-0bbaf4eb118a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:15:55.661192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] validate_networks() for [('a7848b15-50c3-4b4a-8274-0bbaf4eb118a', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:15:55.926187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:55.926954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:55.936099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:55.938202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:55.939571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:55.940070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:55.941033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:55.942325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:55.942982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:56.292485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:56.318583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:56.333990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:56.335301 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dda695e0-cbf2-48eb-b1dc-4e29eb82265e tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1718 microversion: 2.20 time: 0.413624 Oct 29 21:15:56.350204 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2836/5775] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:15:55 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1718 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:15:56.567549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:15:56.567977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:15:56.568786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:15:56.569245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:15:56.571895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:15:56.581239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:15:56.590782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:56.591406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:56.591739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:56.592487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:56.592927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:56.593511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:56.627571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Getting quotas for project 10601894adb44985b208c3ab7ffa22c8. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:15:56.633872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Getting quotas for user 04bbe6295ba34150b3609466e42c8abd and project 10601894adb44985b208c3ab7ffa22c8. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:15:56.648678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:15:56.651495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:15:56.712147 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1b8f06e-d216-4acf-b0e4-7c62c852163c tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134505 Oct 29 21:15:56.718923 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2940/5776] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:15:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:15:56.724456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27e75905-aecf-4534-9c1a-5f83b011f223 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:56.725076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27e75905-aecf-4534-9c1a-5f83b011f223 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:56.827220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27e75905-aecf-4534-9c1a-5f83b011f223 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:56.839959 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27e75905-aecf-4534-9c1a-5f83b011f223 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1218 microversion: 2.1 time: 0.119570 Oct 29 21:15:56.841095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2837/5777] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:56 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:15:57.869740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:57.871833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:57.884877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:57.887190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:57.887190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:57.887880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:57.888735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:57.889379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:58.102746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:58.113342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-174f4b73-f7c9-4c92-ad44-1894e67b90cd tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1270 microversion: 2.1 time: 0.251651 Oct 29 21:15:58.114750 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2941/5778] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:57 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:15:59.143764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:15:59.144373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:15:59.164466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:59.165020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:59.165449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:59.166457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:15:59.166918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:15:59.167350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:15:59.557343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:15:59.574325 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a063febf-048a-4b77-8f92-6d8dfee512f8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.434534 Oct 29 21:15:59.575169 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2838/5779] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:15:59 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:00.602776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:00.603399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:00.620327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:00.620826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:00.621266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:00.622012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:00.622459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:00.623073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:00.908399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:00.945861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ee639f0-adad-45d2-988e-b538395d2c99 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.345243 Oct 29 21:16:00.947737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2942/5780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:00 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:01.035544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c7dfb0f6-8a78-47ca-a18a-e6a7f5715f45 req-10b1f99c-a57c-4f64-a66c-feb8940fe5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3", "tag": "26ec5a2f-4a1c-451f-8e8f-272dd2df7fd1"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:01.058052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c7dfb0f6-8a78-47ca-a18a-e6a7f5715f45 req-10b1f99c-a57c-4f64-a66c-feb8940fe5ca service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:01.058842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c7dfb0f6-8a78-47ca-a18a-e6a7f5715f45 req-10b1f99c-a57c-4f64-a66c-feb8940fe5ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:01.059558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c7dfb0f6-8a78-47ca-a18a-e6a7f5715f45 req-10b1f99c-a57c-4f64-a66c-feb8940fe5ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:01.079374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c7dfb0f6-8a78-47ca-a18a-e6a7f5715f45 req-10b1f99c-a57c-4f64-a66c-feb8940fe5ca service nova] Creating event network-changed:26ec5a2f-4a1c-451f-8e8f-272dd2df7fd1 for instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 on nch2-master-1 Oct 29 21:16:01.087162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c7dfb0f6-8a78-47ca-a18a-e6a7f5715f45 req-10b1f99c-a57c-4f64-a66c-feb8940fe5ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057512 Oct 29 21:16:01.088825 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2839/5781] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:01.970438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:01.972908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:01.984517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:01.985272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:01.985930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:01.989223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:01.990137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:01.993170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:02.265342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:02.279524 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1f5ffb9a-37ce-492f-a3e5-6f8ca30f8121 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.311986 Oct 29 21:16:02.294849 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2943/5782] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:01 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:03.322371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:03.323083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:03.338785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:03.339291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:03.339761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:03.353129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:03.356429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:03.357117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:03.951641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:03.967713 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-10ec300a-b617-4bef-bb23-aa735125f1d5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.649650 Oct 29 21:16:03.969138 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2840/5783] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:03 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:04.994427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:04.996172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:05.016140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:05.017046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:05.020334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:05.022583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:05.024540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:05.027258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:05.864923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:05.883703 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edd09244-adbb-4142-abfe-d10f2f51611d tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.892975 Oct 29 21:16:05.886782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2944/5784] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:04 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:06.907456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:06.908081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:06.919222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:06.920817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:06.921315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:06.931679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:06.933556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:06.934206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:06.934823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:07.501523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:07.516213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-77d52742-dac2-4516-a9a4-844abd85d101 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.612498 Oct 29 21:16:07.517130 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2841/5785] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:06 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:08.063171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:08.065079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:08.069130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:08.070155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:08.087452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:08.090213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:08.093308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:08.094117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:08.094769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:08.098092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:08.148715 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac149fb4-f725-42c2-8065-29b6af71bccf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/ips" status: 200 len: 150 microversion: 2.1 time: 0.089271 Oct 29 21:16:08.151505 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2945/5786] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:16:08 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:08.543314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:08.543952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:08.562757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:08.567956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:08.570017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:08.574433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:08.575083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:08.576501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:08.953313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:08.969916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3dd79bb4-e0c8-4bab-ac3c-f8351f2d5a35 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.430502 Oct 29 21:16:08.972823 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2842/5787] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:08 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:09.305151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5c4a0e48-6eef-491b-993a-be13b2ad217a req-be81e70e-02b3-491a-9444-5072b87740b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3", "name": "network-vif-plugged", "status": "completed", "tag": "26ec5a2f-4a1c-451f-8e8f-272dd2df7fd1"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:09.337074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5c4a0e48-6eef-491b-993a-be13b2ad217a req-be81e70e-02b3-491a-9444-5072b87740b2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:09.337642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5c4a0e48-6eef-491b-993a-be13b2ad217a req-be81e70e-02b3-491a-9444-5072b87740b2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:09.338278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5c4a0e48-6eef-491b-993a-be13b2ad217a req-be81e70e-02b3-491a-9444-5072b87740b2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:09.373653 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5c4a0e48-6eef-491b-993a-be13b2ad217a req-be81e70e-02b3-491a-9444-5072b87740b2 service nova] Creating event network-vif-plugged:26ec5a2f-4a1c-451f-8e8f-272dd2df7fd1 for instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 on nch2-master-1 Oct 29 21:16:09.380922 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5c4a0e48-6eef-491b-993a-be13b2ad217a req-be81e70e-02b3-491a-9444-5072b87740b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081865 Oct 29 21:16:09.381644 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2946/5788] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:09.998063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:10.000213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:10.011365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:10.012147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:10.013255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:10.014398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:10.015028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:10.015655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:10.064281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e2d09bb-2c91-470b-a1b9-7393e264eb22"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:10.066797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:10.087717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:10.088243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:10.088693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:10.089416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:10.089416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:10.089416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:10.477939 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3c5160a9-3439-479f-a114-f6673553b2c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418147 Oct 29 21:16:10.480351 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2947/5789] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:16:10 2022] POST /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:16:10.742967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:10.751002 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11470aa8-20cb-4169-993d-86f13948fc55 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1318 microversion: 2.1 time: 0.758631 Oct 29 21:16:10.754197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2843/5790] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:09 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:11.795910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:11.798090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:11.820341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:11.820923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:11.821593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:11.822841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:11.823451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:11.831575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:12.275423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:12.286071 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b99a0bd7-fb40-40ce-8bf8-9734568b5340 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1507 microversion: 2.1 time: 0.511802 Oct 29 21:16:12.290564 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2948/5791] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:11 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1507 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:12.314984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bde4424f-a811-49fc-b4f0-5d5fc9767766", "device": "/dev/sdb"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:12.317496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:12.326651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:12.327557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:12.328224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:12.330166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:12.330901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:12.331559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:12.759719 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-672de776-3c2c-466e-8685-9d3290b2d96f tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "POST /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446971 Oct 29 21:16:12.776949 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2844/5792] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:16:12 2022] POST /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:16:13.947949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e2d09bb-2c91-470b-a1b9-7393e264eb22"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:13.950604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:13.967679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:13.970092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:13.974992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:13.977886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:13.978586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:13.979281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:14.128479 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Invalid volume: volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22 is already attached to instances: 159937a6-f756-4d55-8fb8-f3f25abd05ed Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments HTTP/1.1 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 74 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: {"volumeAttachment": {"volumeId": "3e2d09bb-2c91-470b-a1b9-7393e264eb22"}} Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid volume: volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22 is already attached to instances: 159937a6-f756-4d55-8fb8-f3f25abd05ed Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': '159937a6-f756-4d55-8fb8-f3f25abd05ed', 'body': {'volumeAttachment': {'volumeId': '3e2d09bb-2c91-470b-a1b9-7393e264eb22'}}} Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22 is already attached to instances: 159937a6-f756-4d55-8fb8-f3f25abd05ed Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:16:14.131089 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22 is already attached to instances: 159937a6-f756-4d55-8fb8-f3f25abd05ed Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22 is already attached to instances: 159937a6-f756-4d55-8fb8-f3f25abd05ed Oct 29 21:16:14.136233 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:14.137839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 400 to user: Invalid volume: volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22 is already attached to instances: 159937a6-f756-4d55-8fb8-f3f25abd05ed {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:14.138832 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6583a08f-65d9-4555-bfb7-0c2b3d68ce74 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.195580 Oct 29 21:16:14.144190 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2949/5793] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:16:13 2022] POST /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:16:14.276205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:14.276783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:14.287946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:14.289063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:14.289723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:14.292925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:14.293640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:14.294493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:14.447426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lazy-loading 'services' on Instance uuid 159937a6-f756-4d55-8fb8-f3f25abd05ed {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:16:14.591466 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1ef4352d-5f99-416b-8d37-703b18a7db29 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments/3e2d09bb-2c91-470b-a1b9-7393e264eb22" status: 202 len: 0 microversion: 2.1 time: 0.307541 Oct 29 21:16:14.592731 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2845/5794] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:16:14 2022] DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments/3e2d09bb-2c91-470b-a1b9-7393e264eb22 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:16:14.605985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:14.608494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:14.616030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:14.616539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:14.616975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:14.618210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:14.618679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:14.619110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:14.639368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:14.666073 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-40bf4003-d35e-4616-8218-1d8ad3fa8e63 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068832 Oct 29 21:16:14.667542 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2950/5795] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:16:14 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:15.690004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:15.698701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:15.731722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:15.732173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:15.732629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:15.733371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:15.734003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:15.734530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:15.822906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:15.827119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-538fdb7a-74d7-455c-8bd0-ca43d9d12cbf tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151963 Oct 29 21:16:15.829504 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2846/5796] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:16:15 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:16.841495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:16.845014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:16.858134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:16.858963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:16.859643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:16.860570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:16.861180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:16.861796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:16.907739 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ef09d8b-243d-456e-96cf-65c488834d55 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070403 Oct 29 21:16:16.908747 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2951/5797] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:16:16 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:16:16.994911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:17.001291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:17.010179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:17.010961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:17.011950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:17.012907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:17.013722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:17.014396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:17.056574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:16:17.169202 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2be4510-10a1-446d-ba2a-a7147c0f3753 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 204 len: 0 microversion: 2.1 time: 0.178221 Oct 29 21:16:17.171270 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2847/5798] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:16:16 2022] DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:16:17.180052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:17.180970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:17.189238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:17.189766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:17.190209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:17.191528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:17.192146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:17.192734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:17.511121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:17.525186 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-52d2ec9b-5910-4bb0-abf6-d1dacdc8db3f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1682 microversion: 2.1 time: 0.350190 Oct 29 21:16:17.526520 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2952/5799] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:17 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1682 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:18.551761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:18.552644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:18.562323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:18.563282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:18.563797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:18.564867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:18.565377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:18.565927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:18.827058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:18.842076 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35480c7a-6392-42b2-b7b4-f3881359cc8b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1682 microversion: 2.1 time: 0.292303 Oct 29 21:16:18.842738 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2848/5800] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:18 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1682 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:19.874394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:19.876220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:19.888358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:19.890934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:19.892848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:19.894983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:19.896535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:19.900094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:20.749088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:20.767156 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4a2c54a-773d-4a25-8448-58627b7563c3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1682 microversion: 2.1 time: 0.899898 Oct 29 21:16:20.768043 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2953/5801] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:19 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1682 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:21.243617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d5833b23-4078-4b8f-8df6-7d6989e6d473 req-b40b7fbf-5f05-4f1e-8a1c-be0f8595a507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159937a6-f756-4d55-8fb8-f3f25abd05ed", "name": "network-vif-deleted", "tag": "49360250-760c-408e-8e33-580b89bc56c7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:21.283026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5833b23-4078-4b8f-8df6-7d6989e6d473 req-b40b7fbf-5f05-4f1e-8a1c-be0f8595a507 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:21.283831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5833b23-4078-4b8f-8df6-7d6989e6d473 req-b40b7fbf-5f05-4f1e-8a1c-be0f8595a507 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:21.285318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5833b23-4078-4b8f-8df6-7d6989e6d473 req-b40b7fbf-5f05-4f1e-8a1c-be0f8595a507 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:21.328265 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d5833b23-4078-4b8f-8df6-7d6989e6d473 req-b40b7fbf-5f05-4f1e-8a1c-be0f8595a507 service nova] Creating event network-vif-deleted:49360250-760c-408e-8e33-580b89bc56c7 for instance 159937a6-f756-4d55-8fb8-f3f25abd05ed on nch1-master-1 Oct 29 21:16:21.345141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d5833b23-4078-4b8f-8df6-7d6989e6d473 req-b40b7fbf-5f05-4f1e-8a1c-be0f8595a507 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107231 Oct 29 21:16:21.346340 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2849/5802] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:21.792175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:21.792794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:21.805965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:21.806474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:21.806918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:21.807658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:21.808147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:21.815426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:21.871504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:21.872009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:21.872455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:21.872915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lazy-loading 'fault' on Instance uuid 159937a6-f756-4d55-8fb8-f3f25abd05ed {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:16:22.045716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:22.072025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e39b6091-ccee-45b9-b943-b08fdb69f45a tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 200 len: 1331 microversion: 2.1 time: 0.275338 Oct 29 21:16:22.074489 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2954/5803] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:21 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 1331 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:23.102838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:23.105511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:23.129389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:23.130396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:23.131875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:23.133730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:23.134999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:23.137901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:23.212704 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed HTTP/1.1 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '159937a6-f756-4d55-8fb8-f3f25abd05ed'} Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:23.217735 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:16:23.221833 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:23.227423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:23.230821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bdbdce79-a57a-40df-a4c4-8bebb56aa0c1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 404 len: 111 microversion: 2.1 time: 0.133566 Oct 29 21:16:23.233039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2850/5804] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:23 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:16:23.250065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a101ecee-1706-4882-b435-033f77e055bb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '.version_select at 0x7fa17008fca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:23.302934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a101ecee-1706-4882-b435-033f77e055bb tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805296114" status: 202 len: 0 microversion: 2.1 time: 0.066014 Oct 29 21:16:23.304962 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2955/5805] 10.222.0.36 () {58 vars in 1218 bytes} [Sat Oct 29 21:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805296114 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:16:24.343903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-080c41a4-677a-4a94-a151-24723ee96d6b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: .version_select at 0x7fa17166e820>, body: {"keypair": {"name": "tempest-keypair-1299134906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjhSGJUkOZihTWjLIBPe36xjt/juK4XywFgBvpptA4DBaZ3uFFtiinV2Ry3rkauLiie2uFjInjHw4+KsLLCGumzy/zK3f0F3x8dyokJFKi8/fI/2i9vuNAx2FMbSYnguw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:24.367512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-080c41a4-677a-4a94-a151-24723ee96d6b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:16:24.381814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-080c41a4-677a-4a94-a151-24723ee96d6b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:16:24.400939 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-080c41a4-677a-4a94-a151-24723ee96d6b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061032 Oct 29 21:16:24.401758 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2851/5806] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:16:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:28.014906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1708505857", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae54bd00-7b0d-4e16-bca3-cda80b70e755"}], "security_groups": [{"name": "tempest-securitygroup--1893465166"}], "key_name": "tempest-keypair-1299134906", "user_data": "}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:28.037625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:28.229815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] validate_networks() for [('ae54bd00-7b0d-4e16-bca3-cda80b70e755', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:16:29.099347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:16:29.100581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:16:29.101311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:16:29.102023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:16:29.102782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:16:29.114413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.116434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.117097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.118403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.119113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.119863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.144919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:16:29.181024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Getting quotas for user f21c99f8530a41439b59b8dbaf2369dc and project bbee029e55124f2bb37672fbee64a42c. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:16:29.230344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:16:29.232926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:16:29.283743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:29.288140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:29.308701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:29.310659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.311494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.312179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.313686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.314612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.317796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b82c29fa-453a-46ee-bc53-d614d08750d1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.309436 Oct 29 21:16:29.319095 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2956/5807] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:16:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:16:29.330866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15b13a40-32c6-4b47-be9b-e151fa45ccc0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:29.331747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-15b13a40-32c6-4b47-be9b-e151fa45ccc0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:29.343625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.438321 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0122535-91bb-4e53-840c-6785e7061f45 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.160593 Oct 29 21:16:29.446074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2852/5808] 10.222.0.36 () {60 vars in 1343 bytes} [Sat Oct 29 21:16:29 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:16:29.551580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:29.552247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:29.563337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.566530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.567181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.569704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.570833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.571959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.625718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-15b13a40-32c6-4b47-be9b-e151fa45ccc0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:29.637375 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15b13a40-32c6-4b47-be9b-e151fa45ccc0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1242 microversion: 2.1 time: 0.308536 Oct 29 21:16:29.638323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2957/5809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:29 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1242 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:16:29.651444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:16:29.885818 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f1fb729a-c623-40b1-a928-fcc20e8682fa tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 204 len: 0 microversion: 2.20 time: 0.336761 Oct 29 21:16:29.894844 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2853/5810] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:16:29 2022] DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:16:29.905181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:29.906037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:29.915198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.915914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.916889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:29.917813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:29.918636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:29.919485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:30.267749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:30.282589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:30.290818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:30.300867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-522ea625-9cd4-4620-b3c2-95e0da0b9cc0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.399459 Oct 29 21:16:30.304865 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2958/5811] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:29 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:16:30.665821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:30.666536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:30.684019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:30.687713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:30.688317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:30.689135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:30.689657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:30.695835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:30.829802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:30.839623 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-211af8f7-10dc-4319-b956-91dd05437967 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1238 microversion: 2.1 time: 0.178953 Oct 29 21:16:30.853482 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2854/5812] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:30 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1238 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:31.329471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:31.330116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:31.345136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:31.350805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:31.351271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:31.352500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:31.353155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:31.353784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:31.866499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:31.868411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:31.901067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:31.901894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:31.905598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:31.909345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:31.911774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:31.912378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:32.125471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:32.135989 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-40a58c3a-77e0-4071-a429-3cdaec6f517b tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1300 microversion: 2.1 time: 0.273933 Oct 29 21:16:32.151765 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2855/5813] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:31 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:16:32.287956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:32.296409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:32.297910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:32.307218 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e7a92b4-1599-44b5-939b-a9c85f2c51a4 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.982709 Oct 29 21:16:32.308339 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2959/5814] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:31 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:16:33.175857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:33.176478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:33.183917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:33.184960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:33.185668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:33.186623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:33.187297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:33.187960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:33.337381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:33.339802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:33.341015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:33.349409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:33.349788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a1078ee7-8e97-4ce1-a5c2-46dcaa69775f tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1300 microversion: 2.1 time: 0.177422 Oct 29 21:16:33.351111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:33.351815 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2856/5815] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:33 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1300 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:33.352505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:33.354214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:33.354900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:33.356030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:33.911635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:33.921344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:33.924069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:33.937128 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9d36cde-c67e-40ab-b1ec-ff9e1e0593ee tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1724 microversion: 2.20 time: 0.603126 Oct 29 21:16:33.939220 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2960/5816] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:33 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1724 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:16:34.372326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:34.372948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:34.384794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:34.391267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:34.392112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:34.392803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:34.394046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:34.394737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:34.395616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:34.963976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:34.964613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:34.981948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:34.983408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:34.983852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:34.984583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:34.985039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:34.985623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:35.163360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:35.173390 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74df3be9-4498-4ecf-ba80-175ac9a0bf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.805044 Oct 29 21:16:35.190341 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2857/5817] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:34 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:35.221965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:35.247526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:35.253119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c6db5dbdaf2447d8c158f1a8076b290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad443ad0828409d8aada4cf90bfc696', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:35.257259 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6a455ac-2016-4c0b-8744-99a0a537702f tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 200 len: 1656 microversion: 2.20 time: 0.297018 Oct 29 21:16:35.264894 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2961/5818] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:34 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 1656 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 21:16:35.398919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7018a608-b3a6-49fc-8197-d19979b8218f req-4f910445-e8f2-4eaf-a393-1cfc16329a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803f923d-9ffa-416b-9eb2-6eb03cdefa47", "name": "network-vif-deleted", "tag": "e1202c46-66c1-43f4-8934-a228aa780d3a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:35.438268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7018a608-b3a6-49fc-8197-d19979b8218f req-4f910445-e8f2-4eaf-a393-1cfc16329a06 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:35.445002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7018a608-b3a6-49fc-8197-d19979b8218f req-4f910445-e8f2-4eaf-a393-1cfc16329a06 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:35.447439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7018a608-b3a6-49fc-8197-d19979b8218f req-4f910445-e8f2-4eaf-a393-1cfc16329a06 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:35.487618 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7018a608-b3a6-49fc-8197-d19979b8218f req-4f910445-e8f2-4eaf-a393-1cfc16329a06 service nova] Creating event network-vif-deleted:e1202c46-66c1-43f4-8934-a228aa780d3a for instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 on nch2-master-1 Oct 29 21:16:35.509245 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7018a608-b3a6-49fc-8197-d19979b8218f req-4f910445-e8f2-4eaf-a393-1cfc16329a06 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113043 Oct 29 21:16:35.511832 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2858/5819] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:36.197622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:36.199355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:36.220255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:36.224803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:36.226148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:36.231320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:36.232061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:36.232835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:36.288968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:36.292158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:36.315476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:36.317427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:36.317911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:36.321727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:36.322411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:36.339700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:36.371557 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] HTTP exception thrown: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Request method failure captured: Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 HTTP/1.1 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZZjK7hfuYZtMjnoWEpu4bRzUkfIRqmuHSWp-qgFoTdQC45JSgA6jhl6ZpYs4V-681yl0sOMVKRCfb7nelCJcoSV-vB38MUhy85B5259ZVnajiUMo3U9WHHVJjFjGic-z3laFwuucBkw-oiNSzx4Q6Lo1rkUU0pqSilWCe4XtS4ppPI Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 2c6db5dbdaf2447d8c158f1a8076b290 Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '803f923d-9ffa-416b-9eb2-6eb03cdefa47'} Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:36.374934 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:36.380121 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:36.388151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Returning 404 to user: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:36.389345 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0243cad2-23fb-4616-a7db-72bb81dfbed0 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 404 len: 111 microversion: 2.20 time: 0.107208 Oct 29 21:16:36.392106 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2859/5820] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:36 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 21:16:36.405644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-530c788a-dd6d-4957-803e-bf926d3879d6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '.version_select at 0x7fa170c03f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:36.464340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-530c788a-dd6d-4957-803e-bf926d3879d6 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059847928" status: 204 len: 0 microversion: 2.20 time: 0.067073 Oct 29 21:16:36.467055 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2860/5821] 10.222.0.36 () {60 vars in 1262 bytes} [Sat Oct 29 21:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059847928 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 21:16:36.834745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:36.857436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01466b04-66ca-424a-96bf-f6514c9c4cdc tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.659537 Oct 29 21:16:36.858141 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2962/5822] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:36 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:16:37.618747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-adb16b43-fdc1-4135-8b57-56906155a0e5 req-782bb937-0011-4d47-80a8-6fb7f5d21fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ee5a1-3f7a-482a-845d-898c52bb2bae", "tag": "c0135f60-1713-432e-8906-908898f34e07"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:37.636086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-adb16b43-fdc1-4135-8b57-56906155a0e5 req-782bb937-0011-4d47-80a8-6fb7f5d21fb2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:37.637610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-adb16b43-fdc1-4135-8b57-56906155a0e5 req-782bb937-0011-4d47-80a8-6fb7f5d21fb2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:37.638312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-adb16b43-fdc1-4135-8b57-56906155a0e5 req-782bb937-0011-4d47-80a8-6fb7f5d21fb2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:37.653126 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-adb16b43-fdc1-4135-8b57-56906155a0e5 req-782bb937-0011-4d47-80a8-6fb7f5d21fb2 service nova] Creating event network-changed:c0135f60-1713-432e-8906-908898f34e07 for instance e19ee5a1-3f7a-482a-845d-898c52bb2bae on nch1-master-1 Oct 29 21:16:37.668857 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-adb16b43-fdc1-4135-8b57-56906155a0e5 req-782bb937-0011-4d47-80a8-6fb7f5d21fb2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057590 Oct 29 21:16:37.670793 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2861/5823] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:37.886095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:37.887345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:37.897295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:37.898166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:37.898825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:37.899938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:37.900919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:37.901632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:38.260519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:38.268558 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6b8b4c8-0b90-4960-b0d9-3bc379945b42 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.392209 Oct 29 21:16:38.284718 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2963/5824] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:37 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:39.293360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:39.296754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:39.309975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:39.310483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:39.310928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:39.311645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:39.318507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:39.322637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:39.704932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:39.716773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aa8862d9-7bcc-4efc-b154-55525222f2a4 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.427648 Oct 29 21:16:39.717724 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2862/5825] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:39 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:40.438643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:40.439168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:40.442088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:40.442795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:40.458836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:40.459723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:40.460453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:40.461435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:40.462175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:40.462838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:40.479767 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] HTTP exception thrown: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Request method failure captured: Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 HTTP/1.1 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZZjK7hfuYZtMjnoWEpu4bRzUkfIRqmuHSWp-qgFoTdQC45JSgA6jhl6ZpYs4V-681yl0sOMVKRCfb7nelCJcoSV-vB38MUhy85B5259ZVnajiUMo3U9WHHVJjFjGic-z3laFwuucBkw-oiNSzx4Q6Lo1rkUU0pqSilWCe4XtS4ppPI Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 2c6db5dbdaf2447d8c158f1a8076b290 Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '803f923d-9ffa-416b-9eb2-6eb03cdefa47'} Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:16:40.481795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.486521 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.489216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Returning 404 to user: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:40.491022 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-06ba85fd-9f74-47fd-bfc9-1477e997e44b tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 404 len: 111 microversion: 2.20 time: 0.056546 Oct 29 21:16:40.492307 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2964/5826] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:16:40 2022] DELETE /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:16:40.500382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:40.501920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 803f923d-9ffa-416b-9eb2-6eb03cdefa47] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:40.512491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:40.513388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:40.514282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:40.515279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:40.515977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:40.516889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:40.531927 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] HTTP exception thrown: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Request method failure captured: Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 HTTP/1.1 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZZjK7hfuYZtMjnoWEpu4bRzUkfIRqmuHSWp-qgFoTdQC45JSgA6jhl6ZpYs4V-681yl0sOMVKRCfb7nelCJcoSV-vB38MUhy85B5259ZVnajiUMo3U9WHHVJjFjGic-z3laFwuucBkw-oiNSzx4Q6Lo1rkUU0pqSilWCe4XtS4ppPI Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 2c6db5dbdaf2447d8c158f1a8076b290 Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '803f923d-9ffa-416b-9eb2-6eb03cdefa47'} Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.533835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Returning 404 to user: Instance 803f923d-9ffa-416b-9eb2-6eb03cdefa47 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cf42c41-0e3f-4e4f-9cd1-52fdd31eb08c tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47" status: 404 len: 111 microversion: 2.20 time: 0.039298 Oct 29 21:16:40.540473 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2863/5827] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:40 2022] GET /compute/v2.1/servers/803f923d-9ffa-416b-9eb2-6eb03cdefa47 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:16:40.741275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:40.742371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:40.752734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:40.753246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:40.753727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:40.754449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:40.754960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:40.755401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:41.084549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:41.100583 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-76406e88-8e0d-4026-aaae-23787677cf56 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.363499 Oct 29 21:16:41.101308 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2965/5828] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:40 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:41.734571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:41.735085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:41.747645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:41.749707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:41.752204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:41.753404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:41.754158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:41.754844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:41.772111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] HTTP exception thrown: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Request method failure captured: Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 HTTP/1.1 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZZjK7hfuYZtMjnoWEpu4bRzUkfIRqmuHSWp-qgFoTdQC45JSgA6jhl6ZpYs4V-681yl0sOMVKRCfb7nelCJcoSV-vB38MUhy85B5259ZVnajiUMo3U9WHHVJjFjGic-z3laFwuucBkw-oiNSzx4Q6Lo1rkUU0pqSilWCe4XtS4ppPI Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 2c6db5dbdaf2447d8c158f1a8076b290 Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '01b200c4-ac17-4bbe-957c-2b52a946ffc6'} Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:16:41.775037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.778965 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.780937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Returning 404 to user: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:41.782932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36a35f5a-de7e-4e13-b948-3b4bf089d469 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 404 len: 111 microversion: 2.20 time: 0.052264 Oct 29 21:16:41.784037 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2864/5829] 10.222.0.36 () {60 vars in 1280 bytes} [Sat Oct 29 21:16:41 2022] DELETE /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:16:41.792387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:41.793542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] [instance: 01b200c4-ac17-4bbe-957c-2b52a946ffc6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:41.806406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:41.807975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:41.809926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:41.810923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:41.811430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:41.812007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:41.835108 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] HTTP exception thrown: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Request method failure captured: Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 HTTP/1.1 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZZjK7hfuYZtMjnoWEpu4bRzUkfIRqmuHSWp-qgFoTdQC45JSgA6jhl6ZpYs4V-681yl0sOMVKRCfb7nelCJcoSV-vB38MUhy85B5259ZVnajiUMo3U9WHHVJjFjGic-z3laFwuucBkw-oiNSzx4Q6Lo1rkUU0pqSilWCe4XtS4ppPI Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fad443ad0828409d8aada4cf90bfc696"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: fad443ad0828409d8aada4cf90bfc696 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1635390820 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 2c6db5dbdaf2447d8c158f1a8076b290 Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1635390820-project Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '01b200c4-ac17-4bbe-957c-2b52a946ffc6'} Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.837501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] Returning 404 to user: Instance 01b200c4-ac17-4bbe-957c-2b52a946ffc6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:41.842182 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1a1e6ba2-a6e4-4440-b4ce-3a5dfb4e29a8 tempest-AttachVolumeShelveTestJSON-1635390820 tempest-AttachVolumeShelveTestJSON-1635390820-project] 10.222.0.36 "GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6" status: 404 len: 111 microversion: 2.20 time: 0.051363 Oct 29 21:16:41.850299 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2966/5830] 10.222.0.36 () {60 vars in 1277 bytes} [Sat Oct 29 21:16:41 2022] GET /compute/v2.1/servers/01b200c4-ac17-4bbe-957c-2b52a946ffc6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:16:42.124218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:42.124876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:42.136874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:42.138395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:42.140909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:42.142088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:42.142950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:42.143700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:42.662883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:42.673242 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d3b3744-1c47-4269-b02c-cc80a0fd40d8 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.553006 Oct 29 21:16:42.687419 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2865/5831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:42 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:43.718432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-dc9ebeac-fc60-4f51-b88c-c0d02e7449bd req-e9a78a60-73e9-4488-bb21-48fc29795c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ee5a1-3f7a-482a-845d-898c52bb2bae", "name": "network-vif-plugged", "status": "completed", "tag": "c0135f60-1713-432e-8906-908898f34e07"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:43.720342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:43.730190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:43.756475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:43.757296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:43.768933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dc9ebeac-fc60-4f51-b88c-c0d02e7449bd req-e9a78a60-73e9-4488-bb21-48fc29795c73 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:43.769431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:43.770620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:43.774222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:43.775274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dc9ebeac-fc60-4f51-b88c-c0d02e7449bd req-e9a78a60-73e9-4488-bb21-48fc29795c73 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:43.780135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dc9ebeac-fc60-4f51-b88c-c0d02e7449bd req-e9a78a60-73e9-4488-bb21-48fc29795c73 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:43.780457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:43.828426 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-dc9ebeac-fc60-4f51-b88c-c0d02e7449bd req-e9a78a60-73e9-4488-bb21-48fc29795c73 service nova] Creating event network-vif-plugged:c0135f60-1713-432e-8906-908898f34e07 for instance e19ee5a1-3f7a-482a-845d-898c52bb2bae on nch1-master-1 Oct 29 21:16:43.836688 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-dc9ebeac-fc60-4f51-b88c-c0d02e7449bd req-e9a78a60-73e9-4488-bb21-48fc29795c73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122283 Oct 29 21:16:43.839383 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2866/5832] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:44.498836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:44.511882 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-abbc7183-8894-4fd3-95aa-a55978de5317 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.815889 Oct 29 21:16:44.514503 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2967/5833] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:43 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:45.539039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:45.542077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:45.551695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:45.552486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:45.554011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:45.554968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:45.556280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:45.556939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:45.585971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:46.468828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:46.486637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bbfce656-477e-413b-a312-e1c980d36433 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1368 microversion: 2.1 time: 0.950481 Oct 29 21:16:46.487286 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2867/5834] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:45 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1368 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:47.514073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:47.514840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:47.546209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:47.546818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:47.547397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:47.548359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:47.548972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:47.549482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:47.560176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=84 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:48.368191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:48.382204 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9989e115-3731-442a-9d30-f3f922fe4d3c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1558 microversion: 2.1 time: 0.871877 Oct 29 21:16:48.390001 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2968/5835] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:47 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1558 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:48.410224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:48.411573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:48.419429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:48.420164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:48.420614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:48.421569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:48.421877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:48.422550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:48.639129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f8b24e3-f332-4059-9d6e-f817c31a24fa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.234512 Oct 29 21:16:48.640209 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2868/5836] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:16:48 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:50.076450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ecd41d0e-3799-4bd1-98ad-a782ee6861a3 req-651c70ca-5694-4147-a806-cc7f3d03e778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ee5a1-3f7a-482a-845d-898c52bb2bae", "tag": "c0135f60-1713-432e-8906-908898f34e07"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:50.092546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ecd41d0e-3799-4bd1-98ad-a782ee6861a3 req-651c70ca-5694-4147-a806-cc7f3d03e778 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:50.097307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ecd41d0e-3799-4bd1-98ad-a782ee6861a3 req-651c70ca-5694-4147-a806-cc7f3d03e778 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:50.098110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ecd41d0e-3799-4bd1-98ad-a782ee6861a3 req-651c70ca-5694-4147-a806-cc7f3d03e778 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:50.122378 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ecd41d0e-3799-4bd1-98ad-a782ee6861a3 req-651c70ca-5694-4147-a806-cc7f3d03e778 service nova] Creating event network-changed:c0135f60-1713-432e-8906-908898f34e07 for instance e19ee5a1-3f7a-482a-845d-898c52bb2bae on nch1-master-1 Oct 29 21:16:50.138559 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ecd41d0e-3799-4bd1-98ad-a782ee6861a3 req-651c70ca-5694-4147-a806-cc7f3d03e778 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069021 Oct 29 21:16:50.140613 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2969/5837] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:50.455867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1548451170", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:50.534618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:16:51.388971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:16:51.389402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:16:51.389915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:16:51.390336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:16:51.390755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:16:51.404330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:51.404836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:51.405293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:51.406063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:51.406529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:51.408895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:51.453869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Getting quotas for project 99d823b5b6e143b1893ac4001ecee8f5. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:16:51.465720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Getting quotas for user d3f40972099f47318f7c17c7e697054d and project 99d823b5b6e143b1893ac4001ecee8f5. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:16:51.498325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:16:51.501014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:16:51.583235 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7634eeab-1c97-4649-931c-dc6c142b624e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132990 Oct 29 21:16:51.590632 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2869/5838] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:16:51.598319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b454a44-483c-460e-8da0-2cf37b36a243 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:51.599073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b454a44-483c-460e-8da0-2cf37b36a243 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:51.824864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b454a44-483c-460e-8da0-2cf37b36a243 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:51.832467 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b454a44-483c-460e-8da0-2cf37b36a243 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1214 microversion: 2.1 time: 0.240593 Oct 29 21:16:51.835055 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2970/5839] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:51 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:52.860977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:52.862217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:52.882587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:52.883310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:52.883933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:52.884848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:52.885507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:52.886104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:53.014320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:53.030177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-54c13fb8-5d74-4d17-bf6c-9a9ee36b320f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1266 microversion: 2.1 time: 0.174410 Oct 29 21:16:53.030784 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2870/5840] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:52 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:16:54.053682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:54.054278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:54.075913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:54.079834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:54.081795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:54.084580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:54.086534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:54.090015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:54.231137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acda1372-6d56-47da-b340-3fb555dfaa20 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Action: 'create', calling method: .version_select at 0x7fa170110b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1361836934"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:54.384458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:54.404764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-437d5d7f-e664-4a0c-836a-f81bc6ce427d tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1272 microversion: 2.1 time: 0.356178 Oct 29 21:16:54.420147 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2871/5841] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:54 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1272 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:54.817516 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acda1372-6d56-47da-b340-3fb555dfaa20 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.847625 Oct 29 21:16:54.819223 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2971/5842] 10.222.0.36 () {60 vars in 1155 bytes} [Sat Oct 29 21:16:53 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 850 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 21:16:54.831926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0f4564f2-ce7b-4650-98c6-8b61e807d6d4 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa171e69700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:54.909086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0f4564f2-ce7b-4650-98c6-8b61e807d6d4 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 200 len: 338 microversion: 2.1 time: 0.081076 Oct 29 21:16:54.915617 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2872/5843] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:16:54 2022] GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 338 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:55.431854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:55.433252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:55.440072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:55.440789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:55.441382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:55.442293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:55.443667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:55.444246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:55.774580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:55.787667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-851c5cd4-03e8-4696-83b1-686086c950ee tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.361218 Oct 29 21:16:55.795548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2972/5844] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:55 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:55.924871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c21a1761-77a0-45d1-b966-34950811b4ca tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170c1dca0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:56.208726 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c21a1761-77a0-45d1-b966-34950811b4ca tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 200 len: 339 microversion: 2.1 time: 0.288499 Oct 29 21:16:56.215033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2873/5845] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:16:55 2022] GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 339 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:56.254422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-955df4a9-352d-477c-8fc7-c99eb79e940b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Action: 'create', calling method: .version_select at 0x7fa1700a4550>, body: {"snapshot": {"volume_id": "b0c7b023-ca52-40e5-8beb-7f1b5954c3e8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-276542326"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:56.655902 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-955df4a9-352d-477c-8fc7-c99eb79e940b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.429016 Oct 29 21:16:56.656753 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2973/5846] 10.222.0.36 () {60 vars in 1162 bytes} [Sat Oct 29 21:16:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:56.668132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de6c7485-9da9-40f8-a429-20f4586da67a tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170b87dc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:56.707328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de6c7485-9da9-40f8-a429-20f4586da67a tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174" status: 200 len: 286 microversion: 2.1 time: 0.043072 Oct 29 21:16:56.708816 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2874/5847] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 21:16:56 2022] GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:56.720530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f63f196e-e2b1-483b-afce-850fd484650d tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa1700a89d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:56.760902 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f63f196e-e2b1-483b-afce-850fd484650d tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044821 Oct 29 21:16:56.761815 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2974/5848] 10.222.0.36 () {58 vars in 1140 bytes} [Sat Oct 29 21:16:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:56.773719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5edfeae-980b-4adc-b9c8-ac58512065db tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170c1d940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:56.812426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:56.813437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:56.824973 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d5edfeae-980b-4adc-b9c8-ac58512065db tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174" status: 200 len: 286 microversion: 2.1 time: 0.055784 Oct 29 21:16:56.825886 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2875/5849] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 21:16:56 2022] GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:56.832451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:56.832952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:56.835301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:56.836495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:56.838388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:56.842144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:57.217852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:57.227990 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-60d957ed-1228-4c80-ba1f-43315c1a6f4b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.420995 Oct 29 21:16:57.230519 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2975/5850] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:56 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:57.840265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b6e475a-fe50-44cf-b330-9b20a7246637 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170b50f70>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:57.876997 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b6e475a-fe50-44cf-b330-9b20a7246637 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174" status: 200 len: 287 microversion: 2.1 time: 0.042290 Oct 29 21:16:57.891543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00ef6547-48bb-4938-ac8c-e0f17585bc32 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170112e50>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:57.894280 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2876/5851] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 21:16:57 2022] GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:57.970507 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00ef6547-48bb-4938-ac8c-e0f17585bc32 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174" status: 202 len: 0 microversion: 2.1 time: 0.083266 Oct 29 21:16:57.971285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2976/5852] 10.222.0.36 () {58 vars in 1254 bytes} [Sat Oct 29 21:16:57 2022] DELETE /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:16:57.981739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-afb15573-f416-4753-953f-15d57a4b7549 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170c1de50>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:58.017046 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-afb15573-f416-4753-953f-15d57a4b7549 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174" status: 200 len: 286 microversion: 2.1 time: 0.040785 Oct 29 21:16:58.022967 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2877/5853] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 21:16:57 2022] GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:58.119377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0e9495a7-8e2d-49ee-81a3-ac68f18a12f9 req-c27dc78d-3f24-49ee-a1c3-32f8a5775c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00", "tag": "2a1b0790-58f0-4454-9c10-7882769de346"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:16:58.138478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:58.141147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0e9495a7-8e2d-49ee-81a3-ac68f18a12f9 req-c27dc78d-3f24-49ee-a1c3-32f8a5775c4e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:58.141918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0e9495a7-8e2d-49ee-81a3-ac68f18a12f9 req-c27dc78d-3f24-49ee-a1c3-32f8a5775c4e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:58.143256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0e9495a7-8e2d-49ee-81a3-ac68f18a12f9 req-c27dc78d-3f24-49ee-a1c3-32f8a5775c4e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:58.155755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0e9495a7-8e2d-49ee-81a3-ac68f18a12f9 req-c27dc78d-3f24-49ee-a1c3-32f8a5775c4e service nova] Creating event network-changed:2a1b0790-58f0-4454-9c10-7882769de346 for instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 on nch2-master-1 Oct 29 21:16:58.163094 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0e9495a7-8e2d-49ee-81a3-ac68f18a12f9 req-c27dc78d-3f24-49ee-a1c3-32f8a5775c4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048621 Oct 29 21:16:58.164324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2977/5854] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:58.257492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:58.261673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:58.274119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:58.275362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:58.276966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:58.279489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:58.279973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:58.280416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:58.543913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:58.555687 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c30a39a-25e0-4911-b7e5-5a9c76d01968 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.304461 Oct 29 21:16:58.556913 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2878/5855] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:58 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:16:59.030917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8cd8a99-77fc-4f58-b758-9f85a79cdd7f tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170371040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:59.065998 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-a8cd8a99-77fc-4f58-b758-9f85a79cdd7f tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] HTTP exception thrown: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8cd8a99-77fc-4f58-b758-9f85a79cdd7f tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Request method failure captured: Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 HTTP/1.1 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZhFvLlA0HphdSzLOabOREx0unApyrrEXsrTvoCr8dadzjBgZ0OBh1SFXZZ8Hv0UjPCLFRJO8A_tbLJntDxnTUVYgj0L3uZAHgu76S9vX0eChNfMvTQbba8TEdRr-oooBWe_NhMTPt_dfSBzMkDzd9jGMVR-E0adSz-IrwpKj2YaKuA Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d4b9a1b71d0640aeb2deb340ea310f88 Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: exception: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '890db0bc-6ee4-41b2-84c6-cc4cdd37e174'} Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. (HTTP 404) (Request-ID: req-222ef266-5be7-45be-b1a9-42e94187a6e6) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:16:59.077141 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8cd8a99-77fc-4f58-b758-9f85a79cdd7f tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Returning 404 to user: Snapshot 890db0bc-6ee4-41b2-84c6-cc4cdd37e174 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:16:59.082852 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8cd8a99-77fc-4f58-b758-9f85a79cdd7f tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174" status: 404 len: 111 microversion: 2.1 time: 0.056439 Oct 29 21:16:59.090747 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2978/5856] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 21:16:59 2022] GET /compute/v2.1/os-snapshots/890db0bc-6ee4-41b2-84c6-cc4cdd37e174 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:16:59.095084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170b87430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:59.173442 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 202 len: 0 microversion: 2.1 time: 0.084162 Oct 29 21:16:59.174207 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2879/5857] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:16:59 2022] DELETE /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:16:59.186262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb29f234-fe6c-400c-a243-4f677fa66851 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa17021f700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:59.264985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb29f234-fe6c-400c-a243-4f677fa66851 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 200 len: 338 microversion: 2.1 time: 0.084937 Oct 29 21:16:59.267881 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2979/5858] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:16:59 2022] GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:16:59.581342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:16:59.581998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:16:59.584560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:16:59.594123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:59.594642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:59.595117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:59.595938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:16:59.596585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:16:59.597183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:16:59.765872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:16:59.774601 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4ed7b248-685a-4ee6-8a5a-7696b940903e tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.197324 Oct 29 21:16:59.775205 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2880/5859] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:16:59 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:00.283606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99381dcd-88d3-4141-b6f0-e66363843d3c tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa1700319d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:00.317227 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-99381dcd-88d3-4141-b6f0-e66363843d3c tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] HTTP exception thrown: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99381dcd-88d3-4141-b6f0-e66363843d3c tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Request method failure captured: Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 HTTP/1.1 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZhFvLlA0HphdSzLOabOREx0unApyrrEXsrTvoCr8dadzjBgZ0OBh1SFXZZ8Hv0UjPCLFRJO8A_tbLJntDxnTUVYgj0L3uZAHgu76S9vX0eChNfMvTQbba8TEdRr-oooBWe_NhMTPt_dfSBzMkDzd9jGMVR-E0adSz-IrwpKj2YaKuA Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d4b9a1b71d0640aeb2deb340ea310f88 Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: exception: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b0c7b023-ca52-40e5-8beb-7f1b5954c3e8'} Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. (HTTP 404) (Request-ID: req-6584d5e0-bb2e-438e-86ab-77be8107f4a8) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:17:00.320411 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.325113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-99381dcd-88d3-4141-b6f0-e66363843d3c tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Returning 404 to user: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:17:00.328767 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-99381dcd-88d3-4141-b6f0-e66363843d3c tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 404 len: 109 microversion: 2.1 time: 0.048305 Oct 29 21:17:00.329970 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2980/5860] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:17:00 2022] GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:17:00.340192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22e37954-32e8-4791-ae52-f79df56c163b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170c1ddc0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:00.377374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-22e37954-32e8-4791-ae52-f79df56c163b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] HTTP exception thrown: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22e37954-32e8-4791-ae52-f79df56c163b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Request method failure captured: Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 HTTP/1.1 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZhFvLlA0HphdSzLOabOREx0unApyrrEXsrTvoCr8dadzjBgZ0OBh1SFXZZ8Hv0UjPCLFRJO8A_tbLJntDxnTUVYgj0L3uZAHgu76S9vX0eChNfMvTQbba8TEdRr-oooBWe_NhMTPt_dfSBzMkDzd9jGMVR-E0adSz-IrwpKj2YaKuA Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: d4b9a1b71d0640aeb2deb340ea310f88 Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: method: Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: exception: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b0c7b023-ca52-40e5-8beb-7f1b5954c3e8'} Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. (HTTP 404) (Request-ID: req-34f66005-e82d-4c4e-a10e-08136fb0fc7b) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:17:00.379814 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.384033 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.391444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-22e37954-32e8-4791-ae52-f79df56c163b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Returning 404 to user: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:17:00.392585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-22e37954-32e8-4791-ae52-f79df56c163b tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 404 len: 109 microversion: 2.1 time: 0.057178 Oct 29 21:17:00.393685 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2881/5861] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:17:00 2022] DELETE /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:17:00.422525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5a46dd4-8d30-45e8-af9e-1fa2c43a97a5 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Calling method '.version_select at 0x7fa170031c10>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:00.491960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-a5a46dd4-8d30-45e8-af9e-1fa2c43a97a5 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] HTTP exception thrown: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5a46dd4-8d30-45e8-af9e-1fa2c43a97a5 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Request method failure captured: Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 HTTP/1.1 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZhFvLlA0HphdSzLOabOREx0unApyrrEXsrTvoCr8dadzjBgZ0OBh1SFXZZ8Hv0UjPCLFRJO8A_tbLJntDxnTUVYgj0L3uZAHgu76S9vX0eChNfMvTQbba8TEdRr-oooBWe_NhMTPt_dfSBzMkDzd9jGMVR-E0adSz-IrwpKj2YaKuA Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/622a4fd091fd467d9d07c1e8bfbd0d1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 622a4fd091fd467d9d07c1e8bfbd0d1a Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519697196 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d4b9a1b71d0640aeb2deb340ea310f88 Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519697196-project Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: method: Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: exception: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b0c7b023-ca52-40e5-8beb-7f1b5954c3e8'} Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. (HTTP 404) (Request-ID: req-6dafaaa3-d79a-429d-bc70-86ce8e2fe7a7) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 21:17:00.496380 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5a46dd4-8d30-45e8-af9e-1fa2c43a97a5 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] Returning 404 to user: Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5a46dd4-8d30-45e8-af9e-1fa2c43a97a5 tempest-VolumesSnapshotsTestJSON-1519697196 tempest-VolumesSnapshotsTestJSON-1519697196-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8" status: 404 len: 109 microversion: 2.1 time: 0.100161 Oct 29 21:17:00.501155 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2981/5862] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:17:00 2022] GET /compute/v2.1/os-volumes/b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:17:00.799644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:00.800344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:00.811762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:00.813158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:00.819812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:00.820590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:00.821076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:00.821552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:01.071952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:01.085362 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4bcf5863-a812-43d4-a157-83510d260473 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.291248 Oct 29 21:17:01.086495 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2882/5863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:00 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:02.107215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:02.112937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:02.113910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:02.127915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:02.149174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:02.150207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:02.161120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:02.162538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:02.163645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:02.884618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:02.897600 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86cc490b-b343-4180-9575-9a17be33d13b tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.793831 Oct 29 21:17:02.898216 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2982/5864] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:02 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:03.927751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:03.929365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:03.934259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:03.935898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:03.940947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:03.945024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:03.946187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:03.951649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:03.953196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:03.953914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:04.393254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:04.404554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a213d494-04ed-441e-9db1-1710e54651fa tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.486787 Oct 29 21:17:04.405731 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2883/5865] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:03 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:04.774263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-06c928f3-80ed-4978-baeb-1e3b16bb67b6 req-daca764b-b737-4e16-9e59-ff2e77079da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00", "name": "network-vif-plugged", "status": "completed", "tag": "2a1b0790-58f0-4454-9c10-7882769de346"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:17:04.793977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-06c928f3-80ed-4978-baeb-1e3b16bb67b6 req-daca764b-b737-4e16-9e59-ff2e77079da2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:04.794468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-06c928f3-80ed-4978-baeb-1e3b16bb67b6 req-daca764b-b737-4e16-9e59-ff2e77079da2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:04.794904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-06c928f3-80ed-4978-baeb-1e3b16bb67b6 req-daca764b-b737-4e16-9e59-ff2e77079da2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:04.824201 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-06c928f3-80ed-4978-baeb-1e3b16bb67b6 req-daca764b-b737-4e16-9e59-ff2e77079da2 service nova] Creating event network-vif-plugged:2a1b0790-58f0-4454-9c10-7882769de346 for instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 on nch2-master-1 Oct 29 21:17:04.839314 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-06c928f3-80ed-4978-baeb-1e3b16bb67b6 req-daca764b-b737-4e16-9e59-ff2e77079da2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068612 Oct 29 21:17:04.840223 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2983/5866] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:17:05.433586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:05.434892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:05.447916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:05.448421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:05.448864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:05.451390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:05.451887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:05.452331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:05.764181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:05.774661 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1e5d9d8-30f2-4c2b-88ce-59c37f28de3f tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1314 microversion: 2.1 time: 0.345156 Oct 29 21:17:05.795591 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2884/5867] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:05 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:06.808157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:06.830885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:06.840434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:06.842371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:06.843003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:06.845144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:06.845830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:06.854399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:07.269499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:07.284020 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ee3a748-2bca-422e-b467-22058c795a75 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1464 microversion: 2.1 time: 0.482141 Oct 29 21:17:07.286086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2984/5868] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:06 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1464 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:07.312232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8cbe8d3-34bb-4c13-afa9-f67aeb021217", "device": "/dev/sdb"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:17:07.314873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:07.332765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:07.334156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:07.334623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:07.335393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:07.337984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:07.340674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:07.748436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0974ee80-1b80-4c17-9097-76c76139fb9a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "POST /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440445 Oct 29 21:17:07.750779 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2885/5869] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:17:07 2022] POST /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:17:19.329323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:19.330836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:19.342038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=7 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:19.347106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=35 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:19.366260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:19.367091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:19.367779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:19.371605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:19.373800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:19.377018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:19.521997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lazy-loading 'services' on Instance uuid 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:17:19.660541 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61d4c3a3-10ff-4bec-9984-d96effa516da tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "DELETE /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00/os-volume_attachments/a8cbe8d3-34bb-4c13-afa9-f67aeb021217" status: 202 len: 0 microversion: 2.1 time: 0.335219 Oct 29 21:17:19.662353 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2985/5870] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:17:19 2022] DELETE /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00/os-volume_attachments/a8cbe8d3-34bb-4c13-afa9-f67aeb021217 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:17:20.917735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:20.919054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:20.932476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=9 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:20.935959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:20.937841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:20.940370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:20.942383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:20.943150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:20.943625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:20.944070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:21.014207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:17:21.174226 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be7c4eee-90ea-4ea4-a6dd-42f46e591a54 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "DELETE /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 204 len: 0 microversion: 2.1 time: 0.261447 Oct 29 21:17:21.174898 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2886/5871] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:17:20 2022] DELETE /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:17:21.184757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:21.185482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:21.200935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:21.202041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:21.202933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:21.204267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:21.212393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:21.213156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:21.513717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:21.529122 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ece8e67-4f65-4540-8fbd-4946368ff11a tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1470 microversion: 2.1 time: 0.347789 Oct 29 21:17:21.530181 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2986/5872] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:21 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:22.559409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:22.560848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:22.572913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:22.573408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:22.573904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:22.574613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:22.575141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:22.575572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:22.959881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:22.974036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3739a214-f506-4793-ba2e-f7fc39c31d43 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1470 microversion: 2.1 time: 0.423273 Oct 29 21:17:22.975339 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2887/5873] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:22 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:24.003340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:24.003977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:24.017352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:24.017880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:24.018319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:24.019035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:24.019490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:24.019916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:24.225597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f40972099f47318f7c17c7e697054d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d823b5b6e143b1893ac4001ecee8f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:24.242946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-509f126c-7764-48d0-8021-bd5c30e92686 req-0221fd31-f3c7-4787-8932-02ea55e275e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00", "name": "network-vif-deleted", "tag": "2a1b0790-58f0-4454-9c10-7882769de346"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:17:24.247796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e5a2e8e-4036-4968-be34-7d9b222a21e0 tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 200 len: 1428 microversion: 2.1 time: 0.249532 Oct 29 21:17:24.252976 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2987/5874] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:23 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 1428 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:24.271827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-509f126c-7764-48d0-8021-bd5c30e92686 req-0221fd31-f3c7-4787-8932-02ea55e275e4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:24.273041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-509f126c-7764-48d0-8021-bd5c30e92686 req-0221fd31-f3c7-4787-8932-02ea55e275e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:24.287350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-509f126c-7764-48d0-8021-bd5c30e92686 req-0221fd31-f3c7-4787-8932-02ea55e275e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:24.335233 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-509f126c-7764-48d0-8021-bd5c30e92686 req-0221fd31-f3c7-4787-8932-02ea55e275e4 service nova] Creating event network-vif-deleted:2a1b0790-58f0-4454-9c10-7882769de346 for instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 on nch2-master-1 Oct 29 21:17:24.371880 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-509f126c-7764-48d0-8021-bd5c30e92686 req-0221fd31-f3c7-4787-8932-02ea55e275e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133080 Oct 29 21:17:24.374956 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2888/5875] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:17:25.280022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:25.280762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] [instance: 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:25.292708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:25.293546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:25.294182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:25.294911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:25.295371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:25.295789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:25.330015 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] HTTP exception thrown: Instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 could not be found. Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Request method failure captured: Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 HTTP/1.1 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZhAkNFdCX2y-2INV9aagN4aruCuH3qZYuXKnnVFq_tjQ9SqdxehEdPv_diIjb2vZouOumx1otLrulslHwfaVndenAF9Ah2WPJSsjyIuh2ZgeolNdDiSt9YB5I_c5AR8fcqd0jgMca9OUEs_dNSQEs7tTKyNlqevC0cdMShcxTd0nDA Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 99d823b5b6e143b1893ac4001ecee8f5 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesBackupsTest-782410826 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/99d823b5b6e143b1893ac4001ecee8f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_99d823b5b6e143b1893ac4001ecee8f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/99d823b5b6e143b1893ac4001ecee8f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/99d823b5b6e143b1893ac4001ecee8f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesBackupsTest-782410826 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 99d823b5b6e143b1893ac4001ecee8f5 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesBackupsTest-782410826 Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesBackupsTest-782410826-project Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: d3f40972099f47318f7c17c7e697054d Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesBackupsTest-782410826-project Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 could not be found. Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00'} Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 could not be found. Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 could not be found. Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:25.336501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 could not be found. Oct 29 21:17:25.341575 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:17:25.346485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] Returning 404 to user: Instance 01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:17:25.347848 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81875433-1a8b-40aa-bd0d-95e79383addc tempest-VolumesBackupsTest-782410826 tempest-VolumesBackupsTest-782410826-project] 10.222.0.36 "GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00" status: 404 len: 111 microversion: 2.1 time: 0.072681 Oct 29 21:17:25.348899 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2988/5876] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:25 2022] GET /compute/v2.1/servers/01fc54d1-b3b0-4fbe-b4f4-e77d43e8bd00 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:17:51.038054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:51.039847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:51.047401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:51.048362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:51.050600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:51.051582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:51.052203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:51.053141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:51.053909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:51.054516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:51.212094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lazy-loading 'services' on Instance uuid b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:17:51.379381 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3/os-volume_attachments/bde4424f-a811-49fc-b4f0-5d5fc9767766" status: 202 len: 0 microversion: 2.1 time: 0.347008 Oct 29 21:17:51.380505 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2889/5877] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:17:51 2022] DELETE /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3/os-volume_attachments/bde4424f-a811-49fc-b4f0-5d5fc9767766 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:17:52.593153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:52.593834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:52.600358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:52.602405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:17:52.605328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:52.606152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:52.607012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:52.608140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:52.609666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:52.610369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:52.675821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:17:52.849060 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df4c581b-9ccd-4c8d-94db-2c0472c79ad8 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 204 len: 0 microversion: 2.1 time: 0.260373 Oct 29 21:17:52.850078 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2989/5878] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:17:52 2022] DELETE /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:17:52.858658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:52.860299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:52.880138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:52.880994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:52.881625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:52.882587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:52.883429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:52.884025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:53.530874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:53.542257 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27768a50-abe4-4327-a5f4-9b9649afdf38 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1513 microversion: 2.1 time: 0.687628 Oct 29 21:17:53.542869 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2890/5879] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:52 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1513 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:54.567655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:54.568378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:54.580090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:54.580601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:54.585019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:54.586139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:54.586771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:54.587622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:54.985281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:55.000472 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b226de1-d2be-4e17-a670-5bf982c1da79 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1513 microversion: 2.1 time: 0.437784 Oct 29 21:17:55.002124 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2990/5880] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:54 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1513 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:55.556733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-91f92d4e-9604-46bc-8b3b-27d2f7f5789a req-31744508-ca23-469b-97c8-b65d17ad40ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3", "name": "network-vif-deleted", "tag": "26ec5a2f-4a1c-451f-8e8f-272dd2df7fd1"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:17:55.578583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-91f92d4e-9604-46bc-8b3b-27d2f7f5789a req-31744508-ca23-469b-97c8-b65d17ad40ca service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:55.580547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-91f92d4e-9604-46bc-8b3b-27d2f7f5789a req-31744508-ca23-469b-97c8-b65d17ad40ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:55.581085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-91f92d4e-9604-46bc-8b3b-27d2f7f5789a req-31744508-ca23-469b-97c8-b65d17ad40ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:55.610587 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-91f92d4e-9604-46bc-8b3b-27d2f7f5789a req-31744508-ca23-469b-97c8-b65d17ad40ca service nova] Creating event network-vif-deleted:26ec5a2f-4a1c-451f-8e8f-272dd2df7fd1 for instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 on nch2-master-1 Oct 29 21:17:55.627722 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-91f92d4e-9604-46bc-8b3b-27d2f7f5789a req-31744508-ca23-469b-97c8-b65d17ad40ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077398 Oct 29 21:17:55.628349 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2891/5881] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:17:56.032008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:56.032749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:56.044947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:56.045469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:56.046238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:56.048168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:56.049023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:56.049658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:56.097749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:56.099576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:56.100334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:56.101217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lazy-loading 'fault' on Instance uuid b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:17:56.236590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bbe6295ba34150b3609466e42c8abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10601894adb44985b208c3ab7ffa22c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:17:56.251586 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc3a4f4a-8e02-49e6-9e25-1ca773b86bc4 tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 200 len: 1308 microversion: 2.1 time: 0.224478 Oct 29 21:17:56.252781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2991/5882] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:56 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:17:57.281558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:57.282325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] [instance: b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:57.297185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:57.297753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:57.298219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:57.298966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:57.299438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:57.299879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:57.336228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] HTTP exception thrown: Instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 could not be found. Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Request method failure captured: Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 HTTP/1.1 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZdiU0xX9yViS5d6eAYUnB6anpuJhp0UTZPS2FMyrRlaCARQnBCBCI6eHj1VRCXl0__BHP-X0UiuLcfte9RyZsacrmALgNm3J3aZqWZpl2frqRwgNmU4pUJ9qNwQshBiYmbomjOnvhJZuNwmTzJ9os1WYpnD3gq-zUbiJaI9i1yNr8s Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 10601894adb44985b208c3ab7ffa22c8 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1969201650 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10601894adb44985b208c3ab7ffa22c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-VolumesSnapshotTestJSON-1969201650 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 10601894adb44985b208c3ab7ffa22c8 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1969201650 Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-VolumesSnapshotTestJSON-1969201650-project Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 04bbe6295ba34150b3609466e42c8abd Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-VolumesSnapshotTestJSON-1969201650-project Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 could not be found. Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3'} Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 could not be found. Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 could not be found. Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:17:57.340238 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 could not be found. Oct 29 21:17:57.344496 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:17:57.346493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] Returning 404 to user: Instance b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:17:57.349773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eeb1440e-5d41-413c-bc50-1fa63391675a tempest-VolumesSnapshotTestJSON-1969201650 tempest-VolumesSnapshotTestJSON-1969201650-project] 10.222.0.36 "GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3" status: 404 len: 111 microversion: 2.1 time: 0.072153 Oct 29 21:17:57.352533 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2892/5883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:17:57 2022] GET /compute/v2.1/servers/b61a143a-4b2a-4e27-8a70-ddee7a1f7dd3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:17:58.189874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:17:58.190513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:17:58.208067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:58.209718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:58.211858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:58.213253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:17:58.214546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:17:58.218068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:17:58.276276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de0f993f-8896-407c-88fb-5fe5437b7692 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/ips" status: 200 len: 149 microversion: 2.1 time: 0.457193 Oct 29 21:17:58.278028 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2992/5884] 10.222.0.36 () {58 vars in 1248 bytes} [Sat Oct 29 21:17:57 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/ips => generated 149 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:00.082809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "648d9275-b6e9-4edb-bc1e-85914451cce2"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:00.086798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:00.119393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:00.121817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:00.122190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:00.123668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:00.126482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:00.129053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:00.680596 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e20f6fec-5012-4702-b160-33acda1dc62c tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "POST /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601727 Oct 29 21:18:00.683539 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2893/5885] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:18:00 2022] POST /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:05.676380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:05.676956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:05.686336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:05.686903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:05.687588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:05.688517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:05.693834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:05.694633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:05.836473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lazy-loading 'services' on Instance uuid e19ee5a1-3f7a-482a-845d-898c52bb2bae {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:18:05.986386 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments/648d9275-b6e9-4edb-bc1e-85914451cce2" status: 202 len: 0 microversion: 2.1 time: 0.313828 Oct 29 21:18:05.992285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2993/5886] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:18:05 2022] DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments/648d9275-b6e9-4edb-bc1e-85914451cce2 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:18:05.998734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:06.000556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:06.017290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:06.017832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:06.018286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:06.019092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:06.019557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:06.020343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:06.084899 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87c810a6-e1a2-4272-81e6-bd9b0042090e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092092 Oct 29 21:18:06.100406 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2894/5887] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:18:05 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:07.117784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:07.122738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:07.137510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:07.138025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:07.138473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:07.139182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:07.141697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:07.148084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:07.237571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-224ac16c-7e7e-4e08-a2f8-1f95ca1035e0 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129916 Oct 29 21:18:07.243629 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2994/5888] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:18:07 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:18:07.345409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:07.346629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:07.355139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:07.355886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:07.356629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:07.357628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:07.358308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:07.359019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:07.389427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:18:07.543731 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45450287-9f7a-440d-af23-2df80fa2e02e tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 204 len: 0 microversion: 2.1 time: 0.201079 Oct 29 21:18:07.544998 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2895/5889] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:18:07 2022] DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:18:07.554707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:07.555587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:07.562906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:07.563686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:07.564321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:07.565565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:07.566376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:07.566970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:07.814131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:07.829188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-028f6d18-8200-4e89-997f-9b0a6a9261c7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1682 microversion: 2.1 time: 0.276128 Oct 29 21:18:07.829867 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2995/5890] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:07 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1682 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:08.856019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:08.856958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:08.870420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:08.870640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:08.871216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:08.871806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:08.872270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:08.872700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:09.452797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:09.470071 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d602c789-86f0-43ff-a0d9-a6c26c6ac0db tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1682 microversion: 2.1 time: 0.617325 Oct 29 21:18:09.471172 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2896/5891] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:08 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1682 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:10.495829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:10.497599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:10.510844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:10.513946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:10.516702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:10.517927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:10.520787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:10.521448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:11.052759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:11.062620 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2e1b6fad-c9e2-455b-a204-07841ee06748 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1682 microversion: 2.1 time: 0.571888 Oct 29 21:18:11.069513 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2996/5892] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:10 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1682 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:12.095664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:12.098098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:12.117576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:12.118900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:12.119383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:12.123289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:12.124654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:12.127645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:12.368000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21c99f8530a41439b59b8dbaf2369dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbee029e55124f2bb37672fbee64a42c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:12.386943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5612cb6d-17b1-41ab-b077-99664a756f09 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 200 len: 1327 microversion: 2.1 time: 0.295804 Oct 29 21:18:12.388989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2997/5893] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:12 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 1327 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:12.519706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1739d158-270e-47ed-b189-3618380927fb req-7dfa1e48-410c-4bfa-8b1d-341c61e1b4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ee5a1-3f7a-482a-845d-898c52bb2bae", "name": "network-vif-deleted", "tag": "c0135f60-1713-432e-8906-908898f34e07"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:12.552102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1739d158-270e-47ed-b189-3618380927fb req-7dfa1e48-410c-4bfa-8b1d-341c61e1b4a5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:12.559824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1739d158-270e-47ed-b189-3618380927fb req-7dfa1e48-410c-4bfa-8b1d-341c61e1b4a5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:12.560576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1739d158-270e-47ed-b189-3618380927fb req-7dfa1e48-410c-4bfa-8b1d-341c61e1b4a5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:12.590780 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1739d158-270e-47ed-b189-3618380927fb req-7dfa1e48-410c-4bfa-8b1d-341c61e1b4a5 service nova] Creating event network-vif-deleted:c0135f60-1713-432e-8906-908898f34e07 for instance e19ee5a1-3f7a-482a-845d-898c52bb2bae on nch1-master-1 Oct 29 21:18:12.626082 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1739d158-270e-47ed-b189-3618380927fb req-7dfa1e48-410c-4bfa-8b1d-341c61e1b4a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.574965 Oct 29 21:18:12.627671 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2897/5894] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:13.416730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:13.417351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:13.432286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:13.432791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:13.433874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:13.434620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:13.436958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:13.437638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:13.477007 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae HTTP/1.1 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'e19ee5a1-3f7a-482a-845d-898c52bb2bae'} Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:13.485223 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:13.490701 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:13.500961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:13.501873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0e333875-e2a0-45af-8d99-8e0adf3d08e1 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 404 len: 111 microversion: 2.1 time: 0.089543 Oct 29 21:18:13.502767 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2998/5895] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:13 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:13.511456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-716440c3-db23-41a7-b258-5b55f43a3dfd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '.version_select at 0x7fa170b1eaf0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:13.562670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-716440c3-db23-41a7-b258-5b55f43a3dfd tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299134906" status: 202 len: 0 microversion: 2.1 time: 0.055317 Oct 29 21:18:13.563515 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2898/5896] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299134906 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:18:17.092120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:17.092750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:17.103657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:17.113502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:17.114510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:17.116206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:17.116805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:17.117360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:17.154033 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae HTTP/1.1 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'e19ee5a1-3f7a-482a-845d-898c52bb2bae'} Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:17.160538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.166495 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.168221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:17.170241 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fe1a2835-c5b9-4435-a5f2-5e990f8032b7 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 404 len: 111 microversion: 2.1 time: 0.082364 Oct 29 21:18:17.173809 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 2999/5897] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:18:17 2022] DELETE /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:17.188810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:17.188810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: e19ee5a1-3f7a-482a-845d-898c52bb2bae] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:17.200775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:17.203494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:17.203967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:17.206121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:17.210455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:17.211137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:17.242484 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae HTTP/1.1 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'e19ee5a1-3f7a-482a-845d-898c52bb2bae'} Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:17.248015 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:17.254437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance e19ee5a1-3f7a-482a-845d-898c52bb2bae could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:17.255946 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-64de5630-0883-400e-8700-89fece832f5d tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae" status: 404 len: 111 microversion: 2.1 time: 0.076689 Oct 29 21:18:17.258120 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2899/5898] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:17 2022] GET /compute/v2.1/servers/e19ee5a1-3f7a-482a-845d-898c52bb2bae => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:18.535645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:18.536153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:18.544420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.551666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.552094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.552823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.557722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.558472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.616785 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed HTTP/1.1 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '159937a6-f756-4d55-8fb8-f3f25abd05ed'} Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:18.627700 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cbfaebb3-5e05-4530-94d5-a9662af6eec3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 404 len: 111 microversion: 2.1 time: 0.099107 Oct 29 21:18:18.633517 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3000/5899] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:18:18 2022] DELETE /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:18.647439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:18.648190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 159937a6-f756-4d55-8fb8-f3f25abd05ed] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:18.672789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.673288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.673759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.677057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.677571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.678010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.757098 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed HTTP/1.1 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '159937a6-f756-4d55-8fb8-f3f25abd05ed'} Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.759804 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. Oct 29 21:18:18.765760 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.770477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 159937a6-f756-4d55-8fb8-f3f25abd05ed could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:18.771605 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-467266f1-a373-4673-a1f6-bc65f169b5a2 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed" status: 404 len: 111 microversion: 2.1 time: 0.135275 Oct 29 21:18:18.773711 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2900/5900] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:18 2022] GET /compute/v2.1/servers/159937a6-f756-4d55-8fb8-f3f25abd05ed => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:18.782010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:18.782520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:18.794842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.795342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.796510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.797234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.797720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.798148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.837318 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be HTTP/1.1 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9a9d342d-50ec-49dc-81b7-29794698b5be'} Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:18.854017 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:18.859222 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-efd819c4-0d91-4ec0-ad80-7aa59f7c23aa tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 404 len: 111 microversion: 2.1 time: 0.077611 Oct 29 21:18:18.865010 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3001/5901] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:18:18 2022] DELETE /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:18.868654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:18.869493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 9a9d342d-50ec-49dc-81b7-29794698b5be] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:18.876543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.879116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.880727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.882384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:18.883059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:18.883471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:18.937415 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be HTTP/1.1 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9a9d342d-50ec-49dc-81b7-29794698b5be'} Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:18.939573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 9a9d342d-50ec-49dc-81b7-29794698b5be could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-020adeaf-8c84-4aff-956d-abecd5fcddc3 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be" status: 404 len: 111 microversion: 2.1 time: 0.078828 Oct 29 21:18:18.947854 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2901/5902] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:18 2022] GET /compute/v2.1/servers/9a9d342d-50ec-49dc-81b7-29794698b5be => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:20.433988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e914b3b1-8da1-48e1-9652-b05bb99ecc0c tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-807672266", "availability_zone": "foo_zone"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:20.438405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.aggregate [None req-e914b3b1-8da1-48e1-9652-b05bb99ecc0c tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Generated uuid abf5e26b-b481-40ed-a37b-fe1b6e041f30 for aggregate {{(pid=138885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 21:18:20.480714 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e914b3b1-8da1-48e1-9652-b05bb99ecc0c tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.434880 Oct 29 21:18:20.481792 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3002/5903] 10.222.0.36 () {60 vars in 1164 bytes} [Sat Oct 29 21:18:20 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:18:20.493058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-50692b09-c257-49ef-b7d5-32322f133b6a tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:20.536876 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-50692b09-c257-49ef-b7d5-32322f133b6a tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.047517 Oct 29 21:18:20.541902 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2902/5904] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 21:18:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:18:20.554026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:20.559024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:20.559527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:20.559977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:20.560736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:20.561876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:20.562540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:20.593226 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-507b5128-181c-489c-bb93-8078f67b0dd2 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044623 Oct 29 21:18:20.594126 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3003/5905] 10.222.0.36 () {58 vars in 1176 bytes} [Sat Oct 29 21:18:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:20.608715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe38d90d-6f66-48c0-941b-7543942bda3e tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:20.619481 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe38d90d-6f66-48c0-941b-7543942bda3e tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.014747 Oct 29 21:18:20.626087 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2903/5906] 10.222.0.36 () {58 vars in 1143 bytes} [Sat Oct 29 21:18:20 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:20.635509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7e13da9f-191f-4818-af92-8e9da70dd577 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:20.650459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e13da9f-191f-4818-af92-8e9da70dd577 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:20.651042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e13da9f-191f-4818-af92-8e9da70dd577 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:20.651946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7e13da9f-191f-4818-af92-8e9da70dd577 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:21.206590 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7e13da9f-191f-4818-af92-8e9da70dd577 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.574635 Oct 29 21:18:21.207639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3004/5907] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 21:18:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:21.221085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-446bf61a-9fd0-40bf-b8b7-06af912cfa02 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:21.242208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:21.249526 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-446bf61a-9fd0-40bf-b8b7-06af912cfa02 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.033199 Oct 29 21:18:21.250092 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2904/5908] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:18:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:18:21.275719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-387ca842-e32f-4515-bbd3-393a307b272f tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1717463624", "availability_zone": "foo_zone"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:21.452560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:21.453445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:21.470819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:21.473122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:21.476066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:21.482401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:21.483807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:21.484712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:21.528693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:21.535573 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 HTTP/1.1 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '45e09e57-1dc6-4020-9eb4-494248d61866'} Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:21.542084 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.552282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.559484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:21.580388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f0a5d10-5a43-4cbc-8499-6992e25c8d94 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 404 len: 111 microversion: 2.1 time: 0.133748 Oct 29 21:18:21.581009 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2905/5909] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:18:21 2022] DELETE /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:18:21.607771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:21.608411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] [instance: 45e09e57-1dc6-4020-9eb4-494248d61866] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:21.615090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-387ca842-e32f-4515-bbd3-393a307b272f tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.355152 Oct 29 21:18:21.625204 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3005/5910] 10.222.0.36 () {60 vars in 1173 bytes} [Sat Oct 29 21:18:21 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:21.628970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:21.629509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:21.629937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:21.632120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5b7bba5-53e8-42e2-993b-f197aced4c76 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:21.637555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:21.639875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:21.640956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:21.680004 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] HTTP exception thrown: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.685797 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5b7bba5-53e8-42e2-993b-f197aced4c76 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.058177 Oct 29 21:18:21.689543 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3006/5911] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 21:18:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Request method failure captured: Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 HTTP/1.1 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZcXO-_03Yk6aL-VePFR3SXWitfVDtb2ZIEyiGR7b8es-ZWeCLICuQyjbggP7Fg0ehdY-fuUIRhV-MpcQcq80VbppnZDAAGh75_nuOcWJTcgDlcZ4GnDFyJDwD38t8WYqyuFkfCydWgyyTpxje3NoCrvYNLCQwvuM4V-IH50Noyrxb8 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbee029e55124f2bb37672fbee64a42c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: bbee029e55124f2bb37672fbee64a42c Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104062597 Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: f21c99f8530a41439b59b8dbaf2369dc Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-AttachVolumeNegativeTest-2104062597-project Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '45e09e57-1dc6-4020-9eb4-494248d61866'} Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:18:21.693687 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] Returning 404 to user: Instance 45e09e57-1dc6-4020-9eb4-494248d61866 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:18:21.698964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0076f674-0d68-4036-83a4-046bd4da5b99 tempest-AttachVolumeNegativeTest-2104062597 tempest-AttachVolumeNegativeTest-2104062597-project] 10.222.0.36 "GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866" status: 404 len: 111 microversion: 2.1 time: 0.100580 Oct 29 21:18:21.699877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f832405f-3366-48db-94b4-28a125397e45 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:21.699983 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2906/5912] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:21 2022] GET /compute/v2.1/servers/45e09e57-1dc6-4020-9eb4-494248d61866 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:18:21.717967 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f832405f-3366-48db-94b4-28a125397e45 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.024168 Oct 29 21:18:21.719003 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3007/5913] 10.222.0.36 () {58 vars in 1152 bytes} [Sat Oct 29 21:18:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:21.731823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02e1cfc9-8f8b-4677-b699-7a95ddf80ef6 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:21.745975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e1cfc9-8f8b-4677-b699-7a95ddf80ef6 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:21.746734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e1cfc9-8f8b-4677-b699-7a95ddf80ef6 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:21.747421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e1cfc9-8f8b-4677-b699-7a95ddf80ef6 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:22.470302 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02e1cfc9-8f8b-4677-b699-7a95ddf80ef6 tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.742043 Oct 29 21:18:22.487299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48dee286-6b86-4a0f-a291-dd2dfbc8c20f tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:22.496187 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2907/5914] 10.222.0.36 () {60 vars in 1194 bytes} [Sat Oct 29 21:18:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:22.554394 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48dee286-6b86-4a0f-a291-dd2dfbc8c20f tempest-TestAggregatesBasicOps-342453916 tempest-TestAggregatesBasicOps-342453916-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.068576 Oct 29 21:18:22.561619 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3008/5915] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 21:18:22 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 21:18:37.107443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=7 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:37.109655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:37.119039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f8e08f4-377d-4e6f-8c53-9c22df814ec5 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa170a77b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:37.248942 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f8e08f4-377d-4e6f-8c53-9c22df814ec5 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1968e5c3-e1c1-478c-9de5-08476b1b48b0" status: 200 len: 343 microversion: 2.1 time: 0.142610 Oct 29 21:18:37.249547 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2908/5916] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:18:37 2022] GET /compute/v2.1/os-volumes/1968e5c3-e1c1-478c-9de5-08476b1b48b0 => generated 343 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:39.084478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-57616ebf-13d7-463f-878a-7ee526cdcfa5 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa1700d73a0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:39.107965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:39.108727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:39.110008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:18:39.215925 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-57616ebf-13d7-463f-878a-7ee526cdcfa5 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48f246ee-3ccc-4535-93c5-8c0d088795d5" status: 200 len: 344 microversion: 2.1 time: 0.136635 Oct 29 21:18:39.224143 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3009/5917] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:18:39 2022] GET /compute/v2.1/os-volumes/48f246ee-3ccc-4535-93c5-8c0d088795d5 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:40.853924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4b6e1c6-0e40-484a-8d10-f3bb7d60f03e tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa170047160>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:40.897159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-802487257", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "330a6b26-db3a-4948-9199-2d8398e08ffc"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:40.951774 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4b6e1c6-0e40-484a-8d10-f3bb7d60f03e tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0aeca3fa-256e-42fd-87a5-2b60c2c04123" status: 200 len: 344 microversion: 2.1 time: 0.101874 Oct 29 21:18:40.952363 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3010/5918] 10.222.0.36 () {58 vars in 1245 bytes} [Sat Oct 29 21:18:40 2022] GET /compute/v2.1/os-volumes/0aeca3fa-256e-42fd-87a5-2b60c2c04123 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:18:40.966634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9a61fe9-01d1-4703-9b11-27cf1cc0c959 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa17015a820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:40.987631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] validate_networks() for [('330a6b26-db3a-4948-9199-2d8398e08ffc', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:18:41.084375 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9a61fe9-01d1-4703-9b11-27cf1cc0c959 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.120440 Oct 29 21:18:41.085551 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3011/5919] 10.222.0.36 () {58 vars in 1134 bytes} [Sat Oct 29 21:18:40 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:41.106981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8a4370a-4104-4fb6-b2c6-711df2abcc40 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa170088280>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:41.243119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8a4370a-4104-4fb6-b2c6-711df2abcc40 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.139982 Oct 29 21:18:41.244495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3012/5920] 10.222.0.36 () {58 vars in 1149 bytes} [Sat Oct 29 21:18:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:41.258434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-051acb12-6485-4ab5-a751-675eba7f74b2 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa170047670>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:41.448406 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-051acb12-6485-4ab5-a751-675eba7f74b2 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.193738 Oct 29 21:18:41.457993 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3013/5921] 10.222.0.36 () {58 vars in 1134 bytes} [Sat Oct 29 21:18:41 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:41.472545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26dc2fd5-8ac7-4720-83c9-9e1dcfdaa952 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa1700a8700>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:41.666815 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26dc2fd5-8ac7-4720-83c9-9e1dcfdaa952 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.207020 Oct 29 21:18:41.667860 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3014/5922] 10.222.0.36 () {58 vars in 1167 bytes} [Sat Oct 29 21:18:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:41.684806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9926d635-2d23-4dd8-9c78-3d169c68a120 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa16bfd9ca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:41.873866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9926d635-2d23-4dd8-9c78-3d169c68a120 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.193688 Oct 29 21:18:41.877080 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3015/5923] 10.222.0.36 () {58 vars in 1170 bytes} [Sat Oct 29 21:18:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:41.899530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f26876c7-538a-4546-b7fa-509f6b56782a tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa17015aaf0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:42.119962 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f26876c7-538a-4546-b7fa-509f6b56782a tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.229621 Oct 29 21:18:42.131512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3016/5924] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 21:18:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:42.136787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d0c67138-53a5-4c40-b972-06b7986b422f tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa170088f70>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:42.147992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:18:42.148514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:18:42.148898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:18:42.149327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:18:42.149774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:18:42.177703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:42.178230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:42.178685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:42.179734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:42.180200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:42.180638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:42.239858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Getting quotas for project adf4e539fc2e481aaf00ec7667e634da. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:18:42.257470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Getting quotas for user ce9cc406e2f74f89b741320b9704a6f8 and project adf4e539fc2e481aaf00ec7667e634da. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:18:42.293383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:18:42.297692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:18:42.337217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d0c67138-53a5-4c40-b972-06b7986b422f tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.204182 Oct 29 21:18:42.338099 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3017/5925] 10.222.0.36 () {58 vars in 1188 bytes} [Sat Oct 29 21:18:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:42.352382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f8fd84bb-9b37-45cf-b6d2-b15fec4dcf49 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] Calling method '.version_select at 0x7fa1700d7040>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:42.409965 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e24e1c90-0b11-4042-b01e-93d4d9fc269c tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863746 Oct 29 21:18:42.411335 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2909/5926] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:18:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:18:42.422613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f01b8e1-6cbb-4e65-9427-df853aa430f6 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:42.423480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f01b8e1-6cbb-4e65-9427-df853aa430f6 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:42.541364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1f01b8e1-6cbb-4e65-9427-df853aa430f6 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:42.549262 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f01b8e1-6cbb-4e65-9427-df853aa430f6 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1214 microversion: 2.1 time: 0.130815 Oct 29 21:18:42.551162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2910/5927] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:42 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:18:42.554485 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f8fd84bb-9b37-45cf-b6d2-b15fec4dcf49 tempest-VolumesTestJSON-1637142375 tempest-VolumesTestJSON-1637142375-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.205588 Oct 29 21:18:42.564604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3018/5928] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 21:18:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:43.584022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c18b16bf-701d-46ba-9f1f-195593fd7559 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:43.586501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c18b16bf-701d-46ba-9f1f-195593fd7559 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:43.764116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c18b16bf-701d-46ba-9f1f-195593fd7559 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:43.772611 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c18b16bf-701d-46ba-9f1f-195593fd7559 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1214 microversion: 2.1 time: 0.196802 Oct 29 21:18:43.776093 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2911/5929] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:43 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:44.804148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:44.804969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:44.822559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:44.826004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:44.827950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:44.829817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:44.832640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:44.834599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:45.186335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:45.210553 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1432578a-cb90-4970-87e9-87f49096a55f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1274 microversion: 2.1 time: 0.414725 Oct 29 21:18:45.223840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3019/5930] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:44 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1274 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:46.238627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:46.239795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:46.254581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:46.256907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:46.258016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:46.261822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:46.262304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:46.264964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:46.711957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:46.726254 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-97014c89-7e8c-4ed5-87c9-a51fcb220b3b tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1272 microversion: 2.1 time: 0.492318 Oct 29 21:18:46.729087 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2912/5931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:46 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:47.759613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:47.760595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:47.773396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:47.773951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:47.774644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:47.775363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:47.775950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:47.776676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:48.404236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:48.415614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7dfd050f-1e9d-4b19-b227-b816fc44e40a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.661188 Oct 29 21:18:48.417778 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3020/5932] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:47 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:49.194099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-294276328", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "d254b85b-74b0-4da0-b334-7467be06e931"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:49.295862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] validate_networks() for [('d254b85b-74b0-4da0-b334-7467be06e931', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:18:49.442412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:49.443297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:49.458360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:49.459867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:49.460532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:49.461571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:49.462238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:49.463018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:50.059205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:50.072982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-918c5dd2-2f79-4686-badd-f1b7eb8f294a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.637375 Oct 29 21:18:50.081784 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3021/5933] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:49 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:50.873015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:18:50.873634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:18:50.874813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:18:50.875303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:18:50.875882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:18:50.889979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:50.890454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:50.891191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:50.892138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:50.892624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:50.893663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:50.959644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Getting quotas for project c4e4f30c260948efa2370c51353d48d5. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:18:50.969056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Getting quotas for user 4f0a921d2a60482ca47fed07daf2e9e0 and project c4e4f30c260948efa2370c51353d48d5. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:18:50.994252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:18:50.998256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:18:51.029105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4c51bff5-c9b7-4376-80b1-71f73f2263d9 req-861e6902-ddad-4a1c-a7ba-862f9c99fb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6a61177-7717-4685-b0af-49124b850ea9", "tag": "2b5f6c2a-ded0-4206-8de0-e52dfc177969"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:51.057395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4c51bff5-c9b7-4376-80b1-71f73f2263d9 req-861e6902-ddad-4a1c-a7ba-862f9c99fb55 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:51.074500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1fd3e275-6f94-4332-9e09-9d1df30167c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884255 Oct 29 21:18:51.075627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4c51bff5-c9b7-4376-80b1-71f73f2263d9 req-861e6902-ddad-4a1c-a7ba-862f9c99fb55 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:51.076817 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2913/5934] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:18:51.077911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4c51bff5-c9b7-4376-80b1-71f73f2263d9 req-861e6902-ddad-4a1c-a7ba-862f9c99fb55 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:51.092780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87d564fc-c3cd-414d-bcb1-d04b3b55360f tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:51.095043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87d564fc-c3cd-414d-bcb1-d04b3b55360f tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:51.097228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4c51bff5-c9b7-4376-80b1-71f73f2263d9 req-861e6902-ddad-4a1c-a7ba-862f9c99fb55 service nova] Creating event network-changed:2b5f6c2a-ded0-4206-8de0-e52dfc177969 for instance d6a61177-7717-4685-b0af-49124b850ea9 on nch1-master-1 Oct 29 21:18:51.122188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4c51bff5-c9b7-4376-80b1-71f73f2263d9 req-861e6902-ddad-4a1c-a7ba-862f9c99fb55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104609 Oct 29 21:18:51.125258 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3022/5935] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:18:51.140410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:51.141375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:51.153300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:51.154253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:51.154926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:51.156806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:51.157402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:51.158274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:51.318396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87d564fc-c3cd-414d-bcb1-d04b3b55360f tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:51.342525 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87d564fc-c3cd-414d-bcb1-d04b3b55360f tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1213 microversion: 2.1 time: 0.257873 Oct 29 21:18:51.342992 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2914/5936] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:51 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:18:51.593391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:51.605603 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0bba6e36-d881-4985-a2ec-c8f64e69b030 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.473184 Oct 29 21:18:51.618564 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3023/5937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:51 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:52.370433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:52.371716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:52.379874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:52.380568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:52.381876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:52.382790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:52.383425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:52.384051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:52.472862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:52.480997 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd029b19-5aa4-4bba-a6a6-9f9c1fbfff3e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1265 microversion: 2.1 time: 0.114539 Oct 29 21:18:52.483351 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2915/5938] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:52 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:52.632053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:52.632661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:52.640485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:52.641385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:52.641856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:52.642757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:52.644004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:52.644606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:52.908766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:52.920965 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fcf7d740-c66b-4009-bcac-874770214428 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.290337 Oct 29 21:18:52.944540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3024/5939] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:52 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:53.512104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:53.513603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:53.523565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:53.524426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:53.525788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:53.526808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:53.528119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:53.529015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:53.693553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:53.744275 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-476646e4-b230-4f21-9a80-44c5f3fe0035 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1271 microversion: 2.1 time: 0.236014 Oct 29 21:18:53.749546 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2916/5940] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:53 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:53.951844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:53.952696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:53.964405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:53.968099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:53.968773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:53.969746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:53.978944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:53.979670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:54.581519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:54.600404 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-02c08010-3d23-474c-bf5d-63d15d9b9083 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.652544 Oct 29 21:18:54.615649 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3025/5941] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:53 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:54.770874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:54.772063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:54.791660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:54.796348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:54.797522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:54.798834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:54.801641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:54.804409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:55.275712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:55.305767 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cc874d8-9ac3-4c7d-9ae1-d3309e86b958 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.538388 Oct 29 21:18:55.306409 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2917/5942] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:54 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:55.629566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:55.630368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:55.656596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:55.660450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:55.661962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:55.672765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:55.674538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:55.676410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:56.332360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:56.333680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:56.344245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:56.349626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:56.350644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:56.351571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:56.353084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:56.357692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:56.377323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:56.393033 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e2c2b99-36c1-4677-b5be-0181992994dd tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.763070 Oct 29 21:18:56.393617 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3026/5943] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:55 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:56.835741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:56.847606 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04e732c7-6835-492a-a3a7-fcb657f5356b tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.517297 Oct 29 21:18:56.849636 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2918/5944] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:56 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:57.419066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:57.420427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:57.447088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:57.447590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:57.448032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:57.448752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:57.449212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:57.449745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:57.876295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:57.877762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:57.905906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:57.909723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:57.911929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:57.932604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:57.934575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:57.935046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:58.307250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:58.317226 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa0d260b-1254-49d8-b409-7298b71b3dc5 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.902554 Oct 29 21:18:58.318678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3027/5945] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:57 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:58.326043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-702ef1b3-189c-4922-91f2-0181d11f9f1a req-9905086e-37de-49a5-83cb-f25a2eb9639a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3541b7-23c4-486b-923c-1c28b40b5c26", "tag": "632f716d-c19b-44c0-a722-60c9dd8ca156"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:58.339075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-702ef1b3-189c-4922-91f2-0181d11f9f1a req-9905086e-37de-49a5-83cb-f25a2eb9639a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:58.340059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-702ef1b3-189c-4922-91f2-0181d11f9f1a req-9905086e-37de-49a5-83cb-f25a2eb9639a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:58.340747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-702ef1b3-189c-4922-91f2-0181d11f9f1a req-9905086e-37de-49a5-83cb-f25a2eb9639a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:58.354502 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-702ef1b3-189c-4922-91f2-0181d11f9f1a req-9905086e-37de-49a5-83cb-f25a2eb9639a service nova] Creating event network-changed:632f716d-c19b-44c0-a722-60c9dd8ca156 for instance fe3541b7-23c4-486b-923c-1c28b40b5c26 on nch2-master-1 Oct 29 21:18:58.360988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-702ef1b3-189c-4922-91f2-0181d11f9f1a req-9905086e-37de-49a5-83cb-f25a2eb9639a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040565 Oct 29 21:18:58.362526 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3028/5946] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:58.400066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:18:58.411659 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1c6bbd97-7a1c-4cf0-8b2f-738a01b6cf80 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.541816 Oct 29 21:18:58.413529 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2919/5947] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:57 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:18:59.348385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:59.350218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:59.371945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:59.373743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:59.374782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:59.379431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:59.381210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:59.382145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:59.499399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-241c7a10-6d3b-4092-821f-969e110a687b req-19e95277-4c5f-4ee0-b9e3-784723a287e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6a61177-7717-4685-b0af-49124b850ea9", "name": "network-vif-plugged", "status": "completed", "tag": "2b5f6c2a-ded0-4206-8de0-e52dfc177969"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:18:59.524519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-241c7a10-6d3b-4092-821f-969e110a687b req-19e95277-4c5f-4ee0-b9e3-784723a287e1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:59.525018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-241c7a10-6d3b-4092-821f-969e110a687b req-19e95277-4c5f-4ee0-b9e3-784723a287e1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:59.529323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-241c7a10-6d3b-4092-821f-969e110a687b req-19e95277-4c5f-4ee0-b9e3-784723a287e1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:59.546053 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-241c7a10-6d3b-4092-821f-969e110a687b req-19e95277-4c5f-4ee0-b9e3-784723a287e1 service nova] Creating event network-vif-plugged:2b5f6c2a-ded0-4206-8de0-e52dfc177969 for instance d6a61177-7717-4685-b0af-49124b850ea9 on nch1-master-1 Oct 29 21:18:59.561859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-241c7a10-6d3b-4092-821f-969e110a687b req-19e95277-4c5f-4ee0-b9e3-784723a287e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.367329 Oct 29 21:18:59.566158 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3029/5948] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:18:59.575972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:18:59.581795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:18:59.597167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:59.600673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:59.601431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:18:59.602213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:18:59.602866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:18:59.608387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:00.043063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:00.056613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbf6b4c2-6483-4ef8-a9f0-914f3340110e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 0.720272 Oct 29 21:19:00.058747 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2920/5949] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:59 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:00.465589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:00.480987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-af5d7c21-3eb4-4fc6-a5ac-136a72f7af69 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.911866 Oct 29 21:19:00.484337 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3030/5950] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:18:59 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:01.089279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:01.090585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:01.093779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:01.102191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:01.102695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:01.105132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:01.106595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:01.107089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:01.119278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:01.323256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=18 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:01.514098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:01.514098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:01.536713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:01.544277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:01.547376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:01.549872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:01.551737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:01.552297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:02.151303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:02.170216 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-701f688b-1f18-4e85-b9f1-34bcb8572514 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1314 microversion: 2.1 time: 1.086257 Oct 29 21:19:02.181642 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2921/5951] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:01 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:02.403979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:02.413436 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b6b55327-8b9f-4f7a-8f49-3f8f894e4612 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.909050 Oct 29 21:19:02.418582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3031/5952] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:01 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:03.201102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:03.205343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:03.225999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:03.226522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:03.229372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:03.230165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:03.230639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:03.233170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:03.444439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:03.445865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:03.459174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:03.462450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:03.463693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:03.464607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:03.465285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:03.468079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:03.717584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:03.739777 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27887799-0905-4566-b2e3-1e05108ab870 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1502 microversion: 2.1 time: 0.545434 Oct 29 21:19:03.745723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2922/5953] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:03 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1502 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:03.779633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:03.780518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:03.790756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:03.793443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:03.794790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:03.797630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:03.798333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:03.803193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:04.166967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:04.176204 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0bfefb3-e44d-4218-aca4-f4dfd20cf903 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1502 microversion: 2.1 time: 0.401465 Oct 29 21:19:04.180297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2923/5954] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:03 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:04.214413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:04.215515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:04.241779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:04.242535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:04.243063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:04.243875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:04.244444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:04.246164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:04.313316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:04.325542 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26bca43c-ba01-48d5-b739-895af3faef9e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.882223 Oct 29 21:19:04.326896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lazy-loading 'flavor' on Instance uuid d6a61177-7717-4685-b0af-49124b850ea9 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:19:04.328540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3032/5955] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:03 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:04.513053 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f6330a42-201c-4db6-9841-c045fc122914 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.309748 Oct 29 21:19:04.518630 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2924/5956] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:19:04 2022] POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:19:04.532156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:04.532908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:04.554873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:04.560067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:04.560840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:04.561807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:04.565562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:04.566151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:05.046830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:05.060207 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db151df7-304d-4f20-a295-cdf1912d2742 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1510 microversion: 2.1 time: 0.541230 Oct 29 21:19:05.064035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3033/5957] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:04 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:05.357834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:05.358563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:05.373051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:05.375098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:05.376794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:05.380520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:05.381024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:05.381493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:05.908295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:05.925094 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4ea7d3e8-55de-470c-9de2-49051ffabb53 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 0.564482 Oct 29 21:19:05.926457 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2925/5958] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:05 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:06.070842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-39997ee9-a602-4ec8-aa6d-e2ff53eab82f req-f1d12edd-b1c9-4549-8cea-3819c0f6a6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3541b7-23c4-486b-923c-1c28b40b5c26", "name": "network-vif-plugged", "status": "completed", "tag": "632f716d-c19b-44c0-a722-60c9dd8ca156"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:06.089934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:06.090731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:06.104862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39997ee9-a602-4ec8-aa6d-e2ff53eab82f req-f1d12edd-b1c9-4549-8cea-3819c0f6a6b9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.110289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.114260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.115317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39997ee9-a602-4ec8-aa6d-e2ff53eab82f req-f1d12edd-b1c9-4549-8cea-3819c0f6a6b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.116436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:06.117660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-39997ee9-a602-4ec8-aa6d-e2ff53eab82f req-f1d12edd-b1c9-4549-8cea-3819c0f6a6b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:06.124458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.127753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.130538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:06.159497 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-39997ee9-a602-4ec8-aa6d-e2ff53eab82f req-f1d12edd-b1c9-4549-8cea-3819c0f6a6b9 service nova] Creating event network-vif-plugged:632f716d-c19b-44c0-a722-60c9dd8ca156 for instance fe3541b7-23c4-486b-923c-1c28b40b5c26 on nch2-master-1 Oct 29 21:19:06.177868 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-39997ee9-a602-4ec8-aa6d-e2ff53eab82f req-f1d12edd-b1c9-4549-8cea-3819c0f6a6b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108698 Oct 29 21:19:06.181829 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3034/5959] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:06.849776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:06.862580 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ad77b97-bbe5-4bb5-890e-93e44b3a9585 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1493 microversion: 2.1 time: 0.778287 Oct 29 21:19:06.864730 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2926/5960] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:06 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1493 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:06.891077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:06.891915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:06.901016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.901819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.902570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:06.903505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.904133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.904728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:06.949825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:06.951034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:06.967489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.968303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.971086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:06.972979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:06.973569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:06.979275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:07.120504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a320495f-953f-48ba-9b20-9bbdc3cce1b1 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.234067 Oct 29 21:19:07.142027 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3035/5961] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:19:06 2022] POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:19:07.165765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:07.169196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:07.206162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:07.207107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:07.207717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:07.208643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:07.209265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:07.209935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:08.256916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:08.259684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:08.274694 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffe7b3d2-8e3b-4fc9-aa18-f54b6a2a32db tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1313 microversion: 2.1 time: 1.328423 Oct 29 21:19:08.276686 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2927/5962] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:06 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1313 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:08.289816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:08.302452 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef22bf69-606e-4c3c-a302-e8518f0aaacf tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1499 microversion: 2.1 time: 1.157750 Oct 29 21:19:08.305928 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3036/5963] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:07 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1499 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:09.330887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:09.339268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:09.339941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:09.341770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:09.351173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=37 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:09.354924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:09.426509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:09.432935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:09.433588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:09.433955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:09.434919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:09.435271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:09.436204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:09.436849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:09.437486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:09.442221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:09.443960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:09.448737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:09.515268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:10.270562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:10.283576 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a362cf1-28f5-4ced-858c-7a7618d0e69c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1498 microversion: 2.1 time: 0.971643 Oct 29 21:19:10.289878 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2928/5964] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:09 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1498 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:10.722257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:10.734985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-78220d93-5035-4692-8701-432fee57fe68 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1499 microversion: 2.1 time: 1.411633 Oct 29 21:19:10.744298 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3037/5965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:09 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1499 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:11.188468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:11.189089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:11.218017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:11.218866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:11.219555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:11.220606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:11.223234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:11.225701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:11.333916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:19:11.481107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-163131583", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "aa877e52-8cbd-4479-8c45-138a06d0ebd0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "61be7916-1aaf-44e0-b8b4-9d255eece552"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:11.708537 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d81faf6a-4f68-4311-8017-62f061f7dae7 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 204 len: 0 microversion: 2.1 time: 0.517547 Oct 29 21:19:11.713854 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2929/5966] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:19:11 2022] DELETE /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:19:11.733148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:11.738765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:11.761570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:11.762818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:11.768296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:11.769275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:11.777806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:11.778321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:11.812980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] validate_networks() for [('61be7916-1aaf-44e0-b8b4-9d255eece552', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:19:12.317734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:12.335711 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c35c5a3-d23e-48e6-b9b1-adee0b5dbb56 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1504 microversion: 2.1 time: 0.616867 Oct 29 21:19:12.337188 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2930/5967] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:11 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1504 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:12.353331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:12.354258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:12.366054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:12.366985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:12.367659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:12.368608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:12.369504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:12.378318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:12.696624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:12.706628 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d29b36aa-767a-46c1-b407-74c7e2c94289 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1502 microversion: 2.1 time: 0.365772 Oct 29 21:19:12.733628 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2931/5968] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:12 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:12.757355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:12.761074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:12.775514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:12.782571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:12.783737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:12.786946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:12.788383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:12.792294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:12.804578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:19:12.805011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:19:12.842149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:19:12.846298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:19:12.846914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:19:12.885591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:12.886134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:12.899111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:12.905288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:12.907160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:12.908137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:12.934570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lazy-loading 'flavor' on Instance uuid d6a61177-7717-4685-b0af-49124b850ea9 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:19:12.985413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:19:13.010587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:19:13.074528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:19:13.081365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='aa877e52-8cbd-4479-8c45-138a06d0ebd0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:19:13.164996 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91cf2834-506c-4520-8bba-0a6e6079f812 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.422296 Oct 29 21:19:13.176131 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2932/5969] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:19:12 2022] POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:19:13.196058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:13.196978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:13.242817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:13.244339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:13.247442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:13.248349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:13.248925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:13.251506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:13.291894 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815804 Oct 29 21:19:13.311144 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3038/5970] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:19:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:19:13.335949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0534b7f-799d-417c-8202-2bcf79a99317 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:13.338688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0534b7f-799d-417c-8202-2bcf79a99317 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:13.980439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0534b7f-799d-417c-8202-2bcf79a99317 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:13.994351 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0534b7f-799d-417c-8202-2bcf79a99317 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1056 microversion: 2.1 time: 0.681547 Oct 29 21:19:14.011553 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3039/5971] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:13 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1056 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:14.045156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:14.061249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:14.087771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:14.101395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:14.102161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:14.103731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:14.104415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:14.105051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:14.850424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:14.864263 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3fe2d5c2-4eef-4732-8eef-d2a0c0f2f34e tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1510 microversion: 2.1 time: 1.685452 Oct 29 21:19:14.867843 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2933/5972] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:13 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1510 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:15.039492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:15.040153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:15.059973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:15.060468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:15.066246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:15.072249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:15.073009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:15.073687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:15.344843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:15.361401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7433296e-bcd6-4aeb-b42c-a2645ee82f5a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1108 microversion: 2.1 time: 0.332526 Oct 29 21:19:15.363877 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2934/5973] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:15 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1108 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:15.485361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:15.504055 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1d4f1b6-a462-4460-9a35-401f3afbd4ea tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1504 microversion: 2.1 time: 1.477432 Oct 29 21:19:15.504932 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3040/5974] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:14 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1504 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:15.731935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cf6bc1f0-dff1-4d39-8772-c9f83a607f3c req-c132d60b-46fc-446d-9aa1-6a641a281fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3541b7-23c4-486b-923c-1c28b40b5c26", "name": "network-vif-deleted", "tag": "632f716d-c19b-44c0-a722-60c9dd8ca156"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:15.757039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cf6bc1f0-dff1-4d39-8772-c9f83a607f3c req-c132d60b-46fc-446d-9aa1-6a641a281fb8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:15.765322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cf6bc1f0-dff1-4d39-8772-c9f83a607f3c req-c132d60b-46fc-446d-9aa1-6a641a281fb8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:15.765814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cf6bc1f0-dff1-4d39-8772-c9f83a607f3c req-c132d60b-46fc-446d-9aa1-6a641a281fb8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:15.836570 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cf6bc1f0-dff1-4d39-8772-c9f83a607f3c req-c132d60b-46fc-446d-9aa1-6a641a281fb8 service nova] Creating event network-vif-deleted:632f716d-c19b-44c0-a722-60c9dd8ca156 for instance fe3541b7-23c4-486b-923c-1c28b40b5c26 on nch2-master-1 Oct 29 21:19:15.857297 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cf6bc1f0-dff1-4d39-8772-c9f83a607f3c req-c132d60b-46fc-446d-9aa1-6a641a281fb8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130684 Oct 29 21:19:15.858652 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2935/5975] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:15.895482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:15.896259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:15.926722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:15.927385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:15.929308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:15.936454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:15.938446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:15.940452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.388942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:16.390458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:16.410547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.411058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.411511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.412258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.412726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.440277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.588938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:16.605934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a05d0527-955a-4753-8afc-fa224653bad2 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1493 microversion: 2.1 time: 0.709364 Oct 29 21:19:16.622262 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3041/5976] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:15 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1493 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:16.627131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:16.627709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:16.636892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.637392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.637867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.638587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.648805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.649317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.748494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.760410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.761963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.762609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lazy-loading 'fault' on Instance uuid fe3541b7-23c4-486b-923c-1c28b40b5c26 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:19:16.882795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:16.900443 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e23aa8f7-33c0-468e-9302-900e3304eb15 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1126 microversion: 2.1 time: 0.515364 Oct 29 21:19:16.900903 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2936/5977] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:16 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1126 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:16.913526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:16.914085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:16.932649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.933156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.933657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:16.934384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:16.934852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:16.935287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:17.006081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:17.021613 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-19107250-58f0-4e91-b752-d821eec8ee19 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 200 len: 1303 microversion: 2.1 time: 0.408124 Oct 29 21:19:17.024498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3042/5978] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:16 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 1303 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:17.162223 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ad0635b-847d-4997-a1e0-a49ddc6d61b9 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.242082 Oct 29 21:19:17.165568 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2937/5979] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:19:16 2022] POST /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:19:17.173702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:17.174586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:17.188680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:17.192145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:17.193891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:17.197912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:17.200429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:17.201379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:17.614015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:17.630045 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-066299cd-00b7-4d30-a0b9-a97301dc4c02 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1499 microversion: 2.1 time: 0.462201 Oct 29 21:19:17.631163 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3043/5980] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:17 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1499 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:17.927777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:17.929433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:17.954953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:17.959142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:17.959845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:17.960786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:17.961425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:17.962104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:18.055071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:18.057729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: fe3541b7-23c4-486b-923c-1c28b40b5c26] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:18.074578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:18.075703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:18.078492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:18.080708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:18.084418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:18.084418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:18.123439 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] HTTP exception thrown: Instance fe3541b7-23c4-486b-923c-1c28b40b5c26 could not be found. Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Request method failure captured: Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 HTTP/1.1 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi3BPQ2cRtrkijmfab2TcsQXYc9TBfcbEBLZt-ORVB8BAa5fJEkqAjJxTFGAjTxaA4TiifFjbno2Z-RQO5sM3_MfLsqEOyZzRX9mC-xJqN2uhAa7uFlsxKW8TVklBsxOnQebAxVy7774JLkrhCIr646cV7uZ6v46Qy_or-Y7IjlwSM Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c4e4f30c260948efa2370c51353d48d5 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesActionsTest-1690945690 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesActionsTest-1690945690 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c4e4f30c260948efa2370c51353d48d5 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesActionsTest-1690945690 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesActionsTest-1690945690-project Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4f0a921d2a60482ca47fed07daf2e9e0 Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesActionsTest-1690945690-project Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance fe3541b7-23c4-486b-923c-1c28b40b5c26 could not be found. Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'fe3541b7-23c4-486b-923c-1c28b40b5c26'} Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3541b7-23c4-486b-923c-1c28b40b5c26 could not be found. Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3541b7-23c4-486b-923c-1c28b40b5c26 could not be found. Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:18.129186 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3541b7-23c4-486b-923c-1c28b40b5c26 could not be found. Oct 29 21:19:18.134991 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:18.138512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Returning 404 to user: Instance fe3541b7-23c4-486b-923c-1c28b40b5c26 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:19:18.139654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-610bb743-328e-4360-bde2-44d0eed13920 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26" status: 404 len: 111 microversion: 2.1 time: 0.094470 Oct 29 21:19:18.142489 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3044/5981] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:18 2022] GET /compute/v2.1/servers/fe3541b7-23c4-486b-923c-1c28b40b5c26 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:19:18.362648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-6804230", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "d254b85b-74b0-4da0-b334-7467be06e931"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:18.368533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:18.377896 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3a62756f-1038-4e7f-9d69-d0c8dea76cb1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1168 microversion: 2.1 time: 0.455954 Oct 29 21:19:18.381949 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2938/5982] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:17 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1168 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:18.502041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] validate_networks() for [('d254b85b-74b0-4da0-b334-7467be06e931', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:19:18.655889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:18.656518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:18.666623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:18.667127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:18.667579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:18.668296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:18.675691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:18.676502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:19.090278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:19.111426 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f1accdf8-bfb5-4b48-933b-d169bfe5ff09 tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1499 microversion: 2.1 time: 0.456180 Oct 29 21:19:19.116361 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2939/5983] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:18 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1499 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:19.405287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:19.406218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:19.420337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:19.421147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:19.421811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:19.422718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:19.423347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:19.424637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:20.490072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:20.492731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:20.509298 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a1406216-a7d8-4d18-8e14-09747b6b1a7a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1168 microversion: 2.1 time: 1.108727 Oct 29 21:19:20.519572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2940/5984] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:19 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1168 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:20.537331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:20.538015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:20.546929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:20.547859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:20.548360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:20.554008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:20.554645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:20.555104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:20.604259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:19:20.605667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:19:20.606560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:19:20.607224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:19:20.607887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:19:20.626215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:20.628426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:20.629143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:20.630286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:20.631004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:20.631699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:20.654794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Getting quotas for project c4e4f30c260948efa2370c51353d48d5. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:19:20.663974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Getting quotas for user 4f0a921d2a60482ca47fed07daf2e9e0 and project c4e4f30c260948efa2370c51353d48d5. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:19:20.681489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:19:20.684404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:19:20.760064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b5792f80-5b2c-4d60-88bb-c0dd4cacb13c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.401509 Oct 29 21:19:20.770548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3045/5985] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:19:20.782099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-92e1a950-1c3d-40e9-9171-d661c9716516 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:20.784485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-92e1a950-1c3d-40e9-9171-d661c9716516 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:21.085335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-92e1a950-1c3d-40e9-9171-d661c9716516 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:21.095969 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-92e1a950-1c3d-40e9-9171-d661c9716516 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1211 microversion: 2.1 time: 0.323987 Oct 29 21:19:21.096574 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3046/5986] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:20 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1211 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:21.238565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:21.253792 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87bea886-d5fd-4e35-97ba-a77b468440aa tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1502 microversion: 2.1 time: 0.725741 Oct 29 21:19:21.288117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:21.288829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:21.296138 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2941/5987] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:20 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1502 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:21.312605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:21.315681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:21.317008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:21.319059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:21.320948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:21.321641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:21.379927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:19:21.537756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:21.539280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:21.562266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:21.564821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:21.565322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:21.569712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:21.570218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:21.572891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:21.598588 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87c6901d-47e3-430a-9121-6669b7e517af tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 204 len: 0 microversion: 2.1 time: 0.308304 Oct 29 21:19:21.599934 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3047/5988] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:19:21 2022] DELETE /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:19:21.609533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:21.611947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:21.632293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:21.645070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:21.646948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:21.649024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:21.649553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:21.650009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:22.442558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:22.450556 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4bfc210-5b3f-4774-bc90-70d192fa9aa3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1168 microversion: 2.1 time: 0.922073 Oct 29 21:19:22.451159 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2942/5989] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:21 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1168 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:22.455773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:22.456398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:22.482961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:22.490768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:22.491820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:22.492906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:22.496188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:22.496745 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-14617b7f-2ad5-4b77-a7c9-b2f55f06d45f tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1508 microversion: 2.1 time: 0.892156 Oct 29 21:19:22.498921 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3048/5990] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:21 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1508 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:22.508206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:22.516587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:22.542201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a8fd2caa-fdcc-4b18-a4b6-b51dca1c486a req-cb856b29-10fa-4594-a801-070d072536b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996f9677-7222-4c80-a6c4-4307d81d1dfb", "tag": "592f1e7e-4189-477c-a49d-8a465e4336e8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:22.564257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a8fd2caa-fdcc-4b18-a4b6-b51dca1c486a req-cb856b29-10fa-4594-a801-070d072536b8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:22.565342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a8fd2caa-fdcc-4b18-a4b6-b51dca1c486a req-cb856b29-10fa-4594-a801-070d072536b8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:22.574267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a8fd2caa-fdcc-4b18-a4b6-b51dca1c486a req-cb856b29-10fa-4594-a801-070d072536b8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:22.587379 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a8fd2caa-fdcc-4b18-a4b6-b51dca1c486a req-cb856b29-10fa-4594-a801-070d072536b8 service nova] Creating event network-changed:592f1e7e-4189-477c-a49d-8a465e4336e8 for instance 996f9677-7222-4c80-a6c4-4307d81d1dfb on nch1-master-1 Oct 29 21:19:22.592839 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a8fd2caa-fdcc-4b18-a4b6-b51dca1c486a req-cb856b29-10fa-4594-a801-070d072536b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054300 Oct 29 21:19:22.594076 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3049/5991] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:19:22.698955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:22.752077 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45b30b30-38f9-4216-b374-cda08a4308c1 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1263 microversion: 2.1 time: 0.299282 Oct 29 21:19:22.753754 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2943/5992] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:22 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1263 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:23.475975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:23.477399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:23.491097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:23.491599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:23.492050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:23.492768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:23.493237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:23.504935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:23.530104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:23.530737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:23.541741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:23.542256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:23.542699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:23.549382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:23.549907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:23.550501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:24.059786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:24.074285 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-42517ea9-8e00-4e6c-b5ba-72ac2b8ad26b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.604797 Oct 29 21:19:24.079271 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3050/5993] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:23 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:24.089303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:24.090780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:24.105105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:24.105741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:24.109058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:24.110026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:24.110567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:24.111666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:24.556664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce9cc406e2f74f89b741320b9704a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf4e539fc2e481aaf00ec7667e634da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:24.569622 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f3b58ed-d63d-484d-8e73-df538c1f48fb tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 200 len: 1508 microversion: 2.1 time: 1.040298 Oct 29 21:19:24.573113 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2944/5994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:23 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 1508 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:24.645840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:24.676806 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0596664c-2782-4a60-9841-4c37d8011e2e tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1269 microversion: 2.1 time: 0.595495 Oct 29 21:19:24.677576 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3051/5995] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:24 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1269 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:25.099423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:25.100180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:25.113806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.114419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.115669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.116646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.117323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.118301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.127327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6793955b-d7c5-45b1-ae74-de1216918650 req-4d8ce3f9-099c-491d-a0a3-d36240a3ccf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6a61177-7717-4685-b0af-49124b850ea9", "name": "network-vif-deleted", "tag": "2b5f6c2a-ded0-4206-8de0-e52dfc177969"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:25.152571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6793955b-d7c5-45b1-ae74-de1216918650 req-4d8ce3f9-099c-491d-a0a3-d36240a3ccf9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.153750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6793955b-d7c5-45b1-ae74-de1216918650 req-4d8ce3f9-099c-491d-a0a3-d36240a3ccf9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.154484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6793955b-d7c5-45b1-ae74-de1216918650 req-4d8ce3f9-099c-491d-a0a3-d36240a3ccf9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.188992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6793955b-d7c5-45b1-ae74-de1216918650 req-4d8ce3f9-099c-491d-a0a3-d36240a3ccf9 service nova] Creating event network-vif-deleted:2b5f6c2a-ded0-4206-8de0-e52dfc177969 for instance d6a61177-7717-4685-b0af-49124b850ea9 on nch1-master-1 Oct 29 21:19:25.197950 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6793955b-d7c5-45b1-ae74-de1216918650 req-4d8ce3f9-099c-491d-a0a3-d36240a3ccf9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.541456 Oct 29 21:19:25.199471 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2945/5996] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:19:25.611754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:25.612602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] [instance: d6a61177-7717-4685-b0af-49124b850ea9] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:25.621483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.622180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.622696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.623660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.624384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.625336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.663937 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] HTTP exception thrown: Instance d6a61177-7717-4685-b0af-49124b850ea9 could not be found. Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Request method failure captured: Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 HTTP/1.1 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZitwM7UUHR8ZEO_rGY8qQZoNBo8evx20RgRjiRX7oxxdz6o-T8zf5Jba4uqt1oex_dt0KJGG8VBIhoLlZKWDDm6HMgUciQCd6eDKLtnJxrJVSYlwpzsC087UfqK0V3q3WrjyOoHvym5abS2hmxHM_DXBuOpyo-m6jI0tsmdRQoovfI Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: adf4e539fc2e481aaf00ec7667e634da Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestServerAdvancedOps-1910955255 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf4e539fc2e481aaf00ec7667e634da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_adf4e539fc2e481aaf00ec7667e634da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/adf4e539fc2e481aaf00ec7667e634da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/adf4e539fc2e481aaf00ec7667e634da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestServerAdvancedOps-1910955255 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: adf4e539fc2e481aaf00ec7667e634da Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestServerAdvancedOps-1910955255 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestServerAdvancedOps-1910955255-project Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ce9cc406e2f74f89b741320b9704a6f8 Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestServerAdvancedOps-1910955255-project Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance d6a61177-7717-4685-b0af-49124b850ea9 could not be found. Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'd6a61177-7717-4685-b0af-49124b850ea9'} Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6a61177-7717-4685-b0af-49124b850ea9 could not be found. Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6a61177-7717-4685-b0af-49124b850ea9 could not be found. Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:25.666692 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6a61177-7717-4685-b0af-49124b850ea9 could not be found. Oct 29 21:19:25.672467 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:25.676505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] Returning 404 to user: Instance d6a61177-7717-4685-b0af-49124b850ea9 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:19:25.680024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cae3a4c2-0112-4bd8-9abc-13b943741e9a tempest-TestServerAdvancedOps-1910955255 tempest-TestServerAdvancedOps-1910955255-project] 10.222.0.36 "GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9" status: 404 len: 111 microversion: 2.1 time: 0.075924 Oct 29 21:19:25.681087 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2946/5997] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:25 2022] GET /compute/v2.1/servers/d6a61177-7717-4685-b0af-49124b850ea9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:19:25.704313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:25.707003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:25.725031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.726010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.726708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.728359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:25.731212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:25.731890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:25.934455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:25.945418 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-58f44040-abfd-4da0-a8c9-a8279e0360bc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.849998 Oct 29 21:19:25.950034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:25.961799 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3052/5998] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:25 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:25.962875 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d222c018-c007-40cd-b8eb-270ba6dd8c9d tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1269 microversion: 2.1 time: 0.265010 Oct 29 21:19:25.963645 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2947/5999] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:25 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:26.993557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:26.994267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:26.994897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:26.996345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:27.028947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:27.032491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:27.033796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:27.035172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:27.035935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:27.036504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:27.041848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:27.042482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:27.042728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:27.046139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:27.049058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:27.058108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:27.902723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:27.912239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c267cb85-3d3b-4835-b1dd-77e80e91818f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.926569 Oct 29 21:19:27.913382 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2948/6000] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:26 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:28.008624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:28.081971 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ef55389-9006-413c-8203-b45d7ac041b6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 1.095501 Oct 29 21:19:28.088116 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3053/6001] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:26 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:28.784964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0a5da330-099b-4ba5-bbac-d43df9c4b5dc tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Action: 'create', calling method: .version_select at 0x7fa171154670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1375333214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4tw02AgeE5wujyf34HCCYiUSexGoBOMlPLpj62cRCsOCZ+g3/ZqLZZS4IToF6oEOC5kUDUdarPBiRy/Ukk2LBumKxJQ0+aoYY7wXgJcXrrWr4PnBjT/kUXzy+odLc2Kg=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:28.841392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-0a5da330-099b-4ba5-bbac-d43df9c4b5dc tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Getting quotas for project 74017e271f93426890b5da5780849913. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:19:28.863321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-0a5da330-099b-4ba5-bbac-d43df9c4b5dc tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Getting quotas for user 631ab24a4f8a4d4c9e68df5df4b23274 and project 74017e271f93426890b5da5780849913. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:19:28.932615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0a5da330-099b-4ba5-bbac-d43df9c4b5dc tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.539800 Oct 29 21:19:28.933893 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2949/6002] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:19:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:28.939992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:28.941087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:28.958999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:28.964095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:28.968674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:28.971673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:28.972993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:28.976775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:29.046771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c96dbfc0-36a1-492d-a9bf-b3c11752ee27 req-566f8b1d-b773-414b-b1e3-eb150ffba63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b", "tag": "9ad7d73e-4bc7-4aee-ac8d-5cd51ea3e012"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:29.083529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c96dbfc0-36a1-492d-a9bf-b3c11752ee27 req-566f8b1d-b773-414b-b1e3-eb150ffba63d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:29.084610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c96dbfc0-36a1-492d-a9bf-b3c11752ee27 req-566f8b1d-b773-414b-b1e3-eb150ffba63d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:29.085380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c96dbfc0-36a1-492d-a9bf-b3c11752ee27 req-566f8b1d-b773-414b-b1e3-eb150ffba63d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:29.116295 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c96dbfc0-36a1-492d-a9bf-b3c11752ee27 req-566f8b1d-b773-414b-b1e3-eb150ffba63d service nova] Creating event network-changed:9ad7d73e-4bc7-4aee-ac8d-5cd51ea3e012 for instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b on nch2-master-1 Oct 29 21:19:29.129053 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c96dbfc0-36a1-492d-a9bf-b3c11752ee27 req-566f8b1d-b773-414b-b1e3-eb150ffba63d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091169 Oct 29 21:19:29.132979 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2950/6003] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:19:29.148376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:29.149432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:29.171990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:29.173066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:29.174540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:29.175506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:29.176181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:29.178651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:30.447120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:30.476278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc101ff5-9b95-4428-b0d2-9b697f4a1bfe tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 1.341533 Oct 29 21:19:30.479331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2951/6004] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:29 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:30.649917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:30.680369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:30.708861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-528a2470-93e8-42c6-9bbd-f7b6f052cd3f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 1.778209 Oct 29 21:19:30.714417 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3054/6005] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:28 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:31.503939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:31.504623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:31.526775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:31.527503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:31.527964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:31.528719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:31.529194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:31.530610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:31.737406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:31.738117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:31.741207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=16 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:31.750683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:31.752049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:31.752715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:31.753673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:31.754406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:31.755061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:32.091029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:32.100679 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c7eb52e-3b8a-490e-bdbf-a627d6339360 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 0.601501 Oct 29 21:19:32.101556 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2952/6006] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:31 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:32.156903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:32.167281 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-803cd232-3c45-4781-a1ee-b8a20ab66612 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.434329 Oct 29 21:19:32.168447 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3055/6007] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:31 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:33.124618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:33.125248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:33.143274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:33.143989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:33.146575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:33.147520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:33.148197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:33.156905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:33.197145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:33.199486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:33.218174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:33.218895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:33.219836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:33.224164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:33.234586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:33.236554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:33.340785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:33.846381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:33.856542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:33.870804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df2ee033-0477-4889-a965-9ab00f7ba828 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.678657 Oct 29 21:19:33.871595 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d8ca8df-478a-4ac5-b79a-e801a3718022 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 0.748815 Oct 29 21:19:33.873426 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3056/6008] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:33 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:33.874437 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2953/6009] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:33 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:33.888535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-313107414", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1375333214", "security_groups": [{"name": "tempest-secgroup-smoke-693777330"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "2cedd513-f3eb-4590-bdb9-c2e1a7d5789c"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:34.118921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] validate_networks() for [('2cedd513-f3eb-4590-bdb9-c2e1a7d5789c', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:19:34.681254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Getting quotas for project 74017e271f93426890b5da5780849913. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:19:34.694906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Getting quotas for user 631ab24a4f8a4d4c9e68df5df4b23274 and project 74017e271f93426890b5da5780849913. Resources: dict_keys(['metadata_items']) {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:19:34.715801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:19:34.716249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:19:34.716743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:19:34.717422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:19:34.718035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:19:34.727706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:34.728208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:34.728655 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:34.729447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:34.729930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:34.730370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:34.752651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Getting quotas for project 74017e271f93426890b5da5780849913. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:19:34.759688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Getting quotas for user 631ab24a4f8a4d4c9e68df5df4b23274 and project 74017e271f93426890b5da5780849913. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:19:34.770800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:34.775216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:19:34.777666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:19:34.830489 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ddd269ac-7e7a-48d4-9d08-a9be7ee419ff tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.953737 Oct 29 21:19:34.831844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3057/6010] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:19:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:19:34.844565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce03a6bb-c74f-445e-ba9b-7592daf278f5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:34.846266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce03a6bb-c74f-445e-ba9b-7592daf278f5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:34.901765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:34.901765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:34.909179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:34.909814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:34.910488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:34.911321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:34.911899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:34.914067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:34.936517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce03a6bb-c74f-445e-ba9b-7592daf278f5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:34.946395 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce03a6bb-c74f-445e-ba9b-7592daf278f5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1302 microversion: 2.1 time: 0.107437 Oct 29 21:19:34.950457 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2954/6011] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:34 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:35.004577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:35.005248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:35.018351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:35.019179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:35.019804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:35.021288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:35.021976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:35.022587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:35.288034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:35.298877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-97950b62-bcc9-40f3-89da-2f106ce7d66a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.403486 Oct 29 21:19:35.318598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3058/6012] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:34 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:35.332439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:35.342214 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-327d9517-4837-4244-bb54-a4caba6c9f08 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 0.352481 Oct 29 21:19:35.364839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2955/6013] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:34 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:35.426530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4d9d5618-dfb6-4a6f-bd3d-8d57195f1d55 req-2d11667f-ecb8-478d-9eb7-c83aa572045d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996f9677-7222-4c80-a6c4-4307d81d1dfb", "name": "network-vif-plugged", "status": "completed", "tag": "592f1e7e-4189-477c-a49d-8a465e4336e8"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:35.441839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4d9d5618-dfb6-4a6f-bd3d-8d57195f1d55 req-2d11667f-ecb8-478d-9eb7-c83aa572045d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:35.443249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4d9d5618-dfb6-4a6f-bd3d-8d57195f1d55 req-2d11667f-ecb8-478d-9eb7-c83aa572045d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:35.443897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4d9d5618-dfb6-4a6f-bd3d-8d57195f1d55 req-2d11667f-ecb8-478d-9eb7-c83aa572045d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:35.465025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4d9d5618-dfb6-4a6f-bd3d-8d57195f1d55 req-2d11667f-ecb8-478d-9eb7-c83aa572045d service nova] Creating event network-vif-plugged:592f1e7e-4189-477c-a49d-8a465e4336e8 for instance 996f9677-7222-4c80-a6c4-4307d81d1dfb on nch1-master-1 Oct 29 21:19:35.477415 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4d9d5618-dfb6-4a6f-bd3d-8d57195f1d55 req-2d11667f-ecb8-478d-9eb7-c83aa572045d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057029 Oct 29 21:19:35.482332 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3059/6014] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:35.980828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:35.980828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:35.985951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:35.986396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:35.986833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:35.987548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:35.988005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:35.988647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:36.100590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:36.108866 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ddd103f5-50fd-4107-93af-477a87810661 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1298 microversion: 2.1 time: 0.134750 Oct 29 21:19:36.122179 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2956/6015] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:35 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:36.335837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:36.336720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:36.344172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:36.345884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:36.346879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:36.348065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:36.349006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:36.350483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:36.370871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:36.373798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:36.383857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:36.388304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:36.389580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:36.390579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:36.391207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:36.392383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:36.641501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:36.658216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e5f2b583-e9e3-4cd7-a577-c7502f0d67cc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1202 microversion: 2.1 time: 0.329404 Oct 29 21:19:36.662017 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3060/6016] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:36 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1202 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:36.727388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:36.742574 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ed810d3a-fbde-4a25-9bfb-ab050f91d9bf tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 0.375711 Oct 29 21:19:36.743176 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2957/6017] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:36 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:37.134025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:37.134789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:37.140828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:37.141328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:37.141966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:37.142742 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:37.143799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:37.144712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:37.262980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:37.275611 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-326e4911-b5d2-4f29-9c46-fdbe2a42a44b tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1354 microversion: 2.1 time: 0.146036 Oct 29 21:19:37.281599 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3061/6018] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:37 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:37.684069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:37.687587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:37.698343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:37.699437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:37.700143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:37.701098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:37.702604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:37.703374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:37.777448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:37.779751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:37.789031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:37.789811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:37.790767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:37.792315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:37.793012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:37.793983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:38.156378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:38.174495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:38.174697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-955102c5-ff00-44a6-9c0b-a3eab972f6bd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1388 microversion: 2.1 time: 0.494871 Oct 29 21:19:38.175791 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2958/6019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:37 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1388 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:38.182772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5a9bc7d7-9fa2-4ae7-8761-6fc91729d021 req-90d91a28-699d-4345-b56c-4c0dba145ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b", "name": "network-vif-plugged", "status": "completed", "tag": "9ad7d73e-4bc7-4aee-ac8d-5cd51ea3e012"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:38.184449 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f12d10fd-8581-427a-bd74-f14e9a81317c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 0.417058 Oct 29 21:19:38.193953 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3062/6020] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:37 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:38.194169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5a9bc7d7-9fa2-4ae7-8761-6fc91729d021 req-90d91a28-699d-4345-b56c-4c0dba145ebd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:38.194927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5a9bc7d7-9fa2-4ae7-8761-6fc91729d021 req-90d91a28-699d-4345-b56c-4c0dba145ebd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:38.195477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5a9bc7d7-9fa2-4ae7-8761-6fc91729d021 req-90d91a28-699d-4345-b56c-4c0dba145ebd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:38.209906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5a9bc7d7-9fa2-4ae7-8761-6fc91729d021 req-90d91a28-699d-4345-b56c-4c0dba145ebd service nova] Creating event network-vif-plugged:9ad7d73e-4bc7-4aee-ac8d-5cd51ea3e012 for instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b on nch2-master-1 Oct 29 21:19:38.216488 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5a9bc7d7-9fa2-4ae7-8761-6fc91729d021 req-90d91a28-699d-4345-b56c-4c0dba145ebd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039064 Oct 29 21:19:38.238453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:38.239308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:38.242065 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2959/6021] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:38.256398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:38.259639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:38.260164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:38.262671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:38.263174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:38.264828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:38.306944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:38.307660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:38.321729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:38.326695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:38.327155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:38.327907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:38.331644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:38.333636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:38.883108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:38.920600 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31ffcea8-e7c3-44de-a2ec-d40555a87b19 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1360 microversion: 2.1 time: 0.618549 Oct 29 21:19:38.924248 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2960/6022] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:38 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1360 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:39.083554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:39.106150 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83c86e8d-5ea8-40ee-8e9a-57e09a23ef2d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1388 microversion: 2.1 time: 0.881396 Oct 29 21:19:39.107168 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3063/6023] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:38 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1388 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:39.129884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:39.130514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:39.141340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.141340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.141859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.142577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.143038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.146946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.219367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:39.219694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:39.231324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.233301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.233983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.235068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.236892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.240258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.484700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:39.503436 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82b6ca1b-2e64-4b9e-aa08-3f8da1a726c2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1388 microversion: 2.1 time: 0.375684 Oct 29 21:19:39.526860 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2961/6024] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:39 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1388 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:39.661733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:39.663413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:39.687828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:39.691007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.692175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.696936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.698120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.698845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.699678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.715586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=100 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:39.740524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:39.751666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:19:39.754579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-36cab295-46bd-4b83-b790-059932613af6 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1311 microversion: 2.1 time: 0.543049 Oct 29 21:19:39.755619 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3064/6025] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:39 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1311 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:39.950910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:39.952307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:39.963388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 204 len: 0 microversion: 2.1 time: 0.312451 Oct 29 21:19:39.964589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.972924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.973583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.975934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:39.976520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:39.985773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:39.986083 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2962/6026] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:19:39 2022] DELETE /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:19:39.991884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:39.992716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:40.004948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:40.005871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:40.007182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:40.009894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:40.021134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:40.028417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:40.513286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:40.523135 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e676765d-15ed-41ce-9d74-b6b34b990925 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.575996 Oct 29 21:19:40.523739 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3065/6027] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:39 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:40.533156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:40.547430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce8f50cc-cd3c-4f89-87fe-d85f466e1b93 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1394 microversion: 2.1 time: 0.559829 Oct 29 21:19:40.548078 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2963/6028] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:39 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1394 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:40.783453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:40.784091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:40.796774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:40.797566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:40.798751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:40.799710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:40.800346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:40.804763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:41.168974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:41.177273 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9aa5954d-00bb-4f52-b05a-6e4502251963 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1496 microversion: 2.1 time: 0.398934 Oct 29 21:19:41.196822 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3066/6029] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:40 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1496 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:41.482271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-43c2c9c6-12e4-4d55-91ee-cdbfaab28b86 req-8e5b1aba-c8c7-406e-825d-35445652af30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb375cf9-8508-4b60-b27c-5a1033f4d774", "tag": "2de406a5-cb91-4767-b9e3-bef0fad89389"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:41.502306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-43c2c9c6-12e4-4d55-91ee-cdbfaab28b86 req-8e5b1aba-c8c7-406e-825d-35445652af30 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:41.502815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-43c2c9c6-12e4-4d55-91ee-cdbfaab28b86 req-8e5b1aba-c8c7-406e-825d-35445652af30 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:41.503270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-43c2c9c6-12e4-4d55-91ee-cdbfaab28b86 req-8e5b1aba-c8c7-406e-825d-35445652af30 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:41.536017 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-43c2c9c6-12e4-4d55-91ee-cdbfaab28b86 req-8e5b1aba-c8c7-406e-825d-35445652af30 service nova] Creating event network-changed:2de406a5-cb91-4767-b9e3-bef0fad89389 for instance cb375cf9-8508-4b60-b27c-5a1033f4d774 on nch1-master-1 Oct 29 21:19:41.546893 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-43c2c9c6-12e4-4d55-91ee-cdbfaab28b86 req-8e5b1aba-c8c7-406e-825d-35445652af30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068074 Oct 29 21:19:41.549769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2964/6030] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:41.550573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:41.551323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:41.571762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:41.572458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:41.573195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:41.574676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:41.575714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:41.576394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:41.577619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:41.578341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:41.588870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:41.589364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:41.589847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:41.590571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:41.591058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:41.591657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:42.119931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:42.128181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be72b831-0ec4-407f-bb17-8bf31a184ebe tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1394 microversion: 2.1 time: 0.558052 Oct 29 21:19:42.128775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2965/6031] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:41 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1394 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:42.138517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:42.142771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:42.143489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:42.149632 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1f67dad-0765-4dd8-93a2-3ce25f7583ea tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.603464 Oct 29 21:19:42.152413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3067/6032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:41 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:42.167161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:42.167663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:42.168109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:42.168838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:42.169301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:42.169767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:42.227972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:19:42.357231 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e398692e-5163-4531-90dd-49f80315b290 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 204 len: 0 microversion: 2.1 time: 0.215813 Oct 29 21:19:42.358252 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2966/6033] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:19:42 2022] DELETE /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:19:42.366468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:42.367381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:42.382555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:42.383328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:42.384703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:42.386036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:42.387091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:42.388661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:42.878766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:42.910959 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-52845ce6-84ec-4ba0-b852-a36be43369bb tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1502 microversion: 2.1 time: 0.547911 Oct 29 21:19:42.926301 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3068/6034] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:42 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:42.932586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d5842551-39a5-469f-acab-3b360f8f9304 req-b493795f-faf3-49c4-b1a9-1e50599d6f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996f9677-7222-4c80-a6c4-4307d81d1dfb", "name": "network-vif-deleted", "tag": "592f1e7e-4189-477c-a49d-8a465e4336e8"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:42.952293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5842551-39a5-469f-acab-3b360f8f9304 req-b493795f-faf3-49c4-b1a9-1e50599d6f2b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:42.952867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5842551-39a5-469f-acab-3b360f8f9304 req-b493795f-faf3-49c4-b1a9-1e50599d6f2b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:42.953315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d5842551-39a5-469f-acab-3b360f8f9304 req-b493795f-faf3-49c4-b1a9-1e50599d6f2b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:42.987248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d5842551-39a5-469f-acab-3b360f8f9304 req-b493795f-faf3-49c4-b1a9-1e50599d6f2b service nova] Creating event network-vif-deleted:592f1e7e-4189-477c-a49d-8a465e4336e8 for instance 996f9677-7222-4c80-a6c4-4307d81d1dfb on nch1-master-1 Oct 29 21:19:43.002162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d5842551-39a5-469f-acab-3b360f8f9304 req-b493795f-faf3-49c4-b1a9-1e50599d6f2b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073252 Oct 29 21:19:43.002858 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2967/6035] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:43.151770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:43.152806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:43.160754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:43.161543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:43.162382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:43.163319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:43.163983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:43.164610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:43.175440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:43.176168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:43.187647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:43.187900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:43.188280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:43.189721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:43.194574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:43.195784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:43.267650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:43.276399 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4beb1b69-5256-405d-ab55-a9ff4d65be55 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1352 microversion: 2.1 time: 0.128498 Oct 29 21:19:43.281414 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3069/6036] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:43 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:43.420267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:43.439872 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-120d5bdf-2e1e-4dc1-aaaf-0b07ad4ad766 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.263327 Oct 29 21:19:43.441584 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2968/6037] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:43 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:43.941375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:43.942200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:43.952457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:43.953698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:43.955069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:43.956349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:43.957005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:43.957488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:44.282851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:44.306691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:44.308008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:44.318027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bd7cfe19-e1ff-4d7b-8bc8-e4dd49a83a4c tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1502 microversion: 2.1 time: 0.359357 Oct 29 21:19:44.319216 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3070/6038] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:43 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:44.322948 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:44.324977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:44.325772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:44.328734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:44.330015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:44.330657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:44.469913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:44.473734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:44.474370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:44.485758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:44.488307 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be3e38ed-b3cb-4d7a-bf03-333237fc7ab2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1352 microversion: 2.1 time: 0.188015 Oct 29 21:19:44.489188 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2969/6039] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:44 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:44.489433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:44.490160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:44.490761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:44.491252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:44.491777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:44.592383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e81ab63d-cced-4ead-819a-b361b67f28ff req-c2f6db05-2413-4484-92fd-8aaa52f1b4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b", "name": "network-vif-deleted", "tag": "9ad7d73e-4bc7-4aee-ac8d-5cd51ea3e012"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:44.606482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e81ab63d-cced-4ead-819a-b361b67f28ff req-c2f6db05-2413-4484-92fd-8aaa52f1b4b9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:44.606939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e81ab63d-cced-4ead-819a-b361b67f28ff req-c2f6db05-2413-4484-92fd-8aaa52f1b4b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:44.607731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e81ab63d-cced-4ead-819a-b361b67f28ff req-c2f6db05-2413-4484-92fd-8aaa52f1b4b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:44.623022 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e81ab63d-cced-4ead-819a-b361b67f28ff req-c2f6db05-2413-4484-92fd-8aaa52f1b4b9 service nova] Creating event network-vif-deleted:9ad7d73e-4bc7-4aee-ac8d-5cd51ea3e012 for instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b on nch2-master-1 Oct 29 21:19:44.630632 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e81ab63d-cced-4ead-819a-b361b67f28ff req-c2f6db05-2413-4484-92fd-8aaa52f1b4b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042341 Oct 29 21:19:44.631916 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2970/6040] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:19:44.740036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:44.761962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:44.769523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:44.774567 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f192f4f-b6d1-4ee9-bfe6-9904376bd2c5 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.311334 Oct 29 21:19:44.775638 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3071/6041] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:44 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:45.342381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:45.356357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:45.358880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:45.373205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.374552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.375668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.377615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.378345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.379015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.475721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.476318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.476863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.478349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lazy-loading 'fault' on Instance uuid ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:19:45.512054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:45.513966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:45.527965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.530032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.531161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.533437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.534518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.536446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.542402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f0a921d2a60482ca47fed07daf2e9e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e4f30c260948efa2370c51353d48d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:45.553994 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab73c7fd-efdb-4ac0-b39c-011575a7a245 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 200 len: 1301 microversion: 2.1 time: 0.213067 Oct 29 21:19:45.568752 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2971/6042] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:45 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 1301 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:45.588017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.589561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.590015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.590608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lazy-loading 'fault' on Instance uuid 996f9677-7222-4c80-a6c4-4307d81d1dfb {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:19:45.667628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:45.690816 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3936671e-465e-4b55-bc2f-6e22801d2f06 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 200 len: 1192 microversion: 2.1 time: 0.182937 Oct 29 21:19:45.692516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3072/6043] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:45 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 1192 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:19:45.804882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:45.806301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:45.816858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.817466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.818053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:45.819071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:45.819659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:45.820379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.200650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:46.208903 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9d4c8e8-69f5-43b9-8498-754a50e577db tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.412826 Oct 29 21:19:46.221821 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2972/6044] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:45 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:46.591480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:46.595278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] [instance: ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:46.606232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.612818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.615153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.618046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.618813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.619692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.650126 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] HTTP exception thrown: Instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b could not be found. Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Request method failure captured: Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b HTTP/1.1 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi3BPQ2cRtrkijmfab2TcsQXYc9TBfcbEBLZt-ORVB8BAa5fJEkqAjJxTFGAjTxaA4TiifFjbno2Z-RQO5sM3_MfLsqEOyZzRX9mC-xJqN2uhAa7uFlsxKW8TVklBsxOnQebAxVy7774JLkrhCIr646cV7uZ6v46Qy_or-Y7IjlwSM Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c4e4f30c260948efa2370c51353d48d5 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-VolumesActionsTest-1690945690 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4e4f30c260948efa2370c51353d48d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-VolumesActionsTest-1690945690 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c4e4f30c260948efa2370c51353d48d5 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-VolumesActionsTest-1690945690 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-VolumesActionsTest-1690945690-project Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4f0a921d2a60482ca47fed07daf2e9e0 Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-VolumesActionsTest-1690945690-project Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b could not be found. Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b'} Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b could not be found. Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b could not be found. Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.653174 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b could not be found. Oct 29 21:19:46.659126 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.662340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] Returning 404 to user: Instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:19:46.663426 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-59226f0e-2a84-417a-ae91-dfcf94ec5b29 tempest-VolumesActionsTest-1690945690 tempest-VolumesActionsTest-1690945690-project] 10.222.0.36 "GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b" status: 404 len: 111 microversion: 2.1 time: 0.078490 Oct 29 21:19:46.682490 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3073/6045] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:46 2022] GET /compute/v2.1/servers/ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:19:46.717632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:46.718404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:46.742920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.743730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.744511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.745473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.746121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.746778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.767261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb HTTP/1.1 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '996f9677-7222-4c80-a6c4-4307d81d1dfb'} Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.769427 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.775646 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.778194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:19:46.779543 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62ed8353-d0d9-4f57-9b11-e510847636ac tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 404 len: 111 microversion: 2.1 time: 0.067636 Oct 29 21:19:46.780144 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2973/6046] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:46 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:19:46.822162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:46.822162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:46.830875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.831388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.831904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.832638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.833174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.833953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.853659 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb HTTP/1.1 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '996f9677-7222-4c80-a6c4-4307d81d1dfb'} Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:19:46.856002 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.861886 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.864770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:19:46.866297 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a8c15d6-4db5-4a38-bd94-beb4c9f0f8ae tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 404 len: 111 microversion: 2.1 time: 0.049985 Oct 29 21:19:46.872574 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3074/6047] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:19:46 2022] DELETE /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:19:46.877650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:46.878464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 996f9677-7222-4c80-a6c4-4307d81d1dfb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:46.904786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.905478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.906075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.906809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:46.907913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:46.908364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:46.933202 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb HTTP/1.1 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '996f9677-7222-4c80-a6c4-4307d81d1dfb'} Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:19:46.941221 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 996f9677-7222-4c80-a6c4-4307d81d1dfb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:19:46.947679 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb11dfde-d2ae-4fa2-9772-6378bfb3d86d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb" status: 404 len: 111 microversion: 2.1 time: 0.073150 Oct 29 21:19:46.949432 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2974/6048] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:46 2022] GET /compute/v2.1/servers/996f9677-7222-4c80-a6c4-4307d81d1dfb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:19:47.239678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:47.240388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:47.257968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:47.269730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:47.270509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:47.271820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:47.273830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:47.274408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:47.305879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:19:47.572504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:47.583467 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e3e1e90-1199-4b61-bd0e-d8cd9aa32c14 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.354520 Oct 29 21:19:47.586313 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3075/6049] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:47 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:48.608949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:48.609906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:48.665656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:48.666552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:48.669282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:48.674306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:48.675101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:48.677424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:49.242441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-da427b04-0277-4853-aaca-bebe4da956c5 req-9f6e03ce-5bdb-4f67-8c3a-f6a44172b489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb375cf9-8508-4b60-b27c-5a1033f4d774", "name": "network-vif-plugged", "status": "completed", "tag": "2de406a5-cb91-4767-b9e3-bef0fad89389"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:49.255177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-da427b04-0277-4853-aaca-bebe4da956c5 req-9f6e03ce-5bdb-4f67-8c3a-f6a44172b489 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:49.255882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-da427b04-0277-4853-aaca-bebe4da956c5 req-9f6e03ce-5bdb-4f67-8c3a-f6a44172b489 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:49.256510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-da427b04-0277-4853-aaca-bebe4da956c5 req-9f6e03ce-5bdb-4f67-8c3a-f6a44172b489 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:49.268673 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-da427b04-0277-4853-aaca-bebe4da956c5 req-9f6e03ce-5bdb-4f67-8c3a-f6a44172b489 service nova] Creating event network-vif-plugged:2de406a5-cb91-4767-b9e3-bef0fad89389 for instance cb375cf9-8508-4b60-b27c-5a1033f4d774 on nch1-master-1 Oct 29 21:19:49.274553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:49.274864 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-da427b04-0277-4853-aaca-bebe4da956c5 req-9f6e03ce-5bdb-4f67-8c3a-f6a44172b489 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036271 Oct 29 21:19:49.276239 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3076/6050] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:19:49.284044 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ee02acf5-da3f-481a-bb66-fc9359d82104 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.679295 Oct 29 21:19:49.285561 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2975/6051] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:48 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:50.311634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:50.312263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:50.327457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:50.327970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:50.328424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:50.331730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:50.332380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:50.333706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:50.888827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:50.898697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-44ff6c71-b246-44ea-8d7e-b7c67e32e803 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1427 microversion: 2.1 time: 0.593381 Oct 29 21:19:50.926796 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3077/6052] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:50 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1427 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:51.925339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:51.929086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:51.965122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:51.965688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:51.966142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:51.966884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:51.967355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:51.967797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:52.401994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:52.416495 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3cdecf9b-f588-4ff0-adfc-0633f1024a17 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1606 microversion: 2.1 time: 0.498211 Oct 29 21:19:52.418970 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2976/6053] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:51 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1606 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:52.448275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:52.448878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:52.470781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:52.471337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:52.471798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:52.472561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:52.473030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:52.490933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:52.832634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:52.889665 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c847be01-44fa-4cba-aa63-263d12213fab tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1606 microversion: 2.1 time: 0.431802 Oct 29 21:19:52.889665 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3078/6054] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:52 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1606 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:52.903525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:52.904409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:52.920574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:52.921873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:52.923071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:52.926536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:52.928040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:52.929178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:53.218384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:53.230238 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16fe76f8-7afe-4525-b3fa-33f47fc639fe tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1606 microversion: 2.1 time: 0.331709 Oct 29 21:19:53.256543 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2977/6055] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:52 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1606 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:54.192846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1084550418", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d77b83fc-0cf8-47e0-ab3e-e84abfe35d95", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "61be7916-1aaf-44e0-b8b4-9d255eece552"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:54.376460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] validate_networks() for [('61be7916-1aaf-44e0-b8b4-9d255eece552', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:19:55.913963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:19:55.915355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:19:55.916689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:19:55.917345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:19:55.918150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:19:55.935253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:55.935889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:55.936370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:55.937183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:55.939852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:55.941766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:55.990824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:19:56.002982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:19:56.086285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:19:56.088676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d77b83fc-0cf8-47e0-ab3e-e84abfe35d95',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:19:56.278684 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6c477ec-e8ae-4be3-b128-762a790be853 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.089597 Oct 29 21:19:56.286693 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3079/6056] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:19:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:19:56.292013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef2009e7-c7bb-40db-b1d1-28520623d33b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:56.293672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef2009e7-c7bb-40db-b1d1-28520623d33b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:56.441918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef2009e7-c7bb-40db-b1d1-28520623d33b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:56.459594 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef2009e7-c7bb-40db-b1d1-28520623d33b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1071 microversion: 2.1 time: 0.172289 Oct 29 21:19:56.473679 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2978/6057] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:56 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1071 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:57.488619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:57.490596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:57.499130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:57.499912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:57.501556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:57.502611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:57.503251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:57.503844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:57.583988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1a3e9cb4-84fb-439a-bd56-7b9002a32bda req-3b0b3757-822c-4a8e-9084-cad69bc2ea01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb375cf9-8508-4b60-b27c-5a1033f4d774", "tag": "2de406a5-cb91-4767-b9e3-bef0fad89389"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:19:57.600664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1a3e9cb4-84fb-439a-bd56-7b9002a32bda req-3b0b3757-822c-4a8e-9084-cad69bc2ea01 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:57.601411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1a3e9cb4-84fb-439a-bd56-7b9002a32bda req-3b0b3757-822c-4a8e-9084-cad69bc2ea01 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:57.602101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1a3e9cb4-84fb-439a-bd56-7b9002a32bda req-3b0b3757-822c-4a8e-9084-cad69bc2ea01 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:57.616915 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1a3e9cb4-84fb-439a-bd56-7b9002a32bda req-3b0b3757-822c-4a8e-9084-cad69bc2ea01 service nova] Creating event network-changed:2de406a5-cb91-4767-b9e3-bef0fad89389 for instance cb375cf9-8508-4b60-b27c-5a1033f4d774 on nch1-master-1 Oct 29 21:19:57.642750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:57.667825 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d53a2f1e-ca04-45ae-b328-181fb9822b39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1169 microversion: 2.1 time: 0.186196 Oct 29 21:19:57.687097 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1a3e9cb4-84fb-439a-bd56-7b9002a32bda req-3b0b3757-822c-4a8e-9084-cad69bc2ea01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104470 Oct 29 21:19:57.688718 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3080/6058] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:57 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:57.693129 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2979/6059] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:19:58.693283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:58.693922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:19:58.717367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:58.720308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:58.721112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:58.730484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:19:58.731287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:19:58.734158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:19:58.940145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:19:58.953260 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-68295519-db7c-42de-b087-b8987b6baa8e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1187 microversion: 2.1 time: 0.263886 Oct 29 21:19:58.954560 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3081/6060] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:58 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1187 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:19:59.978352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:19:59.980158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:00.023397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:00.030387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:00.031292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:00.034205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:00.036570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:00.039337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:00.058437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:00.580864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:00.590840 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87062df4-fa5e-4282-aafb-c699949af461 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1229 microversion: 2.1 time: 0.617325 Oct 29 21:20:00.591442 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2980/6061] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:19:59 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1229 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:01.619225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:01.619829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:01.639283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:01.642960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:01.643538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:01.647590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:01.649598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:01.650147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:01.879202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:01.888235 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1dd8ff92-96c1-472e-bc8d-b27c7a67d9b9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.274788 Oct 29 21:20:01.888835 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3082/6062] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:01 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:02.077839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cbf5abc2-8735-4fb7-9b44-beaedf34c774 req-01add7f9-5afa-47b3-b9fb-0174333eb146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9125f678-3943-4ce1-90fe-9891851b597d", "tag": "87da02d9-a50a-4b4a-afea-ad24be80bcc7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:02.097670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cbf5abc2-8735-4fb7-9b44-beaedf34c774 req-01add7f9-5afa-47b3-b9fb-0174333eb146 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:02.099472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cbf5abc2-8735-4fb7-9b44-beaedf34c774 req-01add7f9-5afa-47b3-b9fb-0174333eb146 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:02.100169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cbf5abc2-8735-4fb7-9b44-beaedf34c774 req-01add7f9-5afa-47b3-b9fb-0174333eb146 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:02.124744 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cbf5abc2-8735-4fb7-9b44-beaedf34c774 req-01add7f9-5afa-47b3-b9fb-0174333eb146 service nova] Creating event network-changed:87da02d9-a50a-4b4a-afea-ad24be80bcc7 for instance 9125f678-3943-4ce1-90fe-9891851b597d on nch2-master-1 Oct 29 21:20:02.140846 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cbf5abc2-8735-4fb7-9b44-beaedf34c774 req-01add7f9-5afa-47b3-b9fb-0174333eb146 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061143 Oct 29 21:20:02.142687 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2981/6063] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:20:02.913163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:02.914508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:02.922988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:02.926456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:02.927991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:02.929227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:02.930961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:02.932269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:03.180761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:03.190975 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0a994394-3363-4786-b705-0c7471278303 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.281901 Oct 29 21:20:03.194691 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3083/6064] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:02 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:04.217334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:04.218102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:04.232365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:04.236127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:04.236807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:04.237796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:04.242472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:04.243222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:04.517040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:04.528988 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30c7b097-3025-4d5c-a2aa-6ee1770ebb17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.316065 Oct 29 21:20:04.541966 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2982/6065] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:04 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:05.552794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:05.553493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:05.574425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:05.589281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:05.591258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:05.601958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:05.605196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:05.615400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:05.615929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:05.870150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:05.881063 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6b2435e-cc82-4a74-bc5d-474ad28510ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.331065 Oct 29 21:20:05.881149 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3084/6066] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:05 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:20:06.908373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:06.909009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:06.913959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:06.931342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:06.934090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:06.936154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:06.936962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:06.940008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:06.940483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:07.231757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:07.244726 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90a7ce40-a5c9-411f-9607-056365208273 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.340641 Oct 29 21:20:07.248095 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2983/6067] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:06 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:08.285428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:08.289178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:08.301239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:08.303679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:08.314383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:08.316589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:08.317728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:08.325596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:08.326932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:08.329252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:08.585374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:08.612596 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6119cf9-caf7-4a80-9388-2b71b9d63414 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.332982 Oct 29 21:20:08.614219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3085/6068] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:08 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:09.637778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:09.638453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:09.653096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:09.653636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:09.654091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:09.654820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:09.655285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:09.655724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:10.012600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:10.024295 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36d2618b-1172-4d58-abd2-9e296c1f4f99 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.390646 Oct 29 21:20:10.041110 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2984/6069] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:09 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:10.137929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9a28678a-896a-4103-87fb-6c82da5d7eb2 req-f7968a8f-2a83-4cbe-b147-0c4f6bb1fc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9125f678-3943-4ce1-90fe-9891851b597d", "name": "network-vif-plugged", "status": "completed", "tag": "87da02d9-a50a-4b4a-afea-ad24be80bcc7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:10.160485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:10.164574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a28678a-896a-4103-87fb-6c82da5d7eb2 req-f7968a8f-2a83-4cbe-b147-0c4f6bb1fc6b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:10.174063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a28678a-896a-4103-87fb-6c82da5d7eb2 req-f7968a8f-2a83-4cbe-b147-0c4f6bb1fc6b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:10.176787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a28678a-896a-4103-87fb-6c82da5d7eb2 req-f7968a8f-2a83-4cbe-b147-0c4f6bb1fc6b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:10.194567 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9a28678a-896a-4103-87fb-6c82da5d7eb2 req-f7968a8f-2a83-4cbe-b147-0c4f6bb1fc6b service nova] Creating event network-vif-plugged:87da02d9-a50a-4b4a-afea-ad24be80bcc7 for instance 9125f678-3943-4ce1-90fe-9891851b597d on nch2-master-1 Oct 29 21:20:10.201845 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9a28678a-896a-4103-87fb-6c82da5d7eb2 req-f7968a8f-2a83-4cbe-b147-0c4f6bb1fc6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069002 Oct 29 21:20:10.202680 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2985/6070] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:20:10.253629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Calling method '.version_select at 0x7fa1712508b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:10.256237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:10.256892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:10.257524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:10.273108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:10.273946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:10.274625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:10.289690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:10.290426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:10.290865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:10.305621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4092a312-a26b-4eed-b929-8548f38e7260 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1817695528-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.520937 Oct 29 21:20:10.308187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3086/6071] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 21:20:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:20:11.049277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:11.050617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:11.058908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:11.059633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:11.060251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:11.061133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:11.061779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:11.062363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:11.271746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:11.288401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82f17e37-9689-48d5-b940-b066ba3fb19f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1217 microversion: 2.1 time: 0.244350 Oct 29 21:20:11.308316 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2986/6072] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:11 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:12.315159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:12.315795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:12.327129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:12.330087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:12.330709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:12.332850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:12.334007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:12.334688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:12.575662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:12.584968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b07df6e-a615-4351-b31c-ab034538a141 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1404 microversion: 2.1 time: 0.273761 Oct 29 21:20:12.586733 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3087/6073] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:12 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:12.610210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:12.611485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:12.621797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:12.622577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:12.623183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:12.623894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:12.624521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:12.624946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:12.887599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:12.900404 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c2ebeb54-1f5a-40fa-a87d-d2dec948dd86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1404 microversion: 2.1 time: 0.293435 Oct 29 21:20:12.926282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-61964869"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:12.931342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:12.935013 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2987/6074] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:12 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1404 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:12.944734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:12.945688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:12.946407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:12.948482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:12.949289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:12.949987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:13.126921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.api [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Attempting to quiesce instance before volume snapshot. Oct 29 21:20:13.219568 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.api [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 29 21:20:13.367981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Creating snapshot from volume d77b83fc-0cf8-47e0-ab3e-e84abfe35d95. {{(pid=138885) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 29 21:20:14.869390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a588d89-5a3a-4cc3-a590-4238e11e834c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d/action" status: 202 len: 0 microversion: 2.1 time: 1.949133 Oct 29 21:20:14.882769 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3088/6075] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:20:12 2022] POST /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d/action => generated 0 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 21:20:15.181162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1786009253", "imageRef": "3317c140-afcc-41b2-aa61-8b7d8ab2e9fe", "flavorRef": "452", "networks": [{"uuid": "61be7916-1aaf-44e0-b8b4-9d255eece552"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:15.278280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] validate_networks() for [('61be7916-1aaf-44e0-b8b4-9d255eece552', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:20:15.928308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:20:15.930341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:20:15.931001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:20:15.931972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:20:15.933006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:20:15.947991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:15.948773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:15.949381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:15.950803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:15.952543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:15.953398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:15.981352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:20:15.988099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:20:16.005779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:20:16.009097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f73a835b-6da5-4752-928d-e711f4fbd229',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:20:16.124424 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4ab5675c-52da-4ef8-9927-324f9672efd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956592 Oct 29 21:20:16.128030 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2988/6076] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:20:16.140282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa9a1a34-4dfd-4b00-a4d5-bebb23a3a028 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:16.141114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa9a1a34-4dfd-4b00-a4d5-bebb23a3a028 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:16.272893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa9a1a34-4dfd-4b00-a4d5-bebb23a3a028 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:16.286667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa9a1a34-4dfd-4b00-a4d5-bebb23a3a028 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1230 microversion: 2.1 time: 0.149333 Oct 29 21:20:16.287439 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3089/6077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:16 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1230 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:20:17.313807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:17.314478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:17.321277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:17.321890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:17.322400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:17.323339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:17.323995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:17.324619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:17.455550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:17.466875 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-097b423b-0f95-465d-8075-d3b21224b145 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1282 microversion: 2.1 time: 0.158573 Oct 29 21:20:17.469528 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2989/6078] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:17 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:18.493111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:18.494494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:18.513283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:18.514725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:18.515350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:18.517383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:18.518316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:18.519048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:18.527207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:18.709787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:18.727518 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c5b1e32-6f50-44af-b0b8-ba07b36c6103 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1300 microversion: 2.1 time: 0.238202 Oct 29 21:20:18.741483 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3090/6079] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:18 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1300 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:19.755806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:19.757232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:19.773737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:19.780317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:19.781216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:19.784524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:19.785258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:19.788144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:20.020571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:20.029943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-44d84719-14e8-43d8-9e70-337bb6f2ac86 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1342 microversion: 2.1 time: 0.278109 Oct 29 21:20:20.031274 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2990/6080] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:19 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:20.635511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a4501e0f-ce78-4d1c-9a6b-d31fe917f32e req-3ceaee5a-ea27-477d-8156-965013109fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e259878-bfb9-46b1-af79-8efad38e0fd0", "tag": "8bad2b52-bdfd-4e35-b361-6f807a748ddc"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:20.655365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4501e0f-ce78-4d1c-9a6b-d31fe917f32e req-3ceaee5a-ea27-477d-8156-965013109fd0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:20.657062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4501e0f-ce78-4d1c-9a6b-d31fe917f32e req-3ceaee5a-ea27-477d-8156-965013109fd0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:20.662110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a4501e0f-ce78-4d1c-9a6b-d31fe917f32e req-3ceaee5a-ea27-477d-8156-965013109fd0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:20.678787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a4501e0f-ce78-4d1c-9a6b-d31fe917f32e req-3ceaee5a-ea27-477d-8156-965013109fd0 service nova] Creating event network-changed:8bad2b52-bdfd-4e35-b361-6f807a748ddc for instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 on nch1-master-1 Oct 29 21:20:20.686005 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a4501e0f-ce78-4d1c-9a6b-d31fe917f32e req-3ceaee5a-ea27-477d-8156-965013109fd0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055338 Oct 29 21:20:20.687412 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3091/6081] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:20:21.054928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:21.057572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:21.066205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:21.067161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:21.068350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:21.069285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:21.070383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:21.071034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:21.285166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:21.294213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b2274ac-df3b-4c1f-b514-5f843fcd61e3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1342 microversion: 2.1 time: 0.243651 Oct 29 21:20:21.294960 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2991/6082] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:21 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:22.322923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:22.324168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:22.338755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:22.338755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:22.338755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:22.339762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:22.340448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:22.341103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:22.735401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:22.752591 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-072ccce8-c92e-488a-a5d6-5249023327bf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1342 microversion: 2.1 time: 0.437526 Oct 29 21:20:22.755023 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3092/6083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:22 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1342 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:23.782219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:23.784139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:23.802283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:23.803050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:23.805238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:23.806041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:23.806521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:23.806961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:24.197317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:24.211472 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6051f5b8-cfbb-42d6-9fd6-d2d4d94452f9 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1388 microversion: 2.1 time: 0.436241 Oct 29 21:20:24.214401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2992/6084] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:23 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1388 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:25.240633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:25.241281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:25.248888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:25.249404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:25.250624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:25.251570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:25.252200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:25.252653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:25.424423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:25.445164 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b2960aee-9071-4731-ba6c-f1f15639f25d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.208488 Oct 29 21:20:25.467244 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3093/6085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:25 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:26.469719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:26.470460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:26.474675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:26.475771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:26.481298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:26.481823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:26.482271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:26.483114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:26.483583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:26.484014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:26.686631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:26.697941 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec9e89cc-9f5f-48e5-bb8a-d8342545f155 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.232398 Oct 29 21:20:26.699491 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2993/6086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:26 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:27.725935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:27.726575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:27.730383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:27.736802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:27.737306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:27.738386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:27.739552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:27.740087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:27.741042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:27.934133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:27.943560 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a906317-bc98-45fb-9c69-bf1778cbff49 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.223064 Oct 29 21:20:27.947016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3094/6087] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:27 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:28.971562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:28.972176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:28.982128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:28.985655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:28.985655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:28.985655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:28.985655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:28.985655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:29.155140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:29.167409 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d1093da0-1846-4bac-a2f8-32220406af5e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.200612 Oct 29 21:20:29.171808 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2994/6088] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:28 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:30.194302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:30.204779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:30.212594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:30.213115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:30.214238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:30.216038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:30.216038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:30.216038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:30.488048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:30.497079 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9fa23e2-5f49-4240-9100-9f15270d0d3e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.306529 Oct 29 21:20:30.497903 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3095/6089] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:30 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:31.478036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-80a68168-49a8-4e96-a98c-05845f30a64e req-9b493977-ab69-45be-a568-789aca6f65e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e259878-bfb9-46b1-af79-8efad38e0fd0", "name": "network-vif-plugged", "status": "completed", "tag": "8bad2b52-bdfd-4e35-b361-6f807a748ddc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:31.503896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a68168-49a8-4e96-a98c-05845f30a64e req-9b493977-ab69-45be-a568-789aca6f65e8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:31.505386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a68168-49a8-4e96-a98c-05845f30a64e req-9b493977-ab69-45be-a568-789aca6f65e8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:31.505791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-80a68168-49a8-4e96-a98c-05845f30a64e req-9b493977-ab69-45be-a568-789aca6f65e8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:31.509938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=78 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:31.522356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:31.523539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:31.533813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:31.534327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:31.538279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:31.542530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:31.543061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:31.543550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:31.548047 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-80a68168-49a8-4e96-a98c-05845f30a64e req-9b493977-ab69-45be-a568-789aca6f65e8 service nova] Creating event network-vif-plugged:8bad2b52-bdfd-4e35-b361-6f807a748ddc for instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 on nch1-master-1 Oct 29 21:20:31.556935 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-80a68168-49a8-4e96-a98c-05845f30a64e req-9b493977-ab69-45be-a568-789aca6f65e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086257 Oct 29 21:20:31.559270 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2995/6090] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:20:31.755600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:31.763971 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea3c7c45-2773-4f7f-af62-7b70bad5c3b1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.247319 Oct 29 21:20:31.764572 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3096/6091] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:31 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:20:32.788363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:32.789732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:32.802254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:32.803047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:32.803702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:32.804855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:32.805702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:32.806318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:33.017522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:33.039537 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-53ff1f49-31bb-413e-95bb-a688835a9179 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1376 microversion: 2.1 time: 0.254272 Oct 29 21:20:33.041107 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2996/6092] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:32 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1376 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:34.065194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:34.066090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:34.073597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:34.074407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:34.075064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:34.075998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:34.076600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:34.077254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:34.617852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:34.629015 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-451d278d-e191-4e07-a19e-84b86928e598 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1563 microversion: 2.1 time: 0.568638 Oct 29 21:20:34.630955 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3097/6093] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:34 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1563 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:34.663682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:34.668067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:34.680886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:34.681526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:34.682220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:34.683769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:34.684192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:34.684706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:34.891596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:34.903978 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b9467c0-0eae-4b3b-bb94-743c067ea5fb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1563 microversion: 2.1 time: 0.252424 Oct 29 21:20:34.914700 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2997/6094] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:34 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:35.060223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:35.061190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:35.068440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:35.069792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:35.070485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:35.071603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:35.072412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:35.072960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:35.112287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:20:35.222390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c989c7f-2027-4d24-8d44-f969824f8791 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 204 len: 0 microversion: 2.1 time: 0.166587 Oct 29 21:20:35.223254 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3098/6095] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:20:35 2022] DELETE /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:20:35.234577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:35.235266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:35.242419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:35.243010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:35.243526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:35.245683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:35.246399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:35.247141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:35.471846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:35.487986 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ccb026e-8948-4099-b360-6acf868a3798 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1569 microversion: 2.1 time: 0.259627 Oct 29 21:20:35.489426 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2998/6096] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:35 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:36.105078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-584171e0-5458-486f-91fc-4198d952380d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: .version_select at 0x7fa171609f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1094118936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDNXr/W51z/qoans3FkpPC+aub1IGv8aWpwZ4klwhZH6QNBSYn3PAFcVc5V2Edl/xI0JU3zEfNGApq8xtew0q95naoPTP0ZnYmQrvfg0GdTSh8bRyty55ApR4vjVWIu0Q=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:36.119161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:36.137933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-584171e0-5458-486f-91fc-4198d952380d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:20:36.145850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-584171e0-5458-486f-91fc-4198d952380d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:20:36.218010 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-584171e0-5458-486f-91fc-4198d952380d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.469895 Oct 29 21:20:36.218960 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3099/6097] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:20:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:20:36.517212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:36.518820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:36.527104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:36.527634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:36.528119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:36.528844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:36.529306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:36.529765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:36.882697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:36.896141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-193a6ea9-2255-4cd4-8708-53950b731f01 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1569 microversion: 2.1 time: 0.384470 Oct 29 21:20:36.903383 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 2999/6098] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:36 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1569 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:37.931409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:37.932726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:37.978623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:37.979305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:37.979852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:37.981126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:37.987781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:37.991053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:38.118950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e70f10dc-7865-4812-9fea-cd418b4dbb71 req-71415e2b-ec46-487a-bf9e-d5bc8aa7b638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e259878-bfb9-46b1-af79-8efad38e0fd0", "name": "network-vif-deleted", "tag": "8bad2b52-bdfd-4e35-b361-6f807a748ddc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:38.146944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e70f10dc-7865-4812-9fea-cd418b4dbb71 req-71415e2b-ec46-487a-bf9e-d5bc8aa7b638 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:38.150306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e70f10dc-7865-4812-9fea-cd418b4dbb71 req-71415e2b-ec46-487a-bf9e-d5bc8aa7b638 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:38.150959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e70f10dc-7865-4812-9fea-cd418b4dbb71 req-71415e2b-ec46-487a-bf9e-d5bc8aa7b638 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:38.176013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:38.222105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6a89a3b3-ea51-472a-a3cf-f341e4838d71 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1527 microversion: 2.1 time: 0.290722 Oct 29 21:20:38.222770 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3100/6099] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:37 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1527 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:38.243700 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e70f10dc-7865-4812-9fea-cd418b4dbb71 req-71415e2b-ec46-487a-bf9e-d5bc8aa7b638 service nova] Creating event network-vif-deleted:8bad2b52-bdfd-4e35-b361-6f807a748ddc for instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 on nch1-master-1 Oct 29 21:20:38.261435 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e70f10dc-7865-4812-9fea-cd418b4dbb71 req-71415e2b-ec46-487a-bf9e-d5bc8aa7b638 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146967 Oct 29 21:20:38.266479 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3000/6100] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:20:39.254124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:39.254959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:39.278117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:39.280264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:39.282112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:39.285808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:39.289747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:39.292324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:39.403321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:39.404149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:39.404816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:39.405760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lazy-loading 'fault' on Instance uuid 2e259878-bfb9-46b1-af79-8efad38e0fd0 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:20:39.560950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:39.576159 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d526c777-c404-4fbe-8fee-397b9832bcfb tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 200 len: 1320 microversion: 2.1 time: 0.330647 Oct 29 21:20:39.579841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3101/6101] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:39 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:40.607224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:40.608050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:40.617605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:40.618465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:40.619518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:40.620709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:40.621760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:40.622403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:40.642141 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 HTTP/1.1 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2e259878-bfb9-46b1-af79-8efad38e0fd0'} Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:20:40.644014 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:20:40.647509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2b5222ef-3a3f-4680-8179-e04ee0dd1a17 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 404 len: 111 microversion: 2.1 time: 0.046443 Oct 29 21:20:40.653176 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3001/6102] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:40 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:20:46.996739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-787507040", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "c16c9b3c-a06b-4344-8726-cd46bb48c74d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1094118936", "security_groups": [{"name": "tempest-secgroup-smoke-1053813007"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:47.014770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:47.177706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] validate_networks() for [('c16c9b3c-a06b-4344-8726-cd46bb48c74d', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:20:48.471608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:20:48.472202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:20:48.473335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:20:48.474146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:20:48.475177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:20:48.488444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:48.489607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:48.490252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:48.491183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:48.491823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:48.492458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:48.513156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:20:48.520793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:20:48.540001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:20:48.542653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:20:48.617958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1e0ab46-f222-4757-99bb-55f8a1b20c83 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.629242 Oct 29 21:20:48.619581 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3102/6103] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:20:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:20:48.642504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9cfd048f-4e63-4553-9517-f11ef4ec78f4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:48.643248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9cfd048f-4e63-4553-9517-f11ef4ec78f4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:48.646726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:48.752733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9cfd048f-4e63-4553-9517-f11ef4ec78f4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:48.763812 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9cfd048f-4e63-4553-9517-f11ef4ec78f4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1266 microversion: 2.1 time: 0.136939 Oct 29 21:20:48.770099 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3002/6104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:48 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:49.795571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:49.797780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:49.810961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:49.811496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:49.812009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:49.812754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:49.813238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:49.815206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:49.819011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:49.943982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:49.962096 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08560245-6f19-49f3-9f1a-bf49986349ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1318 microversion: 2.1 time: 0.177429 Oct 29 21:20:49.970467 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3103/6105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:49 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:20:50.996163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:50.997035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:51.006658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=29 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:51.008253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:51.018469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:51.021409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:51.022396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:51.023050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:51.023507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:51.160409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:51.168768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7887ac59-9c6c-4f9a-a684-cfef7ced957e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1324 microversion: 2.1 time: 0.177376 Oct 29 21:20:51.175818 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3003/6106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:50 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:52.204374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:52.206601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:52.215074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:52.216812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:52.219309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:52.220109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:52.220641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:52.222157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:52.610181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:52.619840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae3865a3-7655-45cf-9ada-63dd3c3c48f6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.423268 Oct 29 21:20:52.620568 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3104/6107] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:52 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:53.541940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4aa5cacc-9b3e-424e-bab2-1f0a8eafa7e6 req-8a6832fb-d13b-42ea-a65a-eacdd17c31c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:20:53.569573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4aa5cacc-9b3e-424e-bab2-1f0a8eafa7e6 req-8a6832fb-d13b-42ea-a65a-eacdd17c31c6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:53.570328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4aa5cacc-9b3e-424e-bab2-1f0a8eafa7e6 req-8a6832fb-d13b-42ea-a65a-eacdd17c31c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:53.573374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4aa5cacc-9b3e-424e-bab2-1f0a8eafa7e6 req-8a6832fb-d13b-42ea-a65a-eacdd17c31c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:53.604919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4aa5cacc-9b3e-424e-bab2-1f0a8eafa7e6 req-8a6832fb-d13b-42ea-a65a-eacdd17c31c6 service nova] Creating event network-changed:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch1-master-1 Oct 29 21:20:53.620687 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4aa5cacc-9b3e-424e-bab2-1f0a8eafa7e6 req-8a6832fb-d13b-42ea-a65a-eacdd17c31c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082740 Oct 29 21:20:53.621377 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3004/6108] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:20:53.649658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:53.650910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:53.660596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:53.661200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:53.661653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:53.662690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:53.663231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:53.664049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:53.936929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:53.959622 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b60cafa-7396-40bc-a60b-1fa728ba80ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.314171 Oct 29 21:20:53.963817 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3105/6109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:53 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:54.987863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:54.988752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:54.996546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:54.997050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:54.997761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:54.998268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:54.998712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:55.005127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:55.269585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:55.279083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc828710-cad0-4927-8b57-b429c47de427 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.297161 Oct 29 21:20:55.279580 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3005/6110] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:54 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:56.304279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:56.305317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:56.314517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:56.315423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:56.316747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:56.317612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:56.318096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:56.318758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:56.572109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:56.583712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-03b6420a-d62d-4af3-8a15-5bfe4a360651 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.283930 Oct 29 21:20:56.594086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3106/6111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:56 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:57.609621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:57.611434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:57.620283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:57.620975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:57.621686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:57.622980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:57.623583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:57.624764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:57.893316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:57.901679 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-152d8a9d-73dc-4740-9ac2-d24fd1ea1cde tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.297133 Oct 29 21:20:57.902421 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3006/6112] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:57 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:20:58.928469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:20:58.929135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:20:58.936345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:58.938158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:20:58.947964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:58.949008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:58.949547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:58.950592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:20:58.951194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:20:58.952004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:20:59.270497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:20:59.282259 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e716ddf2-cea3-4481-a6d4-2aa3c2eb1daa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.356494 Oct 29 21:20:59.283416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3107/6113] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:20:58 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:00.310267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:00.312319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:00.318444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:00.323282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:00.323779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:00.324412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:00.325587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:00.326220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:00.326741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:00.510385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:00.522598 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea733ad9-edb0-475e-a049-7ec6a57f533d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.218661 Oct 29 21:21:00.523451 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3007/6114] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:00 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:01.452879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5aee2d90-f8b7-4497-9e2d-b419c4399265 req-8faf8af1-cde2-4935-819b-e1583a6dc072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "name": "network-vif-plugged", "status": "completed", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:01.469057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5aee2d90-f8b7-4497-9e2d-b419c4399265 req-8faf8af1-cde2-4935-819b-e1583a6dc072 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:01.477002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5aee2d90-f8b7-4497-9e2d-b419c4399265 req-8faf8af1-cde2-4935-819b-e1583a6dc072 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:01.480071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5aee2d90-f8b7-4497-9e2d-b419c4399265 req-8faf8af1-cde2-4935-819b-e1583a6dc072 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:01.504798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5aee2d90-f8b7-4497-9e2d-b419c4399265 req-8faf8af1-cde2-4935-819b-e1583a6dc072 service nova] Creating event network-vif-plugged:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch1-master-1 Oct 29 21:21:01.516008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5aee2d90-f8b7-4497-9e2d-b419c4399265 req-8faf8af1-cde2-4935-819b-e1583a6dc072 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068753 Oct 29 21:21:01.529811 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3108/6115] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:21:01.545809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:01.546471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:01.553348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:01.562564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:01.564643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:01.565684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:01.566205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:01.566654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:01.840941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:01.863386 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-912ab523-e9d0-41c7-9c75-76af1fbffe01 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.321450 Oct 29 21:21:01.865076 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3008/6116] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:01 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:02.890837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:02.891778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:02.901324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:02.902109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:02.902842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:02.903809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:02.904495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:02.905950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:03.125557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:03.135851 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e52da14-2d35-4a20-a263-4cde0bc5f9b3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1392 microversion: 2.1 time: 0.250256 Oct 29 21:21:03.136622 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3109/6117] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:02 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:03.675972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:03.677142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:03.684980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:03.685733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:03.686542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:03.688044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:03.688723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:03.689311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:03.719579 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef74f632-2394-40a3-9d79-187a883292e7 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.048741 Oct 29 21:21:03.720195 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3009/6118] 10.222.0.36 () {58 vars in 1293 bytes} [Sat Oct 29 21:21:03 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774/os-server-password => generated 116 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:04.160410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:04.161046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:04.170131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:04.174346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:04.174873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:04.175639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:04.176122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:04.176575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:04.431816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:04.451441 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e53ce427-4428-4504-8a31-1f9851994bf5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1564 microversion: 2.1 time: 0.295170 Oct 29 21:21:04.470917 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3110/6119] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:04 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1564 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:04.478929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:04.479797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:04.489946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:04.492669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:04.493331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:04.494481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:04.495140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:04.495725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:04.734538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:04.750766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9e16b5dc-6814-44ad-abea-4520d65a8c1b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1564 microversion: 2.1 time: 0.275664 Oct 29 21:21:04.751760 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3010/6120] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:04 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1564 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:07.612796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:07.613445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:07.616553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:07.618074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-67280527-5116-4858-a665-3ba7193eee09 req-7e73db96-ddbc-4f9f-8f7b-e784ff570832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:07.635834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-67280527-5116-4858-a665-3ba7193eee09 req-7e73db96-ddbc-4f9f-8f7b-e784ff570832 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:07.636322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:07.636450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-67280527-5116-4858-a665-3ba7193eee09 req-7e73db96-ddbc-4f9f-8f7b-e784ff570832 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:07.636845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:07.636969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-67280527-5116-4858-a665-3ba7193eee09 req-7e73db96-ddbc-4f9f-8f7b-e784ff570832 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:07.637312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:07.640715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:07.641262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:07.642011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:07.656697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-67280527-5116-4858-a665-3ba7193eee09 req-7e73db96-ddbc-4f9f-8f7b-e784ff570832 service nova] Creating event network-changed:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch1-master-1 Oct 29 21:21:07.662521 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-67280527-5116-4858-a665-3ba7193eee09 req-7e73db96-ddbc-4f9f-8f7b-e784ff570832 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048626 Oct 29 21:21:07.663743 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3011/6121] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:21:07.847710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:07.856987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e9787de-4ac5-4bdb-a3a2-6147f5a99a12 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1564 microversion: 2.1 time: 0.249554 Oct 29 21:21:07.877498 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3111/6122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:07 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:11.138031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:11.139147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:11.148381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:11.148824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:11.149548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:11.150430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:11.151165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:11.151879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:11.184878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:21:11.395457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a684d691-1b97-4cd6-bcfa-9508e82f012b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 204 len: 0 microversion: 2.1 time: 0.262434 Oct 29 21:21:11.399990 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3012/6123] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:21:11 2022] DELETE /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:21:11.407122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:11.407931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:11.425893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:11.426625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:11.427316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:11.434038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:11.435080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:11.435760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:11.770524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:11.779256 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67f01df9-f420-4dcb-8a86-116f972b8f1b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1410 microversion: 2.1 time: 0.377538 Oct 29 21:21:11.780364 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3112/6124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:11 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1410 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:21:12.805598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:12.807006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:12.824511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:12.829817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:12.830463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:12.832978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:12.834268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:12.837140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:13.275892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:13.284677 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c697147-00bc-4f6d-9fad-f71094766223 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1410 microversion: 2.1 time: 0.483902 Oct 29 21:21:13.285285 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3013/6125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:12 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1410 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:13.679408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2be71440-c6fe-4464-8bfc-125665888776 req-c9921106-94ef-4c7b-8cb0-b51f22fdda10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9125f678-3943-4ce1-90fe-9891851b597d", "name": "network-vif-deleted", "tag": "87da02d9-a50a-4b4a-afea-ad24be80bcc7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:13.695451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2be71440-c6fe-4464-8bfc-125665888776 req-c9921106-94ef-4c7b-8cb0-b51f22fdda10 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:13.696414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2be71440-c6fe-4464-8bfc-125665888776 req-c9921106-94ef-4c7b-8cb0-b51f22fdda10 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:13.697980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2be71440-c6fe-4464-8bfc-125665888776 req-c9921106-94ef-4c7b-8cb0-b51f22fdda10 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:13.715366 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2be71440-c6fe-4464-8bfc-125665888776 req-c9921106-94ef-4c7b-8cb0-b51f22fdda10 service nova] Creating event network-vif-deleted:87da02d9-a50a-4b4a-afea-ad24be80bcc7 for instance 9125f678-3943-4ce1-90fe-9891851b597d on nch2-master-1 Oct 29 21:21:13.722384 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2be71440-c6fe-4464-8bfc-125665888776 req-c9921106-94ef-4c7b-8cb0-b51f22fdda10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049442 Oct 29 21:21:13.722978 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3113/6126] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:14.308432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:14.309146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:14.318741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:14.319247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:14.320096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:14.321136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:14.321902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:14.322641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:14.365260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:14.365851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:14.366307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:14.366775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lazy-loading 'fault' on Instance uuid 9125f678-3943-4ce1-90fe-9891851b597d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:21:14.557922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:14.567507 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aac1871c-0a47-4aae-be6f-ff41b24df9ad tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 200 len: 1373 microversion: 2.1 time: 0.263492 Oct 29 21:21:14.568378 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3014/6127] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:14 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 1373 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:15.594493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:15.595353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:15.606741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:15.607400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:15.608573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:15.609557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:15.610204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:15.610956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:15.628616 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d HTTP/1.1 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9125f678-3943-4ce1-90fe-9891851b597d'} Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:15.631125 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-350f8e4f-2fe5-4cc0-9803-f3daa3c0c6c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 404 len: 111 microversion: 2.1 time: 0.043951 Oct 29 21:21:15.635619 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3114/6128] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:15 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:21:15.673749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:15.674770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:15.682998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:15.683648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:15.684239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:15.685908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:15.687221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:15.687805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:15.715343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 HTTP/1.1 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '2e259878-bfb9-46b1-af79-8efad38e0fd0'} Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:21:15.718103 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.723611 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.725332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:21:15.726479 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fec30251-e4a0-4c76-9086-d02c271dcfe2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 404 len: 111 microversion: 2.1 time: 0.057721 Oct 29 21:21:15.727520 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3015/6129] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:21:15 2022] DELETE /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:21:15.736443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:15.738223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 2e259878-bfb9-46b1-af79-8efad38e0fd0] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:15.745276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:15.746051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:15.746777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:15.748008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:15.748646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:15.749320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:15.768584 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 HTTP/1.1 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2e259878-bfb9-46b1-af79-8efad38e0fd0'} Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:15.771144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 2e259878-bfb9-46b1-af79-8efad38e0fd0 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bb2d16e9-78f4-456c-ab32-47f8e8785a3b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0" status: 404 len: 111 microversion: 2.1 time: 0.042333 Oct 29 21:21:15.778795 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3115/6130] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:15 2022] GET /compute/v2.1/servers/2e259878-bfb9-46b1-af79-8efad38e0fd0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:21:16.439961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:16.440482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:16.446991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:16.447689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:16.448278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:16.449143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:16.449837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:16.450267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:16.470777 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d HTTP/1.1 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '9125f678-3943-4ce1-90fe-9891851b597d'} Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:21:16.472369 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0c1c69e-992d-4368-a215-22e444954149 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 404 len: 111 microversion: 2.1 time: 0.037783 Oct 29 21:21:16.479939 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3016/6131] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:21:16 2022] DELETE /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:21:16.484308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:16.484979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 9125f678-3943-4ce1-90fe-9891851b597d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:16.491935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:16.492613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:16.492927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:16.493924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:16.494519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:16.495068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:16.511049 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d HTTP/1.1 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9125f678-3943-4ce1-90fe-9891851b597d'} Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:21:16.512671 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 9125f678-3943-4ce1-90fe-9891851b597d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f669a35f-f388-4fdc-9fb4-61d72c324a32 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d" status: 404 len: 111 microversion: 2.1 time: 0.035409 Oct 29 21:21:16.519960 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3116/6132] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:16 2022] GET /compute/v2.1/servers/9125f678-3943-4ce1-90fe-9891851b597d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:21:16.601016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c87a82c3-501c-48cd-81c5-d87730376cbd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: .version_select at 0x7fa170993e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1426309693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbtJXa54H04z5tuukNAqRDCbd4ftr1OuaSaX7l4V102Z6aivLLaCLcHF2HFoPbdicjsKQ/1qft+gc1y9KEJ8URh/kxyctY9D3vFakhxTLy8dArA70PY5uejUa5gUO8aNw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:16.620325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c87a82c3-501c-48cd-81c5-d87730376cbd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:21:16.626515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c87a82c3-501c-48cd-81c5-d87730376cbd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:21:16.659026 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c87a82c3-501c-48cd-81c5-d87730376cbd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.062383 Oct 29 21:21:16.660135 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3017/6133] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:21:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:21.047182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-867724289", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1426309693", "security_groups": [{"name": "tempest-secgroup-smoke-1319913458"}], "block_device_mapping_v2": [{"uuid": "1dd52dee-26a8-4479-b52c-88863fc657c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61be7916-1aaf-44e0-b8b4-9d255eece552"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:21.245207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] validate_networks() for [('61be7916-1aaf-44e0-b8b4-9d255eece552', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:21:21.978952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:21:21.979846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:21:21.980704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:21:21.981308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:21:21.981964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:21:22.009730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:22.010905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:22.011856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:22.015827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:22.016735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:22.017624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:22.039202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=64 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:22.068950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:21:22.085707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:21:22.194020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:21:22.196800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dd52dee-26a8-4479-b52c-88863fc657c0',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:21:22.371321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.330343 Oct 29 21:21:22.373621 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3117/6134] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:21:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:21:22.391016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e8c40ed-2e9d-44b8-a039-eafcb4ce2ef8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:22.392322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e8c40ed-2e9d-44b8-a039-eafcb4ce2ef8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:22.394437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:22.593569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7e8c40ed-2e9d-44b8-a039-eafcb4ce2ef8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:22.614372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e8c40ed-2e9d-44b8-a039-eafcb4ce2ef8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1094 microversion: 2.1 time: 0.229055 Oct 29 21:21:22.615975 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3018/6135] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:22 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1094 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:23.638772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:23.640073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:23.647032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:23.647662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:23.648192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:23.649170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:23.649891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:23.650427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:23.737780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:23.746873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-17aed6a5-29e7-4a2b-aa8b-d4243b45884b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1192 microversion: 2.1 time: 0.113156 Oct 29 21:21:23.759781 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3118/6136] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:23 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:24.774867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:24.778084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:24.796289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:24.797219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:24.797903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:24.798868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:24.799559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:24.800166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:24.842381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:24.922419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:24.938715 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f932943-3b5b-4414-9ccd-edfc203a1737 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1210 microversion: 2.1 time: 0.170892 Oct 29 21:21:24.942301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3019/6137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:24 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1210 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:25.971092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:25.971707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:25.986746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:25.987693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:25.988415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:25.989334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:25.990197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:25.991003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:26.303093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:26.315960 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a80134f-3e9c-4bfa-b626-69cca0ef52b2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1266 microversion: 2.1 time: 0.352376 Oct 29 21:21:26.319371 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3119/6138] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:25 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:26.424459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-712b27c9-af95-44ce-b42a-eeb692449cde req-0f37d432-2d3f-4278-b4a0-6d43bb47863d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470a094a-d503-4055-819c-306c001ab9fb", "tag": "f3490ebf-87b1-4ac9-92b0-579c0ea8cccb"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:26.462038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-712b27c9-af95-44ce-b42a-eeb692449cde req-0f37d432-2d3f-4278-b4a0-6d43bb47863d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:26.462693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-712b27c9-af95-44ce-b42a-eeb692449cde req-0f37d432-2d3f-4278-b4a0-6d43bb47863d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:26.462863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-712b27c9-af95-44ce-b42a-eeb692449cde req-0f37d432-2d3f-4278-b4a0-6d43bb47863d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:26.506209 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-712b27c9-af95-44ce-b42a-eeb692449cde req-0f37d432-2d3f-4278-b4a0-6d43bb47863d service nova] Creating event network-changed:f3490ebf-87b1-4ac9-92b0-579c0ea8cccb for instance 470a094a-d503-4055-819c-306c001ab9fb on nch2-master-1 Oct 29 21:21:26.513146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-712b27c9-af95-44ce-b42a-eeb692449cde req-0f37d432-2d3f-4278-b4a0-6d43bb47863d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092780 Oct 29 21:21:26.522781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3020/6139] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:27.346066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:27.346621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:27.353898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:27.354598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:27.355063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:27.355782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:27.356259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:27.356711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:27.592092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:27.604096 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3e58a6fd-86f9-4982-9102-4922282cd022 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1266 microversion: 2.1 time: 0.262493 Oct 29 21:21:27.606278 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3120/6140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:27 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:28.632316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:28.633683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:28.644500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:28.645230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:28.645989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:28.647187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:28.648344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:28.649006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:28.926362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:28.950001 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-134fc0fe-dddd-47be-9349-57ad10caa60b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1266 microversion: 2.1 time: 0.320639 Oct 29 21:21:28.951830 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3021/6141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:28 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:29.976516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:29.977152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:29.984871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:29.985604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:29.986208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:29.987854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:29.988340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:29.988797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:30.222027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:30.230669 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdebd1bc-0c09-46df-9de0-d53ae223d289 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1266 microversion: 2.1 time: 0.258196 Oct 29 21:21:30.231547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3121/6142] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:29 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:30.710623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-645003fb-cbf0-46be-9021-a17df15616e8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Action: 'create', calling method: .version_select at 0x7fa170c385e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1655609183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMwiPqm7C3VQQeM/OveuZq9KwYs5wq6L6cX31qxblgzbbigLWb886wxcNEErwEjlYsBuum5GWqPZp1QjiGvUn2HExxLkWCk4BeQBKwuoIYJtWR5uaWAC0duRdKPxiaESg=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:30.729625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-645003fb-cbf0-46be-9021-a17df15616e8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Getting quotas for project 1e4a4ea4687f4465b38bbb82f52d85e9. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:21:30.736369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-645003fb-cbf0-46be-9021-a17df15616e8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Getting quotas for user 8d0e9b3a14994f9a8ce549fc59ba71df and project 1e4a4ea4687f4465b38bbb82f52d85e9. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:21:30.764920 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-645003fb-cbf0-46be-9021-a17df15616e8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.301277 Oct 29 21:21:30.765571 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3022/6143] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:21:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:31.260401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:31.261094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:31.271187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:31.271710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:31.272377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:31.273118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:31.273649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:31.274104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:31.494429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:31.504125 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef04664f-1c12-4099-b652-7f8eff1be91b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1266 microversion: 2.1 time: 0.249196 Oct 29 21:21:31.512107 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3122/6144] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:31 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:32.225482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7a613f76-2b19-44c7-821c-3e0b9429216e req-4b86d5cf-2f8f-4c75-aa8d-84b71d2fba95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470a094a-d503-4055-819c-306c001ab9fb", "name": "network-vif-plugged", "status": "completed", "tag": "f3490ebf-87b1-4ac9-92b0-579c0ea8cccb"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:32.242096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7a613f76-2b19-44c7-821c-3e0b9429216e req-4b86d5cf-2f8f-4c75-aa8d-84b71d2fba95 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:32.243190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7a613f76-2b19-44c7-821c-3e0b9429216e req-4b86d5cf-2f8f-4c75-aa8d-84b71d2fba95 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:32.243860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7a613f76-2b19-44c7-821c-3e0b9429216e req-4b86d5cf-2f8f-4c75-aa8d-84b71d2fba95 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:32.256786 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7a613f76-2b19-44c7-821c-3e0b9429216e req-4b86d5cf-2f8f-4c75-aa8d-84b71d2fba95 service nova] Creating event network-vif-plugged:f3490ebf-87b1-4ac9-92b0-579c0ea8cccb for instance 470a094a-d503-4055-819c-306c001ab9fb on nch2-master-1 Oct 29 21:21:32.262636 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7a613f76-2b19-44c7-821c-3e0b9429216e req-4b86d5cf-2f8f-4c75-aa8d-84b71d2fba95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067817 Oct 29 21:21:32.263757 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3023/6145] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:21:32.526995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:32.527665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:32.530092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:32.530789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:32.537083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:32.537588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:32.538050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:32.538779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:32.539251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:32.539703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:32.682314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:32.691236 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72079043-1015-4dd4-99d8-485c85a02c35 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1266 microversion: 2.1 time: 0.168226 Oct 29 21:21:32.691839 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3123/6146] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:32 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:33.716203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:33.717574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:33.737893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:33.738448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:33.738907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:33.739636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:33.742138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:33.742604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:33.924602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:33.934148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0fe6c0c6-d962-47a4-a6d5-3d1e69c9e81c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1453 microversion: 2.1 time: 0.222658 Oct 29 21:21:33.946412 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3024/6147] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:33 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1453 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:33.959891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:33.960434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:33.968702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:33.969434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:33.970111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:33.970993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:33.975340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:33.976112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:34.143253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:34.155098 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c0f1eb50-028f-4681-92f8-6131ea9b17dc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1453 microversion: 2.1 time: 0.198664 Oct 29 21:21:34.155713 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3124/6148] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:33 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:38.136939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7cfbe21c-38b0-4dd1-83e9-7920073e0b0a req-bc19e7fc-7140-4b8f-9c32-461cb68b4b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470a094a-d503-4055-819c-306c001ab9fb", "tag": "f3490ebf-87b1-4ac9-92b0-579c0ea8cccb"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:38.161006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7cfbe21c-38b0-4dd1-83e9-7920073e0b0a req-bc19e7fc-7140-4b8f-9c32-461cb68b4b77 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:38.161770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7cfbe21c-38b0-4dd1-83e9-7920073e0b0a req-bc19e7fc-7140-4b8f-9c32-461cb68b4b77 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:38.162397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7cfbe21c-38b0-4dd1-83e9-7920073e0b0a req-bc19e7fc-7140-4b8f-9c32-461cb68b4b77 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:38.179615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7cfbe21c-38b0-4dd1-83e9-7920073e0b0a req-bc19e7fc-7140-4b8f-9c32-461cb68b4b77 service nova] Creating event network-changed:f3490ebf-87b1-4ac9-92b0-579c0ea8cccb for instance 470a094a-d503-4055-819c-306c001ab9fb on nch2-master-1 Oct 29 21:21:38.188704 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7cfbe21c-38b0-4dd1-83e9-7920073e0b0a req-bc19e7fc-7140-4b8f-9c32-461cb68b4b77 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055657 Oct 29 21:21:38.190861 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3025/6149] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:38.264487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1134826655-access_point-1335788374", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "0406f24b-0305-4f2d-a615-7b494f95b161"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1655609183", "security_groups": [{"name": "tempest-secgroup_access--1244772439"}, {"name": "tempest-secgroup_general--915711650"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:38.305773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:38.696239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] validate_networks() for [('0406f24b-0305-4f2d-a615-7b494f95b161', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:21:40.150207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:21:40.150849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:21:40.151148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:21:40.151765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:21:40.152368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:21:40.174143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:40.174694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:40.175178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:40.176001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:40.176660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:40.178581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:40.226174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Getting quotas for project 1e4a4ea4687f4465b38bbb82f52d85e9. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:21:40.234552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Getting quotas for user 8d0e9b3a14994f9a8ce549fc59ba71df and project 1e4a4ea4687f4465b38bbb82f52d85e9. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:21:40.250164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:21:40.252662 ncdv-master-1 devstack@n-api.service[138885]: WARNING nova.utils [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1134826655-access_point-1335788374 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1134826655-ac Oct 29 21:21:40.253492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:21:40.313361 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5b256ed-282e-41f4-ba53-51ed92f236e2 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.053543 Oct 29 21:21:40.314740 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3125/6150] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:21:38 2022] POST /compute/v2.1/servers => generated 457 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:21:40.329670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d3df83b-d2d2-4e53-bb52-a618414b5b69 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:40.330496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d3df83b-d2d2-4e53-bb52-a618414b5b69 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:40.399883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:40.402625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:40.413991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:40.414512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:40.414979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:40.419536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:40.420317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:40.421053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:40.464073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d3df83b-d2d2-4e53-bb52-a618414b5b69 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:40.473055 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d3df83b-d2d2-4e53-bb52-a618414b5b69 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1295 microversion: 2.1 time: 0.150362 Oct 29 21:21:40.475573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3026/6151] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:40 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1295 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:40.537689 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a6e834f0-3760-45c9-ad10-8d9fd407a899 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action" status: 200 len: 24571 microversion: 2.1 time: 0.141191 Oct 29 21:21:40.550270 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3126/6152] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:21:40 2022] POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action => generated 24571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:21:41.500255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:41.501478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:41.514567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:41.515218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:41.522909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:41.523860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:41.525576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:41.526711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:41.617974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:41.628992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ccc1bbf-32c3-47d4-8244-ad8d8e484c1e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1347 microversion: 2.1 time: 0.133453 Oct 29 21:21:41.641666 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3027/6153] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:41 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1347 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:42.656622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:42.658237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:42.673388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:42.675227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:42.676049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:42.677689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:42.679604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:42.681676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:42.783541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:42.792322 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-48b171fe-ddf3-4205-a6c0-f00b7fe02ff8 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1353 microversion: 2.1 time: 0.143248 Oct 29 21:21:42.792918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3127/6154] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:42 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:43.816452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:43.817090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:43.835988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:43.836557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:43.841736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:43.843359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:43.844054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:43.844756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:44.298377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:44.313492 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ff2dcf4-e746-4985-84de-2ab4b5934318 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.500938 Oct 29 21:21:44.314467 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3028/6155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:43 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:44.647051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-023946d6-3e3f-4959-b060-9fdc3ddfcafe req-baecf479-db9b-4942-b8ac-3e6093d0977c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b9c598-f753-4290-a7a5-3e8ce7ab156b", "tag": "f9a81890-35c7-4f09-921e-7d68ea19cb26"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:44.671689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-023946d6-3e3f-4959-b060-9fdc3ddfcafe req-baecf479-db9b-4942-b8ac-3e6093d0977c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:44.675787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-023946d6-3e3f-4959-b060-9fdc3ddfcafe req-baecf479-db9b-4942-b8ac-3e6093d0977c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:44.676531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-023946d6-3e3f-4959-b060-9fdc3ddfcafe req-baecf479-db9b-4942-b8ac-3e6093d0977c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:44.697757 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-023946d6-3e3f-4959-b060-9fdc3ddfcafe req-baecf479-db9b-4942-b8ac-3e6093d0977c service nova] Creating event network-changed:f9a81890-35c7-4f09-921e-7d68ea19cb26 for instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b on nch1-master-1 Oct 29 21:21:44.714216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-023946d6-3e3f-4959-b060-9fdc3ddfcafe req-baecf479-db9b-4942-b8ac-3e6093d0977c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070727 Oct 29 21:21:44.718554 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3128/6156] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:45.342109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:45.343353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:45.356986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:45.358187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:45.362566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:45.371598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:45.372576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:45.373842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:45.782736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:45.794564 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90979027-fbca-4a2f-9ebc-a9ef042e0961 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.457868 Oct 29 21:21:45.796722 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3029/6157] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:45 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:46.821999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:46.822548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:46.831750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:46.832273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:46.833730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:46.833847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:46.834345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:46.836014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:47.124165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:47.145784 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15e7e215-5e62-4b29-888f-4854501266d9 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.322738 Oct 29 21:21:47.146423 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3129/6158] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:46 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:21:48.169692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:48.170620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:48.177951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:48.178664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:48.179211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:48.180232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:48.180745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:48.181198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:48.363542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:48.372595 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89e6c704-e80b-4911-aea9-2a01b7f5be0a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.207779 Oct 29 21:21:48.374001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3030/6159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:48 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:49.396618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:49.398276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:49.406529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:49.407264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:49.411713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:49.412788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:49.413713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:49.414494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:49.595949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:49.605193 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c90ff47c-6e42-4f7e-9ccc-6c6c9ae4cd88 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.212743 Oct 29 21:21:49.616847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3130/6160] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:49 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:50.628565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:50.629122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:50.632066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:50.638023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:50.639043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:50.639659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:50.640442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:50.640989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:50.641351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:50.800662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:50.814003 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d2c5b16-ca9a-4622-ad5d-5827e68fdfc4 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.188566 Oct 29 21:21:50.815025 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3031/6161] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:50 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:51.799008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c437a1ef-9004-46a7-b661-578e1da5b68f req-6600e3bd-1d92-443d-9e53-3a1851f3a378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b9c598-f753-4290-a7a5-3e8ce7ab156b", "name": "network-vif-plugged", "status": "completed", "tag": "f9a81890-35c7-4f09-921e-7d68ea19cb26"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:51.809122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:51.810011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:51.817716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c437a1ef-9004-46a7-b661-578e1da5b68f req-6600e3bd-1d92-443d-9e53-3a1851f3a378 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:51.820351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c437a1ef-9004-46a7-b661-578e1da5b68f req-6600e3bd-1d92-443d-9e53-3a1851f3a378 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:51.822517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c437a1ef-9004-46a7-b661-578e1da5b68f req-6600e3bd-1d92-443d-9e53-3a1851f3a378 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:51.838321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:51.839307 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c437a1ef-9004-46a7-b661-578e1da5b68f req-6600e3bd-1d92-443d-9e53-3a1851f3a378 service nova] Creating event network-vif-plugged:f9a81890-35c7-4f09-921e-7d68ea19cb26 for instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b on nch1-master-1 Oct 29 21:21:51.839454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:51.853569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:51.856827 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c437a1ef-9004-46a7-b661-578e1da5b68f req-6600e3bd-1d92-443d-9e53-3a1851f3a378 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062182 Oct 29 21:21:51.858359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:51.858475 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3131/6162] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:21:51.858812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:51.859776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:51.860238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:51.860675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:52.033568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:52.042014 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5109f600-0c27-4bd1-bd1e-8e0d21829a19 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.208050 Oct 29 21:21:52.042658 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3032/6163] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:51 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:53.067760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:53.068508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:53.076546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:53.077315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:53.078152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:53.079112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:53.079758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:53.080220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:53.083552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=72 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:53.265414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:53.273972 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c75eab32-13a2-4bc3-9b01-c7d33dd02063 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1472 microversion: 2.1 time: 0.211595 Oct 29 21:21:53.274561 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3132/6164] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:53 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:54.296970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:54.298138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:54.301025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:54.307964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:54.308710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:54.309524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:54.310974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:54.311577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:54.312299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:54.593816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:54.601893 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cdbb6cd-b5ee-4d6a-8064-4c71eac9609e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1645 microversion: 2.1 time: 0.309047 Oct 29 21:21:54.602488 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3033/6165] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:54 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1645 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:54.626477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:54.627740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:54.635168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:54.635898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:54.636505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:54.645242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:54.646056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:54.648084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:54.829989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:21:54.837920 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1c5d2e4-78a2-459e-9043-926b577446a0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1645 microversion: 2.1 time: 0.216487 Oct 29 21:21:54.838497 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3133/6166] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:54 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1645 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:54.861643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:21:54.862273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:21:54.870432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:54.871009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:54.871527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:54.872343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:54.873014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:54.873488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:55.137345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=68 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:21:55.448625 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cdec4c8b-c5cb-46ae-919c-c0a1e9fddd0b tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1796 microversion: 2.1 time: 0.591986 Oct 29 21:21:55.449212 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3034/6167] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:21:54 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1796 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:21:57.559685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-f6745cd2-9d54-4ef0-9209-6edc0d204bf9 req-a35fb247-ffae-4230-8a53-e9813415cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b9c598-f753-4290-a7a5-3e8ce7ab156b", "tag": "f9a81890-35c7-4f09-921e-7d68ea19cb26"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:21:57.570843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6745cd2-9d54-4ef0-9209-6edc0d204bf9 req-a35fb247-ffae-4230-8a53-e9813415cc05 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:21:57.571683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6745cd2-9d54-4ef0-9209-6edc0d204bf9 req-a35fb247-ffae-4230-8a53-e9813415cc05 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:21:57.572199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-f6745cd2-9d54-4ef0-9209-6edc0d204bf9 req-a35fb247-ffae-4230-8a53-e9813415cc05 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:21:57.585266 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-f6745cd2-9d54-4ef0-9209-6edc0d204bf9 req-a35fb247-ffae-4230-8a53-e9813415cc05 service nova] Creating event network-changed:f9a81890-35c7-4f09-921e-7d68ea19cb26 for instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b on nch1-master-1 Oct 29 21:21:57.591092 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-f6745cd2-9d54-4ef0-9209-6edc0d204bf9 req-a35fb247-ffae-4230-8a53-e9813415cc05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035848 Oct 29 21:21:57.592667 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3134/6168] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:22:19.511658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:19.512241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:19.515026 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 29 21:22:19.515925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:22:19.516591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:22:19.524708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:19.525270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:19.525777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:19.526487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:19.526957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:19.527401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:19.955106 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c8e2da2-720c-4fd0-9560-1539404292c4 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1833 microversion: 2.1 time: 0.447965 Oct 29 21:22:19.955753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3035/6169] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:19 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1833 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:19.979557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:22:19.980523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=13 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:22:19.984937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:19.986007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:19.994137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:19.994652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:19.995326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:19.996074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:19.996560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:19.997019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.198003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:20.206616 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a99967e2-912b-458f-9a3d-8f7691882341 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1682 microversion: 2.1 time: 0.229728 Oct 29 21:22:20.207202 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3135/6170] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:19 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:20.302060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:22:20.305351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:20.311570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:20.312066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:20.312529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.313218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:20.313761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:20.314233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.389615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3937e1b6-6535-4f5d-bae8-979203640118 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action" status: 200 len: 32644 microversion: 2.1 time: 0.091391 Oct 29 21:22:20.390242 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3036/6171] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:22:20 2022] POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action => generated 32644 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:22:20.523396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:22:20.523992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:20.530330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:20.530830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:20.531282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.531985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:20.532493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:20.532939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.572250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '80fc6ee8bddd477aba6d56a6aea98c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4810c8879d4a55994e5d0635cc102b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:20.572876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] flavor_id is None. Assuming migration. {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 21:22:20.573335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:22:20.688910 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-523da5ad-f118-4ce9-9190-55bf25943283 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action" status: 202 len: 0 microversion: 2.1 time: 0.170083 Oct 29 21:22:20.689546 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3136/6172] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:22:20 2022] POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:22:20.698583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:20.699453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:20.707558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:20.708136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:20.708593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.709315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:20.710322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:20.711008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:20.883222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:20.891301 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6ca812ff-5332-42e2-9ee7-2a9f191bdd69 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1691 microversion: 2.1 time: 0.196952 Oct 29 21:22:20.892171 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3037/6173] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:20 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:21.917750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:21.919227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:21.928094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:21.929648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:21.930616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:21.931800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:21.932511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:21.933163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:22.150340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:22.160512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9673a156-8174-4bfd-8b81-595fe585d5d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1691 microversion: 2.1 time: 0.247259 Oct 29 21:22:22.161110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3137/6174] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:21 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:23.187287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:23.188629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:23.198884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:23.199690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:23.200123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:23.200975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:23.201584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:23.202027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:23.358749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:23.367662 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-59a94207-583d-4d6e-8c51-ff05db207148 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1691 microversion: 2.1 time: 0.185017 Oct 29 21:22:23.368242 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3038/6175] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:23 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:24.395893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:24.396599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:24.404916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:24.405486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:24.405962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:24.406716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:24.407199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:24.407657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:24.539800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:24.547783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef059c79-4f36-4b1a-8799-9013e413041d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.156497 Oct 29 21:22:24.548361 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3138/6176] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:24 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:25.572116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:25.572741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:25.579637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:25.580128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:25.580586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:25.581308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:25.581797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:25.582237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:25.718083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:25.726569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35b5afaf-afef-46b7-bea5-6f47918fc3b6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.158412 Oct 29 21:22:25.727138 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3039/6177] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:25 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:26.751652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:26.753662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:26.762256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:26.763140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:26.763632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:26.764604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:26.765276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:26.765985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:26.917778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:26.926656 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b993867-03b2-418d-a19d-4928545149cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.180396 Oct 29 21:22:26.927232 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3139/6178] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:26 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:27.951626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:27.952282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:27.959502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:27.960050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:27.960733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:27.961423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:27.961906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:27.962345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:28.100899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:28.110399 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2147430-4ea8-4e3b-9588-b2676c838153 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.162726 Oct 29 21:22:28.110978 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3040/6179] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:27 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:29.135072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:29.135703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:29.142953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:29.143460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:29.143914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:29.144634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:29.145103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:29.145573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:29.295354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:29.306447 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a89ee715-805e-4ef7-a759-b300362f3149 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.175324 Oct 29 21:22:29.306918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3140/6180] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:29 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:30.330926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:30.331554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:30.339310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:30.339818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:30.340249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:30.340979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:30.341562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:30.341988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:30.491109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:30.500024 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-80cb68fe-7850-40b1-9cf9-e727b5c2eadf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.173091 Oct 29 21:22:30.500829 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3041/6181] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:30 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:31.524012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:31.524684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:31.532026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:31.532715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:31.533397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:31.534241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:31.534879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:31.535374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:31.681040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:31.689630 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b43062d-fca5-4ea5-9835-e6766001ba56 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.169499 Oct 29 21:22:31.690336 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3141/6182] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:31 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:32.713183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:32.713833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:32.721752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:32.722534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:32.723132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:32.724120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:32.724685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:32.726037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:32.863964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:32.872561 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d630a4b7-1aed-4a8a-a706-0f7d8373651f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.163185 Oct 29 21:22:32.873117 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3042/6183] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:32 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:33.896924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:33.897738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:33.904494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:33.904995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:33.905464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:33.906194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:33.906694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:33.907137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:34.050218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:34.059718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b2215e6-23e0-42cf-a74f-15c22e5ac6c7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.167287 Oct 29 21:22:34.060466 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3142/6184] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:33 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:35.084264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:35.085612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:35.093413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:35.094051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:35.094731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:35.095524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:35.096093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:35.096602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:35.249845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:35.258248 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8561fe24-7ec9-4d1a-97ba-2c33e630e4c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1696 microversion: 2.1 time: 0.177865 Oct 29 21:22:35.259470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3043/6185] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:35 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:36.283410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:36.284036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:36.291844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:36.292354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:36.292865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:36.293636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:36.294110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:36.294557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:36.663029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:36.670929 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-acc4e7b5-0b07-41f4-a8e3-80276497bc22 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1695 microversion: 2.1 time: 0.391562 Oct 29 21:22:36.671526 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3143/6186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:36 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1695 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:36.688986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "name": "network-vif-unplugged", "status": "completed", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:22:36.699673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:36.700372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:36.700980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:36.714239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] Creating event network-vif-unplugged:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch2-master-1 Oct 29 21:22:36.719620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] Instance ea4b3354-2d08-4827-808c-bd72f804e590 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:22:36.731489 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d95e9888-5ab3-4e11-9bba-136632b6bb77 req-830d74fb-8f4e-4f24-9ce4-2c5e1f4614f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046545 Oct 29 21:22:36.732342 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3044/6187] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:22:37.695842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:37.697378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:37.704616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:37.705236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:37.705937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:37.706767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:37.707243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:37.707860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:37.925106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:37.933646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0b7e0d99-4a9b-4983-bd8b-40b99e843bfa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1695 microversion: 2.1 time: 0.242298 Oct 29 21:22:37.934607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3144/6188] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:37 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:38.760920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:22:38.772191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:38.772765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:38.773281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:38.785444 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] Creating event network-changed:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch2-master-1 Oct 29 21:22:38.791840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] Instance ea4b3354-2d08-4827-808c-bd72f804e590 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:22:38.802717 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6d3ea365-6d95-4a99-b5ed-0a40b6a237db req-b46eb0f1-ab6e-470b-ab87-61757ecc4067 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046040 Oct 29 21:22:38.803909 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3045/6189] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:22:38.958317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:38.958946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:38.973315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:38.974083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:38.974703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:38.976126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:38.976749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:38.977349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:39.175643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:39.188662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01865626-527c-477a-bb5c-7f28f50c840d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1693 microversion: 2.1 time: 0.232140 Oct 29 21:22:39.188662 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3145/6190] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:38 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:40.212324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:40.213241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:40.219553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:40.220108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:40.220759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:40.221500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:40.221965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:40.222574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:40.364987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:40.374019 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-baddf161-dadf-4c56-9092-3f22a5879fc1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1690 microversion: 2.1 time: 0.166944 Oct 29 21:22:40.374776 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3046/6191] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:40 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:40.397219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:22:40.397894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:40.404776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:40.405281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:40.406092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:40.406677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:40.407161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:40.407613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:40.478232 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c8a2f7a9-1bb1-49be-8bb2-cce728c5caad tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action" status: 204 len: 0 microversion: 2.1 time: 0.084546 Oct 29 21:22:40.479820 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3146/6192] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:22:40 2022] POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:22:40.488649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:40.489559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:40.510022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:40.510670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:40.511351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:40.512160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:40.512586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:40.513060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:40.748254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:40.764998 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60321daa-c4af-4c14-81bc-1b0a911a8fca tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1690 microversion: 2.1 time: 0.280773 Oct 29 21:22:40.791394 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3047/6193] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:40 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1690 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:41.796818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:41.797860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:41.808485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:41.809002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:41.809517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:41.810292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:41.810836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:41.811311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:41.978528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:41.996923 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-49366ee5-55c2-4fb2-a9bd-50d8fb969ad4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1690 microversion: 2.1 time: 0.205809 Oct 29 21:22:41.997870 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3147/6194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:41 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:22:42.637597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-dcaab8fe-0d62-4275-be29-71140706ca1b req-e07b8d69-6d1f-4d94-b145-3225760d3016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "name": "network-vif-plugged", "status": "completed", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:22:42.648866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dcaab8fe-0d62-4275-be29-71140706ca1b req-e07b8d69-6d1f-4d94-b145-3225760d3016 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:42.650924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dcaab8fe-0d62-4275-be29-71140706ca1b req-e07b8d69-6d1f-4d94-b145-3225760d3016 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:42.651560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dcaab8fe-0d62-4275-be29-71140706ca1b req-e07b8d69-6d1f-4d94-b145-3225760d3016 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:42.664920 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-dcaab8fe-0d62-4275-be29-71140706ca1b req-e07b8d69-6d1f-4d94-b145-3225760d3016 service nova] Creating event network-vif-plugged:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch2-master-1 Oct 29 21:22:42.669968 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-dcaab8fe-0d62-4275-be29-71140706ca1b req-e07b8d69-6d1f-4d94-b145-3225760d3016 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036543 Oct 29 21:22:42.670695 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3048/6195] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:22:43.022148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:22:43.022941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:22:43.032227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:43.032832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:43.033378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:43.034207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:22:43.034752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:22:43.035517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:22:43.206776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:22:43.209327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:22:43.219302 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9832f781-6288-472d-ac9e-67d27e632f95 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1682 microversion: 2.1 time: 0.201140 Oct 29 21:22:43.219945 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3148/6196] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:22:43 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:07.417328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=28 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:07.418120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=74 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:07.422657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:07.424913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:07.432863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:07.433297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:07.433772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:07.434486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:07.434952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:07.435390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:07.489031 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff197a2d-fe70-4e2b-8464-50f1124b80fa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action" status: 200 len: 24574 microversion: 2.1 time: 0.073951 Oct 29 21:23:07.489704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3049/6197] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:23:07 2022] POST /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590/action => generated 24574 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:23:13.694048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:13.694721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:13.697305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=30 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:13.703545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:13.704051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:13.704509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:13.705225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:13.705739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:13.706189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:13.839364 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a3bdc365-6782-48b4-adf8-015b033ce130 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1833 microversion: 2.1 time: 0.149161 Oct 29 21:23:13.840057 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3149/6198] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:13 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:15.400171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:15.401338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:15.421038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:15.423809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:15.425480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:15.427362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:15.428190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:15.430863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:15.480012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:23:15.606731 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c39adcc-7459-4aaf-87a2-126cac1fe35e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 204 len: 0 microversion: 2.1 time: 0.211347 Oct 29 21:23:15.607640 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3050/6199] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:23:15 2022] DELETE /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:23:15.616397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:15.619707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:15.632834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:15.633597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:15.634288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:15.636004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:15.639122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:15.640196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:15.692833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c86dc0b3-4cac-4292-b1ee-3a808eb101ea req-52027d19-8eca-4c48-a151-efcd3c52852a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:15.705723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c86dc0b3-4cac-4292-b1ee-3a808eb101ea req-52027d19-8eca-4c48-a151-efcd3c52852a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:15.706562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c86dc0b3-4cac-4292-b1ee-3a808eb101ea req-52027d19-8eca-4c48-a151-efcd3c52852a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:15.707377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c86dc0b3-4cac-4292-b1ee-3a808eb101ea req-52027d19-8eca-4c48-a151-efcd3c52852a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:15.728183 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c86dc0b3-4cac-4292-b1ee-3a808eb101ea req-52027d19-8eca-4c48-a151-efcd3c52852a service nova] Creating event network-changed:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch2-master-1 Oct 29 21:23:15.735747 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c86dc0b3-4cac-4292-b1ee-3a808eb101ea req-52027d19-8eca-4c48-a151-efcd3c52852a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335391 Oct 29 21:23:15.736979 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3150/6200] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:23:15.980586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:15.985290 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0daa026-e287-4633-ac93-971e080e11a4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1570 microversion: 2.1 time: 0.373096 Oct 29 21:23:15.986450 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3051/6201] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:15 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1570 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:17.012602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:17.013967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:17.021113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:17.021860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:17.022478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:17.024479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:17.025619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:17.026327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:17.404524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:17.420287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db0f278e-bd56-4814-ac86-6fc7b6ae893e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 200 len: 1570 microversion: 2.1 time: 0.413169 Oct 29 21:23:17.420976 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3151/6202] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:17 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 1570 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:17.675458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e8d30e3f-7c69-4a55-b9cc-4bb61c691211 req-cf8c9017-779a-4065-a3a8-6c89fb77ff7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4b3354-2d08-4827-808c-bd72f804e590", "name": "network-vif-deleted", "tag": "25463f1d-803d-4f59-a8f4-c1f52958fa76"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:17.718608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e8d30e3f-7c69-4a55-b9cc-4bb61c691211 req-cf8c9017-779a-4065-a3a8-6c89fb77ff7a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:17.722178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e8d30e3f-7c69-4a55-b9cc-4bb61c691211 req-cf8c9017-779a-4065-a3a8-6c89fb77ff7a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:17.722931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e8d30e3f-7c69-4a55-b9cc-4bb61c691211 req-cf8c9017-779a-4065-a3a8-6c89fb77ff7a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:17.763157 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e8d30e3f-7c69-4a55-b9cc-4bb61c691211 req-cf8c9017-779a-4065-a3a8-6c89fb77ff7a service nova] Creating event network-vif-deleted:25463f1d-803d-4f59-a8f4-c1f52958fa76 for instance ea4b3354-2d08-4827-808c-bd72f804e590 on nch2-master-1 Oct 29 21:23:17.771214 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e8d30e3f-7c69-4a55-b9cc-4bb61c691211 req-cf8c9017-779a-4065-a3a8-6c89fb77ff7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103614 Oct 29 21:23:17.773010 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3052/6203] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:18.450326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:18.451889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: ea4b3354-2d08-4827-808c-bd72f804e590] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:18.459388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:18.462676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:18.463333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:18.464100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:18.464583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:18.465031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:18.483313 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] HTTP exception thrown: Instance ea4b3354-2d08-4827-808c-bd72f804e590 could not be found. Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Request method failure captured: Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 HTTP/1.1 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZkiwwqKESTVDGAQICgVPul-ChT-_yLrnA591om_JgqjMDaL5QEWtut9sXT8-Btu3QBQ5deyvuUc44RIKAjyXhMC-8DtRWhkTtXEgXduUmQijUFGS0Sbxjf9yAZyx-9ltHE_HKPl11nE4IgPQ0Pdq0tDxYmL2ScSJKxYLbqUYkEyL-M Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c6bec1dc25f940a491e35c8f471e040d Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance ea4b3354-2d08-4827-808c-bd72f804e590 could not be found. Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ea4b3354-2d08-4827-808c-bd72f804e590'} Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4b3354-2d08-4827-808c-bd72f804e590 could not be found. Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4b3354-2d08-4827-808c-bd72f804e590 could not be found. Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:18.485051 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4b3354-2d08-4827-808c-bd72f804e590 could not be found. Oct 29 21:23:18.489764 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:18.491427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Returning 404 to user: Instance ea4b3354-2d08-4827-808c-bd72f804e590 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:23:18.492374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d091556d-2402-4292-b0a5-82d6f41b180a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590" status: 404 len: 111 microversion: 2.1 time: 0.049591 Oct 29 21:23:18.492966 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3152/6204] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:18 2022] GET /compute/v2.1/servers/ea4b3354-2d08-4827-808c-bd72f804e590 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:23:20.023782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-701623710", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "775e2c07-f682-40a2-a025-dbe00390a050"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1655609183", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a7b9c598-f753-4290-a7a5-3e8ce7ab156b"]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:20.107616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] validate_networks() for [('775e2c07-f682-40a2-a025-dbe00390a050', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:23:20.532995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:23:20.533837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:23:20.535444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:23:20.536175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:23:20.536839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:23:20.548859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:20.549373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:20.549875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:20.550637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:20.551111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:20.551559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:20.572770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Getting quotas for project 1e4a4ea4687f4465b38bbb82f52d85e9. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:23:20.578980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Getting quotas for user 8d0e9b3a14994f9a8ce549fc59ba71df and project 1e4a4ea4687f4465b38bbb82f52d85e9. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:23:20.594022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:23:20.596588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:23:20.656324 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be47adac-0c0c-4de3-b07f-bdb874188538 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.639129 Oct 29 21:23:20.657392 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3053/6205] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:23:20 2022] POST /compute/v2.1/servers => generated 361 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:23:20.668849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bb0d3f09-1cb7-4f4f-a5e9-f347731617b3 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:20.670056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bb0d3f09-1cb7-4f4f-a5e9-f347731617b3 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:20.739400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bb0d3f09-1cb7-4f4f-a5e9-f347731617b3 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:20.747844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bb0d3f09-1cb7-4f4f-a5e9-f347731617b3 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1241 microversion: 2.1 time: 0.083083 Oct 29 21:23:20.749172 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3153/6206] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:20 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:21.772194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:21.772819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:21.797046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:21.800958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:21.801771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:21.803937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:21.804461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:21.804902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:21.923389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:21.932534 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbd30292-a10b-4fe4-af91-6038218d94fb tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1293 microversion: 2.1 time: 0.164402 Oct 29 21:23:21.933808 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3054/6207] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:21 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:22.957026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:22.957855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:22.974947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:22.975698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:22.977047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:22.978041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:22.979376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:22.980739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:23.209700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:23.224962 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-69cd778d-0919-47d4-830d-8d7dd6dfb3d7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.270767 Oct 29 21:23:23.228020 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3154/6208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:22 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:23.884231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8e3be152-4281-4f50-b03f-933bbb7b6ab3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '.version_select at 0x7fa170e8e040>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:23.917217 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8e3be152-4281-4f50-b03f-933bbb7b6ab3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1094118936" status: 202 len: 0 microversion: 2.1 time: 0.038344 Oct 29 21:23:23.919917 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3055/6209] 10.222.0.36 () {58 vars in 1284 bytes} [Sat Oct 29 21:23:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1094118936 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:23:23.956428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3a1cfe10-c9d6-4314-9a41-b7949bd306b7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: .version_select at 0x7fa170044670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2005339582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh9TFkVheubLaEvYu1Jkxf72CqDPxtYaIydi/Kzf4ogkwr1GsILkUbdZvnUkQGXjY6RS9+y2GAcf6ofwvgfrrZzuII+HOUSH++zVGd05XCILdLLQpwSM5qycf+gEBpsEw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:23.980543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3a1cfe10-c9d6-4314-9a41-b7949bd306b7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:23:23.989226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3a1cfe10-c9d6-4314-9a41-b7949bd306b7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:23:24.007819 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a1cfe10-c9d6-4314-9a41-b7949bd306b7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [22be7d3f-3c68-493e-a533-41213e7f7ed6] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:23:24.252631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:24.253563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:24.264555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:24.265325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:24.266071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:24.266798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:24.267262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:24.267702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:24.392231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:24.400215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d5bbcc7-3a72-4cad-85b9-f5b0b8d942bd tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.151635 Oct 29 21:23:24.400836 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3056/6210] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:24 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:24.445428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bc400b7e-aed0-4b57-ad5f-750ffc7c6614 req-d669bed7-5fc0-40df-bdbb-a9c2bce22520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a824f10-d6be-44ed-ad71-f26a2bf8118e", "tag": "173dd79e-83fd-4e3b-8135-a138255b0f2f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:24.460270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bc400b7e-aed0-4b57-ad5f-750ffc7c6614 req-d669bed7-5fc0-40df-bdbb-a9c2bce22520 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:24.461063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bc400b7e-aed0-4b57-ad5f-750ffc7c6614 req-d669bed7-5fc0-40df-bdbb-a9c2bce22520 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:24.461701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bc400b7e-aed0-4b57-ad5f-750ffc7c6614 req-d669bed7-5fc0-40df-bdbb-a9c2bce22520 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:24.483207 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bc400b7e-aed0-4b57-ad5f-750ffc7c6614 req-d669bed7-5fc0-40df-bdbb-a9c2bce22520 service nova] Creating event network-changed:173dd79e-83fd-4e3b-8135-a138255b0f2f for instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e on nch2-master-1 Oct 29 21:23:24.488434 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bc400b7e-aed0-4b57-ad5f-750ffc7c6614 req-d669bed7-5fc0-40df-bdbb-a9c2bce22520 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046998 Oct 29 21:23:24.489250 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3057/6211] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:23:25.016029 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a1cfe10-c9d6-4314-9a41-b7949bd306b7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [22be7d3f-3c68-493e-a533-41213e7f7ed6] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38034. Oct 29 21:23:25.030981 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3a1cfe10-c9d6-4314-9a41-b7949bd306b7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.078658 Oct 29 21:23:25.031598 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3155/6212] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:23:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:25.426549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:25.427385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:25.439850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:25.440996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:25.441684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:25.442573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:25.443055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:25.443505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:25.538035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:25.547322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3725657a-fe26-40ca-a232-7fb62dfa664a tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.126629 Oct 29 21:23:25.548034 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3058/6213] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:25 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:26.573109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:26.573868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:26.580464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:26.581110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:26.581745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:26.582584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:26.583171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:26.583733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:26.724629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:26.742573 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4424f3ae-e9a7-49a2-9ee0-2ecabad1a238 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.174455 Oct 29 21:23:26.745624 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3156/6214] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:26 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:27.769703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:27.770357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:27.779232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:27.779729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:27.780182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:27.781367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:27.782124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:27.782738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:27.887863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:27.896880 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c5b601a-914e-4d47-8f64-3c6546c04252 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.131817 Oct 29 21:23:27.897885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3059/6215] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:27 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:28.923429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:28.924997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:28.936381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:28.937039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:28.937813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:28.938843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:28.939324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:28.939777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:29.073819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:29.085188 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4734cf59-b449-448c-967d-d0adcf6c4c9f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.167430 Oct 29 21:23:29.099917 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3157/6216] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:28 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:29.207869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4a11008c-56e5-4a05-9675-052e688e999a req-f03afa79-40cb-4560-be86-ea888e6bede8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a824f10-d6be-44ed-ad71-f26a2bf8118e", "name": "network-vif-plugged", "status": "completed", "tag": "173dd79e-83fd-4e3b-8135-a138255b0f2f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:29.240077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4a11008c-56e5-4a05-9675-052e688e999a req-f03afa79-40cb-4560-be86-ea888e6bede8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:29.240770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4a11008c-56e5-4a05-9675-052e688e999a req-f03afa79-40cb-4560-be86-ea888e6bede8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:29.241407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4a11008c-56e5-4a05-9675-052e688e999a req-f03afa79-40cb-4560-be86-ea888e6bede8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:29.259495 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4a11008c-56e5-4a05-9675-052e688e999a req-f03afa79-40cb-4560-be86-ea888e6bede8 service nova] Creating event network-vif-plugged:173dd79e-83fd-4e3b-8135-a138255b0f2f for instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e on nch2-master-1 Oct 29 21:23:29.265973 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4a11008c-56e5-4a05-9675-052e688e999a req-f03afa79-40cb-4560-be86-ea888e6bede8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065101 Oct 29 21:23:29.267331 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3060/6217] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:30.110652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:30.111875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:30.122953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:30.123469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:30.124622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:30.125630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:30.126047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:30.127013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:30.248164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:30.268988 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1215fdc9-bfad-4bc5-991b-e00233be5350 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1299 microversion: 2.1 time: 0.162728 Oct 29 21:23:30.269830 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3158/6218] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:30 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:31.299010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:31.300634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:31.309173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:31.310539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:31.316004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.316914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.317688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.320044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.321895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.322557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.455264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:31.471418 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d9aec0b-a60f-4f82-9191-38c1914b995d tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1472 microversion: 2.1 time: 0.176887 Oct 29 21:23:31.472043 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3061/6219] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:31 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:31.501836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:31.502632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:31.524599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.525519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.526517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.527511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.528213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.530421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.650835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-291475489", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "7c813649-86d1-41a9-bd60-a8cf6e0a2722"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2005339582", "security_groups": [{"name": "tempest-secgroup-smoke-753685655"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:31.660108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:31.672462 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6cf2bda5-47da-4279-91e4-4956d4cbb517 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1472 microversion: 2.1 time: 0.177592 Oct 29 21:23:31.686880 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3159/6220] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:31 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:31.702138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:31.704229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:31.712433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.713256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.713920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.715833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.716491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.717369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.832115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] validate_networks() for [('7c813649-86d1-41a9-bd60-a8cf6e0a2722', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:23:31.851222 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ba009d4-3a84-41a5-97d3-1dad34580eaa tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1623 microversion: 2.1 time: 0.155429 Oct 29 21:23:31.869374 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3160/6221] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:31 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1623 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:23:31.875390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:31.876232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:31.883473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.884518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.884983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:31.885786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:31.886296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:31.887034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.189758 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f289ac40-481e-4e5a-87d2-fd1598123759 tempest-TestSecurityGroupsBasicOps-361423533 tempest-TestSecurityGroupsBasicOps-361423533-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1914 microversion: 2.1 time: 0.312582 Oct 29 21:23:32.190425 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3161/6222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:31 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1914 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:23:32.302723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:32.303910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:32.311200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:32.311836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:32.312359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.313190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:32.313772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:32.314321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.344386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:23:32.445867 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5a9361b6-990f-4dbe-82c3-e3cb5e335210 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 204 len: 0 microversion: 2.1 time: 0.148898 Oct 29 21:23:32.451219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3162/6223] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:23:32 2022] DELETE /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:23:32.458181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:32.458934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:32.462454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:23:32.463673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:23:32.464330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:23:32.464822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:23:32.466995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:23:32.467080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:32.467080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:32.467303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.468199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:32.468679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:32.469126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.481035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:32.489036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:32.489935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.491846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:32.502296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:32.503103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:32.533433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:23:32.554608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:23:32.591231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:23:32.593859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:23:32.618702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:32.627616 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d311b95-c5ea-447f-abf5-7799ec9a406f tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1478 microversion: 2.1 time: 0.174796 Oct 29 21:23:32.628229 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3163/6224] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:32 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:32.645181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f96e5a28-7dc7-4073-876e-695de19a3a00 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.998406 Oct 29 21:23:32.652416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3062/6225] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:23:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:23:32.658112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e6ca667-fb0f-4b89-b688-a0b86584831a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:32.659093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6e6ca667-fb0f-4b89-b688-a0b86584831a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:32.760014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6e6ca667-fb0f-4b89-b688-a0b86584831a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:32.779151 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e6ca667-fb0f-4b89-b688-a0b86584831a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1266 microversion: 2.1 time: 0.115268 Oct 29 21:23:32.780255 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3164/6226] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:32 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:33.656583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:33.657221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:33.666328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:33.666836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:33.667280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:33.668016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:33.668482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:33.668922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:33.767660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:33.776620 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-905d63fb-067b-4cdf-ac78-ec8c2310de92 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1478 microversion: 2.1 time: 0.124062 Oct 29 21:23:33.777218 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3063/6227] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:33 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1478 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:33.804038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:33.804700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:33.812986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:33.813527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:33.813988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:33.814710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:33.815184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:33.815633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:33.929296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:33.946982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eb5baba8-a576-4a03-b74b-58c6f5050891 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1318 microversion: 2.1 time: 0.146655 Oct 29 21:23:33.948456 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3165/6228] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:33 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:34.488139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-255d0fa2-b890-499f-b1d1-9ed02a73a452 req-33eb928f-c76e-416e-bc99-2a54c66f70b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a824f10-d6be-44ed-ad71-f26a2bf8118e", "name": "network-vif-deleted", "tag": "173dd79e-83fd-4e3b-8135-a138255b0f2f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:34.499453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-255d0fa2-b890-499f-b1d1-9ed02a73a452 req-33eb928f-c76e-416e-bc99-2a54c66f70b3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:34.500289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-255d0fa2-b890-499f-b1d1-9ed02a73a452 req-33eb928f-c76e-416e-bc99-2a54c66f70b3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:34.500975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-255d0fa2-b890-499f-b1d1-9ed02a73a452 req-33eb928f-c76e-416e-bc99-2a54c66f70b3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:34.516405 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-255d0fa2-b890-499f-b1d1-9ed02a73a452 req-33eb928f-c76e-416e-bc99-2a54c66f70b3 service nova] Creating event network-vif-deleted:173dd79e-83fd-4e3b-8135-a138255b0f2f for instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e on nch2-master-1 Oct 29 21:23:34.522343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-255d0fa2-b890-499f-b1d1-9ed02a73a452 req-33eb928f-c76e-416e-bc99-2a54c66f70b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039657 Oct 29 21:23:34.523654 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3064/6229] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:23:34.802329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:34.803701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:34.812788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:34.813430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:34.813924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:34.814794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:34.815272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:34.815724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:34.853039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:34.853583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:34.854055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:34.854528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lazy-loading 'fault' on Instance uuid 1a824f10-d6be-44ed-ad71-f26a2bf8118e {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:23:34.922652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:34.934268 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d11553e7-6319-44f1-95c8-715a661620ce tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 200 len: 1331 microversion: 2.1 time: 0.137466 Oct 29 21:23:34.935413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3166/6230] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:34 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:34.973313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:34.974082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:34.981159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:34.981702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:34.982391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:34.983412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:34.984050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:34.984662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:35.195396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:35.209909 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0974b643-65cd-49d2-b072-6410f5cfb233 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.241846 Oct 29 21:23:35.222902 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3065/6231] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:34 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:35.685954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1afeca12-65ad-421c-9632-dea8027fa238 req-4dc4a1fa-45ee-4808-aab9-d3d018740728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:35.697351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1afeca12-65ad-421c-9632-dea8027fa238 req-4dc4a1fa-45ee-4808-aab9-d3d018740728 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:35.698205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1afeca12-65ad-421c-9632-dea8027fa238 req-4dc4a1fa-45ee-4808-aab9-d3d018740728 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:35.698660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1afeca12-65ad-421c-9632-dea8027fa238 req-4dc4a1fa-45ee-4808-aab9-d3d018740728 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:35.711602 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1afeca12-65ad-421c-9632-dea8027fa238 req-4dc4a1fa-45ee-4808-aab9-d3d018740728 service nova] Creating event network-changed:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:23:35.719391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1afeca12-65ad-421c-9632-dea8027fa238 req-4dc4a1fa-45ee-4808-aab9-d3d018740728 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036968 Oct 29 21:23:35.721195 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3167/6232] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:35.957352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:35.958052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: 1a824f10-d6be-44ed-ad71-f26a2bf8118e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:35.965126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:35.965978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:35.966433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:35.967185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:35.967659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:35.968103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:35.982689 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] HTTP exception thrown: Instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e could not be found. Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Request method failure captured: Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e HTTP/1.1 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZlZUF1IvIoSlk9mZzVK0PCxGMzWl4cROBibV0jl7uyVBgfhUbBzk14hHMS2zJ7hr_2pOjXvmSJlMtvEPg-pNy1GgPfJSZ-XFeau2S0hPFNmKfitNKANkSAH9_aQCnX7DLOKZNRlu36irJetlETskNWclOWwaOg-nUIa8Rkzk7S8K1A Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 1e4a4ea4687f4465b38bbb82f52d85e9 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1134826655 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1134826655 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 1e4a4ea4687f4465b38bbb82f52d85e9 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1134826655 Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestSecurityGroupsBasicOps-1134826655-project Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 8d0e9b3a14994f9a8ce549fc59ba71df Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1134826655-project Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e could not be found. Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '1a824f10-d6be-44ed-ad71-f26a2bf8118e'} Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e could not be found. Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e could not be found. Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:35.984306 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e could not be found. Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Returning 404 to user: Instance 1a824f10-d6be-44ed-ad71-f26a2bf8118e could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00e81eae-5e18-4b96-9cab-2dc88b3960ac tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e" status: 404 len: 111 microversion: 2.1 time: 0.032526 Oct 29 21:23:35.988697 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3066/6233] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:35 2022] GET /compute/v2.1/servers/1a824f10-d6be-44ed-ad71-f26a2bf8118e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:23:36.239405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:36.240060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:36.247534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:36.248053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:36.248523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:36.249266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:36.249773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:36.250230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:36.267489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:36.390470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:36.398529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b18fbe4-975d-4388-b63a-814eacd7c20f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.164593 Oct 29 21:23:36.399709 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3168/6234] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:36 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:37.423674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:37.424575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:37.432200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:37.432698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:37.433170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:37.433896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:37.434401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:37.434865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:37.438677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:37.589187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:37.597606 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-740ff600-8e4b-404f-b1df-7b6cac8058bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.177814 Oct 29 21:23:37.598186 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3067/6235] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:37 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:38.620604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:38.621850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:38.631264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:38.631776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:38.632430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:38.634642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:38.636732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:38.639524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:38.856750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:38.866207 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-de7dd2fb-dda6-4060-98db-e80b77418710 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.249696 Oct 29 21:23:38.872407 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3169/6236] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:38 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:39.896448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:39.897140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:39.899651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:39.906054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:39.906520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:39.906984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:39.907711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:39.908187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:39.908632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:40.056261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:40.065053 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e068a10a-f702-4da8-b8a7-6925c4c28bbc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.172998 Oct 29 21:23:40.066080 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3068/6237] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:39 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:40.370360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:40.370966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:40.372619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bd7ffbc0-2bae-4257-a41a-439b53327214 req-198751cf-0ed9-4fe2-8b87-d1cc1247c93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b9c598-f753-4290-a7a5-3e8ce7ab156b", "tag": "f9a81890-35c7-4f09-921e-7d68ea19cb26"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:40.378136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:40.378713 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:40.379396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:40.380188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:40.380750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:40.381440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:40.382444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bd7ffbc0-2bae-4257-a41a-439b53327214 req-198751cf-0ed9-4fe2-8b87-d1cc1247c93f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:40.382964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bd7ffbc0-2bae-4257-a41a-439b53327214 req-198751cf-0ed9-4fe2-8b87-d1cc1247c93f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:40.384238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bd7ffbc0-2bae-4257-a41a-439b53327214 req-198751cf-0ed9-4fe2-8b87-d1cc1247c93f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:40.396820 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bd7ffbc0-2bae-4257-a41a-439b53327214 req-198751cf-0ed9-4fe2-8b87-d1cc1247c93f service nova] Creating event network-changed:f9a81890-35c7-4f09-921e-7d68ea19cb26 for instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b on nch1-master-1 Oct 29 21:23:40.402140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bd7ffbc0-2bae-4257-a41a-439b53327214 req-198751cf-0ed9-4fe2-8b87-d1cc1247c93f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033972 Oct 29 21:23:40.402830 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3069/6238] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:40.410264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:23:40.504110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9a0693cd-a95c-42f9-af69-0f7445ea61c0 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 204 len: 0 microversion: 2.1 time: 0.137950 Oct 29 21:23:40.504789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3170/6239] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:23:40 2022] DELETE /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:23:40.515462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:40.516186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:40.523803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:40.525018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:40.525495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:40.526431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:40.526900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:40.527340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:40.683153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:40.696628 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f60a827-b8b6-4aad-b402-adc56b4f2f93 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1769 microversion: 2.1 time: 0.186892 Oct 29 21:23:40.709920 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3070/6240] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:40 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1769 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:41.089840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:41.090610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:41.096960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:41.097589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:41.098142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:41.098946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:41.099501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:41.100029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:41.250246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:41.260085 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8a67f1d-e57a-46fb-b13e-1b7295433c13 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.174612 Oct 29 21:23:41.260877 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3171/6241] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:41 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:41.720312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:41.720943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:41.728361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:41.728854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:41.729300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:41.730029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:41.730493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:41.730930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:41.884338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:41.892201 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e4be5948-aac2-4831-a47c-c6b58ef300f7 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1769 microversion: 2.1 time: 0.175956 Oct 29 21:23:41.892782 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3071/6242] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:41 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1769 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:42.192456 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-cecee122-de90-4e0d-8f3d-d745789b6a1e req-cb3a8e6e-0173-464a-a9d2-1c927c27064a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "name": "network-vif-plugged", "status": "completed", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:42.207584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cecee122-de90-4e0d-8f3d-d745789b6a1e req-cb3a8e6e-0173-464a-a9d2-1c927c27064a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.208156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cecee122-de90-4e0d-8f3d-d745789b6a1e req-cb3a8e6e-0173-464a-a9d2-1c927c27064a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.208673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-cecee122-de90-4e0d-8f3d-d745789b6a1e req-cb3a8e6e-0173-464a-a9d2-1c927c27064a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.222466 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-cecee122-de90-4e0d-8f3d-d745789b6a1e req-cb3a8e6e-0173-464a-a9d2-1c927c27064a service nova] Creating event network-vif-plugged:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:23:42.227651 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-cecee122-de90-4e0d-8f3d-d745789b6a1e req-cb3a8e6e-0173-464a-a9d2-1c927c27064a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 Oct 29 21:23:42.228601 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3172/6243] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:42.284999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:42.285807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:42.294187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.295000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.295298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.296025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.296494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.296936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.521101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:42.577330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:42.647408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-afa274eb-ee22-4183-9de4-257536ebc95c req-0bc7a370-681b-4984-ab69-fd8555b7b052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b9c598-f753-4290-a7a5-3e8ce7ab156b", "name": "network-vif-deleted", "tag": "f9a81890-35c7-4f09-921e-7d68ea19cb26"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:42.667915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-afa274eb-ee22-4183-9de4-257536ebc95c req-0bc7a370-681b-4984-ab69-fd8555b7b052 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.668517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-afa274eb-ee22-4183-9de4-257536ebc95c req-0bc7a370-681b-4984-ab69-fd8555b7b052 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.669054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-afa274eb-ee22-4183-9de4-257536ebc95c req-0bc7a370-681b-4984-ab69-fd8555b7b052 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.683426 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-afa274eb-ee22-4183-9de4-257536ebc95c req-0bc7a370-681b-4984-ab69-fd8555b7b052 service nova] Creating event network-vif-deleted:f9a81890-35c7-4f09-921e-7d68ea19cb26 for instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b on nch1-master-1 Oct 29 21:23:42.688413 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-afa274eb-ee22-4183-9de4-257536ebc95c req-0bc7a370-681b-4984-ab69-fd8555b7b052 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045379 Oct 29 21:23:42.689029 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3173/6244] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:42.800365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:42.808830 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-33108d51-a04b-4eee-9b77-ca6bcdbad249 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.528375 Oct 29 21:23:42.809357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3072/6245] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:42 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:42.912739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:42.918191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:42.918865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:42.925714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.926220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.926675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.927393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.927880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.928332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.964775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:42.965268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:42.965752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:42.966237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lazy-loading 'fault' on Instance uuid a7b9c598-f753-4290-a7a5-3e8ce7ab156b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:23:43.009776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:43.018227 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62639f3e-d84b-40a5-a51e-245c9ad9a8cc tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1385 microversion: 2.1 time: 0.106357 Oct 29 21:23:43.018827 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3174/6246] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:42 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:43.832285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:43.832912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:43.840482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:43.840972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:43.841418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:43.842149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:43.842613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:43.843051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:43.977799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:43.985603 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aba952e6-0da2-4a12-a35d-8d9a7645ee35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1391 microversion: 2.1 time: 0.157281 Oct 29 21:23:43.986184 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3073/6247] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:43 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:44.041968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:44.043018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:44.046188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:44.053530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.053980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.054445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.055169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.055932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.056378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.091636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.092144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.092604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.093111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lazy-loading 'fault' on Instance uuid a7b9c598-f753-4290-a7a5-3e8ce7ab156b {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:23:44.136336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0e9b3a14994f9a8ce549fc59ba71df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e4a4ea4687f4465b38bbb82f52d85e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:44.144560 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8277c7ef-2d57-4778-92ea-26a35ab65a71 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 200 len: 1385 microversion: 2.1 time: 0.106871 Oct 29 21:23:44.145150 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3175/6248] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:44 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 1385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:44.155320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:44.155835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:44.161969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.162460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.162910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.163619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.164080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.164515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.189868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:23:44.277086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 204 len: 0 microversion: 2.1 time: 0.125356 Oct 29 21:23:44.277769 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3074/6249] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:23:44 2022] DELETE /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:23:44.288635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:44.289278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:44.295688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.296126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.296691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.297561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:44.298136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:44.298662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:44.432849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:44.440819 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e67791bc-21fa-4b04-8728-c90a334dbfd3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1578 microversion: 2.1 time: 0.158793 Oct 29 21:23:44.441396 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3176/6250] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:44 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:45.009204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:45.010493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:45.017419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.017943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.018400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.019136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.019606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.020046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.153026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:45.161514 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7d76be0c-f06b-481c-bb76-832866e93ff6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1563 microversion: 2.1 time: 0.156360 Oct 29 21:23:45.162463 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3075/6251] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:45 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:45.168716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:45.170141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] [instance: a7b9c598-f753-4290-a7a5-3e8ce7ab156b] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:45.177916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.178560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.179122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.179979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.181055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.181636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.185920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:45.186542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:45.192506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.192997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.193443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.194166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.194666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.195055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.196069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] HTTP exception thrown: Instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b could not be found. Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Request method failure captured: Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b HTTP/1.1 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZlZUF1IvIoSlk9mZzVK0PCxGMzWl4cROBibV0jl7uyVBgfhUbBzk14hHMS2zJ7hr_2pOjXvmSJlMtvEPg-pNy1GgPfJSZ-XFeau2S0hPFNmKfitNKANkSAH9_aQCnX7DLOKZNRlu36irJetlETskNWclOWwaOg-nUIa8Rkzk7S8K1A Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 1e4a4ea4687f4465b38bbb82f52d85e9 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1134826655 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1e4a4ea4687f4465b38bbb82f52d85e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1134826655 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 1e4a4ea4687f4465b38bbb82f52d85e9 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1134826655 Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestSecurityGroupsBasicOps-1134826655-project Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 8d0e9b3a14994f9a8ce549fc59ba71df Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1134826655-project Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b could not be found. Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a7b9c598-f753-4290-a7a5-3e8ce7ab156b'} Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b could not be found. Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b could not be found. Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:45.197805 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b could not be found. Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Returning 404 to user: Instance a7b9c598-f753-4290-a7a5-3e8ce7ab156b could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed824212-726a-4864-91cd-30c8fe08637e tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b" status: 404 len: 111 microversion: 2.1 time: 0.035079 Oct 29 21:23:45.206584 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3177/6252] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:45 2022] GET /compute/v2.1/servers/a7b9c598-f753-4290-a7a5-3e8ce7ab156b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:23:45.332938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:45.341943 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-df0b6ca6-ce60-49ca-b974-45f4fee5dfef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1563 microversion: 2.1 time: 0.159855 Oct 29 21:23:45.351946 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3076/6253] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:45 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:45.467676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:45.468636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:45.476065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.476725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.477355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.478111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:45.478588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:45.479374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:45.755949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:45.766813 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b398a761-76e6-4dae-9783-d2d6967a779c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1578 microversion: 2.1 time: 0.303713 Oct 29 21:23:45.767719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3178/6254] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:45 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1578 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:23:46.791982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:46.792612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:46.799539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:46.800031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:46.800477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:46.801233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:46.801715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:46.802145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:47.066501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:47.077313 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9d6ea14-65fa-4fdc-a13f-b71cb2ad5daf tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1578 microversion: 2.1 time: 0.291103 Oct 29 21:23:47.086904 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3077/6255] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:46 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1578 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:47.581892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ed222dba-3c05-4a04-912a-2b13148e822d req-4cc7a00c-090f-47eb-903e-afc89b9528e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:47.583536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:47.587121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:47.603624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:47.606115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:47.606965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:47.608047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ed222dba-3c05-4a04-912a-2b13148e822d req-4cc7a00c-090f-47eb-903e-afc89b9528e7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:47.609508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:47.610333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ed222dba-3c05-4a04-912a-2b13148e822d req-4cc7a00c-090f-47eb-903e-afc89b9528e7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:47.611687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ed222dba-3c05-4a04-912a-2b13148e822d req-4cc7a00c-090f-47eb-903e-afc89b9528e7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:47.611948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:47.613219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:47.643048 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ed222dba-3c05-4a04-912a-2b13148e822d req-4cc7a00c-090f-47eb-903e-afc89b9528e7 service nova] Creating event network-changed:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:23:47.655806 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ed222dba-3c05-4a04-912a-2b13148e822d req-4cc7a00c-090f-47eb-903e-afc89b9528e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079763 Oct 29 21:23:47.656454 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3078/6256] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:23:48.102588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:48.105290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:48.115307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:48.116181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:48.116911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:48.118174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:48.118895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:48.119560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:48.234992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:48.247134 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6265e727-f029-45bf-aedc-a3e023052847 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1563 microversion: 2.1 time: 0.677414 Oct 29 21:23:48.247820 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3179/6257] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:47 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1563 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:48.299508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:48.311243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9360a7b4-433c-479e-82e1-1e1fe82db20d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 200 len: 1510 microversion: 2.1 time: 0.213540 Oct 29 21:23:48.312605 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3079/6258] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:48 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:48.319945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e28b2e06-3101-43c0-867b-04318f07977f req-508726e4-2995-4c06-b0f0-28b058525a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470a094a-d503-4055-819c-306c001ab9fb", "name": "network-vif-deleted", "tag": "f3490ebf-87b1-4ac9-92b0-579c0ea8cccb"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:48.332517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e28b2e06-3101-43c0-867b-04318f07977f req-508726e4-2995-4c06-b0f0-28b058525a52 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:48.334018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e28b2e06-3101-43c0-867b-04318f07977f req-508726e4-2995-4c06-b0f0-28b058525a52 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:48.334018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e28b2e06-3101-43c0-867b-04318f07977f req-508726e4-2995-4c06-b0f0-28b058525a52 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:48.374473 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e28b2e06-3101-43c0-867b-04318f07977f req-508726e4-2995-4c06-b0f0-28b058525a52 service nova] Creating event network-vif-deleted:f3490ebf-87b1-4ac9-92b0-579c0ea8cccb for instance 470a094a-d503-4055-819c-306c001ab9fb on nch2-master-1 Oct 29 21:23:48.382804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e28b2e06-3101-43c0-867b-04318f07977f req-508726e4-2995-4c06-b0f0-28b058525a52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067147 Oct 29 21:23:48.384581 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3180/6259] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:23:49.339992 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:49.341559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:49.354827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:49.355939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:49.356750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:49.357619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:49.358550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:49.359360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:49.381119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb HTTP/1.1 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '470a094a-d503-4055-819c-306c001ab9fb'} Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:23:49.384524 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:23:49.388665 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:23:49.390669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:23:49.391816 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb018c4f-4878-4a5f-8fcf-889148676c81 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 404 len: 111 microversion: 2.1 time: 0.058404 Oct 29 21:23:49.392666 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3080/6260] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:49 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:23:49.575518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1206596950", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1426309693", "security_groups": [{"name": "tempest-secgroup-smoke-1319913458"}], "block_device_mapping_v2": [{"uuid": "1dd52dee-26a8-4479-b52c-88863fc657c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61be7916-1aaf-44e0-b8b4-9d255eece552"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:49.718615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] validate_networks() for [('61be7916-1aaf-44e0-b8b4-9d255eece552', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:23:50.169385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:23:50.169892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:23:50.170341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:23:50.170765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:23:50.171382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:23:50.183348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:50.184303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:50.185244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:50.186429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:50.187089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:50.187993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:50.209087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:23:50.215670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:23:50.291128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:23:50.293683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dd52dee-26a8-4479-b52c-88863fc657c0',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:23:50.474684 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.906071 Oct 29 21:23:50.476014 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3181/6261] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:23:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 21:23:50.492610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f74ff1f-128b-4a68-968c-328cedc5295d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:50.493246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f74ff1f-128b-4a68-968c-328cedc5295d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:50.593150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8f74ff1f-128b-4a68-968c-328cedc5295d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:50.604104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f74ff1f-128b-4a68-968c-328cedc5295d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1095 microversion: 2.1 time: 0.117080 Oct 29 21:23:50.604700 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3081/6262] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:50 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1095 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:50.717656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5ebf44c0-9274-4cad-a674-e3ddc9918c66 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] Calling method '.version_select at 0x7fa1703b18b0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:50.746472 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5ebf44c0-9274-4cad-a674-e3ddc9918c66 tempest-TestSecurityGroupsBasicOps-1134826655 tempest-TestSecurityGroupsBasicOps-1134826655-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1655609183" status: 202 len: 0 microversion: 2.1 time: 0.033185 Oct 29 21:23:50.747935 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3182/6263] 10.222.0.36 () {58 vars in 1278 bytes} [Sat Oct 29 21:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1655609183 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:23:51.627623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:51.628857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:51.636224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:51.636728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:51.637244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:51.638005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:51.638476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:51.638916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:51.708713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:51.717975 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f110f6ed-c8b4-4c96-b1eb-20faf997d17a tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1193 microversion: 2.1 time: 0.094054 Oct 29 21:23:51.718490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3082/6264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:51 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:23:52.746798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:52.748638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:52.762931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:52.763823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:52.764528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:52.765922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:52.766617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:52.767286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:53.069629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:53.078236 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6942dcdb-28cc-4bdc-af31-95ddca63a338 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1279 microversion: 2.1 time: 0.338220 Oct 29 21:23:53.078846 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3183/6265] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:52 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:53.550965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4643fb98-6344-4cf3-a5c0-54412c564349 req-dfef6b72-9281-4105-a843-844bce653102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9993452-3bb0-4590-8b31-aa7c97036004", "tag": "8cba055f-a882-4227-ba71-63651132f25c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:53.562805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4643fb98-6344-4cf3-a5c0-54412c564349 req-dfef6b72-9281-4105-a843-844bce653102 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:53.563298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4643fb98-6344-4cf3-a5c0-54412c564349 req-dfef6b72-9281-4105-a843-844bce653102 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:53.563744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4643fb98-6344-4cf3-a5c0-54412c564349 req-dfef6b72-9281-4105-a843-844bce653102 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:53.575432 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4643fb98-6344-4cf3-a5c0-54412c564349 req-dfef6b72-9281-4105-a843-844bce653102 service nova] Creating event network-changed:8cba055f-a882-4227-ba71-63651132f25c for instance a9993452-3bb0-4590-8b31-aa7c97036004 on nch2-master-1 Oct 29 21:23:53.580234 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4643fb98-6344-4cf3-a5c0-54412c564349 req-dfef6b72-9281-4105-a843-844bce653102 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Oct 29 21:23:53.580842 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3083/6266] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:23:54.103514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:54.104183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:54.111185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:54.111690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:54.112150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:54.112865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:54.113339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:54.113821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:54.248151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:54.256079 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d3712e64-f22f-4fac-907f-878c3354ec9e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1267 microversion: 2.1 time: 0.156521 Oct 29 21:23:54.256657 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3184/6267] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:54 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:55.282023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:55.282742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:55.288985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:55.290054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:55.290497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:55.291192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:55.291692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:55.292125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:55.424190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:55.432816 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-62bb752b-0ed6-4f0c-9027-8d8a0e25a2aa tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1267 microversion: 2.1 time: 0.156426 Oct 29 21:23:55.433401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3084/6268] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:55 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:56.454566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:56.455204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:56.462736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:56.463176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:56.463626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:56.464327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:56.464794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:56.465243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:56.597620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:56.606146 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67930459-04d6-4ab1-86cb-cc68098ae70b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1267 microversion: 2.1 time: 0.155509 Oct 29 21:23:56.606728 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3185/6269] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:56 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:57.628288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:57.628956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:57.636660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:57.637152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:57.637688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:57.638397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:57.638857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:57.639289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:57.778266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:57.780572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:23:57.787509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89cb77d6-b739-44d1-9646-6b821c8b6986 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1267 microversion: 2.1 time: 0.163251 Oct 29 21:23:57.788094 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3085/6270] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:57 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:58.810185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:58.811423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:23:58.818400 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:58.818918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:58.819383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:58.820110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:58.820590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:58.821045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:58.963504 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:23:58.973888 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16fad7b5-4a4a-4408-b769-a3e2b0e7ca0c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1267 microversion: 2.1 time: 0.167568 Oct 29 21:23:58.975152 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3186/6271] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:58 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:23:59.047271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1c6caab9-6577-47e6-9d65-509d3f103517 req-2399a498-6172-4078-9b1b-0afddbba4b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9993452-3bb0-4590-8b31-aa7c97036004", "name": "network-vif-plugged", "status": "completed", "tag": "8cba055f-a882-4227-ba71-63651132f25c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:23:59.057734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1c6caab9-6577-47e6-9d65-509d3f103517 req-2399a498-6172-4078-9b1b-0afddbba4b44 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:23:59.058322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1c6caab9-6577-47e6-9d65-509d3f103517 req-2399a498-6172-4078-9b1b-0afddbba4b44 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:23:59.058840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1c6caab9-6577-47e6-9d65-509d3f103517 req-2399a498-6172-4078-9b1b-0afddbba4b44 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:23:59.070986 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1c6caab9-6577-47e6-9d65-509d3f103517 req-2399a498-6172-4078-9b1b-0afddbba4b44 service nova] Creating event network-vif-plugged:8cba055f-a882-4227-ba71-63651132f25c for instance a9993452-3bb0-4590-8b31-aa7c97036004 on nch2-master-1 Oct 29 21:23:59.075987 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1c6caab9-6577-47e6-9d65-509d3f103517 req-2399a498-6172-4078-9b1b-0afddbba4b44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181653 Oct 29 21:23:59.076606 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3086/6272] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:23:59.996627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:23:59.997259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:00.004711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:00.005357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:00.005960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:00.006679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:00.007152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:00.007599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 29 21:24:00.051624 ncdv-master-1 devstack@n-api.service[138885]: ERROR sqlalchemy.pool.impl.QueuePool Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: Exception ignored in: . at 0x7fa1710a6280> Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: Traceback (most recent call last): Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: connection_record.checkin() Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: pool.dispatch.checkin(connection, self) Oct 29 21:24:00.054018 ncdv-master-1 devstack@n-api.service[138885]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 29 21:24:00.061752 ncdv-master-1 devstack@n-api.service[138885]: fn(*args, **kw) Oct 29 21:24:00.061752 ncdv-master-1 devstack@n-api.service[138885]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 29 21:24:00.068273 ncdv-master-1 devstack@n-api.service[138885]: time.sleep(0) Oct 29 21:24:00.068273 ncdv-master-1 devstack@n-api.service[138885]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 29 21:24:00.074416 ncdv-master-1 devstack@n-api.service[138885]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 29 21:24:00.074416 ncdv-master-1 devstack@n-api.service[138885]: AssertionError: do not call blocking functions from the mainloop Oct 29 21:24:00.078324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:00.200970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:00.210319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:00.218783 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73b9c405-9a68-4748-af48-ea77aa77969e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1267 microversion: 2.1 time: 0.226673 Oct 29 21:24:00.219394 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3187/6273] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:23:59 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:01.240678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:01.244907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:01.245658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:01.252384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:01.252875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:01.253324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:01.254137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:01.254604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:01.255042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:01.692898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:01.701544 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d068701-802d-4384-a17a-287a8f15e3be tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1453 microversion: 2.1 time: 0.462975 Oct 29 21:24:01.702121 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3087/6274] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:01 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1453 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:01.726988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:01.727648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:01.729557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:01.735668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:01.736201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:01.736654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:01.737362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:01.737855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:01.738296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:01.869429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:01.877249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdde2f75-0943-463e-8021-040308b50dc6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1453 microversion: 2.1 time: 0.154346 Oct 29 21:24:01.877850 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3188/6275] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:01 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:03.457558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9f57576a-d842-4af2-afbb-898b3231df14 req-4625b194-ff3f-4922-a879-fe4a9b8296ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9993452-3bb0-4590-8b31-aa7c97036004", "tag": "8cba055f-a882-4227-ba71-63651132f25c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:24:03.468512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9f57576a-d842-4af2-afbb-898b3231df14 req-4625b194-ff3f-4922-a879-fe4a9b8296ca service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:03.469008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9f57576a-d842-4af2-afbb-898b3231df14 req-4625b194-ff3f-4922-a879-fe4a9b8296ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:03.469472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9f57576a-d842-4af2-afbb-898b3231df14 req-4625b194-ff3f-4922-a879-fe4a9b8296ca service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:03.480858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9f57576a-d842-4af2-afbb-898b3231df14 req-4625b194-ff3f-4922-a879-fe4a9b8296ca service nova] Creating event network-changed:8cba055f-a882-4227-ba71-63651132f25c for instance a9993452-3bb0-4590-8b31-aa7c97036004 on nch2-master-1 Oct 29 21:24:03.485802 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9f57576a-d842-4af2-afbb-898b3231df14 req-4625b194-ff3f-4922-a879-fe4a9b8296ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031925 Oct 29 21:24:03.486519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3088/6276] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:24:19.719059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:19.720658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=11 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:19.724511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:24:19.726774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:19.734410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:19.735007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:19.735470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:19.736712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:19.737194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:19.737677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:19.805857 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0bf0968c-cc08-4bfb-826c-618514574348 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action" status: 200 len: 24572 microversion: 2.1 time: 0.087906 Oct 29 21:24:19.807690 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3189/6277] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:24:19 2022] POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action => generated 24572 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:24:50.052752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:50.053537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=11 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:50.058825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:50.059543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:50.067007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.067533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.068013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.068721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.069187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.069656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.203115 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d481976b-3fab-431d-b6d5-c4c41ec356b0 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1833 microversion: 2.1 time: 0.153295 Oct 29 21:24:50.203702 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3089/6278] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:50 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1833 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:50.228246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:50.228996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:50.232385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:50.233056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:24:50.239861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.240364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.240816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.241544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.242017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.242500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.375973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:50.383802 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c7769083-e191-44d0-a429-6967e12c8c58 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1682 microversion: 2.1 time: 0.159855 Oct 29 21:24:50.384367 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3190/6279] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:50 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:50.478230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:24:50.481175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:50.487295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.487792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.488244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.488975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.489422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.489890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.555509 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7b8b106-8752-4c78-95e1-10fb9c009a49 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action" status: 200 len: 32638 microversion: 2.1 time: 0.081070 Oct 29 21:24:50.556413 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3090/6280] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:24:50 2022] POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action => generated 32638 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:24:50.715184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:24:50.715699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:50.722829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.723331 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.723782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.724486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:50.724958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:50.725401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:50.752296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '80fc6ee8bddd477aba6d56a6aea98c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4810c8879d4a55994e5d0635cc102b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:50.752891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] flavor_id is None. Assuming migration. {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 21:24:50.753347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:24:50.997982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-30f3d90c-5782-4868-a23a-e193cf49fb07 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action" status: 202 len: 0 microversion: 2.1 time: 0.287817 Oct 29 21:24:50.998603 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3191/6281] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:24:50 2022] POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:24:51.007662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:51.008436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:51.016346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:51.016866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:51.017310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:51.018061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:51.018539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:51.018988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:51.162143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:51.170129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12d1dcb1-7e89-4449-a4b5-677eec8d71ae tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1691 microversion: 2.1 time: 0.167088 Oct 29 21:24:51.170704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3091/6282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:51 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:52.195997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:52.196993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:52.205487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:52.206023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:52.206679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:52.207463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:52.208196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:52.208806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:52.431724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:52.440270 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1a80b2f-06ea-4758-90fb-712ed95fce3b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1691 microversion: 2.1 time: 0.248451 Oct 29 21:24:52.440852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3192/6283] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:52 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:53.465410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:53.466229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:53.474057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:53.474577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:53.474999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:53.475707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:53.476175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:53.476614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:53.615190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:53.623378 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1398f434-d4c1-4239-97fe-7f7040cc1506 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.162546 Oct 29 21:24:53.623964 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3092/6284] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:53 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:54.651432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:54.653148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:54.659783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:54.660247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:54.660805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:54.661552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:54.662029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:54.662478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:54.810293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:54.818344 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2d1c4d9-8afd-45b8-9674-be05da6ae4cc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.171159 Oct 29 21:24:54.818936 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3193/6285] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:54 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:24:55.842895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:55.843529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:55.852373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:55.852932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:55.853767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:55.854725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:55.855230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:55.856343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:56.023238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:56.033591 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da8a3c95-d304-4b83-9702-ecc916c98f98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.195146 Oct 29 21:24:56.034182 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3093/6286] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:55 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:57.062379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:57.063022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:57.070121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:57.070633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:57.071098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:57.071819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:57.072336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:57.072809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:57.213596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:57.221700 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-149033fd-475c-404b-b56f-417c09276a3d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.163825 Oct 29 21:24:57.222285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3194/6287] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:57 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:24:58.248774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:58.249498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:58.258380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:58.258988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:58.259534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:58.260305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:58.260763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:58.261196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:58.413939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:58.422580 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b8c80ffa-eba6-4ffe-bc39-86196b5d9be6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.178506 Oct 29 21:24:58.423197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3094/6288] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:58 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:24:59.448262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:24:59.448831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:24:59.456492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:59.457003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:59.457487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:59.458213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:24:59.458693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:24:59.459148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:24:59.595261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:24:59.603049 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21367a54-8e5c-413d-bab9-b1f97fe62d73 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.158836 Oct 29 21:24:59.603636 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3195/6289] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:24:59 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:00.626734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:00.627369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:00.634722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:00.635218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:00.636011 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:00.636730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:00.637201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:00.637682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:00.773685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:00.781670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d0a6c6df-aacf-4fdc-a040-121f86acec2c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.158976 Oct 29 21:25:00.782995 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3095/6290] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:00 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:01.806634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:01.807283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:01.815045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:01.815556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:01.816023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:01.816747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:01.817231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:01.817725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:01.960425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:01.968381 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b198e80-e061-4c3b-858e-3af4309cc4c5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.166007 Oct 29 21:25:01.968965 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3196/6291] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:01 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:02.992200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:02.992828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:02.999982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:03.000483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:03.001501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:03.002247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:03.002718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:03.003160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:03.134238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:03.142554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf6b076c-92d2-4059-b894-8d4c28239e7f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.154448 Oct 29 21:25:03.143138 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3096/6292] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:02 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:04.166257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:04.166899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:04.173910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:04.174420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:04.174885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:04.175609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:04.176091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:04.176546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:04.314801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:04.323157 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b6ecac1-e746-4afb-bcb2-33e6a18789d5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1696 microversion: 2.1 time: 0.160806 Oct 29 21:25:04.323738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3197/6293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:04 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:05.351676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "name": "network-vif-unplugged", "status": "completed", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:05.352260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:05.352878 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:05.361232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:05.361876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:05.362437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:05.363265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:05.363950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:05.364603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:05.364813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:05.365886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:05.366519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:05.385786 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] Creating event network-vif-unplugged:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch2-master-1 Oct 29 21:25:05.395041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:25:05.410028 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cfe4d5be-f0a9-49be-9b30-8b4e955ab8e9 req-c2d65cac-2956-4a1d-878e-0f40464ebb28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063319 Oct 29 21:25:05.410901 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3097/6294] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:05.661304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:05.669421 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dde21afd-6b70-4d52-9427-68f71f6413f2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1695 microversion: 2.1 time: 0.322283 Oct 29 21:25:05.670072 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3198/6295] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:05 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:06.695611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:06.696519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:06.703201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:06.703742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:06.704233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:06.704938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:06.705402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:06.705963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:06.842788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:06.851184 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c0324c6-bf85-4061-9567-8b653b7eb35d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1693 microversion: 2.1 time: 0.161108 Oct 29 21:25:06.851787 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3098/6296] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:06 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:07.430672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:07.441388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.441901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.442336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:07.456518 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] Creating event network-changed:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch2-master-1 Oct 29 21:25:07.463613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:25:07.478215 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-06beeee8-d8a2-4a16-b61e-196eb3ad09d4 req-61768f1a-9127-438e-a35d-d5279f9ed76c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051396 Oct 29 21:25:07.479170 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3099/6297] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:07.518731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:07.521141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:07.527907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.528485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.528885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:07.529642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.530130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.530575 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:07.559614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:25:07.653147 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4fa3e23c-8731-49f1-b592-d21d5941a52c tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 204 len: 0 microversion: 2.1 time: 0.274334 Oct 29 21:25:07.653985 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3199/6298] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:25:07 2022] DELETE /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:25:07.663361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:07.664172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:07.670666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.671180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.671631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:07.672354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.673358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.673823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:07.846203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:07.855213 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-336a39ea-7dd8-40a7-8862-a8755e7dc8d4 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1731 microversion: 2.1 time: 0.196214 Oct 29 21:25:07.855901 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3100/6299] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:07 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:25:07.878179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:07.878917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:07.885832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.886591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.887129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:07.888010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:07.888554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:07.889080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:08.228113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:08.238835 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa5f1b89-cfe8-4def-831a-86fdbd7a2303 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1693 microversion: 2.1 time: 0.366441 Oct 29 21:25:08.239453 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3200/6300] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:07 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1693 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:25:08.880638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:08.881236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:08.888973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:08.890016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:08.890484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:08.891478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:08.892070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:08.892903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.124722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:09.134985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dfbb794e-df6e-4154-a3f4-edaf63750046 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1731 microversion: 2.1 time: 0.258630 Oct 29 21:25:09.136611 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3101/6301] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:08 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:09.269414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:09.270227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:09.278469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.279074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.279615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.280959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.281598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.282763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.479151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:09.487712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-84a11821-e9e4-4faa-a50b-1d67d2ac59a1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1690 microversion: 2.1 time: 0.224885 Oct 29 21:25:09.488590 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3201/6302] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:09 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1690 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:09.511313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:09.511865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:09.518689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.519195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.519681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.520382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.520850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.521287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.669065 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7146b2ae-5e07-499a-b007-7cf00fdbeefd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action" status: 202 len: 0 microversion: 2.1 time: 0.161428 Oct 29 21:25:09.673342 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3102/6303] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:25:09 2022] POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:25:09.680174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:09.681976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:09.692618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.693226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.694005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.695350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.696061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.697223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.758259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5b33444d-5e75-475f-ad42-6057ff743eb6 req-1f913a06-e279-4762-a41c-6c959a36ec28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb375cf9-8508-4b60-b27c-5a1033f4d774", "name": "network-vif-deleted", "tag": "2de406a5-cb91-4767-b9e3-bef0fad89389"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:09.793159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5b33444d-5e75-475f-ad42-6057ff743eb6 req-1f913a06-e279-4762-a41c-6c959a36ec28 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:09.794066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5b33444d-5e75-475f-ad42-6057ff743eb6 req-1f913a06-e279-4762-a41c-6c959a36ec28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:09.794712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5b33444d-5e75-475f-ad42-6057ff743eb6 req-1f913a06-e279-4762-a41c-6c959a36ec28 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:09.811723 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5b33444d-5e75-475f-ad42-6057ff743eb6 req-1f913a06-e279-4762-a41c-6c959a36ec28 service nova] Creating event network-vif-deleted:2de406a5-cb91-4767-b9e3-bef0fad89389 for instance cb375cf9-8508-4b60-b27c-5a1033f4d774 on nch1-master-1 Oct 29 21:25:09.819280 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5b33444d-5e75-475f-ad42-6057ff743eb6 req-1f913a06-e279-4762-a41c-6c959a36ec28 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187213 Oct 29 21:25:09.820518 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3202/6304] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:10.067017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:10.076486 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7f74d7a-6b76-4fbf-8bf4-6aa4eb0533ce tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.400920 Oct 29 21:25:10.077019 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3103/6305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:09 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:10.162695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:10.163567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:10.171731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:10.172650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:10.173376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:10.174390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:10.175029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:10.175632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:10.224499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:10.244828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:10.245373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:10.245900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lazy-loading 'fault' on Instance uuid cb375cf9-8508-4b60-b27c-5a1033f4d774 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:25:10.249489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:25:10.315103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631ab24a4f8a4d4c9e68df5df4b23274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74017e271f93426890b5da5780849913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:10.326794 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3ca2a009-ec44-417d-9887-289198cef969 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 200 len: 1388 microversion: 2.1 time: 0.170078 Oct 29 21:25:10.327620 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3203/6306] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:10 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 1388 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:25:11.101145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:11.102548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:11.111066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.111573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.112026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.112987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.113705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.114145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.267673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "name": "network-vif-plugged", "status": "completed", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:11.284118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:11.286599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:25:11.295158 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d932a0c4-e05a-4e92-9a75-f55ce0495ffc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.198049 Oct 29 21:25:11.295302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.295947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.296145 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3104/6307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:11 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:11.296320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.310944 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] Creating event network-vif-plugged:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch2-master-1 Oct 29 21:25:11.316977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:25:11.327930 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2d6acef8-efed-4a0a-a961-576f7017ed02 req-2b77f3b6-6e13-441f-91cb-4caa2b100597 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068085 Oct 29 21:25:11.328890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3204/6308] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:25:11.351417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:11.351984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:11.358962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.359457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.360551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.361259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.361748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.362187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.376478 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] HTTP exception thrown: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Request method failure captured: Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 HTTP/1.1 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZjNIoFGhvzX90zwZ3UiPY9t784DJH0nij4ETL9sqoS9odCuxF2xXX2SaH8pLQkNk9am4UQprI3SnTqaKTm5MCen2hnKyOruH8mzvay0wVb7uNIVtvHgH0TGmXfdlNJLVK-BphhnQ43dR0UK1qqkqeFi0kBYkodb7ewO1XusJLImYEM Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 74017e271f93426890b5da5780849913 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74017e271f93426890b5da5780849913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74017e271f93426890b5da5780849913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74017e271f93426890b5da5780849913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74017e271f93426890b5da5780849913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 74017e271f93426890b5da5780849913 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestServerBasicOps-1286133914-project Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 631ab24a4f8a4d4c9e68df5df4b23274 Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestServerBasicOps-1286133914-project Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'cb375cf9-8508-4b60-b27c-5a1033f4d774'} Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:25:11.378179 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Returning 404 to user: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3da091c4-533b-4003-a123-9a1c892e68cd tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 404 len: 111 microversion: 2.1 time: 0.032189 Oct 29 21:25:11.382438 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3105/6309] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:11 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:25:11.831463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:11.832074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:11.838415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.838923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.839378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.840091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.840564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.841028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.857149 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] HTTP exception thrown: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Request method failure captured: Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 HTTP/1.1 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZjNIoFGhvzX90zwZ3UiPY9t784DJH0nij4ETL9sqoS9odCuxF2xXX2SaH8pLQkNk9am4UQprI3SnTqaKTm5MCen2hnKyOruH8mzvay0wVb7uNIVtvHgH0TGmXfdlNJLVK-BphhnQ43dR0UK1qqkqeFi0kBYkodb7ewO1XusJLImYEM Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 74017e271f93426890b5da5780849913 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74017e271f93426890b5da5780849913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74017e271f93426890b5da5780849913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74017e271f93426890b5da5780849913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74017e271f93426890b5da5780849913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 74017e271f93426890b5da5780849913 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestServerBasicOps-1286133914-project Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 631ab24a4f8a4d4c9e68df5df4b23274 Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestServerBasicOps-1286133914-project Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'cb375cf9-8508-4b60-b27c-5a1033f4d774'} Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:25:11.858837 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Returning 404 to user: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d99d204-d707-4ab0-a7f9-eb3cc13b95de tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 404 len: 111 microversion: 2.1 time: 0.034116 Oct 29 21:25:11.862826 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3205/6310] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:25:11 2022] DELETE /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:25:11.868943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:11.869612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] [instance: cb375cf9-8508-4b60-b27c-5a1033f4d774] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:11.876259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.876742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.877211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.877930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:11.878390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:11.878823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:11.895182 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] HTTP exception thrown: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Request method failure captured: Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 HTTP/1.1 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZjNIoFGhvzX90zwZ3UiPY9t784DJH0nij4ETL9sqoS9odCuxF2xXX2SaH8pLQkNk9am4UQprI3SnTqaKTm5MCen2hnKyOruH8mzvay0wVb7uNIVtvHgH0TGmXfdlNJLVK-BphhnQ43dR0UK1qqkqeFi0kBYkodb7ewO1XusJLImYEM Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 74017e271f93426890b5da5780849913 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74017e271f93426890b5da5780849913"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_74017e271f93426890b5da5780849913"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/74017e271f93426890b5da5780849913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/74017e271f93426890b5da5780849913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 74017e271f93426890b5da5780849913 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestServerBasicOps-1286133914 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestServerBasicOps-1286133914-project Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 631ab24a4f8a4d4c9e68df5df4b23274 Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestServerBasicOps-1286133914-project Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'cb375cf9-8508-4b60-b27c-5a1033f4d774'} Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:25:11.896745 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Returning 404 to user: Instance cb375cf9-8508-4b60-b27c-5a1033f4d774 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79bafb2e-be67-4b32-9932-583659ff8fcf tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774" status: 404 len: 111 microversion: 2.1 time: 0.033089 Oct 29 21:25:11.900959 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3106/6311] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:11 2022] GET /compute/v2.1/servers/cb375cf9-8508-4b60-b27c-5a1033f4d774 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:25:12.067355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83864a68-8685-418d-a233-f26244f7ec83 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] Calling method '.version_select at 0x7fa171e52820>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:12.087619 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83864a68-8685-418d-a233-f26244f7ec83 tempest-TestServerBasicOps-1286133914 tempest-TestServerBasicOps-1286133914-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1375333214" status: 202 len: 0 microversion: 2.1 time: 0.024039 Oct 29 21:25:12.088508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3206/6312] 10.222.0.36 () {58 vars in 1254 bytes} [Sat Oct 29 21:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1375333214 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:25:12.319662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:12.320278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:12.327198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:12.327687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:12.328129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:12.329426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:12.329914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:12.330346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:12.470381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:12.478897 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ddcdc20-e953-41ff-b353-1d5473869a06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.163028 Oct 29 21:25:12.479563 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3107/6313] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:12 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:13.507841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:13.508690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:13.516118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:13.516776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:13.517436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:13.518192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:13.518965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:13.519439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:13.668961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:13.677754 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ae24af06-1d12-4654-b891-8179cb6a10ab tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.174823 Oct 29 21:25:13.689492 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3207/6314] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:13 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:14.287728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "name": "network-vif-unplugged", "status": "completed", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:14.307088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:14.307871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:14.308700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:14.338746 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] Creating event network-vif-unplugged:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:25:14.350320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:25:14.366592 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-47d1bec4-ad80-4902-b5a3-55ff39dddad5 req-d71f3632-609d-4692-b214-9474744fa94f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085226 Oct 29 21:25:14.367862 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3108/6315] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:14.705118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:14.705794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:14.719927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:14.720584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:14.721762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:14.722593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:14.723098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:14.723559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:14.959393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:14.968769 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-71e5a7ab-7622-4b20-8d88-27723530c611 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.268295 Oct 29 21:25:14.970912 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3208/6316] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:14 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:15.995934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:15.997581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:16.005698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:16.007068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:16.007989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:16.009400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:16.010103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:16.011205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:16.246113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:16.257415 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec463a62-9126-41da-a101-e6cadb0bd893 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.266525 Oct 29 21:25:16.269922 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3109/6317] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:15 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:16.411557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:16.425674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:16.426247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:16.426979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:16.441024 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] Creating event network-changed:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:25:16.447544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:25:16.458868 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2a7e960c-a9d2-4917-b620-839ac46d528a req-e116f604-fe57-4a11-98ed-9b919d6ecf95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052961 Oct 29 21:25:16.459840 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3209/6318] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:17.285857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:17.286497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:17.293716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:17.294225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:17.294681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:17.295407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:17.296137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:17.296672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:17.612870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:17.620755 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4e60e3d-dd37-43c7-a2c6-1e9433434d6e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1689 microversion: 2.1 time: 0.339180 Oct 29 21:25:17.621337 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3110/6319] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:17 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1689 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:18.646941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:18.648290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:18.663205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:18.664043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:18.664670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:18.665613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:18.669252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:18.670016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:19.010416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:19.022786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4b562f0e-c45a-4716-aca9-a35c0935f4c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1682 microversion: 2.1 time: 0.380608 Oct 29 21:25:19.024236 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3210/6320] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:18 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:20.547980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f313c2d5-def2-4e86-bdc3-5f1914b011b7 req-ed8b2695-4825-4624-a9f8-8142ac659df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "name": "network-vif-plugged", "status": "completed", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:20.567028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=49 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:25:20.571665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f313c2d5-def2-4e86-bdc3-5f1914b011b7 req-ed8b2695-4825-4624-a9f8-8142ac659df7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:20.571665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f313c2d5-def2-4e86-bdc3-5f1914b011b7 req-ed8b2695-4825-4624-a9f8-8142ac659df7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:20.571665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f313c2d5-def2-4e86-bdc3-5f1914b011b7 req-ed8b2695-4825-4624-a9f8-8142ac659df7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:20.583584 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f313c2d5-def2-4e86-bdc3-5f1914b011b7 req-ed8b2695-4825-4624-a9f8-8142ac659df7 service nova] Creating event network-vif-plugged:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:25:20.589039 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f313c2d5-def2-4e86-bdc3-5f1914b011b7 req-ed8b2695-4825-4624-a9f8-8142ac659df7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048245 Oct 29 21:25:20.589904 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3111/6321] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:51.278916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:25:51.279670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=30 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:25:51.450205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:51.452549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:51.458674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:51.459180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:51.459641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:51.460379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:51.460861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:51.461360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:51.534143 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9001d6b-1282-467e-a723-53d81b12d661 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action" status: 200 len: 63073 microversion: 2.1 time: 0.260384 Oct 29 21:25:51.534783 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3211/6322] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:25:51 2022] POST /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d/action => generated 63073 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:25:54.861343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1734960995", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1426309693", "security_groups": [{"name": "tempest-secgroup-smoke-1319913458"}], "block_device_mapping_v2": [{"uuid": "4b580ab1-99d9-4c83-995d-602d8d953016", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61be7916-1aaf-44e0-b8b4-9d255eece552"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:54.873438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=29 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:25:54.874590 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:25:54.877369 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 29 21:25:54.879440 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:25:54.879553 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 29 21:25:54.995678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] validate_networks() for [('61be7916-1aaf-44e0-b8b4-9d255eece552', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:25:55.781201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:25:55.781727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:25:55.782291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:25:55.782711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:25:55.783128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:25:55.792297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:55.792776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:55.793214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:55.793981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:55.794443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:55.794873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:55.812803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:25:55.818706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Getting quotas for user 1254ce210eae494b8c2bfc925b9978c6 and project c1eca42e66ec4ad1b747ef6027e894df. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:25:55.876584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:25:55.878920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b580ab1-99d9-4c83-995d-602d8d953016',volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:25:56.006677 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.151502 Oct 29 21:25:56.007326 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3112/6323] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:25:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:25:56.019164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1e531da-d163-43e0-8ead-f55b363e652f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:56.020099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1e531da-d163-43e0-8ead-f55b363e652f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:56.080346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1e531da-d163-43e0-8ead-f55b363e652f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:56.087646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1e531da-d163-43e0-8ead-f55b363e652f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1095 microversion: 2.1 time: 0.072978 Oct 29 21:25:56.088449 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3212/6324] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:56 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:57.112307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:57.112860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:57.119372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:57.119871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:57.120316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:57.121022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:57.121515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:57.121950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:57.192890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:57.201588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-205643a8-58a1-4791-bc0f-88914fb4a41e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1201 microversion: 2.1 time: 0.094438 Oct 29 21:25:57.209697 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3113/6325] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:57 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:58.225117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:58.225932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:58.233294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:58.233932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:58.234490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:58.235547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:58.236120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:58.236839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:58.383137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:58.391158 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07481b2c-35f2-4f05-b6ae-10cd3ec54ccc tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1279 microversion: 2.1 time: 0.170100 Oct 29 21:25:58.392318 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3213/6326] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:58 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:25:58.514146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-0eca40ca-b081-4517-85a4-f5df4b5f7a0b req-f852afec-51b8-4dff-96e7-958da3e90326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0801560d-f8f0-4e27-b0fe-a40a63a2f578", "tag": "bcf120e0-a7cc-489b-b63e-2bb631574615"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:25:58.526684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0eca40ca-b081-4517-85a4-f5df4b5f7a0b req-f852afec-51b8-4dff-96e7-958da3e90326 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:58.527187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0eca40ca-b081-4517-85a4-f5df4b5f7a0b req-f852afec-51b8-4dff-96e7-958da3e90326 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:58.527648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-0eca40ca-b081-4517-85a4-f5df4b5f7a0b req-f852afec-51b8-4dff-96e7-958da3e90326 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:58.539470 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-0eca40ca-b081-4517-85a4-f5df4b5f7a0b req-f852afec-51b8-4dff-96e7-958da3e90326 service nova] Creating event network-changed:bcf120e0-a7cc-489b-b63e-2bb631574615 for instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 on nch1-master-1 Oct 29 21:25:58.544412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-0eca40ca-b081-4517-85a4-f5df4b5f7a0b req-f852afec-51b8-4dff-96e7-958da3e90326 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034095 Oct 29 21:25:58.545011 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3114/6327] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:25:59.414430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:25:59.415027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:25:59.421987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:59.422491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:59.422948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:59.423659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:25:59.424133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:25:59.424588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:25:59.556521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:25:59.564690 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1d087d0-5516-4e5c-8ed4-fbcd4fb0e7dd tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.154265 Oct 29 21:25:59.565284 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3214/6328] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:25:59 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:00.589763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:00.590530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:00.596880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:00.597375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:00.597856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:00.598567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:00.599033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:00.599471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:00.732348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:00.740277 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4e611710-7527-46b9-87ed-3a66707a408b tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.155845 Oct 29 21:26:00.740857 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3115/6329] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:00 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:01.763432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:01.764093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:01.771624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:01.772136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:01.772586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:01.773294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:01.773811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:01.774258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:01.903581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:01.912437 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef175a6a-dc42-4e16-914f-ce33364ab9a8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.152967 Oct 29 21:26:01.913021 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3215/6330] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:01 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:02.935051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:02.935685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:02.942563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:02.943054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:02.943504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:02.944205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:02.944701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:02.945137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:03.078537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:03.086922 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-98c5578b-c6a1-4f9a-b44d-b72222522fd2 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.156066 Oct 29 21:26:03.087510 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3116/6331] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:02 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:04.109919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:04.110555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:04.118020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:04.118680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:04.119137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:04.119840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:04.120310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:04.120750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:04.258107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:04.265937 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b21c76b9-6f5c-493c-b2ff-d8fd7a1e0266 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.160000 Oct 29 21:26:04.266528 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3216/6332] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:04 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:04.689729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-86195cd9-3b20-4356-a031-2a49bce1997d req-2d9dcfef-9c22-4b5c-9e14-a444da4f4cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0801560d-f8f0-4e27-b0fe-a40a63a2f578", "name": "network-vif-plugged", "status": "completed", "tag": "bcf120e0-a7cc-489b-b63e-2bb631574615"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:04.701353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-86195cd9-3b20-4356-a031-2a49bce1997d req-2d9dcfef-9c22-4b5c-9e14-a444da4f4cce service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:04.701890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-86195cd9-3b20-4356-a031-2a49bce1997d req-2d9dcfef-9c22-4b5c-9e14-a444da4f4cce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:04.702541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-86195cd9-3b20-4356-a031-2a49bce1997d req-2d9dcfef-9c22-4b5c-9e14-a444da4f4cce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:04.714667 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-86195cd9-3b20-4356-a031-2a49bce1997d req-2d9dcfef-9c22-4b5c-9e14-a444da4f4cce service nova] Creating event network-vif-plugged:bcf120e0-a7cc-489b-b63e-2bb631574615 for instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 on nch1-master-1 Oct 29 21:26:04.719615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-86195cd9-3b20-4356-a031-2a49bce1997d req-2d9dcfef-9c22-4b5c-9e14-a444da4f4cce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Oct 29 21:26:04.720224 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3117/6333] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:26:05.288567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:05.288944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:05.295945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:05.296457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:05.296951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:05.297722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:05.298199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:05.298648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:05.431533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:05.439552 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-05de68bd-04b2-41c3-936d-13afe109f4ab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.155200 Oct 29 21:26:05.440773 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3217/6334] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:05 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:26:06.463116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:06.463869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:06.466686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:06.467359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:06.474107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:06.474603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:06.475053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:06.475761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:06.476229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:06.476669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:06.612971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:06.621246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9d3e3439-0dd7-4d4c-8c90-f8515fb2b2c0 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1267 microversion: 2.1 time: 0.162249 Oct 29 21:26:06.621874 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3118/6335] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:06 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:07.645131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:07.645813 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:07.647812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:07.654257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:07.654768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:07.655235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:07.655957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:07.656438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:07.656894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:07.788583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:07.796822 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-67f30c17-6140-48ca-a90b-2715c561ac39 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1453 microversion: 2.1 time: 0.156348 Oct 29 21:26:07.797411 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3218/6336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:07 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:07.818858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:07.819486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:07.826418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:07.826904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:07.827349 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:07.828044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:07.828505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:07.828937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:07.962844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:07.970727 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74d472d7-d89a-4dca-9353-7fe702a17c34 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1453 microversion: 2.1 time: 0.155824 Oct 29 21:26:07.971941 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3119/6337] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:07 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:09.540569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-281ccf5c-9c89-41ff-86d8-3c4c1b865ff1 req-df6a7ccb-98de-4f0f-90c0-85cf9d4e555a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0801560d-f8f0-4e27-b0fe-a40a63a2f578", "tag": "bcf120e0-a7cc-489b-b63e-2bb631574615"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:09.551663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-281ccf5c-9c89-41ff-86d8-3c4c1b865ff1 req-df6a7ccb-98de-4f0f-90c0-85cf9d4e555a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:09.552166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-281ccf5c-9c89-41ff-86d8-3c4c1b865ff1 req-df6a7ccb-98de-4f0f-90c0-85cf9d4e555a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:09.552624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-281ccf5c-9c89-41ff-86d8-3c4c1b865ff1 req-df6a7ccb-98de-4f0f-90c0-85cf9d4e555a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:09.564054 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-281ccf5c-9c89-41ff-86d8-3c4c1b865ff1 req-df6a7ccb-98de-4f0f-90c0-85cf9d4e555a service nova] Creating event network-changed:bcf120e0-a7cc-489b-b63e-2bb631574615 for instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 on nch1-master-1 Oct 29 21:26:09.569117 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-281ccf5c-9c89-41ff-86d8-3c4c1b865ff1 req-df6a7ccb-98de-4f0f-90c0-85cf9d4e555a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032296 Oct 29 21:26:09.569817 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3219/6338] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:26:14.543945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:14.544581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:14.550710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:14.551207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:14.551659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:14.552370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:14.552835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:14.553269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:14.688799 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3a3c073-ab23-4ccd-b351-75b92c596e7f tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1833 microversion: 2.1 time: 0.261515 Oct 29 21:26:14.689313 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3120/6339] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:14 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1833 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:15.586507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:15.587022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-88e93de2-f711-4450-9456-de758fc0a8a6 req-f1f48ecb-7b51-41c0-8fb6-9db43d60deff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:15.587419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:15.601126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-88e93de2-f711-4450-9456-de758fc0a8a6 req-f1f48ecb-7b51-41c0-8fb6-9db43d60deff service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:15.601671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-88e93de2-f711-4450-9456-de758fc0a8a6 req-f1f48ecb-7b51-41c0-8fb6-9db43d60deff service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:15.602177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-88e93de2-f711-4450-9456-de758fc0a8a6 req-f1f48ecb-7b51-41c0-8fb6-9db43d60deff service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:15.606077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:15.606614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:15.607058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:15.607789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:15.608267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:15.608717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:15.620661 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-88e93de2-f711-4450-9456-de758fc0a8a6 req-f1f48ecb-7b51-41c0-8fb6-9db43d60deff service nova] Creating event network-changed:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:26:15.627429 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-88e93de2-f711-4450-9456-de758fc0a8a6 req-f1f48ecb-7b51-41c0-8fb6-9db43d60deff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043900 Oct 29 21:26:15.628076 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3121/6340] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:26:15.651402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:26:15.752449 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6b778a1-b026-468c-bd6b-8ad70d38a94a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 204 len: 0 microversion: 2.1 time: 0.171096 Oct 29 21:26:15.753746 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3220/6341] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:26:15 2022] DELETE /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:26:15.763124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:15.764023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:15.771979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:15.772876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:15.773548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:15.775288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:15.776013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:15.777261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:15.960702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:15.969415 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a88aa3c1-67db-4f9d-83c2-e790c766d4bc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1688 microversion: 2.1 time: 0.210849 Oct 29 21:26:15.982869 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3122/6342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:15 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:26:16.994448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:16.995198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:17.002299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:17.002814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:17.003278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:17.004004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:17.004484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:17.004946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:17.141545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:17.149568 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-686e89ea-5791-4920-85b5-900653ac7fa3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1688 microversion: 2.1 time: 0.159695 Oct 29 21:26:17.150145 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3221/6343] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:16 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:17.881752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c1179d98-8fc5-4348-950a-3dd4a5a3a6f9 req-62c9e3f1-a5f6-4b09-9d0b-fdf666d1e89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbd5458-355c-40b2-8e45-413bd49aa98d", "name": "network-vif-deleted", "tag": "843e4807-46e1-4588-8246-0fbb01a026ef"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:17.894478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c1179d98-8fc5-4348-950a-3dd4a5a3a6f9 req-62c9e3f1-a5f6-4b09-9d0b-fdf666d1e89e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:17.894953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c1179d98-8fc5-4348-950a-3dd4a5a3a6f9 req-62c9e3f1-a5f6-4b09-9d0b-fdf666d1e89e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:17.895388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c1179d98-8fc5-4348-950a-3dd4a5a3a6f9 req-62c9e3f1-a5f6-4b09-9d0b-fdf666d1e89e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:17.908311 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c1179d98-8fc5-4348-950a-3dd4a5a3a6f9 req-62c9e3f1-a5f6-4b09-9d0b-fdf666d1e89e service nova] Creating event network-vif-deleted:843e4807-46e1-4588-8246-0fbb01a026ef for instance 6fbd5458-355c-40b2-8e45-413bd49aa98d on nch1-master-1 Oct 29 21:26:17.914343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c1179d98-8fc5-4348-950a-3dd4a5a3a6f9 req-62c9e3f1-a5f6-4b09-9d0b-fdf666d1e89e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036836 Oct 29 21:26:17.914953 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3123/6344] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:26:18.173875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:18.174514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:18.182608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:18.183348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:18.183817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:18.184582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:18.185149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:18.185537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:18.225914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:18.226421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:18.226871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:18.227344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lazy-loading 'fault' on Instance uuid 6fbd5458-355c-40b2-8e45-413bd49aa98d {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:26:18.270288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:18.278681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08ec8baa-0f19-46a8-b054-685c04585052 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 200 len: 1356 microversion: 2.1 time: 0.108829 Oct 29 21:26:18.279277 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3222/6345] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:18 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:26:19.304319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:19.305042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 6fbd5458-355c-40b2-8e45-413bd49aa98d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:19.312575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:19.313074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:19.313563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:19.314287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:19.314757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:19.315200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:19.330281 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] HTTP exception thrown: Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d could not be found. Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Request method failure captured: Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d HTTP/1.1 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZkiwwqKESTVDGAQICgVPul-ChT-_yLrnA591om_JgqjMDaL5QEWtut9sXT8-Btu3QBQ5deyvuUc44RIKAjyXhMC-8DtRWhkTtXEgXduUmQijUFGS0Sbxjf9yAZyx-9ltHE_HKPl11nE4IgPQ0Pdq0tDxYmL2ScSJKxYLbqUYkEyL-M Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c6bec1dc25f940a491e35c8f471e040d Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d could not be found. Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '6fbd5458-355c-40b2-8e45-413bd49aa98d'} Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d could not be found. Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d could not be found. Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:26:19.331985 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d could not be found. Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Returning 404 to user: Instance 6fbd5458-355c-40b2-8e45-413bd49aa98d could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b85c573-1278-4077-bf48-77eab06069c9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d" status: 404 len: 111 microversion: 2.1 time: 0.034078 Oct 29 21:26:19.336352 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3124/6346] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:19 2022] GET /compute/v2.1/servers/6fbd5458-355c-40b2-8e45-413bd49aa98d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:26:22.343886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-73b4a3d6-09bc-4da6-a25d-ef8ee7bf9dcb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '.version_select at 0x7fa17109b0d0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:22.354343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:22.368899 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-73b4a3d6-09bc-4da6-a25d-ef8ee7bf9dcb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2005339582" status: 202 len: 0 microversion: 2.1 time: 0.029109 Oct 29 21:26:22.369550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3223/6347] 10.222.0.36 () {58 vars in 1284 bytes} [Sat Oct 29 21:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2005339582 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:26:22.405299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c7df9782-a3d0-42ad-a33b-9224ef94066c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: .version_select at 0x7fa1726a2430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1530950878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+moMbnUjs/VNwrMdEAv0ow3eB8YEYUrJh0GrHPWuycmQ/mXDV2KqN61bDFXC4iNmCSW1zmpUVwpg6gr4o5+2mF41rbTr6R16UewrqMdaKXqE+5fMV+9wPr7wq3rJXIbg=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:22.421692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c7df9782-a3d0-42ad-a33b-9224ef94066c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:26:22.427787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-c7df9782-a3d0-42ad-a33b-9224ef94066c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:26:22.455038 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c7df9782-a3d0-42ad-a33b-9224ef94066c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053644 Oct 29 21:26:22.455650 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3125/6348] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:26:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:26:28.808703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:28.813559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1098773057", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "2c5dd98f-2312-430c-836e-ae69f11322d5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1530950878", "security_groups": [{"name": "tempest-secgroup-smoke-1314903509"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:28.951001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] validate_networks() for [('2c5dd98f-2312-430c-836e-ae69f11322d5', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:26:29.471017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:26:29.471469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:26:29.472212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:26:29.472682 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:26:29.473126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:26:29.488022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:29.489071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:29.489568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:29.490329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:29.490809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:29.491258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:29.509376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:26:29.515307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:26:29.528329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:26:29.530739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:26:29.582667 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc804bbf-7619-4a5b-ab35-62197140cc17 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775676 Oct 29 21:26:29.583659 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3224/6349] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:26:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:26:29.593079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=54 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:29.597665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe241aa6-b75a-4cc5-ba6d-8315281e3e5e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:29.598419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fe241aa6-b75a-4cc5-ba6d-8315281e3e5e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:29.600341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:29.688585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fe241aa6-b75a-4cc5-ba6d-8315281e3e5e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:29.696882 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe241aa6-b75a-4cc5-ba6d-8315281e3e5e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1267 microversion: 2.1 time: 0.105503 Oct 29 21:26:29.697722 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3126/6350] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:29 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:26:30.721927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:30.722552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:30.730379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:30.730893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:30.731556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:30.732468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:30.733118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:30.733621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:30.831143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:30.840941 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-041b468b-049a-47b2-a07a-560202ab63e0 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1319 microversion: 2.1 time: 0.123725 Oct 29 21:26:30.841920 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3225/6351] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:30 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1319 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:31.867056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:31.868523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:31.878016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:31.879208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:31.879912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:31.881235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:31.882206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:31.882964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:32.163772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:32.171860 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c41ff19d-cc35-4fc7-a2d0-7207f525bf57 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.311166 Oct 29 21:26:32.172440 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3127/6352] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:31 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:32.556684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ac07b53a-0be2-448a-8eb0-6ba6bba97bff req-55eae612-4606-4067-b7af-459731d25af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:32.570036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ac07b53a-0be2-448a-8eb0-6ba6bba97bff req-55eae612-4606-4067-b7af-459731d25af8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:32.570887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ac07b53a-0be2-448a-8eb0-6ba6bba97bff req-55eae612-4606-4067-b7af-459731d25af8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:32.571484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ac07b53a-0be2-448a-8eb0-6ba6bba97bff req-55eae612-4606-4067-b7af-459731d25af8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:32.583414 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ac07b53a-0be2-448a-8eb0-6ba6bba97bff req-55eae612-4606-4067-b7af-459731d25af8 service nova] Creating event network-changed:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch1-master-1 Oct 29 21:26:32.588892 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ac07b53a-0be2-448a-8eb0-6ba6bba97bff req-55eae612-4606-4067-b7af-459731d25af8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Oct 29 21:26:32.589926 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3226/6353] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:26:33.196393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:33.197094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:33.204364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:33.204882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:33.205340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:33.206090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:33.206553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:33.207013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:33.346665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:33.356569 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af066d0e-79a3-40b5-9d4a-56740d4b17b9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.164237 Oct 29 21:26:33.357179 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3128/6354] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:33 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:26:34.381793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:34.382690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:34.389676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:34.390202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:34.390666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:34.391484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:34.392011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:34.392523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:34.540284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:34.548636 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8147ae3b-f7e8-4977-94a1-be1f4854b3eb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.172488 Oct 29 21:26:34.549323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3227/6355] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:34 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:35.572381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:35.572910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:35.580255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:35.580744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:35.581192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:35.581932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:35.582944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:35.583350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:35.730207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:35.738032 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c31baf2-4c2d-4c37-a19d-278f87bd529c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.169606 Oct 29 21:26:35.749639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3129/6356] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:35 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:36.760386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:36.761016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:36.767936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:36.768440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:36.768894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:36.769641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:36.770117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:36.770559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:36.905173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:36.913685 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7289a614-a51d-4c29-9efe-78a402abcb06 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.157243 Oct 29 21:26:36.914253 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3228/6357] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:36 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:37.935943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:37.936570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:37.943599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:37.944091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:37.944539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:37.945249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:37.945740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:37.946180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:38.082589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:38.090529 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-23395505-c48b-47fc-897c-ca1523b1383b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.158781 Oct 29 21:26:38.091123 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3130/6358] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:37 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:38.811486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a9429053-f144-4a0f-abc9-20b03f5d6341 req-49638d8d-d57c-4654-b72f-cdf3b0b18632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "name": "network-vif-plugged", "status": "completed", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:38.823275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a9429053-f144-4a0f-abc9-20b03f5d6341 req-49638d8d-d57c-4654-b72f-cdf3b0b18632 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:38.823958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a9429053-f144-4a0f-abc9-20b03f5d6341 req-49638d8d-d57c-4654-b72f-cdf3b0b18632 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:38.824516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a9429053-f144-4a0f-abc9-20b03f5d6341 req-49638d8d-d57c-4654-b72f-cdf3b0b18632 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:38.836021 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a9429053-f144-4a0f-abc9-20b03f5d6341 req-49638d8d-d57c-4654-b72f-cdf3b0b18632 service nova] Creating event network-vif-plugged:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch1-master-1 Oct 29 21:26:38.841226 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a9429053-f144-4a0f-abc9-20b03f5d6341 req-49638d8d-d57c-4654-b72f-cdf3b0b18632 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Oct 29 21:26:38.841860 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3229/6359] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:26:39.114017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:39.114649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:39.120764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:39.121268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:39.121773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:39.122491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:39.122974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:39.123402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:39.259660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:39.267545 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a6f15145-9481-47e5-8957-0d334daae22c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.157797 Oct 29 21:26:39.268133 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3131/6360] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:39 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:40.292876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:40.293537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:40.295533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:40.296602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:40.304472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:40.305038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:40.305530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:40.306233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:40.306704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:40.307147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:40.445925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:40.453877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d71232d8-0f97-478d-ba4a-837d552c03bd tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1393 microversion: 2.1 time: 0.165276 Oct 29 21:26:40.454458 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3230/6361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:40 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:41.477376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:41.478044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:41.480003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:26:41.486209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:41.486703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:41.487156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:41.487868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:41.488336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:41.488778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:41.618386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:41.626206 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0e61680-4e93-4295-b9e1-8ace375f0e11 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1566 microversion: 2.1 time: 0.153377 Oct 29 21:26:41.626786 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3132/6362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:41 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:41.650870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:41.651511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:41.659141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:41.659776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:41.660384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:41.661030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:41.661603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:41.662110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:41.796596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:41.804359 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a63a965e-31af-4aa2-ac36-162b86a55812 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1566 microversion: 2.1 time: 0.158166 Oct 29 21:26:41.804938 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3231/6363] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:41 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:26:43.668978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:26:43.669648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:26:43.676386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1ad555cc-c31b-4a01-87ba-a336efbd9817 req-fd23e7e8-b48c-4c4c-8bb7-1ad7a0bf6625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:26:43.676857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:43.676970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:43.677650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:43.678378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:43.678851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:43.679295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:43.687537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ad555cc-c31b-4a01-87ba-a336efbd9817 req-fd23e7e8-b48c-4c4c-8bb7-1ad7a0bf6625 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:26:43.688042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ad555cc-c31b-4a01-87ba-a336efbd9817 req-fd23e7e8-b48c-4c4c-8bb7-1ad7a0bf6625 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:26:43.688498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1ad555cc-c31b-4a01-87ba-a336efbd9817 req-fd23e7e8-b48c-4c4c-8bb7-1ad7a0bf6625 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:26:43.700035 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1ad555cc-c31b-4a01-87ba-a336efbd9817 req-fd23e7e8-b48c-4c4c-8bb7-1ad7a0bf6625 service nova] Creating event network-changed:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch1-master-1 Oct 29 21:26:43.705760 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1ad555cc-c31b-4a01-87ba-a336efbd9817 req-fd23e7e8-b48c-4c4c-8bb7-1ad7a0bf6625 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032952 Oct 29 21:26:43.706548 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3232/6364] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:26:43.892357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:26:43.903888 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-344b2bb2-f260-491a-a279-73b80f297154 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1566 microversion: 2.1 time: 0.238847 Oct 29 21:26:43.904910 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3133/6365] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:26:43 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:27:17.217806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:27:17.218614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=38 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:27:17.223505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:27:17.225892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:17.234527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:17.235030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:17.235485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:17.236201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:17.236672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:17.237116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:17.306753 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3664a695-122c-4e2a-84a3-f62b90fd98e7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action" status: 200 len: 24563 microversion: 2.1 time: 0.091467 Oct 29 21:27:17.307422 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3233/6366] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:27:17 2022] POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action => generated 24563 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:27:56.342724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=17 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:27:56.343582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=42 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:27:56.351019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:27:56.351663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:56.358736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:56.359237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:56.359690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:56.360405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:56.360874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:56.361317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:56.565740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:27:56.573612 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a406ec6b-8bf3-48bf-8312-e5adbc893e45 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1684 microversion: 2.1 time: 0.232872 Oct 29 21:27:56.574190 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3134/6367] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:27:56 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:27:56.667489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:27:56.669859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:56.672477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:27:56.673163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:27:56.681766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:56.682301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:56.682764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:56.683489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:56.683972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:56.684427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:56.759596 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac1957ef-61f7-401f-a6bb-3f0543cffbba tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action" status: 200 len: 32639 microversion: 2.1 time: 0.096639 Oct 29 21:27:56.760170 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3234/6368] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:27:56 2022] POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action => generated 32639 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:27:56.915257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:27:56.915895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:56.922531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:56.923015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:56.923451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:56.924144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:56.924598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:56.925056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:57.052730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a9408e57-f1b3-4d98-8b30-ae352e4a4781 tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1835 microversion: 2.1 time: 0.141140 Oct 29 21:27:57.053257 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3135/6369] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:27:56 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1835 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:27:57.082800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:27:57.085396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:57.093073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:57.093610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:57.094074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:57.094793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:57.095272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:57.095728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:57.121961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lazy-loading 'flavor' on Instance uuid 85f26353-cacc-4b14-8f70-2cb043fb1eb6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:27:57.134017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Going to try to live migrate instance to another host {{(pid=138885) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 21:27:58.745759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:27:58.747015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:58.754874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:58.755923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:58.757063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:58.758083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:58.758767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:58.759420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:58.794701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:27:58.889869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5cfc5292-7e7f-4830-82f4-19ab7476399d tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 204 len: 0 microversion: 2.1 time: 0.147769 Oct 29 21:27:58.891310 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3136/6370] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:27:58 2022] DELETE /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:27:58.899557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5cbfdce7-e269-4ca0-a50a-cafe1ae14c42 req-e67b42cf-f81e-44e7-b3e9-71457e24f19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0801560d-f8f0-4e27-b0fe-a40a63a2f578", "tag": "bcf120e0-a7cc-489b-b63e-2bb631574615"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:27:58.910205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5cbfdce7-e269-4ca0-a50a-cafe1ae14c42 req-e67b42cf-f81e-44e7-b3e9-71457e24f19a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:58.910696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5cbfdce7-e269-4ca0-a50a-cafe1ae14c42 req-e67b42cf-f81e-44e7-b3e9-71457e24f19a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:58.911136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5cbfdce7-e269-4ca0-a50a-cafe1ae14c42 req-e67b42cf-f81e-44e7-b3e9-71457e24f19a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:58.924333 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5cbfdce7-e269-4ca0-a50a-cafe1ae14c42 req-e67b42cf-f81e-44e7-b3e9-71457e24f19a service nova] Creating event network-changed:bcf120e0-a7cc-489b-b63e-2bb631574615 for instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 on nch1-master-1 Oct 29 21:27:58.931607 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5cbfdce7-e269-4ca0-a50a-cafe1ae14c42 req-e67b42cf-f81e-44e7-b3e9-71457e24f19a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037669 Oct 29 21:27:58.932498 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3137/6371] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:27:58.938865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:27:58.939701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:27:58.945966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:58.946722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:58.947217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:58.948002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:27:58.948330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:27:58.948769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:27:59.105238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:27:59.113802 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a0d9deee-45f8-4c17-acdc-9ff67f86fdab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1578 microversion: 2.1 time: 0.179941 Oct 29 21:27:59.125717 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3138/6372] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:27:58 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:00.137804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:00.138434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:00.147040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:00.147536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:00.147988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:00.148705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:00.149173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:00.149647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:00.317971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:00.325843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d9692d29-bbc1-467f-9559-c87af026f11f tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1578 microversion: 2.1 time: 0.191986 Oct 29 21:28:00.326431 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3139/6373] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:00 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:01.240636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c20c47bd-5157-4486-a157-6e302d345493 req-3e95a36f-011d-4e86-8668-80a5def68f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0801560d-f8f0-4e27-b0fe-a40a63a2f578", "name": "network-vif-deleted", "tag": "bcf120e0-a7cc-489b-b63e-2bb631574615"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:01.253102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c20c47bd-5157-4486-a157-6e302d345493 req-3e95a36f-011d-4e86-8668-80a5def68f87 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:01.253723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c20c47bd-5157-4486-a157-6e302d345493 req-3e95a36f-011d-4e86-8668-80a5def68f87 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:01.254174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c20c47bd-5157-4486-a157-6e302d345493 req-3e95a36f-011d-4e86-8668-80a5def68f87 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:01.267800 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c20c47bd-5157-4486-a157-6e302d345493 req-3e95a36f-011d-4e86-8668-80a5def68f87 service nova] Creating event network-vif-deleted:bcf120e0-a7cc-489b-b63e-2bb631574615 for instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 on nch1-master-1 Oct 29 21:28:01.273795 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c20c47bd-5157-4486-a157-6e302d345493 req-3e95a36f-011d-4e86-8668-80a5def68f87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036922 Oct 29 21:28:01.274470 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3140/6374] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:28:01.350479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:01.351199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:01.366858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:01.367359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:01.367805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:01.368583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:01.369046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:01.369502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:01.448372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:01.458264 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2605a093-b6ea-4d23-91c6-7212d408eeb3 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 200 len: 1226 microversion: 2.1 time: 0.113606 Oct 29 21:28:01.461490 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3141/6375] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:01 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:28:01.510671 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2a2b5451-7b26-4b62-9714-781f4543efda tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action" status: 202 len: 0 microversion: 2.1 time: 4.431927 Oct 29 21:28:01.511550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3235/6376] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:27:57 2022] POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action => generated 0 bytes in 4434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:28:01.529567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:01.530525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:01.536766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:01.537274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:01.537761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:01.538493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:01.538968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:01.539422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:01.725852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:01.734223 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef9c107a-0321-4737-8919-471e4fd30183 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.217277 Oct 29 21:28:01.735600 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3142/6377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:01 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:28:02.481653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:02.482304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 0801560d-f8f0-4e27-b0fe-a40a63a2f578] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:02.490393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:02.490906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:02.491371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:02.492097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:02.492613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:02.493067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:02.508786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 could not be found. Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 HTTP/1.1 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 could not be found. Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '0801560d-f8f0-4e27-b0fe-a40a63a2f578'} Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 could not be found. Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 could not be found. Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:02.510536 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 could not be found. Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 0801560d-f8f0-4e27-b0fe-a40a63a2f578 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-89e55608-9d54-4581-a51d-2585695e415c tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578" status: 404 len: 111 microversion: 2.1 time: 0.034325 Oct 29 21:28:02.515144 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3236/6378] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:02 2022] GET /compute/v2.1/servers/0801560d-f8f0-4e27-b0fe-a40a63a2f578 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:28:02.718263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c1bb6793-79ed-4851-a0f9-d3ec3a50e2cc req-1335eb8b-483e-44bf-bce5-960207c2cbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "name": "network-vif-unplugged", "status": "completed", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:02.729413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c1bb6793-79ed-4851-a0f9-d3ec3a50e2cc req-1335eb8b-483e-44bf-bce5-960207c2cbc1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:02.729928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c1bb6793-79ed-4851-a0f9-d3ec3a50e2cc req-1335eb8b-483e-44bf-bce5-960207c2cbc1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:02.730385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c1bb6793-79ed-4851-a0f9-d3ec3a50e2cc req-1335eb8b-483e-44bf-bce5-960207c2cbc1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:02.743803 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c1bb6793-79ed-4851-a0f9-d3ec3a50e2cc req-1335eb8b-483e-44bf-bce5-960207c2cbc1 service nova] Creating event network-vif-unplugged:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch1-master-1 Oct 29 21:28:02.750015 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c1bb6793-79ed-4851-a0f9-d3ec3a50e2cc req-1335eb8b-483e-44bf-bce5-960207c2cbc1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036437 Oct 29 21:28:02.750834 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3143/6379] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:28:02.760505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:02.761142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:02.768173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:02.768681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:02.769794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:02.770525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:02.771000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:02.771451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:03.084953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:03.099242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b54b845-4752-4ce7-b09f-9b2e9906b8c6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.342572 Oct 29 21:28:03.100023 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3237/6380] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:02 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:04.124700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:04.125419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:04.131656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:04.132152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:04.132606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:04.133310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:04.133834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:04.134276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:04.271869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:04.280237 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-89749c0f-8a53-4a74-960a-8e955cddb010 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.160140 Oct 29 21:28:04.280808 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3144/6381] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:04 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:04.767158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9308d047-db52-4f83-a5fc-509afce31349 req-d8563d22-0be1-4e11-a646-fc56e16ffdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:04.778702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9308d047-db52-4f83-a5fc-509afce31349 req-d8563d22-0be1-4e11-a646-fc56e16ffdf8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:04.779204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9308d047-db52-4f83-a5fc-509afce31349 req-d8563d22-0be1-4e11-a646-fc56e16ffdf8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:04.780193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9308d047-db52-4f83-a5fc-509afce31349 req-d8563d22-0be1-4e11-a646-fc56e16ffdf8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:04.790485 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9308d047-db52-4f83-a5fc-509afce31349 req-d8563d22-0be1-4e11-a646-fc56e16ffdf8 service nova] Creating event network-changed:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch1-master-1 Oct 29 21:28:04.796289 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9308d047-db52-4f83-a5fc-509afce31349 req-d8563d22-0be1-4e11-a646-fc56e16ffdf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032311 Oct 29 21:28:04.796890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3238/6382] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:28:05.305333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:05.305993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:05.313527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:05.314035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:05.314501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:05.315246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:05.315720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:05.316163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:05.450242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:05.458775 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e29cde94-4e0d-4a6b-ae96-625b6c235681 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.157454 Oct 29 21:28:05.459355 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3145/6383] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:05 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:06.483869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:06.484520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:06.490887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:06.491402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:06.491870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:06.492599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:06.493090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:06.493590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:06.627035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:06.634984 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edb55b39-b6ab-4884-8841-40e63f6b4a66 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.156369 Oct 29 21:28:06.635658 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3239/6384] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:06 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:07.659187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:07.659814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:07.666827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:07.667325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:07.667774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:07.668479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:07.668946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:07.669384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:07.805521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:07.814251 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b09a1c6-be36-4d14-bd37-1300e255024c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.159605 Oct 29 21:28:07.814843 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3146/6385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:07 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:08.838607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:08.839301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:08.846961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:08.847471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:08.847944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:08.848665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:08.849143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:08.849662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:08.987795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:08.995778 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3f0d7f79-8353-44ae-a02b-9ea5bfdc0234 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.161071 Oct 29 21:28:08.996569 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3240/6386] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:08 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:10.019724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:10.020352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:10.027128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:10.027659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:10.028243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:10.028964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:10.030138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:10.030584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:10.183056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:10.191394 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b12a9883-0b52-408a-8509-96310e9ebb4f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1694 microversion: 2.1 time: 0.175699 Oct 29 21:28:10.191969 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3147/6387] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:10 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:11.215785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:11.216428 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:11.223588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.224097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.224551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.225270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.225777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.226226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.369509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:11.378391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-645fa0ca-7921-44e2-ae3f-410c46f2a1fc tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1684 microversion: 2.1 time: 0.167270 Oct 29 21:28:11.378983 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3241/6388] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:11 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:11.400957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:11.401655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:11.408606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.409104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.409599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.410307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.410779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.411220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.544300 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-65c9f63d-c799-4304-a903-0f4462524c8b tempest-TestNetworkAdvancedServerOps-1091492572 tempest-TestNetworkAdvancedServerOps-1091492572-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1835 microversion: 2.1 time: 0.147087 Oct 29 21:28:11.544882 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3148/6389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:11 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1835 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:11.568420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:11.569059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:11.575101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.575603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.576061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.576808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.577287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.577768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.708859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:11.716792 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e52eac35-f3fc-4702-a369-c05e14267b82 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1684 microversion: 2.1 time: 0.152269 Oct 29 21:28:11.717950 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3242/6390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:11 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:11.817683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:11.819935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:11.825960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.826970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.827416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.828121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:11.828602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:11.829036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:11.896198 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-549eb634-18a9-4d12-a7c0-8c70b42b645a tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action" status: 200 len: 38378 microversion: 2.1 time: 0.082341 Oct 29 21:28:11.897002 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3149/6391] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:28:11 2022] POST /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6/action => generated 38378 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:28:12.867600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:12.868127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:12.870107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-41d5b740-a1d8-431c-a99c-fd992a4970ac req-3f28ecaa-31d1-401f-9099-467c685716d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:12.876020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:12.876548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:12.877011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:12.877775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:12.878473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:12.878929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:12.882620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-41d5b740-a1d8-431c-a99c-fd992a4970ac req-3f28ecaa-31d1-401f-9099-467c685716d3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:12.883184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-41d5b740-a1d8-431c-a99c-fd992a4970ac req-3f28ecaa-31d1-401f-9099-467c685716d3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:12.883911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-41d5b740-a1d8-431c-a99c-fd992a4970ac req-3f28ecaa-31d1-401f-9099-467c685716d3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:12.897394 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-41d5b740-a1d8-431c-a99c-fd992a4970ac req-3f28ecaa-31d1-401f-9099-467c685716d3 service nova] Creating event network-changed:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch2-master-1 Oct 29 21:28:12.902824 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-41d5b740-a1d8-431c-a99c-fd992a4970ac req-3f28ecaa-31d1-401f-9099-467c685716d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037024 Oct 29 21:28:12.903635 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3150/6392] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:28:12.906581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:28:13.008207 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6f17d31-1e45-4666-9e23-ee165517a1bf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 204 len: 0 microversion: 2.1 time: 0.144684 Oct 29 21:28:13.008994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3243/6393] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:28:12 2022] DELETE /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:28:13.018670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:13.019816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:13.026672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:13.027439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:13.028063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:13.028976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:13.030371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:13.030983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:13.209126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:13.212876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:13.219325 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96486140-6d30-4980-a2be-ca941670bbd8 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1690 microversion: 2.1 time: 0.205526 Oct 29 21:28:13.219930 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3151/6394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:13 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:14.224133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2e2b68ce-f815-41da-9349-16976868d523 req-0cfbeb33-777e-414d-b2b7-ba46d959cc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f26353-cacc-4b14-8f70-2cb043fb1eb6", "name": "network-vif-deleted", "tag": "9f727600-9ac2-466e-9625-a018b4198a8a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:14.236567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e2b68ce-f815-41da-9349-16976868d523 req-0cfbeb33-777e-414d-b2b7-ba46d959cc83 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:14.237065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e2b68ce-f815-41da-9349-16976868d523 req-0cfbeb33-777e-414d-b2b7-ba46d959cc83 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:14.238945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2e2b68ce-f815-41da-9349-16976868d523 req-0cfbeb33-777e-414d-b2b7-ba46d959cc83 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:14.244200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:14.244833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:14.249248 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2e2b68ce-f815-41da-9349-16976868d523 req-0cfbeb33-777e-414d-b2b7-ba46d959cc83 service nova] Creating event network-vif-deleted:9f727600-9ac2-466e-9625-a018b4198a8a for instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 on nch2-master-1 Oct 29 21:28:14.254481 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2e2b68ce-f815-41da-9349-16976868d523 req-0cfbeb33-777e-414d-b2b7-ba46d959cc83 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034318 Oct 29 21:28:14.255015 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3244/6395] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:28:14.257804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:14.258314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:14.258867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:14.259484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:14.260054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:14.260382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:14.328796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:14.336522 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16395abb-6e25-4019-ae0b-f3ac80af06df tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 200 len: 1352 microversion: 2.1 time: 0.096262 Oct 29 21:28:14.337112 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3152/6396] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:14 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:15.362543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:15.363275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: 85f26353-cacc-4b14-8f70-2cb043fb1eb6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:15.369671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:15.370174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:15.370633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:15.371343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:15.371815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:15.372261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:15.386155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] HTTP exception thrown: Instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 could not be found. Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Request method failure captured: Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 HTTP/1.1 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZkiwwqKESTVDGAQICgVPul-ChT-_yLrnA591om_JgqjMDaL5QEWtut9sXT8-Btu3QBQ5deyvuUc44RIKAjyXhMC-8DtRWhkTtXEgXduUmQijUFGS0Sbxjf9yAZyx-9ltHE_HKPl11nE4IgPQ0Pdq0tDxYmL2ScSJKxYLbqUYkEyL-M Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c6bec1dc25f940a491e35c8f471e040d Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 could not be found. Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '85f26353-cacc-4b14-8f70-2cb043fb1eb6'} Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 could not be found. Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 could not be found. Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:15.387824 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 could not be found. Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Returning 404 to user: Instance 85f26353-cacc-4b14-8f70-2cb043fb1eb6 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0897c976-9c1d-4c40-9d09-60e733ac4b3e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6" status: 404 len: 111 microversion: 2.1 time: 0.032699 Oct 29 21:28:15.393086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3245/6397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:15 2022] GET /compute/v2.1/servers/85f26353-cacc-4b14-8f70-2cb043fb1eb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:28:18.775247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c81b7b2d-7591-4e6b-bd64-0b21b6c4fc60 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '.version_select at 0x7fa176205940>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:18.797771 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c81b7b2d-7591-4e6b-bd64-0b21b6c4fc60 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1530950878" status: 202 len: 0 microversion: 2.1 time: 0.026290 Oct 29 21:28:18.798291 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3153/6398] 10.222.0.36 () {58 vars in 1284 bytes} [Sat Oct 29 21:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1530950878 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:28:18.829317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1abe9ccc-a8af-4c70-b85f-a6e0d3790377 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: .version_select at 0x7fa171087670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-277307261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFwKaGxPYLD7cW3sbHww3xEbWgIm2I9u/ViaG4R0x623FLz36fwBDz90SuXY8hBCJDx+TAk9Yd7zpKLvE5g+XLZUydb0wjtpEueCWHxT5rWLKNhcyx2X/XTz96S9oK2Qw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:18.847399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1abe9ccc-a8af-4c70-b85f-a6e0d3790377 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:28:18.852645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-1abe9ccc-a8af-4c70-b85f-a6e0d3790377 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:28:18.875817 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1abe9ccc-a8af-4c70-b85f-a6e0d3790377 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050949 Oct 29 21:28:18.876409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3246/6399] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:28:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:28:24.485590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-41636947", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "20f41320-c0cc-4ed7-8f6d-a1f5976df3ac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-277307261", "security_groups": [{"name": "tempest-secgroup-smoke-1706150163"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:24.498433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:24.601227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] validate_networks() for [('20f41320-c0cc-4ed7-8f6d-a1f5976df3ac', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:28:25.016934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:28:25.017378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:28:25.017917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:28:25.018343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:28:25.018779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:28:25.029134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:25.029855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:25.030310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:25.031100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:25.031572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:25.032039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:25.055124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:28:25.060558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Getting quotas for user c6bec1dc25f940a491e35c8f471e040d and project b47bfc6cf9c143fd861d1fae9eb779fd. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:28:25.074888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:28:25.077279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:28:25.139753 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad8c13d8-fd76-428b-a66b-668281a77089 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658604 Oct 29 21:28:25.141404 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3154/6400] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:28:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:28:25.155411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-877d3cba-6068-43f2-95ea-4403d0f1eb98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:25.156438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-877d3cba-6068-43f2-95ea-4403d0f1eb98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:25.237737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-877d3cba-6068-43f2-95ea-4403d0f1eb98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:25.248718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-877d3cba-6068-43f2-95ea-4403d0f1eb98 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1264 microversion: 2.1 time: 0.099533 Oct 29 21:28:25.249470 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3247/6401] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:25 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1264 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:28:26.274520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:26.275800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:26.283176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:26.283685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:26.284129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:26.284858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:26.285431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:26.285896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:26.352222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:26.362850 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-73559f7c-357b-45d6-83d8-a9771b8d7957 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1316 microversion: 2.1 time: 0.093800 Oct 29 21:28:26.363562 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3155/6402] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:26 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:27.388190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:27.389136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:27.405181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:27.409050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:27.434859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:27.435671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:27.436710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:27.438828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:27.439839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:27.440762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:27.671233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:27.681310 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f0624778-18f7-4399-b46c-9ddc94eff39e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.297881 Oct 29 21:28:27.682788 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3248/6403] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:27 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:28.291761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-171ac678-e52b-4655-bdad-ed233a3dbd43 req-6310e30c-4236-4e8e-8325-e42c5010b571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:28.298498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:28.307788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-171ac678-e52b-4655-bdad-ed233a3dbd43 req-6310e30c-4236-4e8e-8325-e42c5010b571 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:28.308289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-171ac678-e52b-4655-bdad-ed233a3dbd43 req-6310e30c-4236-4e8e-8325-e42c5010b571 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:28.308946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-171ac678-e52b-4655-bdad-ed233a3dbd43 req-6310e30c-4236-4e8e-8325-e42c5010b571 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:28.323406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-171ac678-e52b-4655-bdad-ed233a3dbd43 req-6310e30c-4236-4e8e-8325-e42c5010b571 service nova] Creating event network-changed:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:28:28.329340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-171ac678-e52b-4655-bdad-ed233a3dbd43 req-6310e30c-4236-4e8e-8325-e42c5010b571 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Oct 29 21:28:28.329988 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3156/6404] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:28:28.708282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:28.708926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:28.716098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:28.716535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:28.717002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:28.717746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:28.718222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:28.719177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:28.862466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:28.870919 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9db897f-b124-4b53-8f99-3863f55e66be tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.166626 Oct 29 21:28:28.871519 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3249/6405] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:28 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:29.896530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:29.897288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:29.904506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:29.905127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:29.905602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:29.906935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:29.907396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:29.907833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:30.039687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:30.047731 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e3f68894-7787-4a66-aed0-bbeab2a91b21 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.156523 Oct 29 21:28:30.048299 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3157/6406] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:29 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:31.071270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:31.072016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:31.079810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:31.080330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:31.080797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:31.081558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:31.082130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:31.082492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:31.224028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:31.232326 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab310e73-d3f1-43fe-9117-330ae034461c tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.165149 Oct 29 21:28:31.232974 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3250/6407] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:31 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:32.255233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:32.255859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:32.262778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:32.263272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:32.263724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:32.264428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:32.264927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:32.265364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:32.396781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:32.404577 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27841973-f94c-4bfe-bb60-a2dfd95e211e tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.153344 Oct 29 21:28:32.405157 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3158/6408] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:32 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:33.427796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:33.428425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:33.435513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:33.436016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:33.436817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:33.438080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:33.438554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:33.438998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:33.464693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-304dac4e-88a1-4702-9bc9-2ba15960054e req-c617b541-c93c-4938-a574-2ea8b5d345ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "name": "network-vif-plugged", "status": "completed", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:33.487101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-304dac4e-88a1-4702-9bc9-2ba15960054e req-c617b541-c93c-4938-a574-2ea8b5d345ce service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:33.487688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-304dac4e-88a1-4702-9bc9-2ba15960054e req-c617b541-c93c-4938-a574-2ea8b5d345ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:33.488205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-304dac4e-88a1-4702-9bc9-2ba15960054e req-c617b541-c93c-4938-a574-2ea8b5d345ce service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:33.500397 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-304dac4e-88a1-4702-9bc9-2ba15960054e req-c617b541-c93c-4938-a574-2ea8b5d345ce service nova] Creating event network-vif-plugged:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:28:33.505753 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-304dac4e-88a1-4702-9bc9-2ba15960054e req-c617b541-c93c-4938-a574-2ea8b5d345ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044867 Oct 29 21:28:33.506370 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3159/6409] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:28:33.587042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:33.595296 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5631dd5d-5c34-47f4-a58b-9b7b0f862ae5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.171501 Oct 29 21:28:33.595876 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3251/6410] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:33 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:34.619899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:34.620620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:34.626985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:34.627478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:34.627928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:34.628632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:34.629098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:34.629638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:34.854004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:34.861810 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e6486ac-c54a-4f75-bf2f-cb4b2af55160 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1390 microversion: 2.1 time: 0.246903 Oct 29 21:28:34.862339 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3160/6411] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:34 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:35.864685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:35.865206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:35.868127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:35.868395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:35.869423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:28:35.873933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:35.874679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:35.875250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:35.875815 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:35.876359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:35.876865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:35.905937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:28:35.940794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a6291cf5-db8f-4c1b-b0e3-25efad7e278c req-6d4e8f49-e79d-46d0-8242-5efebeb5ede2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9993452-3bb0-4590-8b31-aa7c97036004", "tag": "8cba055f-a882-4227-ba71-63651132f25c"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:35.953867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a6291cf5-db8f-4c1b-b0e3-25efad7e278c req-6d4e8f49-e79d-46d0-8242-5efebeb5ede2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:35.954466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a6291cf5-db8f-4c1b-b0e3-25efad7e278c req-6d4e8f49-e79d-46d0-8242-5efebeb5ede2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:35.954977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a6291cf5-db8f-4c1b-b0e3-25efad7e278c req-6d4e8f49-e79d-46d0-8242-5efebeb5ede2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:35.968025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a6291cf5-db8f-4c1b-b0e3-25efad7e278c req-6d4e8f49-e79d-46d0-8242-5efebeb5ede2 service nova] Creating event network-changed:8cba055f-a882-4227-ba71-63651132f25c for instance a9993452-3bb0-4590-8b31-aa7c97036004 on nch2-master-1 Oct 29 21:28:35.974320 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a6291cf5-db8f-4c1b-b0e3-25efad7e278c req-6d4e8f49-e79d-46d0-8242-5efebeb5ede2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110499 Oct 29 21:28:35.975033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3161/6412] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:28:35.982305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:35.983032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:35.993792 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4c8f399-684f-473e-8b41-884ebf8def7e tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 204 len: 0 microversion: 2.1 time: 0.132591 Oct 29 21:28:35.994963 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3252/6413] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:28:35 2022] DELETE /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:28:36.006507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:36.006735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:36.007021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:36.007475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:36.007999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:36.008216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:36.008685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:36.011379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:36.018890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:36.019719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:36.020180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:36.021011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:36.021759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:36.022394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:36.228375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:36.236482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:36.238776 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7adcb80d-978d-4bfd-8232-3c256b50d5a1 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1578 microversion: 2.1 time: 0.237924 Oct 29 21:28:36.239595 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3253/6414] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:35 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1578 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:36.244421 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6a6d9918-ffc1-4ed7-a116-a4be2d5027e5 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1562 microversion: 2.1 time: 0.267768 Oct 29 21:28:36.255472 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3162/6415] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:35 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1562 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:36.269515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:36.270412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:36.276707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:36.277218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:36.277712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:36.278466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:36.278950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:36.279395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:36.417669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:36.425623 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-307164bf-db66-40d7-903b-dcf9a75d8fc2 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1562 microversion: 2.1 time: 0.161110 Oct 29 21:28:36.426209 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3254/6416] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:36 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:37.264434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:37.265086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:37.272183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:37.272673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:37.273116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:37.274077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:37.274545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:37.274976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:37.422987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:37.431077 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6a793d87-81e2-443e-80a6-d1965e7f8bd8 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1578 microversion: 2.1 time: 0.170662 Oct 29 21:28:37.431759 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3163/6417] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:37 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:38.236392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c95b7599-4030-4ccb-a236-829e6e091caa req-8771d52b-7e9d-419b-a4c9-8dd90176d81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9993452-3bb0-4590-8b31-aa7c97036004", "name": "network-vif-deleted", "tag": "8cba055f-a882-4227-ba71-63651132f25c"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:38.248438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c95b7599-4030-4ccb-a236-829e6e091caa req-8771d52b-7e9d-419b-a4c9-8dd90176d81b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.249236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c95b7599-4030-4ccb-a236-829e6e091caa req-8771d52b-7e9d-419b-a4c9-8dd90176d81b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.250394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c95b7599-4030-4ccb-a236-829e6e091caa req-8771d52b-7e9d-419b-a4c9-8dd90176d81b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.263191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c95b7599-4030-4ccb-a236-829e6e091caa req-8771d52b-7e9d-419b-a4c9-8dd90176d81b service nova] Creating event network-vif-deleted:8cba055f-a882-4227-ba71-63651132f25c for instance a9993452-3bb0-4590-8b31-aa7c97036004 on nch2-master-1 Oct 29 21:28:38.268730 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c95b7599-4030-4ccb-a236-829e6e091caa req-8771d52b-7e9d-419b-a4c9-8dd90176d81b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037868 Oct 29 21:28:38.269361 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3255/6418] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:28:38.453850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:38.454531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:38.462214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.463041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.463708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.464854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.465391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.465933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.501961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.502559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.503090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.503624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lazy-loading 'fault' on Instance uuid a9993452-3bb0-4590-8b31-aa7c97036004 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:28:38.556965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1254ce210eae494b8c2bfc925b9978c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1eca42e66ec4ad1b747ef6027e894df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:38.567553 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e7f0051c-9b22-41ab-a5cf-0fdeb09766b6 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 200 len: 1396 microversion: 2.1 time: 0.117499 Oct 29 21:28:38.584080 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3164/6419] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:38 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 1396 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:38.713819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:38.714709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cc8cbb2d-caea-4d6c-afb4-e96f1154a0ce req-d69c8e2f-ed06-4760-8436-f3b9dc41c3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:28:38.714983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:38.723694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.724762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.725208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.726209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.726847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.727488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.732754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cc8cbb2d-caea-4d6c-afb4-e96f1154a0ce req-d69c8e2f-ed06-4760-8436-f3b9dc41c3ad service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:38.733862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cc8cbb2d-caea-4d6c-afb4-e96f1154a0ce req-d69c8e2f-ed06-4760-8436-f3b9dc41c3ad service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:38.735049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cc8cbb2d-caea-4d6c-afb4-e96f1154a0ce req-d69c8e2f-ed06-4760-8436-f3b9dc41c3ad service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:38.746976 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cc8cbb2d-caea-4d6c-afb4-e96f1154a0ce req-d69c8e2f-ed06-4760-8436-f3b9dc41c3ad service nova] Creating event network-changed:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:28:38.752119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cc8cbb2d-caea-4d6c-afb4-e96f1154a0ce req-d69c8e2f-ed06-4760-8436-f3b9dc41c3ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041630 Oct 29 21:28:38.752805 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3165/6420] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:28:38.873367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:28:38.882211 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb0608db-906d-4b81-b680-0a512f1cac53 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1562 microversion: 2.1 time: 0.173142 Oct 29 21:28:38.883018 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3256/6421] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:38 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:28:39.593500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:39.594237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: a9993452-3bb0-4590-8b31-aa7c97036004] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:39.600715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:39.601218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:39.601700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:39.602415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:39.602882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:39.603319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:39.618278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance a9993452-3bb0-4590-8b31-aa7c97036004 could not be found. Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 HTTP/1.1 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance a9993452-3bb0-4590-8b31-aa7c97036004 could not be found. Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'a9993452-3bb0-4590-8b31-aa7c97036004'} Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9993452-3bb0-4590-8b31-aa7c97036004 could not be found. Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9993452-3bb0-4590-8b31-aa7c97036004 could not be found. Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:39.619994 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9993452-3bb0-4590-8b31-aa7c97036004 could not be found. Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance a9993452-3bb0-4590-8b31-aa7c97036004 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91a5aa8e-4cb6-485b-92f9-1cbc74d93537 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004" status: 404 len: 111 microversion: 2.1 time: 0.034285 Oct 29 21:28:39.625615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3166/6422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:39 2022] GET /compute/v2.1/servers/a9993452-3bb0-4590-8b31-aa7c97036004 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:28:40.094506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:40.095022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:40.101843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:40.102343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:40.102792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:40.103491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:40.103958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:40.104403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:40.118460 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb HTTP/1.1 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '470a094a-d503-4055-819c-306c001ab9fb'} Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:28:40.120111 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-491fefa4-9c02-4660-84df-9a901eed0987 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 404 len: 111 microversion: 2.1 time: 0.031444 Oct 29 21:28:40.124217 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3257/6423] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:28:40 2022] DELETE /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:28:40.130112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:40.130730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] [instance: 470a094a-d503-4055-819c-306c001ab9fb] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:28:40.136899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:40.137387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:40.137854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:40.138553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:28:40.139014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:28:40.139444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:28:40.152936 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] HTTP exception thrown: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Request method failure captured: Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb HTTP/1.1 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZi7-_f6oH9DsextRz99E08ecdyjBLOQPxzeymwptwybJ04Pcap9ChRp2exlgWtEeflkMNDeWwCer0mPioB9bXcwbs6v1SZRVL0HAVu3KLsXcB3Yxu6AgWQLk7xwNCzb3TFQiEsgdtumDRjt2fUHTAIoL2ZI2Fnhwu6Ed1VFd-G8lH0 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c1eca42e66ec4ad1b747ef6027e894df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c1eca42e66ec4ad1b747ef6027e894df Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBootPattern-1121030847 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1254ce210eae494b8c2bfc925b9978c6 Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBootPattern-1121030847-project Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '470a094a-d503-4055-819c-306c001ab9fb'} Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:28:40.154479 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Returning 404 to user: Instance 470a094a-d503-4055-819c-306c001ab9fb could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-496d408a-090b-4d94-9987-a0875a11bb20 tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb" status: 404 len: 111 microversion: 2.1 time: 0.029621 Oct 29 21:28:40.159328 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3167/6424] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:28:40 2022] GET /compute/v2.1/servers/470a094a-d503-4055-819c-306c001ab9fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:28:41.450098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d109ed87-bcc3-4eb7-a7ee-f7bc48c94fab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] Calling method '.version_select at 0x7fa17626aca0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:28:41.473669 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d109ed87-bcc3-4eb7-a7ee-f7bc48c94fab tempest-TestVolumeBootPattern-1121030847 tempest-TestVolumeBootPattern-1121030847-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1426309693" status: 202 len: 0 microversion: 2.1 time: 0.027344 Oct 29 21:28:41.474609 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3258/6425] 10.222.0.36 () {58 vars in 1263 bytes} [Sat Oct 29 21:28:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1426309693 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:29:12.206217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:29:12.208459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:12.210959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=25 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:29:12.212379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=58 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:29:12.217735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:12.218236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:12.218692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:12.219929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:12.220394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:12.220833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:12.290552 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca0f613c-38dd-4c45-b16a-e42c38621bb7 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366/action" status: 200 len: 24571 microversion: 2.1 time: 0.088238 Oct 29 21:29:12.291114 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3168/6426] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:29:12 2022] POST /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:29:42.699507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:29:42.700287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:29:42.706037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:29:42.708809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:42.718203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:42.718708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:42.719166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:42.719885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:42.721019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:42.721491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:42.799359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:29:42.799807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:29:42.800303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:29:42.800732 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:29:42.801164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:29:42.860619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:42.866797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:42.867320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:42.867783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:42.868515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:42.868993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:42.869444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:42.901418 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-82fceab2-969f-49be-ba41-3f6aeff022d6 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366/action" status: 202 len: 1136 microversion: 2.1 time: 0.203921 Oct 29 21:29:42.902318 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3259/6427] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:29:42 2022] POST /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366/action => generated 1136 bytes in 205 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 21:29:42.922689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:42.923408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:42.926882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:29:42.927803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:29:42.936076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:42.936581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:42.937033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:42.937787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:42.938532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:42.939479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:43.076736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:43.086101 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a164a60c-7d80-4400-aa31-c395c2c3eee9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.167595 Oct 29 21:29:43.086610 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3169/6428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:42 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:44.111033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:44.111667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:44.119190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:44.119721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:44.120189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:44.120900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:44.121417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:44.121897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:44.254665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:44.262536 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2cf6486-fc9a-49c7-a326-6bc95a53365d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.155569 Oct 29 21:29:44.263139 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3260/6429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:44 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:45.287325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:45.287957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:45.294972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:45.295463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:45.295917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:45.296620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:45.297083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:45.297557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:45.731893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:45.739766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca00bda0-3d65-467f-8ec0-923b1e52b0c1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.456908 Oct 29 21:29:45.740343 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3170/6430] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:45 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:46.763250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:46.763884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:46.770924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:46.771427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:46.771883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:46.772591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:46.773061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:46.773531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:46.906572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:46.914966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4f6375ba-7d40-4165-a737-111bb8af7528 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.155711 Oct 29 21:29:46.915556 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3261/6431] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:46 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:47.939321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:47.939946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:47.946809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:47.947290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:47.947728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:47.948420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:47.948878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:47.949308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:48.082188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:48.090824 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d5ba2bbb-7eeb-4244-b5fc-46c53a5ed6d1 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.155697 Oct 29 21:29:48.091387 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3171/6432] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:47 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:49.115547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:49.116203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:49.122722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:49.123219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:49.123674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:49.124373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:49.124841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:49.125289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:49.255591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:49.263337 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d9d04239-7269-4afe-9adb-6a9402207099 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.152546 Oct 29 21:29:49.263910 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3262/6433] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:49 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:50.287652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:50.288275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:50.295140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:50.295628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:50.296074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:50.296800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:50.297262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:50.297729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:50.431592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:50.440194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-73be158e-a988-4ba5-9e3d-831c94b485f3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.156449 Oct 29 21:29:50.440766 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3172/6434] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:50 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:51.464513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:51.465079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:51.471660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:51.472161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:51.472618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:51.473324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:51.473828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:51.474276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:51.603198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:51.611451 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-117a16a4-dd15-4998-b5ef-4a8bae90a7aa tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.150662 Oct 29 21:29:51.612032 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3263/6435] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:51 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:52.635391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:52.636013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:52.642993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:52.643531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:52.644634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:52.645330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:52.645826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:52.646257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:52.779990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:52.787714 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bd6d5417-6211-4bcf-8972-35d4f36052e4 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.156359 Oct 29 21:29:52.788289 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3173/6436] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:52 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:53.811548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:53.812181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:53.819496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:53.819993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:53.820445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:53.821150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:53.821657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:53.822102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:53.951888 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:53.960437 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9265651d-fa0e-4425-b1c8-2eec1de7a2bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.152797 Oct 29 21:29:53.961016 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3264/6437] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:53 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:54.984250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:54.984871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:54.992455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:54.992945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:54.993392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:54.994110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:54.994572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:54.995005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:55.125393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:55.133148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-378a248a-d7a5-4e18-b151-5808c6a2a737 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.152788 Oct 29 21:29:55.133752 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3174/6438] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:54 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:56.156185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:56.156851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:56.164489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:56.164992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:56.165472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:56.166190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:56.166669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:56.167120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:56.301644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:56.309678 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bc59396-24c6-4116-82b7-6401f0bf1c50 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.157369 Oct 29 21:29:56.310258 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3265/6439] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:56 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:29:57.334150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:57.334771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:57.341706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:57.342181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:57.342624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:57.343362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:57.343817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:57.344248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:57.475738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:57.483504 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0587d87a-05f1-4be5-92dc-946f2bb5c1bb tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.153981 Oct 29 21:29:57.484082 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3175/6440] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:57 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:58.507293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:58.507834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:58.514779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:58.515275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:58.515730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:58.516435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:58.516903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:58.517346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:58.654698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:58.662953 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bdde9804-8804-460d-bb50-e2d8884681d9 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.160238 Oct 29 21:29:58.663522 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3266/6441] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:58 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:29:59.687131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:29:59.687693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:29:59.695373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:59.695865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:59.696390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:59.697016 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:29:59.697555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:29:59.697995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:29:59.837876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:29:59.845650 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-792e6a0f-3fd1-4f12-9e4e-083c8e0271ef tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1690 microversion: 2.1 time: 0.162546 Oct 29 21:29:59.846232 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3176/6442] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:29:59 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:30:00.868921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:30:00.869762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:30:00.876916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:00.877426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:00.878415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:00.879132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:00.879636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:00.880235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:01.012581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:30:01.021131 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c9f270d7-b7e2-4791-a1c7-5af25c85b1cf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1696 microversion: 2.1 time: 0.156134 Oct 29 21:30:01.021743 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3267/6443] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:30:00 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:30:02.045164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:30:02.045829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:30:02.053098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:02.053633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:02.054090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:02.054797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:02.055263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:02.055707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:02.194431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:30:02.202854 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7c74594-56fa-4c12-96ea-6d53e75fdd5d tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1696 microversion: 2.1 time: 0.161547 Oct 29 21:30:02.203449 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3177/6444] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:30:02 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:30:03.226866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:30:03.227544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:30:03.234529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:03.235034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:03.235494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:03.236209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:03.236691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:03.237146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:03.368572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:30:03.377519 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-540ed005-d800-42ae-8185-93773a055ddf tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1696 microversion: 2.1 time: 0.154608 Oct 29 21:30:03.378683 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3268/6445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:30:03 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:30:04.074373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-eb6b5d25-5a0b-4d9a-a507-ef90ddc17052 req-5c6c5a9b-efbe-4ecc-b0a0-8be72150aec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "name": "network-vif-unplugged", "status": "completed", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:30:04.084429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-eb6b5d25-5a0b-4d9a-a507-ef90ddc17052 req-5c6c5a9b-efbe-4ecc-b0a0-8be72150aec2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:04.084918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-eb6b5d25-5a0b-4d9a-a507-ef90ddc17052 req-5c6c5a9b-efbe-4ecc-b0a0-8be72150aec2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:04.085362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-eb6b5d25-5a0b-4d9a-a507-ef90ddc17052 req-5c6c5a9b-efbe-4ecc-b0a0-8be72150aec2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:04.096296 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-eb6b5d25-5a0b-4d9a-a507-ef90ddc17052 req-5c6c5a9b-efbe-4ecc-b0a0-8be72150aec2 service nova] Creating event network-vif-unplugged:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:30:04.101356 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-eb6b5d25-5a0b-4d9a-a507-ef90ddc17052 req-5c6c5a9b-efbe-4ecc-b0a0-8be72150aec2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.224675 Oct 29 21:30:04.101978 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3178/6446] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:30:04.401755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:30:04.402402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:30:04.409537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:04.410050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:04.410516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:04.411242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:04.411725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:04.412187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:04.546205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:30:04.554811 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e78a2cf7-ac63-4681-8601-b49924bd05ee tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1681 microversion: 2.1 time: 0.157097 Oct 29 21:30:04.555413 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3269/6447] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:30:04 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:30:06.116624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-38cb32e8-797a-4df9-9753-161183979a17 req-9edce1d4-2926-4540-b808-137f56a2b227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "name": "network-vif-plugged", "status": "completed", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:30:06.127248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-38cb32e8-797a-4df9-9753-161183979a17 req-9edce1d4-2926-4540-b808-137f56a2b227 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:06.127754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-38cb32e8-797a-4df9-9753-161183979a17 req-9edce1d4-2926-4540-b808-137f56a2b227 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:06.128687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-38cb32e8-797a-4df9-9753-161183979a17 req-9edce1d4-2926-4540-b808-137f56a2b227 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:06.139603 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-38cb32e8-797a-4df9-9753-161183979a17 req-9edce1d4-2926-4540-b808-137f56a2b227 service nova] Creating event network-vif-plugged:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:30:06.145000 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-38cb32e8-797a-4df9-9753-161183979a17 req-9edce1d4-2926-4540-b808-137f56a2b227 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Oct 29 21:30:06.145615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3179/6448] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:30:38.833295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:30:38.836144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:30:38.838227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=26 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:30:38.838931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:30:38.844483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:38.844973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:38.845449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:38.846191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:30:38.846664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:30:38.847108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:30:38.914495 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6e8df9b5-05d6-44cf-912b-fad963e71bc3 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "POST /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366/action" status: 200 len: 24567 microversion: 2.1 time: 0.085349 Oct 29 21:30:38.915120 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3270/6449] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:30:38 2022] POST /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:31:10.387938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=22 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:10.389213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=58 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:10.392735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:10.394143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:10.394304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:10.395290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:10.404528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:10.405027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:10.405493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:10.406224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:10.406691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:10.407129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:10.435610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:31:10.467277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6ced4bee-237c-4e5c-99f9-8b52c385371b req-08dc2080-fe97-47ac-b63d-b73198c80209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:10.478586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ced4bee-237c-4e5c-99f9-8b52c385371b req-08dc2080-fe97-47ac-b63d-b73198c80209 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:10.479230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ced4bee-237c-4e5c-99f9-8b52c385371b req-08dc2080-fe97-47ac-b63d-b73198c80209 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:10.479718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ced4bee-237c-4e5c-99f9-8b52c385371b req-08dc2080-fe97-47ac-b63d-b73198c80209 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:10.490727 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6ced4bee-237c-4e5c-99f9-8b52c385371b req-08dc2080-fe97-47ac-b63d-b73198c80209 service nova] Creating event network-changed:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:31:10.496172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6ced4bee-237c-4e5c-99f9-8b52c385371b req-08dc2080-fe97-47ac-b63d-b73198c80209 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109028 Oct 29 21:31:10.496794 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3271/6450] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:31:10.522069 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d66f34b9-7842-4711-9c17-d270baf01316 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 204 len: 0 microversion: 2.1 time: 0.137077 Oct 29 21:31:10.522675 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3180/6451] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:31:10 2022] DELETE /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:31:10.532616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:10.533465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:10.540671 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:10.541526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:10.542213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:10.543164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:10.543844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:10.544519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:10.685930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:31:10.694208 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91904579-efea-4c86-8f21-3ba2c7b57e9f tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1687 microversion: 2.1 time: 0.166445 Oct 29 21:31:10.694991 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3272/6452] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:10 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:11.720603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:11.721551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:11.729751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:11.730250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:11.730693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:11.731413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:11.731872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:11.732336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:11.870788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:31:11.878730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-133523fe-1878-4903-9c7a-8c5017d29d35 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1687 microversion: 2.1 time: 0.163363 Oct 29 21:31:11.879323 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3181/6453] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:11 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:12.676952 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1088c187-33d5-4ea4-a29f-b4af2feafe23 req-510ae465-bcd7-4597-a4ab-31edc67016cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fddc35d8-00b5-44e9-bcf4-81aa24bb1366", "name": "network-vif-deleted", "tag": "799c0022-3cf3-47ad-927b-3c276c686c1b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:12.687964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1088c187-33d5-4ea4-a29f-b4af2feafe23 req-510ae465-bcd7-4597-a4ab-31edc67016cd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:12.688455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1088c187-33d5-4ea4-a29f-b4af2feafe23 req-510ae465-bcd7-4597-a4ab-31edc67016cd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:12.688901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1088c187-33d5-4ea4-a29f-b4af2feafe23 req-510ae465-bcd7-4597-a4ab-31edc67016cd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:12.701242 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1088c187-33d5-4ea4-a29f-b4af2feafe23 req-510ae465-bcd7-4597-a4ab-31edc67016cd service nova] Creating event network-vif-deleted:799c0022-3cf3-47ad-927b-3c276c686c1b for instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 on nch1-master-1 Oct 29 21:31:12.706328 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1088c187-33d5-4ea4-a29f-b4af2feafe23 req-510ae465-bcd7-4597-a4ab-31edc67016cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Oct 29 21:31:12.706928 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3273/6454] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:31:12.903232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:12.903885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:12.911239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:12.911726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:12.912170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:12.912868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:12.913326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:12.913810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:12.946749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:12.947237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:12.947682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:12.948132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lazy-loading 'fault' on Instance uuid fddc35d8-00b5-44e9-bcf4-81aa24bb1366 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:31:12.993223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bec1dc25f940a491e35c8f471e040d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47bfc6cf9c143fd861d1fae9eb779fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:31:13.001388 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60155a02-2cd0-444c-88ab-03d389824f6b tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 200 len: 1354 microversion: 2.1 time: 0.101941 Oct 29 21:31:13.002115 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3182/6455] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:12 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 1354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:14.026137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:14.026925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [instance: fddc35d8-00b5-44e9-bcf4-81aa24bb1366] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:14.033209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:14.033751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:14.034215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:14.034937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:14.035417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:14.035870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:14.049093 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] HTTP exception thrown: Instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 could not be found. Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Request method failure captured: Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 HTTP/1.1 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZkiwwqKESTVDGAQICgVPul-ChT-_yLrnA591om_JgqjMDaL5QEWtut9sXT8-Btu3QBQ5deyvuUc44RIKAjyXhMC-8DtRWhkTtXEgXduUmQijUFGS0Sbxjf9yAZyx-9ltHE_HKPl11nE4IgPQ0Pdq0tDxYmL2ScSJKxYLbqUYkEyL-M Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b47bfc6cf9c143fd861d1fae9eb779fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: b47bfc6cf9c143fd861d1fae9eb779fd Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1589969501 Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c6bec1dc25f940a491e35c8f471e040d Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1589969501-project Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 could not be found. Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'fddc35d8-00b5-44e9-bcf4-81aa24bb1366'} Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 could not be found. Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 could not be found. Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:14.050747 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 could not be found. Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Returning 404 to user: Instance fddc35d8-00b5-44e9-bcf4-81aa24bb1366 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3e0b7487-e9bd-468c-aac0-25216df9dd88 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366" status: 404 len: 111 microversion: 2.1 time: 0.031316 Oct 29 21:31:14.055755 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3274/6456] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:14 2022] GET /compute/v2.1/servers/fddc35d8-00b5-44e9-bcf4-81aa24bb1366 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:31:17.047658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2eed4149-ec5b-4d51-a26a-bfc9e7a31a04 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] Calling method '.version_select at 0x7fa170c38b80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:17.052769 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2eed4149-ec5b-4d51-a26a-bfc9e7a31a04 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [637b60ea-6cc0-4d1a-84f9-8e2ac1df387b] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:31:18.063426 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [None req-2eed4149-ec5b-4d51-a26a-bfc9e7a31a04 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] [637b60ea-6cc0-4d1a-84f9-8e2ac1df387b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 39540. Oct 29 21:31:18.083964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2eed4149-ec5b-4d51-a26a-bfc9e7a31a04 tempest-TestNetworkAdvancedServerOps-1589969501 tempest-TestNetworkAdvancedServerOps-1589969501-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-277307261" status: 202 len: 0 microversion: 2.1 time: 1.040518 Oct 29 21:31:18.084577 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3183/6457] 10.222.0.36 () {58 vars in 1281 bytes} [Sat Oct 29 21:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-277307261 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:31:32.552351 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:31:32.552942 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-availability-zone/detail (ip 10.222.0.36) !!! Oct 29 21:31:32.553892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:32.554690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=12 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:32.690333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:32.692337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:32.692832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:32.693281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:32.694048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:32.694516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:32.694954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:32.719943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1e6e80dd-6aaa-4a65-9ce7-0acd5dfd2887 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.172955 Oct 29 21:31:32.720539 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3275/6458] 10.222.0.36 () {58 vars in 1185 bytes} [Sat Oct 29 21:31:32 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:31:32.826130 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:31:32.826615 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 29 21:31:32.827467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:32.828381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:32.832190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1086579482", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "e534d665-1f0c-4476-8233-ae416732f49d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:32.898712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] validate_networks() for [('e534d665-1f0c-4476-8233-ae416732f49d', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:31:33.382548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:31:33.383082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:31:33.383564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:31:33.383980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:31:33.384395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:31:33.394222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:33.394713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:33.395157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:33.395896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:33.396357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:33.396788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:33.414985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Getting quotas for project 8202441ca0b24a4a9d3511e7e19fbe31. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:31:33.420229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Getting quotas for user 527c58ea62f24220980b21ae79f4bea4 and project 8202441ca0b24a4a9d3511e7e19fbe31. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:31:33.432480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:31:33.434856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:31:33.483297 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aeaac623-3a34-4c16-ba85-c69b60bc1fec tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658987 Oct 29 21:31:33.486839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3184/6459] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:31:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:31:33.495385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e867442b-f46f-4d10-b320-b7463944acb0 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:33.496185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e867442b-f46f-4d10-b320-b7463944acb0 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:33.563068 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e867442b-f46f-4d10-b320-b7463944acb0 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1329 microversion: 2.1 time: 0.071034 Oct 29 21:31:33.563944 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3276/6460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:33 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1329 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:34.587725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:34.588383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:34.595129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:34.595635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:34.596083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:34.596797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:34.597263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:34.597728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:34.672513 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1438e154-66b4-41c5-bbb4-2f3bce0db363 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1416 microversion: 2.1 time: 0.089956 Oct 29 21:31:34.673244 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3185/6461] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:34 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1416 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:35.696926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:35.698199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:35.708640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:35.709580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:35.710316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:35.711326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:35.711953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:35.712694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:35.917706 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-113a2309-c7fb-466e-9c39-45436ac927bb tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.225178 Oct 29 21:31:35.919019 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3277/6462] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:35 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:36.256507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-19f249be-7d58-43ee-a5e4-536f301527f0 req-b537cceb-f719-4fb8-beed-a2c94650ae97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea5d8986-b960-40aa-88a7-4effb8e1b45d", "tag": "ed49f8d0-0301-449b-bea6-5b7d3d83c148"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:36.272744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-19f249be-7d58-43ee-a5e4-536f301527f0 req-b537cceb-f719-4fb8-beed-a2c94650ae97 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:36.274307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-19f249be-7d58-43ee-a5e4-536f301527f0 req-b537cceb-f719-4fb8-beed-a2c94650ae97 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:36.274866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-19f249be-7d58-43ee-a5e4-536f301527f0 req-b537cceb-f719-4fb8-beed-a2c94650ae97 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:36.286879 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-19f249be-7d58-43ee-a5e4-536f301527f0 req-b537cceb-f719-4fb8-beed-a2c94650ae97 service nova] Creating event network-changed:ed49f8d0-0301-449b-bea6-5b7d3d83c148 for instance ea5d8986-b960-40aa-88a7-4effb8e1b45d on nch1-master-1 Oct 29 21:31:36.293127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-19f249be-7d58-43ee-a5e4-536f301527f0 req-b537cceb-f719-4fb8-beed-a2c94650ae97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040357 Oct 29 21:31:36.294515 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3186/6463] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:31:36.942958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:36.943597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:36.950618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:36.951126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:36.951616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:36.952327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:36.952800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:36.953247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:37.078284 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f360c797-27fe-48da-89e5-f1eff7f16001 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.139270 Oct 29 21:31:37.078888 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3278/6464] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:36 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:38.102122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:38.102838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:38.109946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:38.110435 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:38.110875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:38.111570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:38.112030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:38.112464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:38.251010 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d96ecf36-45fe-46b5-9b50-82ea0011b89a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.153001 Oct 29 21:31:38.251691 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3187/6465] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:38 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:31:39.273378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:39.274048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:39.281125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:39.281667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:39.282127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:39.282837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:39.283313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:39.283759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:39.414881 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c8547b36-b868-4126-b0f5-5c56f94bde7a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.144618 Oct 29 21:31:39.415489 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3279/6466] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:39 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:40.439142 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:40.439777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:40.446639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:40.447128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:40.447573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:40.448277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:40.448739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:40.449225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:40.573698 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f6b7d03c-f5c6-4756-aa30-f26f1f11b463 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.138463 Oct 29 21:31:40.574285 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3188/6467] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:40 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:41.596531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:41.597196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:41.604722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:41.605217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:41.605700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:41.606406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:41.606875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:41.607315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:41.734205 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c274aaf-a956-46ff-875e-6c7e7def9018 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.141333 Oct 29 21:31:41.734785 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3280/6468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:41 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:42.364374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2cd3f8ca-d46e-4fdc-9c58-d6b8046d4017 req-cd22fbcd-a036-4265-9cd7-fde83f98e8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea5d8986-b960-40aa-88a7-4effb8e1b45d", "name": "network-vif-plugged", "status": "completed", "tag": "ed49f8d0-0301-449b-bea6-5b7d3d83c148"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:42.377746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cd3f8ca-d46e-4fdc-9c58-d6b8046d4017 req-cd22fbcd-a036-4265-9cd7-fde83f98e8e2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:42.378456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cd3f8ca-d46e-4fdc-9c58-d6b8046d4017 req-cd22fbcd-a036-4265-9cd7-fde83f98e8e2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:42.379039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2cd3f8ca-d46e-4fdc-9c58-d6b8046d4017 req-cd22fbcd-a036-4265-9cd7-fde83f98e8e2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:42.390984 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2cd3f8ca-d46e-4fdc-9c58-d6b8046d4017 req-cd22fbcd-a036-4265-9cd7-fde83f98e8e2 service nova] Creating event network-vif-plugged:ed49f8d0-0301-449b-bea6-5b7d3d83c148 for instance ea5d8986-b960-40aa-88a7-4effb8e1b45d on nch1-master-1 Oct 29 21:31:42.396687 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2cd3f8ca-d46e-4fdc-9c58-d6b8046d4017 req-cd22fbcd-a036-4265-9cd7-fde83f98e8e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035777 Oct 29 21:31:42.397275 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3189/6469] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:31:42.756598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:42.757228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:42.760087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:42.765824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:42.766327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:42.766805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:42.767512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:42.768026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:42.768470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:42.890750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ea04da1e-5493-4f13-be83-b2f448c2c357 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.137814 Oct 29 21:31:42.891323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3281/6470] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:42 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:43.915209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:43.916535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:43.919352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:43.920234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:43.926906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:43.927399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:43.927843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:43.928544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:43.929003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:43.929434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:44.064194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e96f3be-78cb-4404-b15c-6790440a0800 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1464 microversion: 2.1 time: 0.152975 Oct 29 21:31:44.064844 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3190/6471] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:43 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:45.089067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:45.089731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:45.091623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:45.097792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:45.098311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:45.098743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:45.099446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:45.099918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:45.100390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:45.223531 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cf7fc4e2-04ab-47f1-9be4-3ef2ccd94a83 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1649 microversion: 2.1 time: 0.138745 Oct 29 21:31:45.224507 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3282/6472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:45 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1649 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:45.245504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:45.246133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:45.253000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:45.253550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:45.254003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:45.254713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:45.255759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:45.256197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:45.388971 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-28be356e-9299-4e62-b7c4-df5dade334b2 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1649 microversion: 2.1 time: 0.147078 Oct 29 21:31:45.389585 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3191/6473] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:45 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1649 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:45.410912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:45.411581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:45.417680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:45.418188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:45.418649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:45.419363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:45.419836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:45.420284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:45.547695 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5d9bbc6-b57f-4539-9692-9d5172706f72 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1649 microversion: 2.1 time: 0.140503 Oct 29 21:31:45.548272 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3283/6474] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:45 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1649 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:45.608403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-663048715", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "e534d665-1f0c-4476-8233-ae416732f49d"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:45.663897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] validate_networks() for [('e534d665-1f0c-4476-8233-ae416732f49d', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:31:46.004130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:31:46.004569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:31:46.005064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:31:46.005519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:31:46.005973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:31:46.014993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:46.015485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:46.015934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:46.016684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:46.017148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:46.017624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:46.035137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Getting quotas for project 8202441ca0b24a4a9d3511e7e19fbe31. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:31:46.040410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Getting quotas for user 527c58ea62f24220980b21ae79f4bea4 and project 8202441ca0b24a4a9d3511e7e19fbe31. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:31:46.053923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:31:46.056279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:31:46.101749 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a10e913d-aa33-47c9-8b75-0a695d8e9325 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497029 Oct 29 21:31:46.102400 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3192/6475] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:31:46.114539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2bf02a5-5413-4bc3-b44a-7ebc894fb637 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:46.115171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2bf02a5-5413-4bc3-b44a-7ebc894fb637 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:46.176721 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2bf02a5-5413-4bc3-b44a-7ebc894fb637 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1328 microversion: 2.1 time: 0.065835 Oct 29 21:31:46.177324 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3284/6476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:46 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1328 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:47.205396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:47.208856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:47.219997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:47.220864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:47.221717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:47.222681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:47.223209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:47.223700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:47.335229 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9eb84fa9-e8b2-4ecf-a926-b506ca08f670 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1423 microversion: 2.1 time: 0.138843 Oct 29 21:31:47.336122 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3193/6477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:47 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1423 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:48.359182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:48.359823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:48.367550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:48.368059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:48.368514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:48.369233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:48.369771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:48.370224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:48.495469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-853133d8-714f-423b-8c8f-264eead3e4ab req-44fdbf22-01b4-43ca-b2c2-c18f96da7c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b736a0-45b9-4c95-be2a-1e48fdabedfd", "tag": "04e40c33-9305-466b-bcf8-44c5fdaf4aa1"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:48.511068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-853133d8-714f-423b-8c8f-264eead3e4ab req-44fdbf22-01b4-43ca-b2c2-c18f96da7c77 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:48.512251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-853133d8-714f-423b-8c8f-264eead3e4ab req-44fdbf22-01b4-43ca-b2c2-c18f96da7c77 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:48.512746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-853133d8-714f-423b-8c8f-264eead3e4ab req-44fdbf22-01b4-43ca-b2c2-c18f96da7c77 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:48.530430 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-853133d8-714f-423b-8c8f-264eead3e4ab req-44fdbf22-01b4-43ca-b2c2-c18f96da7c77 service nova] Creating event network-changed:04e40c33-9305-466b-bcf8-44c5fdaf4aa1 for instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd on nch2-master-1 Oct 29 21:31:48.536023 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-853133d8-714f-423b-8c8f-264eead3e4ab req-44fdbf22-01b4-43ca-b2c2-c18f96da7c77 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044344 Oct 29 21:31:48.536944 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3194/6478] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:31:48.825728 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf41173e-01f3-4632-b166-e3730201d3e5 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1463 microversion: 2.1 time: 0.470208 Oct 29 21:31:48.826400 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3285/6479] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:48 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1463 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:49.851195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:49.851914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:49.858872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:49.859363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:49.859811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:49.860511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:49.860975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:49.861408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:49.989269 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f83c9b8-db25-4c96-8c36-2e38d7022ef7 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1463 microversion: 2.1 time: 0.142989 Oct 29 21:31:49.989876 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3195/6480] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:49 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:51.013553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:51.014297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:51.020488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:51.020993 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:51.021470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:51.022208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:51.022721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:51.023176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:51.149662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a1ac849e-e3ae-4523-852d-c53b9a6c593a tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1463 microversion: 2.1 time: 0.141110 Oct 29 21:31:51.150241 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3286/6481] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:51 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:52.172801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:52.173428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:52.180505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:52.181000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:52.182026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:52.182759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:52.183741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:52.184177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:52.307189 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e548130-eb1e-45cf-adef-44dd95f09173 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1463 microversion: 2.1 time: 0.138051 Oct 29 21:31:52.307772 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3196/6482] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:52 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:52.997811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-44c121a8-d202-412b-afaa-0c8c1bc12ddb req-a515deb6-0812-4522-9e0b-6b93a60f04b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b736a0-45b9-4c95-be2a-1e48fdabedfd", "name": "network-vif-plugged", "status": "completed", "tag": "04e40c33-9305-466b-bcf8-44c5fdaf4aa1"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:53.008507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-44c121a8-d202-412b-afaa-0c8c1bc12ddb req-a515deb6-0812-4522-9e0b-6b93a60f04b1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:53.009010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-44c121a8-d202-412b-afaa-0c8c1bc12ddb req-a515deb6-0812-4522-9e0b-6b93a60f04b1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:53.009516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-44c121a8-d202-412b-afaa-0c8c1bc12ddb req-a515deb6-0812-4522-9e0b-6b93a60f04b1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:53.020786 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-44c121a8-d202-412b-afaa-0c8c1bc12ddb req-a515deb6-0812-4522-9e0b-6b93a60f04b1 service nova] Creating event network-vif-plugged:04e40c33-9305-466b-bcf8-44c5fdaf4aa1 for instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd on nch2-master-1 Oct 29 21:31:53.025952 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-44c121a8-d202-412b-afaa-0c8c1bc12ddb req-a515deb6-0812-4522-9e0b-6b93a60f04b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Oct 29 21:31:53.027230 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3287/6483] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:31:53.330797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:53.331428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:53.338321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:53.338810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:53.339248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:53.339941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:53.340396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:53.340829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:53.464951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dfb77ccb-551b-41d5-a71b-909a608c3877 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1463 microversion: 2.1 time: 0.137891 Oct 29 21:31:53.465539 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3197/6484] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:53 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:54.489787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:54.490458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:54.496832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.497342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.497826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.498541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.499015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.499463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.626621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63278941-b585-4f38-ab02-b3e1736c2355 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1649 microversion: 2.1 time: 0.141755 Oct 29 21:31:54.627201 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3288/6485] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:54 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:54.649109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:54.649773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:54.657241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.657798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.658252 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.658955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.659423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.659861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.784693 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0d74af0b-8d7f-4870-9ea1-da79e2059efa tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1649 microversion: 2.1 time: 0.139195 Oct 29 21:31:54.785281 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3198/6486] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:54 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1649 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:54.807198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:54.807843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:54.814154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.814663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.815125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.815842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.816589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.817040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.942287 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8445310c-d97c-462d-9f46-b3991c87f47c tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1649 microversion: 2.1 time: 0.138715 Oct 29 21:31:54.942876 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3289/6487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:54 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1649 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:54.965119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:54.966289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:54.972446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.972945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.973401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.974147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:54.974618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:54.975084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:54.999946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:31:55.076573 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45efc688-3910-4c63-b994-7047b5635e24 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 204 len: 0 microversion: 2.1 time: 0.114825 Oct 29 21:31:55.077263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3199/6488] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:31:54 2022] DELETE /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:31:55.085690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:55.086351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:55.092354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:55.092852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:55.093306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:55.094033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:55.094503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:55.094943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:55.220655 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f2054cb-4446-43c4-9228-ca563802d434 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1655 microversion: 2.1 time: 0.138586 Oct 29 21:31:55.221223 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3290/6489] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:55 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1655 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:56.243511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:56.244289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:56.247095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:56.247774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:56.253675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:56.254169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:56.254615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:56.255326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:56.255790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:56.256227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:56.384227 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-730d0422-05a1-453e-a16f-7c080e9094f6 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1655 microversion: 2.1 time: 0.144835 Oct 29 21:31:56.384924 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3200/6490] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:56 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:56.883111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-9c754eef-af91-401e-8367-8db915016b9b req-6589dcba-28f9-47da-9af4-a6f343ef6799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b736a0-45b9-4c95-be2a-1e48fdabedfd", "name": "network-vif-deleted", "tag": "04e40c33-9305-466b-bcf8-44c5fdaf4aa1"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:31:56.899352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:56.928544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9c754eef-af91-401e-8367-8db915016b9b req-6589dcba-28f9-47da-9af4-a6f343ef6799 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:56.930188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9c754eef-af91-401e-8367-8db915016b9b req-6589dcba-28f9-47da-9af4-a6f343ef6799 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:56.930929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-9c754eef-af91-401e-8367-8db915016b9b req-6589dcba-28f9-47da-9af4-a6f343ef6799 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:56.952343 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-9c754eef-af91-401e-8367-8db915016b9b req-6589dcba-28f9-47da-9af4-a6f343ef6799 service nova] Creating event network-vif-deleted:04e40c33-9305-466b-bcf8-44c5fdaf4aa1 for instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd on nch2-master-1 Oct 29 21:31:56.963862 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-9c754eef-af91-401e-8367-8db915016b9b req-6589dcba-28f9-47da-9af4-a6f343ef6799 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085703 Oct 29 21:31:56.966407 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3291/6491] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:31:57.407466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:57.408198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:57.415206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:57.415702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:57.416152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:57.416858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:57.417335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:57.417807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:57.450229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:57.450723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:57.451171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:57.451636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lazy-loading 'fault' on Instance uuid 69b736a0-45b9-4c95-be2a-1e48fdabedfd {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:31:57.501379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:31:57.506680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81893b0c-ceb4-4076-972c-df370a61ba85 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 200 len: 1453 microversion: 2.1 time: 0.103317 Oct 29 21:31:57.507425 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3201/6492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:57 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:58.532170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:58.532845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: 69b736a0-45b9-4c95-be2a-1e48fdabedfd] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:58.539199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:58.539703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:58.540160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:58.540865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:58.541337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:58.541807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:58.554852 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] HTTP exception thrown: Instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd could not be found. Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Request method failure captured: Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd HTTP/1.1 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZu0x5sG-34OQezrqRxvK7Ni8-ijGtDWxVwKwu2RP7cA3rQKTXPoTFmOESpaepk0B9ruj7fCSy4o-d-bCdX0ACgQmwL4f08c3lJbZlj01HVbTpoqvADIeudBfZbNzEYhrn_meRKxIkqkhIyu7tGOPgpCMEKBTQkWAu0oEV6IAQVhJgs Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 8202441ca0b24a4a9d3511e7e19fbe31 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestServerMultinode-172935969 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestServerMultinode-172935969 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 8202441ca0b24a4a9d3511e7e19fbe31 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestServerMultinode-172935969 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestServerMultinode-172935969-project-admin Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 527c58ea62f24220980b21ae79f4bea4 Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestServerMultinode-172935969-project-admin Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd could not be found. Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '69b736a0-45b9-4c95-be2a-1e48fdabedfd'} Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd could not be found. Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd could not be found. Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:31:58.556482 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd could not be found. Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Returning 404 to user: Instance 69b736a0-45b9-4c95-be2a-1e48fdabedfd could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cfd98ec8-d6fe-455d-a70b-6d5ed3b740d9 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd" status: 404 len: 111 microversion: 2.1 time: 0.031473 Oct 29 21:31:58.561514 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3292/6493] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:58 2022] GET /compute/v2.1/servers/69b736a0-45b9-4c95-be2a-1e48fdabedfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:31:58.567484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:58.568046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:58.576865 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:58.577351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:58.577828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:58.578524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:58.578990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:58.579422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:58.605431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:31:58.679596 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-93a0426c-75ef-492d-810d-1a803d56521d tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 204 len: 0 microversion: 2.1 time: 0.115669 Oct 29 21:31:58.680208 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3202/6494] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:31:58 2022] DELETE /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:31:58.688534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:58.689174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:58.695538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:58.696039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:58.696499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:58.697213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:58.697715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:58.698161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:58.825995 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ba79f79-a1fd-4c09-ac90-344aad004ed3 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1655 microversion: 2.1 time: 0.140615 Oct 29 21:31:58.826594 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3293/6495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:58 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1655 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:31:59.849633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:31:59.850347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:31:59.857689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:59.858177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:59.858618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:59.859315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:31:59.859772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:31:59.860224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:31:59.987108 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-073c7bac-8989-4836-b80d-f5d3685258ff tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1655 microversion: 2.1 time: 0.141564 Oct 29 21:31:59.987682 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3203/6496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:31:59 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1655 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:00.824618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-deb2f268-95d5-4148-98c9-d8db3f62265c req-8d450296-ff61-4cf8-8df0-34536d7c79e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea5d8986-b960-40aa-88a7-4effb8e1b45d", "name": "network-vif-deleted", "tag": "ed49f8d0-0301-449b-bea6-5b7d3d83c148"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:00.837027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-deb2f268-95d5-4148-98c9-d8db3f62265c req-8d450296-ff61-4cf8-8df0-34536d7c79e4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:00.837562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-deb2f268-95d5-4148-98c9-d8db3f62265c req-8d450296-ff61-4cf8-8df0-34536d7c79e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:00.838023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-deb2f268-95d5-4148-98c9-d8db3f62265c req-8d450296-ff61-4cf8-8df0-34536d7c79e4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:00.851755 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-deb2f268-95d5-4148-98c9-d8db3f62265c req-8d450296-ff61-4cf8-8df0-34536d7c79e4 service nova] Creating event network-vif-deleted:ed49f8d0-0301-449b-bea6-5b7d3d83c148 for instance ea5d8986-b960-40aa-88a7-4effb8e1b45d on nch1-master-1 Oct 29 21:32:00.857800 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-deb2f268-95d5-4148-98c9-d8db3f62265c req-8d450296-ff61-4cf8-8df0-34536d7c79e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037073 Oct 29 21:32:00.859127 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3294/6497] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:32:01.010777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:01.011404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:01.018857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:01.019357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:01.019799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:01.020502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:01.020964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:01.021401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:01.052894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:01.053387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:01.053864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:01.054320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lazy-loading 'fault' on Instance uuid ea5d8986-b960-40aa-88a7-4effb8e1b45d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:32:01.103617 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8af916e6-f439-4a4e-b01d-aa5f1e96f577 tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 200 len: 1454 microversion: 2.1 time: 0.096552 Oct 29 21:32:01.104189 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3204/6498] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:01 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:32:02.128414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:02.129181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] [instance: ea5d8986-b960-40aa-88a7-4effb8e1b45d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:02.135514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:02.136023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:02.136486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:02.137201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:02.138213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:02.138665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:02.151950 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] HTTP exception thrown: Instance ea5d8986-b960-40aa-88a7-4effb8e1b45d could not be found. Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Request method failure captured: Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d HTTP/1.1 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZu0x5sG-34OQezrqRxvK7Ni8-ijGtDWxVwKwu2RP7cA3rQKTXPoTFmOESpaepk0B9ruj7fCSy4o-d-bCdX0ACgQmwL4f08c3lJbZlj01HVbTpoqvADIeudBfZbNzEYhrn_meRKxIkqkhIyu7tGOPgpCMEKBTQkWAu0oEV6IAQVhJgs Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 8202441ca0b24a4a9d3511e7e19fbe31 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestServerMultinode-172935969 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8202441ca0b24a4a9d3511e7e19fbe31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestServerMultinode-172935969 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 8202441ca0b24a4a9d3511e7e19fbe31 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestServerMultinode-172935969 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestServerMultinode-172935969-project-admin Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 527c58ea62f24220980b21ae79f4bea4 Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestServerMultinode-172935969-project-admin Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance ea5d8986-b960-40aa-88a7-4effb8e1b45d could not be found. Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'ea5d8986-b960-40aa-88a7-4effb8e1b45d'} Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5d8986-b960-40aa-88a7-4effb8e1b45d could not be found. Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5d8986-b960-40aa-88a7-4effb8e1b45d could not be found. Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:32:02.154282 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5d8986-b960-40aa-88a7-4effb8e1b45d could not be found. Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] Returning 404 to user: Instance ea5d8986-b960-40aa-88a7-4effb8e1b45d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2bc9e97-b94d-4f22-bbd6-ff982542d3db tempest-TestServerMultinode-172935969 tempest-TestServerMultinode-172935969-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d" status: 404 len: 111 microversion: 2.1 time: 0.032676 Oct 29 21:32:02.159547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3295/6499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:02 2022] GET /compute/v2.1/servers/ea5d8986-b960-40aa-88a7-4effb8e1b45d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:32:35.249554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bcc10bc-dacb-4845-af1e-b02b49de7282 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Action: 'create', calling method: .version_select at 0x7fa17625b8b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1526349812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC//pulF1uchuveKEFH0Aw/WRVFXw1VpG6Rkj5EXoemu0bR20clB8nz4H5aF2igw/Cr+ns1Aye+Aw4mP0gjjfrVbHvSXd8yI/u0bNvUEIuynO8aPqpLi6tQB1Wt/gueumQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:35.255972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:35.256786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:35.271643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7bcc10bc-dacb-4845-af1e-b02b49de7282 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Getting quotas for project 95c3945de287465586005125fb5cdc6f. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:32:35.277433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7bcc10bc-dacb-4845-af1e-b02b49de7282 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Getting quotas for user 1a26316480cd41b8b1469ced129540a9 and project 95c3945de287465586005125fb5cdc6f. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:32:35.302766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bcc10bc-dacb-4845-af1e-b02b49de7282 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057273 Oct 29 21:32:35.303382 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3205/6500] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:32:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:32:36.245211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1518979259", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3fbf07a3-4a30-47a6-9015-204ce7f9490c", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1526349812", "security_groups": [{"name": "tempest-secgroup-smoke-1714600"}], "networks": [{"uuid": "bdd6d070-1e92-4594-aacf-31a4e7236dc4"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:36.255977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=48 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:36.256644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=90 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:36.361357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] validate_networks() for [('bdd6d070-1e92-4594-aacf-31a4e7236dc4', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:32:36.837688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:32:36.838141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:32:36.838640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:32:36.839073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:32:36.839510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:32:36.849395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:36.849934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:36.850398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:36.851157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:36.851643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:36.852094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:36.869107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Getting quotas for project 95c3945de287465586005125fb5cdc6f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:32:36.875084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Getting quotas for user 1a26316480cd41b8b1469ced129540a9 and project 95c3945de287465586005125fb5cdc6f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:32:36.933512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:32:36.936343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fbf07a3-4a30-47a6-9015-204ce7f9490c',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:32:37.061715 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [e92792ad-f158-4260-af76-4a7de588139b] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:32:38.075782 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [e92792ad-f158-4260-af76-4a7de588139b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40340. Oct 29 21:32:38.080668 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aeb48bc2-af12-49c9-931d-4193f68693d7 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.839640 Oct 29 21:32:38.081347 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3296/6501] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:32:36 2022] POST /compute/v2.1/servers => generated 403 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:32:38.092594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da019bdf-9610-49e9-8ba3-a31e1be42340 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:38.093221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da019bdf-9610-49e9-8ba3-a31e1be42340 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:38.455778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da019bdf-9610-49e9-8ba3-a31e1be42340 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:38.462924 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da019bdf-9610-49e9-8ba3-a31e1be42340 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1099 microversion: 2.1 time: 0.374185 Oct 29 21:32:38.463595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3206/6502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:38 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1099 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:39.488040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:39.488586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:39.495124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:39.495628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:39.496080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:39.496796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:39.497266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:39.497738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:39.579788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:39.587910 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-62db7755-8fe9-46e3-aa9e-79c5bd07658b tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1215 microversion: 2.1 time: 0.106047 Oct 29 21:32:39.588495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3297/6503] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:39 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:40.612428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:40.613681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:40.621482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:40.622255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:40.622869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:40.623750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:40.625231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:40.625348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:40.663810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-50ce7f98-d303-40c4-8a74-d97902f8ede8 req-397274e8-1387-4feb-9bda-2f624e752e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:40.678491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-50ce7f98-d303-40c4-8a74-d97902f8ede8 req-397274e8-1387-4feb-9bda-2f624e752e76 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:40.679094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-50ce7f98-d303-40c4-8a74-d97902f8ede8 req-397274e8-1387-4feb-9bda-2f624e752e76 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:40.679776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-50ce7f98-d303-40c4-8a74-d97902f8ede8 req-397274e8-1387-4feb-9bda-2f624e752e76 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:40.691630 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-50ce7f98-d303-40c4-8a74-d97902f8ede8 req-397274e8-1387-4feb-9bda-2f624e752e76 service nova] Creating event network-changed:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:32:40.697075 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-50ce7f98-d303-40c4-8a74-d97902f8ede8 req-397274e8-1387-4feb-9bda-2f624e752e76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038702 Oct 29 21:32:40.697982 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3298/6504] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:32:40.931523 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:40.940014 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13343591-2a91-47f6-b786-1db60ee47159 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1280 microversion: 2.1 time: 0.332213 Oct 29 21:32:40.940594 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3207/6505] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:40 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1280 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:41.964261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:41.964981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:41.972018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:41.972515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:41.972966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:41.973696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:41.974165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:41.974605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:42.112466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:42.120316 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f99af525-a2de-4558-9b43-d78d8a39840a tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.161321 Oct 29 21:32:42.120887 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3299/6506] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:41 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:43.144354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:43.144989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:43.152162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:43.152656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:43.153107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:43.153842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:43.154319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:43.154755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:43.290115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:43.298778 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e59a170e-3ccf-446a-ad2c-97d1157403cc tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.158953 Oct 29 21:32:43.299369 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3208/6507] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:43 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:44.322002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:44.322634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:44.330054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:44.330553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:44.331004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:44.331706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:44.332175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:44.332617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:44.464332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:44.472085 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-74a89bea-fbea-401c-bcb4-8b1fe7e84599 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.154055 Oct 29 21:32:44.472652 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3300/6508] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:44 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:45.495001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:45.495552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:45.502590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:45.503084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:45.503534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:45.504241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:45.504709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:45.505144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:45.637968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:45.646261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02c1ff04-2bcd-498c-b6a0-981ec6706f72 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.155308 Oct 29 21:32:45.646835 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3209/6509] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:45 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:46.669644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:46.670280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:46.677229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:46.677708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:46.678168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:46.678875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:46.679347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:46.679791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:46.820191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:46.829191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c26e093-09f5-4c9c-9f70-902e579f67ff tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.163242 Oct 29 21:32:46.830323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3301/6510] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:46 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:47.853279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:47.853936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:47.860821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:47.861313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:47.861800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:47.862507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:47.862970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:47.863405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:47.995644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:48.003352 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da819c5b-a6a0-43e5-9c57-2baa4c432d7c tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.153991 Oct 29 21:32:48.003926 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3210/6511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:47 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:48.483989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-78b0055b-24fa-4d0f-a241-5a67077b7073 req-c52d9f94-2d95-488a-98c1-89ae11f14a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "name": "network-vif-plugged", "status": "completed", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:48.489486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:48.490466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:48.498578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-78b0055b-24fa-4d0f-a241-5a67077b7073 req-c52d9f94-2d95-488a-98c1-89ae11f14a42 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:48.499092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-78b0055b-24fa-4d0f-a241-5a67077b7073 req-c52d9f94-2d95-488a-98c1-89ae11f14a42 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:48.500053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-78b0055b-24fa-4d0f-a241-5a67077b7073 req-c52d9f94-2d95-488a-98c1-89ae11f14a42 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:48.511741 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-78b0055b-24fa-4d0f-a241-5a67077b7073 req-c52d9f94-2d95-488a-98c1-89ae11f14a42 service nova] Creating event network-vif-plugged:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:32:48.517609 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-78b0055b-24fa-4d0f-a241-5a67077b7073 req-c52d9f94-2d95-488a-98c1-89ae11f14a42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037877 Oct 29 21:32:48.518217 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3302/6512] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:32:49.027215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:49.027847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:49.029738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:32:49.036918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:49.037411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:49.037890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:49.038602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:49.039070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:49.039508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:49.173506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:49.181261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4abb0179-f217-466d-afb6-712de2b3c048 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1268 microversion: 2.1 time: 0.158054 Oct 29 21:32:49.181871 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3211/6513] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:49 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:50.206360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:50.207149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:50.213445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:50.213983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:50.214437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:50.215145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:50.215613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:50.216050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:50.350167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:50.357957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b948b50-c8bd-443f-b3b7-ceee40d1bc99 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1456 microversion: 2.1 time: 0.157446 Oct 29 21:32:50.358530 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3303/6514] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:50 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1456 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:50.380318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:32:50.380938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:32:50.388427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:50.388915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:50.389355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:50.390141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:50.391109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:50.391595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:50.523235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:32:50.531283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b0cba3a8-4d50-4600-99a7-49baa2682187 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1456 microversion: 2.1 time: 0.154840 Oct 29 21:32:50.531856 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3212/6515] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:32:50 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1456 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:32:52.142818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a784439d-5f61-4a70-8f53-5064180b5f0a req-a16c81d4-95e7-439c-bfd6-f1b0f4c7be09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:52.153229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a784439d-5f61-4a70-8f53-5064180b5f0a req-a16c81d4-95e7-439c-bfd6-f1b0f4c7be09 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:52.153867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a784439d-5f61-4a70-8f53-5064180b5f0a req-a16c81d4-95e7-439c-bfd6-f1b0f4c7be09 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:52.154389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a784439d-5f61-4a70-8f53-5064180b5f0a req-a16c81d4-95e7-439c-bfd6-f1b0f4c7be09 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:52.166568 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a784439d-5f61-4a70-8f53-5064180b5f0a req-a16c81d4-95e7-439c-bfd6-f1b0f4c7be09 service nova] Creating event network-changed:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:32:52.171733 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a784439d-5f61-4a70-8f53-5064180b5f0a req-a16c81d4-95e7-439c-bfd6-f1b0f4c7be09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042179 Oct 29 21:32:52.172459 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3304/6516] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:32:54.186642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}, {"name": "network-changed", "server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:32:54.197949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:32:54.198442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:32:54.198885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:32:54.210685 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] Creating event network-changed:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:32:54.211209 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] Creating event network-changed:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:32:54.216629 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-47d7e4ff-2739-4437-be5b-e0feb34e4110 req-ac80898c-a2bc-41e4-8d17-71c102d81a7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033593 Oct 29 21:32:54.217239 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3213/6517] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:33:35.272817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:33:35.273833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:33:35.274535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=38 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:33:35.279961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-956a8317-846a-4d94-b48b-689533bfc2a6 req-1d1ef8a8-4446-4a76-bf4a-fad265116108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:33:35.285917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=38 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:33:35.291514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:33:35.292134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:33:35.300117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:35.300867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:35.301227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-956a8317-846a-4d94-b48b-689533bfc2a6 req-1d1ef8a8-4446-4a76-bf4a-fad265116108 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:35.301793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:35.301944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-956a8317-846a-4d94-b48b-689533bfc2a6 req-1d1ef8a8-4446-4a76-bf4a-fad265116108 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:35.302264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-956a8317-846a-4d94-b48b-689533bfc2a6 req-1d1ef8a8-4446-4a76-bf4a-fad265116108 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:35.302560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:35.303042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:35.303484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:35.314406 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-956a8317-846a-4d94-b48b-689533bfc2a6 req-1d1ef8a8-4446-4a76-bf4a-fad265116108 service nova] Creating event network-changed:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:33:35.319927 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-956a8317-846a-4d94-b48b-689533bfc2a6 req-1d1ef8a8-4446-4a76-bf4a-fad265116108 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048946 Oct 29 21:33:35.320729 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3214/6518] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:33:35.331852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:33:35.423678 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 204 len: 0 microversion: 2.1 time: 0.155793 Oct 29 21:33:35.425063 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3305/6519] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:33:35 2022] DELETE /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:33:35.440955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:33:35.442715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:33:35.449706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:35.450342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:35.450790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:35.451630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:35.452094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:35.452557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:35.729174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:33:35.737680 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3e46a768-5cac-4df6-8da4-bd22ff3211e1 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1579 microversion: 2.1 time: 0.305657 Oct 29 21:33:35.738284 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3215/6520] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:33:35 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1579 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:33:36.763324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:33:36.764060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:33:36.771031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:36.771793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:36.772248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:36.772977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:36.773443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:36.773951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:37.014200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:33:37.021994 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94cf6849-9431-45e9-a36a-47bb2dd45c40 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1579 microversion: 2.1 time: 0.263730 Oct 29 21:33:37.022597 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3306/6521] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:33:36 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1579 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:33:37.838884 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-46378b83-15f4-4622-947f-752e227b287c req-11b865a4-b063-425f-8f6b-b2522f0287bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ede645b-b942-419a-95f2-96e3b3e1ad5e", "name": "network-vif-deleted", "tag": "e7ddf2d6-b82a-4af1-9f9c-313438602c4b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:33:37.848722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46378b83-15f4-4622-947f-752e227b287c req-11b865a4-b063-425f-8f6b-b2522f0287bf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:37.849297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46378b83-15f4-4622-947f-752e227b287c req-11b865a4-b063-425f-8f6b-b2522f0287bf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:37.849782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-46378b83-15f4-4622-947f-752e227b287c req-11b865a4-b063-425f-8f6b-b2522f0287bf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:37.861865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-46378b83-15f4-4622-947f-752e227b287c req-11b865a4-b063-425f-8f6b-b2522f0287bf service nova] Creating event network-vif-deleted:e7ddf2d6-b82a-4af1-9f9c-313438602c4b for instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e on nch1-master-1 Oct 29 21:33:37.866598 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-46378b83-15f4-4622-947f-752e227b287c req-11b865a4-b063-425f-8f6b-b2522f0287bf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099484 Oct 29 21:33:37.867202 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3216/6522] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:33:38.047545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:33:38.048196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:33:38.059761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:38.060299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:38.060749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:38.061696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:38.062171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:38.062610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:38.099337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:38.099843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:38.100295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:38.100766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lazy-loading 'fault' on Instance uuid 3ede645b-b942-419a-95f2-96e3b3e1ad5e {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:33:38.148598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a26316480cd41b8b1469ced129540a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c3945de287465586005125fb5cdc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:33:38.157503 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-812e383d-dd92-4411-8876-719654a16b48 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 200 len: 1235 microversion: 2.1 time: 0.114422 Oct 29 21:33:38.158354 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3307/6523] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:33:38 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 1235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:33:39.182338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:33:39.183052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] [instance: 3ede645b-b942-419a-95f2-96e3b3e1ad5e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:33:39.189221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:39.189737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:39.190190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:39.190880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:33:39.191390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:33:39.191823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:33:39.205638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] HTTP exception thrown: Instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e could not be found. Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Request method failure captured: Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e HTTP/1.1 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZveXeA1IZr8ca1mjk5EhVKeOg9mxNRXiAyMzr3PAxf2nSpN2-ZOrYj_OgsIN2Il2GPRx2MitJZMUNeUBLtu00oZPH_1WJH2Cuq9c4ccnpD6n2sRnv_RywpC7gE3xfLqUbd1IRrfdQBwbbtGdE6eD-cSBUWfnrhhLSP3Tquk8xXy900 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 95c3945de287465586005125fb5cdc6f Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestVolumeBackupRestore-663968730 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95c3945de287465586005125fb5cdc6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_95c3945de287465586005125fb5cdc6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/95c3945de287465586005125fb5cdc6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/95c3945de287465586005125fb5cdc6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestVolumeBackupRestore-663968730 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 95c3945de287465586005125fb5cdc6f Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestVolumeBackupRestore-663968730 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestVolumeBackupRestore-663968730-project Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 1a26316480cd41b8b1469ced129540a9 Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestVolumeBackupRestore-663968730-project Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e could not be found. Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '3ede645b-b942-419a-95f2-96e3b3e1ad5e'} Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e could not be found. Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e could not be found. Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:33:39.207282 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e could not be found. Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Returning 404 to user: Instance 3ede645b-b942-419a-95f2-96e3b3e1ad5e could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c22b6419-0c8f-4d95-9229-7a3ba29da20d tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e" status: 404 len: 111 microversion: 2.1 time: 0.032299 Oct 29 21:33:39.211920 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3217/6524] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:33:39 2022] GET /compute/v2.1/servers/3ede645b-b942-419a-95f2-96e3b3e1ad5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:33:39.366564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d99941d0-8d14-453e-8304-9851a54d8788 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] Calling method '.version_select at 0x7fa17633da60>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:33:39.392097 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d99941d0-8d14-453e-8304-9851a54d8788 tempest-TestVolumeBackupRestore-663968730 tempest-TestVolumeBackupRestore-663968730-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1526349812" status: 202 len: 0 microversion: 2.1 time: 0.029156 Oct 29 21:33:39.392882 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3308/6525] 10.222.0.36 () {58 vars in 1269 bytes} [Sat Oct 29 21:33:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1526349812 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:34:01.327528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:01.328260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:01.440249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-171259654", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:01.496673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] validate_networks() for None {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:34:01.781712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:34:01.782149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:34:01.782638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:34:01.783088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:34:01.783511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:34:01.792538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:01.793030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:01.793500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:01.794244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:01.794710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:01.795144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:01.812464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Getting quotas for project 5f8daecf20194a43a479d4728ebdb9c6. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:34:01.817702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Getting quotas for user 6f3f03ca44844ea6be86e76e53e4d634 and project 5f8daecf20194a43a479d4728ebdb9c6. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:34:01.830969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:34:01.833285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:34:01.876636 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79254b37-dec3-4b0e-9416-6fc7907b7618 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555305 Oct 29 21:34:01.877297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3218/6526] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:34:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:34:01.889930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:01.891233 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:01.896905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-35820e81-cbe0-4c26-b8ab-aa1837c01379 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:01.898289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-35820e81-cbe0-4c26-b8ab-aa1837c01379 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:01.956591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-35820e81-cbe0-4c26-b8ab-aa1837c01379 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:01.963747 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-35820e81-cbe0-4c26-b8ab-aa1837c01379 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1221 microversion: 2.1 time: 0.077649 Oct 29 21:34:01.964328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3309/6527] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:01 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:02.987336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:02.987965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:02.995861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:02.996405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:02.997517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:02.998249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:02.998900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:02.999347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:03.070024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:03.078611 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5efa2008-7328-4a5c-bd63-c5aac04f4fad tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1281 microversion: 2.1 time: 0.095291 Oct 29 21:34:03.079870 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3219/6528] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:02 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:04.103419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:04.104047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:04.111295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:04.111808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:04.112260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:04.112989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:04.113480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:04.113930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:04.252507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:04.260588 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-945a7cd8-1d4b-4717-8649-616ff4cd70aa tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.161113 Oct 29 21:34:04.261187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3310/6529] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:04 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:04.763954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2e5a3216-9f12-4440-a983-e813e7e8924b req-f76c060e-5445-452d-b8ed-54d777ee6a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570d4a7c-b4a3-4c44-ab8d-cd095c3c3782", "tag": "384354cb-53f7-4c99-bd8e-0180cd8c73c7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:04.776334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2e5a3216-9f12-4440-a983-e813e7e8924b req-f76c060e-5445-452d-b8ed-54d777ee6a55 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:04.777405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2e5a3216-9f12-4440-a983-e813e7e8924b req-f76c060e-5445-452d-b8ed-54d777ee6a55 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:04.778553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2e5a3216-9f12-4440-a983-e813e7e8924b req-f76c060e-5445-452d-b8ed-54d777ee6a55 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:04.791638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2e5a3216-9f12-4440-a983-e813e7e8924b req-f76c060e-5445-452d-b8ed-54d777ee6a55 service nova] Creating event network-changed:384354cb-53f7-4c99-bd8e-0180cd8c73c7 for instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 on nch2-master-1 Oct 29 21:34:04.797307 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2e5a3216-9f12-4440-a983-e813e7e8924b req-f76c060e-5445-452d-b8ed-54d777ee6a55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037427 Oct 29 21:34:04.798110 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3220/6530] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:05.284398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:05.284959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:05.291891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:05.292396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:05.292858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:05.294118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:05.294592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:05.295041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:05.424854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:05.432717 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ee5a21f-4a1b-4393-87f5-5271d2349d9c tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.152343 Oct 29 21:34:05.433306 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3311/6531] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:05 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:06.457479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:06.458245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:06.465661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:06.466096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:06.466550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:06.467274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:06.467745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:06.468191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:06.606571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:06.614621 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa42ab3e-15fe-4c04-8838-21c1d4483fd2 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.161467 Oct 29 21:34:06.615255 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3221/6532] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:06 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:07.638601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:07.639244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:07.646172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:07.646674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:07.647133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:07.647840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:07.648311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:07.648757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:07.776597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:07.784367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc2f0fde-f74e-4c3f-9802-8a66ad5254a6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.150282 Oct 29 21:34:07.784942 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3312/6533] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:07 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:08.806365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:08.807017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:08.813904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:08.814387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:08.814832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:08.815526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:08.815988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:08.816429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:08.942880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:08.951433 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa38b723-662b-439a-94de-5ad033a6f91d tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.149060 Oct 29 21:34:08.952007 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3222/6534] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:08 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:09.974324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:09.975039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:09.982007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:09.982445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:09.982897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:09.983602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:09.984086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:09.984513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:10.116924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:10.125742 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db20d50a-61da-4069-8c2c-e96adacba9df tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.155353 Oct 29 21:34:10.126327 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3313/6535] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:09 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:11.149123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:11.149779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:11.157102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:11.157632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:11.158082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:11.158792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:11.159256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:11.159697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:11.287093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:11.295283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-da11f000-205d-47f7-aa0e-e3687cdc558e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.150031 Oct 29 21:34:11.295906 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3223/6536] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:11 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:11.728202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e53e0630-480f-41df-bcd4-6116009f508a req-85928baa-efaf-4693-9a27-85aa7cee9db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570d4a7c-b4a3-4c44-ab8d-cd095c3c3782", "name": "network-vif-plugged", "status": "completed", "tag": "384354cb-53f7-4c99-bd8e-0180cd8c73c7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:11.739729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e53e0630-480f-41df-bcd4-6116009f508a req-85928baa-efaf-4693-9a27-85aa7cee9db3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:11.740232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e53e0630-480f-41df-bcd4-6116009f508a req-85928baa-efaf-4693-9a27-85aa7cee9db3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:11.740680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e53e0630-480f-41df-bcd4-6116009f508a req-85928baa-efaf-4693-9a27-85aa7cee9db3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:11.752104 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e53e0630-480f-41df-bcd4-6116009f508a req-85928baa-efaf-4693-9a27-85aa7cee9db3 service nova] Creating event network-vif-plugged:384354cb-53f7-4c99-bd8e-0180cd8c73c7 for instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 on nch2-master-1 Oct 29 21:34:11.757356 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e53e0630-480f-41df-bcd4-6116009f508a req-85928baa-efaf-4693-9a27-85aa7cee9db3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Oct 29 21:34:11.758019 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3314/6537] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:12.318400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:12.319321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:12.321390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:12.322096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:12.329681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:12.330185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:12.330634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:12.331347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:12.332136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:12.332136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:12.466221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:12.474039 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-281f2c26-0df1-4152-a288-5dc62927d044 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1321 microversion: 2.1 time: 0.160144 Oct 29 21:34:12.474635 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3224/6538] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:12 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:13.494830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:13.499859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:13.500592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:13.507195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:13.507706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:13.508165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:13.508879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:13.509354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:13.509833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:13.646953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:13.655369 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-515a84c7-82bb-46e0-8621-60312238b7d4 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1471 microversion: 2.1 time: 0.161745 Oct 29 21:34:13.655950 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3315/6539] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:13 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:13.730188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f26e3297-1e4c-4518-8644-8936b975fe17 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Calling method '.version_select at 0x7fa1719b5550>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:13.796712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f26e3297-1e4c-4518-8644-8936b975fe17 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/1562cc5debd040bc8b9334e7d3da5215" status: 200 len: 371 microversion: 2.1 time: 0.120526 Oct 29 21:34:13.797262 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3225/6540] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 21:34:13 2022] GET /compute/v2.1/os-quota-sets/1562cc5debd040bc8b9334e7d3da5215 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:13.809836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6888e40d-b38f-44b7-a2e3-4895a1c4e942 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-577034606", "id": 470965397, "os-flavor-access:is_public": "True"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:13.834895 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6888e40d-b38f-44b7-a2e3-4895a1c4e942 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.029311 Oct 29 21:34:13.835473 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3316/6541] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:34:13 2022] POST /compute/v2.1/flavors => generated 434 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:13.848229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "470965397"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:13.850527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:13.857181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:13.857706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:13.858158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:13.858869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:13.859335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:13.859787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:13.945912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b892eff2e5b74c5fa5636f29a786ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1562cc5debd040bc8b9334e7d3da5215', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:13.951958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-577034606 {{(pid=138884) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:34:13.958701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:13.959180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:13.959646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:13.960369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:13.960849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:13.961271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:13.987055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Getting quotas for project 5f8daecf20194a43a479d4728ebdb9c6. Resources: {'ram', 'cores'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:34:13.992155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Getting quotas for user 6f3f03ca44844ea6be86e76e53e4d634 and project 5f8daecf20194a43a479d4728ebdb9c6. Resources: {'ram', 'cores'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:34:14.004086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.api [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] ram quota exceeded for 1562cc5debd040bc8b9334e7d3da5215, tried to resize instance. Oct 29 21:34:14.004843 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Request method failure captured: Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782/action HTTP/1.1 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 38 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZxJ6TOsiTAPlDsJZCGCtsSIO4sDGLKmfp0yHAV000HbGGKUsEYfJJ18kx1S0_nOJELIVaszI9wO_W4WOIleDhR64obwSlYx4UpfqtnfKT7tUF8B_VPPaUanvjfIRckVyNZ4FsEbhlVg_fR8_DUKtOlNL0LChtIEzRbE3sHfwwonBwg Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 1562cc5debd040bc8b9334e7d3da5215 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-561285753 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,admin,member Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,admin,member Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersAdminNegativeTestJSON-561285753 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 1562cc5debd040bc8b9334e7d3da5215 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-561285753 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersAdminNegativeTestJSON-561285753-project-admin Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: b892eff2e5b74c5fa5636f29a786ffd4 Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersAdminNegativeTestJSON-561285753-project-admin Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: {"resize": {"flavorRef": "470965397"}} Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '570d4a7c-b4a3-4c44-ab8d-cd095c3c3782', 'body': {'resize': {'flavorRef': '470965397'}}} Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:34:14.022846 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e7580abf-c475-4d5c-a3d0-8ffdcea18912 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782/action" status: 403 len: 118 microversion: 2.1 time: 0.179944 Oct 29 21:34:14.028652 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3226/6542] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:34:13 2022] POST /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782/action => generated 118 bytes in 181 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:34:14.033754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9d990b4c-90e3-49dd-abbf-57f0ded3d4bd tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.051397 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9d990b4c-90e3-49dd-abbf-57f0ded3d4bd tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/470965397" status: 202 len: 0 microversion: 2.1 time: 0.021461 Oct 29 21:34:14.051942 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3317/6543] 10.222.0.36 () {58 vars in 1158 bytes} [Sat Oct 29 21:34:14 2022] DELETE /compute/v2.1/flavors/470965397 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:34:14.059582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6aeaa6c2-21d5-4b45-a684-e20e02f58a65 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.080516 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6aeaa6c2-21d5-4b45-a684-e20e02f58a65 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024536 Oct 29 21:34:14.081083 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3227/6544] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 21:34:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:14.101935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-736cbbae-b479-4f9c-bf5b-34c023902341 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Calling method '.version_select at 0x7fa1701c4940>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.173930 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-736cbbae-b479-4f9c-bf5b-34c023902341 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/1562cc5debd040bc8b9334e7d3da5215" status: 200 len: 371 microversion: 2.1 time: 0.075691 Oct 29 21:34:14.174505 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3318/6545] 10.222.0.36 () {58 vars in 1242 bytes} [Sat Oct 29 21:34:14 2022] GET /compute/v2.1/os-quota-sets/1562cc5debd040bc8b9334e7d3da5215 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:14.186224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1658c0e7-dd31-4ab5-b806-dedc442046e3 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-396570653", "id": 24246809, "os-flavor-access:is_public": "True"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:14.206109 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1658c0e7-dd31-4ab5-b806-dedc442046e3 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.023502 Oct 29 21:34:14.206716 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3228/6546] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:34:14 2022] POST /compute/v2.1/flavors => generated 430 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:14.219375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "24246809"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:14.221832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:14.227985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.228483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.228936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.229672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.230143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.230586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.314459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b892eff2e5b74c5fa5636f29a786ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1562cc5debd040bc8b9334e7d3da5215', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:14.320785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-396570653 {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:34:14.327999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.328501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.328959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.329743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.330218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.330666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.351626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Getting quotas for project 5f8daecf20194a43a479d4728ebdb9c6. Resources: {'ram', 'cores'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:34:14.356755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Getting quotas for user 6f3f03ca44844ea6be86e76e53e4d634 and project 5f8daecf20194a43a479d4728ebdb9c6. Resources: {'ram', 'cores'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:34:14.368838 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.api [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] cores quota exceeded for 1562cc5debd040bc8b9334e7d3da5215, tried to resize instance. Oct 29 21:34:14.369400 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Request method failure captured: Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782/action HTTP/1.1 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 37 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZxJ6TOsiTAPlDsJZCGCtsSIO4sDGLKmfp0yHAV000HbGGKUsEYfJJ18kx1S0_nOJELIVaszI9wO_W4WOIleDhR64obwSlYx4UpfqtnfKT7tUF8B_VPPaUanvjfIRckVyNZ4FsEbhlVg_fR8_DUKtOlNL0LChtIEzRbE3sHfwwonBwg Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 1562cc5debd040bc8b9334e7d3da5215 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-561285753 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,admin,member Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,admin,member Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1562cc5debd040bc8b9334e7d3da5215"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-561285753 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 1562cc5debd040bc8b9334e7d3da5215 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-561285753 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAdminNegativeTestJSON-561285753-project-admin Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: b892eff2e5b74c5fa5636f29a786ffd4 Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-561285753-project-admin Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: {"resize": {"flavorRef": "24246809"}} Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '570d4a7c-b4a3-4c44-ab8d-cd095c3c3782', 'body': {'resize': {'flavorRef': '24246809'}}} Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:34:14.371497 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5bc658fa-9654-42d1-810d-59f237390b3b tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782/action" status: 403 len: 113 microversion: 2.1 time: 0.158111 Oct 29 21:34:14.376538 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3319/6547] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:34:14 2022] POST /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782/action => generated 113 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:34:14.382187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab1d0c91-4ba7-45dc-9ed5-315115cf5803 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.399769 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab1d0c91-4ba7-45dc-9ed5-315115cf5803 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/24246809" status: 202 len: 0 microversion: 2.1 time: 0.021464 Oct 29 21:34:14.400317 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3229/6548] 10.222.0.36 () {58 vars in 1155 bytes} [Sat Oct 29 21:34:14 2022] DELETE /compute/v2.1/flavors/24246809 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:34:14.408984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec701a3d-58ae-4591-b1ec-4bba9b928105 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.429254 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec701a3d-58ae-4591-b1ec-4bba9b928105 tempest-ServersAdminNegativeTestJSON-561285753 tempest-ServersAdminNegativeTestJSON-561285753-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024006 Oct 29 21:34:14.429833 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3320/6549] 10.222.0.36 () {58 vars in 1146 bytes} [Sat Oct 29 21:34:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:14.451869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.452372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:14.458357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.458837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.459278 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.459967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.460444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.460875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.485939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:34:14.560300 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fed59077-1f05-4e8c-8f74-d2f1aaf03795 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 204 len: 0 microversion: 2.1 time: 0.112704 Oct 29 21:34:14.560950 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3230/6550] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:34:14 2022] DELETE /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:34:14.569911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:14.570554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:14.578495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.579006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.579468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.580186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:14.580666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:14.581121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:14.712540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:14.720368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-540a183c-d6df-48c1-9323-c778f60b08e6 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1477 microversion: 2.1 time: 0.154895 Oct 29 21:34:14.720948 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3321/6551] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:14 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:15.744239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:15.744947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:15.751858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:15.752344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:15.752784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:15.753493 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:15.753953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:15.754380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:15.884126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:15.892465 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9ba33f6a-f428-482f-9555-0db6f7c20d25 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1477 microversion: 2.1 time: 0.152523 Oct 29 21:34:15.893037 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3231/6552] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:15 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:16.406517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ddad580b-11b9-4911-8443-970636bde3cd req-22bab3ac-a112-49ad-826c-fcc788fd359c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570d4a7c-b4a3-4c44-ab8d-cd095c3c3782", "name": "network-vif-deleted", "tag": "384354cb-53f7-4c99-bd8e-0180cd8c73c7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:16.421110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ddad580b-11b9-4911-8443-970636bde3cd req-22bab3ac-a112-49ad-826c-fcc788fd359c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:16.421644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ddad580b-11b9-4911-8443-970636bde3cd req-22bab3ac-a112-49ad-826c-fcc788fd359c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:16.422178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ddad580b-11b9-4911-8443-970636bde3cd req-22bab3ac-a112-49ad-826c-fcc788fd359c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:16.436704 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ddad580b-11b9-4911-8443-970636bde3cd req-22bab3ac-a112-49ad-826c-fcc788fd359c service nova] Creating event network-vif-deleted:384354cb-53f7-4c99-bd8e-0180cd8c73c7 for instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 on nch2-master-1 Oct 29 21:34:16.442422 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ddad580b-11b9-4911-8443-970636bde3cd req-22bab3ac-a112-49ad-826c-fcc788fd359c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039602 Oct 29 21:34:16.443037 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3322/6553] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:16.916942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:16.918993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:16.926157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:16.926556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:16.926996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:16.927701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:16.928159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:16.928590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:16.959826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:16.960313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:16.961194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:16.961706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lazy-loading 'fault' on Instance uuid 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:34:17.004989 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f3f03ca44844ea6be86e76e53e4d634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8daecf20194a43a479d4728ebdb9c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:17.012865 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad3b88c5-7b72-4fdc-a411-3d2b7d4c173e tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 200 len: 1311 microversion: 2.1 time: 0.100469 Oct 29 21:34:17.013481 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3232/6554] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:16 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:18.036917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:18.037609 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] [instance: 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:18.045282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:18.045812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:18.046267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:18.046966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:18.047432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:18.047870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:18.061932 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] HTTP exception thrown: Instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 could not be found. Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Request method failure captured: Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 HTTP/1.1 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZxI5pNXSGCdqZ3zs8HDjZKRC2aUYCZnMRKGBNTNjwExspONHfB5KT6E5ucJ6z307J4anwEXoS8TxRHyueP6kARrCS6nhDAILPLqLIiA_zMORYtHq5DIEEUAELXZ0oLFPofAICmr49i34dWnYhEcngBekjf-l_1fBWWDIdO5zJfiAvA Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 5f8daecf20194a43a479d4728ebdb9c6 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-785181933 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8daecf20194a43a479d4728ebdb9c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5f8daecf20194a43a479d4728ebdb9c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5f8daecf20194a43a479d4728ebdb9c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5f8daecf20194a43a479d4728ebdb9c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-785181933 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 5f8daecf20194a43a479d4728ebdb9c6 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-785181933 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersAdminNegativeTestJSON-785181933-project Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 6f3f03ca44844ea6be86e76e53e4d634 Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-785181933-project Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 could not be found. Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '570d4a7c-b4a3-4c44-ab8d-cd095c3c3782'} Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 could not be found. Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 could not be found. Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:18.063686 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 could not be found. Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] Returning 404 to user: Instance 570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c5648ee-3ea0-44d1-98fe-db93ec5eff41 tempest-ServersAdminNegativeTestJSON-785181933 tempest-ServersAdminNegativeTestJSON-785181933-project] 10.222.0.36 "GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782" status: 404 len: 111 microversion: 2.1 time: 0.032708 Oct 29 21:34:18.068088 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3323/6555] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:18 2022] GET /compute/v2.1/servers/570d4a7c-b4a3-4c44-ab8d-cd095c3c3782 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:34:24.109444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:24.110264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:24.233527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-383946762", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "caccdccf-fba9-4eb7-b4d3-ed41294962af"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:24.288808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] validate_networks() for [('caccdccf-fba9-4eb7-b4d3-ed41294962af', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:34:24.665427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:34:24.665891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:34:24.666365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:34:24.666778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:34:24.667189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:34:24.676656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:24.677139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:24.677609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:24.678342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:24.678797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:24.679223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:24.696668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Getting quotas for project 6ece1cf281544894a4f87499081414a1. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:34:24.701966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Getting quotas for user ec7a298ab975451c9169729bb19619ef and project 6ece1cf281544894a4f87499081414a1. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:34:24.714667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:34:24.717121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:34:24.763421 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-972c1b34-b91a-42ab-9081-ecb8d0356d5b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659459 Oct 29 21:34:24.764007 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3233/6556] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:34:24.775250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26150530-695a-4f32-afcc-02f74c3fd4d9 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:24.775886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26150530-695a-4f32-afcc-02f74c3fd4d9 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:24.778416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:24.779297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:24.834382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26150530-695a-4f32-afcc-02f74c3fd4d9 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:24.841608 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26150530-695a-4f32-afcc-02f74c3fd4d9 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1214 microversion: 2.1 time: 0.070268 Oct 29 21:34:24.842178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3324/6557] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:24 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:25.866981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:25.869326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:25.879380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:25.880246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:25.880973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:25.882031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:25.882728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:25.884305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:25.989177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:26.004532 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3900e2b3-2949-4122-9d44-c593b2bb3f9e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1274 microversion: 2.1 time: 0.143703 Oct 29 21:34:26.019768 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3234/6558] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:25 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:27.028865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:27.030659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:27.039156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:27.039660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:27.040122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:27.040879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:27.041635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:27.042073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:27.187173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:27.200423 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca8130c2-009f-4e37-bd46-673e12e547fd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.175338 Oct 29 21:34:27.201282 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3325/6559] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:27 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:27.687769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8b903820-8289-4c63-8677-18afa64e2586 req-78bae90d-36e9-442d-93ae-609ecfecccb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596a1ae4-eaf1-4db2-a310-fef05f4bcee2", "tag": "81d9b383-a27b-4ec7-b12c-2b767c13c43f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:27.706440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8b903820-8289-4c63-8677-18afa64e2586 req-78bae90d-36e9-442d-93ae-609ecfecccb2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:27.706822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8b903820-8289-4c63-8677-18afa64e2586 req-78bae90d-36e9-442d-93ae-609ecfecccb2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:27.709108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8b903820-8289-4c63-8677-18afa64e2586 req-78bae90d-36e9-442d-93ae-609ecfecccb2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:27.751386 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8b903820-8289-4c63-8677-18afa64e2586 req-78bae90d-36e9-442d-93ae-609ecfecccb2 service nova] Creating event network-changed:81d9b383-a27b-4ec7-b12c-2b767c13c43f for instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 on nch2-master-1 Oct 29 21:34:27.756734 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8b903820-8289-4c63-8677-18afa64e2586 req-78bae90d-36e9-442d-93ae-609ecfecccb2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072751 Oct 29 21:34:27.758017 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3235/6560] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:34:28.224074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:28.224714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:28.231731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:28.232236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:28.232694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:28.233397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:28.233914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:28.234360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:28.366191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:28.374720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-12d12214-16a5-4e6d-9f8f-35a101538bfa tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.154536 Oct 29 21:34:28.375300 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3326/6561] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:28 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:29.400837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:29.401767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:29.409514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:29.410008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:29.410448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:29.411149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:29.411701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:29.412127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:29.549977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:29.557849 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-990eee22-1926-48d5-8d6a-0e46b1c0d920 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.163504 Oct 29 21:34:29.558523 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3236/6562] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:29 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:30.582063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:30.582700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:30.589753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:30.590261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:30.590704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:30.591403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:30.591872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:30.592311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:30.720100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:30.727865 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08406883-27b0-475e-a89d-b5a4fbb20e78 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.149760 Oct 29 21:34:30.728440 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3327/6563] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:30 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:31.751828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:31.753075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:31.755939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:31.761283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:31.762405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:31.762860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:31.763572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:31.764032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:31.764468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:31.768087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:31.911765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:31.919772 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff45630c-8691-4bf7-a583-99e1c72b30ad tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.171877 Oct 29 21:34:31.920358 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3237/6564] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:31 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:32.943457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:32.944455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:32.949530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:32.953928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:32.954440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:32.954906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:32.955635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:32.956121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:32.956572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:32.960203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=74 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:33.090676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:33.098318 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-903c1599-d3b2-463e-8155-cd87b0417c9d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.158762 Oct 29 21:34:33.098890 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3328/6565] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:32 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:33.859347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3f0170db-ff33-4c97-8ab1-3be0d140ae5e req-7dcee838-4dad-4721-9ee2-8a35b0ffac47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596a1ae4-eaf1-4db2-a310-fef05f4bcee2", "name": "network-vif-plugged", "status": "completed", "tag": "81d9b383-a27b-4ec7-b12c-2b767c13c43f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:33.870707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3f0170db-ff33-4c97-8ab1-3be0d140ae5e req-7dcee838-4dad-4721-9ee2-8a35b0ffac47 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:33.871910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3f0170db-ff33-4c97-8ab1-3be0d140ae5e req-7dcee838-4dad-4721-9ee2-8a35b0ffac47 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:33.872696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3f0170db-ff33-4c97-8ab1-3be0d140ae5e req-7dcee838-4dad-4721-9ee2-8a35b0ffac47 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:33.885579 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3f0170db-ff33-4c97-8ab1-3be0d140ae5e req-7dcee838-4dad-4721-9ee2-8a35b0ffac47 service nova] Creating event network-vif-plugged:81d9b383-a27b-4ec7-b12c-2b767c13c43f for instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 on nch2-master-1 Oct 29 21:34:33.891323 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3f0170db-ff33-4c97-8ab1-3be0d140ae5e req-7dcee838-4dad-4721-9ee2-8a35b0ffac47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035905 Oct 29 21:34:33.891937 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3238/6566] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:34:34.122735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:34.123367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:34.130220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:34.130719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:34.131170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:34.131908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:34.132377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:34.132819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:34.260684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:34.269144 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd47b535-ce4f-4adf-8909-b49155d5f2f7 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1314 microversion: 2.1 time: 0.150862 Oct 29 21:34:34.269918 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3329/6567] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:34 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:35.289371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:35.290289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:35.295852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:35.296569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:35.303900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:35.304395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:35.305700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:35.306672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:35.307139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:35.307849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:35.450621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:35.458500 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ddb42a05-1457-4b64-8e75-d220a310f90f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1500 microversion: 2.1 time: 0.170149 Oct 29 21:34:35.459081 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3239/6568] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:35 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:35.481180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:34:35.483490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:35.485516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:34:35.491631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:35.492142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:35.492606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:35.493324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:35.493904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:35.494356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:35.522843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:35.528242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Old instance type m1.heat2, new instance type m1.heat {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:34:35.534841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:34:35.535288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:34:35.535788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:34:35.536223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:34:35.536659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:34:35.600076 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e8fad0f1-af4b-49e0-b92a-e48b5eb2bb05 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "POST /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2/action" status: 202 len: 0 microversion: 2.1 time: 0.122793 Oct 29 21:34:35.600720 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3330/6569] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:34:35 2022] POST /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:34:35.609078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:35.609742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:35.616321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:35.616469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:35.616934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:35.617739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:35.618286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:35.618799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:35.791155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:35.799710 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f39262b2-001d-445d-b3e0-0229ea83cfba tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1509 microversion: 2.1 time: 0.194541 Oct 29 21:34:35.800305 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3240/6570] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:35 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:34:36.823946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:36.824586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:36.834636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:36.834900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:36.835431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:36.836147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:36.836733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:36.837186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:36.970423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:36.978263 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9fcfeb41-a862-4826-80b5-8cd3c03dcf47 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1509 microversion: 2.1 time: 0.159636 Oct 29 21:34:36.978841 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3331/6571] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:36 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:38.002381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:38.003006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:38.009974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:38.010463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:38.010909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:38.012319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:38.012786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:38.013221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:38.147615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:38.155367 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45b9e099-1e9c-44e0-b216-7de063038ea6 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.156916 Oct 29 21:34:38.155950 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3241/6572] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:37 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:39.179468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:39.180147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:39.187633 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:39.188130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:39.188584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:39.190042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:39.190514 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:39.190959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:39.319602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:39.328043 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8b3906c2-0b3d-452a-8e9f-22409e1bdf6a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152466 Oct 29 21:34:39.328634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3332/6573] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:39 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:40.351740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:40.352359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:40.358899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:40.359384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:40.359822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:40.360513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:40.360973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:40.361400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:40.494775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:40.503112 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3cb890a0-6f89-457f-a4a7-cd06681f1f35 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.155730 Oct 29 21:34:40.503689 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3242/6574] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:40 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:41.526261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:41.526807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:41.534282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:41.534779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:41.535231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:41.535932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:41.536401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:41.536837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:41.665924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:41.674309 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a84438e3-aeca-423d-b3a5-1d6d7a986fe5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152049 Oct 29 21:34:41.674879 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3333/6575] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:41 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:42.697615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:42.698256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:42.705091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:42.705612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:42.706054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:42.706749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:42.707201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:42.707627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:42.835084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:42.842965 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1374b37c-bd14-411d-8bbc-eadfe0b9f379 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.149674 Oct 29 21:34:42.843545 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3243/6576] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:42 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:43.867056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:43.867614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:43.875085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:43.875586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:43.876043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:43.876757 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:43.877230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:43.877708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:44.008366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:44.016732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e5deb21-6cbb-4284-9e11-33f09ff6a871 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.153634 Oct 29 21:34:44.017315 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3334/6577] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:43 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:45.039744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:45.040369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:45.047835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:45.048332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:45.048778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:45.049500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:45.049966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:45.050402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:45.179748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:45.188261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b97c70d-b068-47da-af5a-2cf3f3c0a8c2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152506 Oct 29 21:34:45.188840 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3244/6578] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:45 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:46.211703 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:46.212339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:46.219420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:46.219925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:46.220382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:46.221088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:46.221586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:46.222030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:46.359129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:46.367026 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b0a8be1e-810d-4eb6-82d6-d32d43d20b20 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.159326 Oct 29 21:34:46.367634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3335/6579] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:46 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:47.389185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:47.389836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:47.397168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:47.397855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:47.398381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:47.399239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:47.399792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:47.400384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:47.531088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:47.538866 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-faccf04a-efe8-4374-8a26-6e5d9cd9e36b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.153575 Oct 29 21:34:47.539456 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3245/6580] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:47 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:48.562749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:48.563378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:48.570549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:48.571041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:48.571490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:48.572182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:48.572647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:48.573083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:48.700983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:48.708703 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d661ef8-f7d6-4578-9b7d-40599dd0f725 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.149916 Oct 29 21:34:48.709283 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3336/6581] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:48 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:49.732113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:49.732731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:49.739659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:49.740140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:49.740579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:49.741265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:49.741748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:49.742178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:49.872712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:49.880439 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e8a8b5b-6a96-49d5-b9a7-5161fb7e6d17 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152231 Oct 29 21:34:49.881015 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3246/6582] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:49 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:50.905150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:50.905810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:50.911863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:50.912370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:50.912827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:50.913559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:50.914037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:50.914484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:51.045010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:51.052780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc54fc74-1bd6-4951-bb3e-322fe75c223b tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152518 Oct 29 21:34:51.053355 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3337/6583] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:50 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:52.076683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:52.077337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:52.084120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:52.084605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:52.085045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:52.085769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:52.086223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:52.086651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:52.218336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:52.226283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-283c4051-3ac7-4307-babd-36d2149f8071 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.154118 Oct 29 21:34:52.226863 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3247/6584] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:52 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:53.249786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:53.250422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:53.257307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:53.257846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:53.258302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:53.259008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:53.259481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:53.259926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:53.389107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:53.397032 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b19a20b1-1273-4c90-bfe3-19b08b17cd15 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.151761 Oct 29 21:34:53.397677 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3338/6585] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:53 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:54.420780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:54.421401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:54.428472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:54.428956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:54.429396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:54.430117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:54.430575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:54.431012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:54.566144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:54.574234 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ea69ecde-1cf1-483b-a675-ef34b455acb2 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.157351 Oct 29 21:34:54.574820 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3248/6586] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:54 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:55.599000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:55.599631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:55.606557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:55.607076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:55.607529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:55.608231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:55.608700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:55.609140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:55.739773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:55.748091 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac022335-963f-44c2-85a9-f041e53a8b3c tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.153018 Oct 29 21:34:55.748668 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3339/6587] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:55 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:56.771902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:56.772519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:56.780064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:56.780553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:56.780996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:56.781720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:56.782179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:56.782614 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:56.908615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:56.916581 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c145340b-5573-42bb-a300-1f92ee26347f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.148603 Oct 29 21:34:56.917819 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3249/6588] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:56 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:57.940133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:57.940686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:57.947943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:57.948441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:57.948890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:57.949619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:57.950089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:57.950536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:58.080380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:58.088069 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-50d17927-c21e-4152-9b9f-a8a9e2631435 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.151975 Oct 29 21:34:58.088641 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3340/6589] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:57 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:34:59.112113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:34:59.112729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:34:59.119808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:59.120957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:59.120957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:59.121403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:34:59.121974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:34:59.122304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:34:59.252802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:34:59.260601 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ef4279f5-d24d-4398-b95a-b5a06b7c499a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152420 Oct 29 21:34:59.261171 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3250/6590] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:34:59 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:00.283765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:00.284395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:00.291342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:00.291839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:00.292291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:00.293021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:00.293522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:00.293962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:00.424602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:00.432361 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23852849-2450-419f-85e2-fdd9fa8c045d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.152515 Oct 29 21:35:00.432933 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3341/6591] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:00 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:01.456529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:01.457151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:01.464119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:01.464606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:01.465048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:01.465787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:01.466241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:01.467335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:01.602084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:01.610134 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-17420219-5df2-4fbd-93c3-37325560e5f3 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.157424 Oct 29 21:35:01.610717 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3251/6592] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:01 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:02.633607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:02.634252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:02.641184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:02.641753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:02.642218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:02.642968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:02.643446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:02.643895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:02.772103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:02.779939 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3e437a8d-4935-400c-8a0d-4fd43ca863e8 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.150258 Oct 29 21:35:02.780515 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3342/6593] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:02 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:03.802635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:03.803259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:03.806192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=30 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:03.812442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:03.812923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:03.813365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:03.814083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:03.814541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:03.814968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:03.817551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=86 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:03.947812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:03.955665 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a965a785-eede-4a4c-b8da-9404810c9dbd tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1514 microversion: 2.1 time: 0.156899 Oct 29 21:35:03.956238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3252/6594] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:03 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:04.979314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:04.979873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:04.983411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:04.989163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:04.989697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:04.990152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:04.990876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:04.991537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:04.991985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:04.996472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:05.244610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:05.253090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07effde8-a744-4802-b796-445bd59c298d tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1513 microversion: 2.1 time: 0.277781 Oct 29 21:35:05.253949 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3343/6595] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:04 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:05.352653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596a1ae4-eaf1-4db2-a310-fef05f4bcee2", "name": "network-vif-unplugged", "status": "completed", "tag": "81d9b383-a27b-4ec7-b12c-2b767c13c43f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:05.363748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:05.364384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:05.364840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:05.377389 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] Creating event network-vif-unplugged:81d9b383-a27b-4ec7-b12c-2b767c13c43f for instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 on nch1-master-1 Oct 29 21:35:05.383082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:35:05.393974 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-dc4b5790-192b-4d32-8165-a55594c5b535 req-846b2e69-c06f-48d1-aa79-4e174a0fab59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045078 Oct 29 21:35:05.394796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3253/6596] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:35:06.276324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:06.277083 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:06.284249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:06.284754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:06.285245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:06.285992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:06.286467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:06.286914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:06.421357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:06.429113 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-23ec7a2e-ada1-4da8-aff0-58dca56c0649 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1511 microversion: 2.1 time: 0.156648 Oct 29 21:35:06.429723 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3344/6597] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:06 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:07.410696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596a1ae4-eaf1-4db2-a310-fef05f4bcee2", "tag": "81d9b383-a27b-4ec7-b12c-2b767c13c43f"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:07.420287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:07.421308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:07.421768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:07.432910 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] Creating event network-changed:81d9b383-a27b-4ec7-b12c-2b767c13c43f for instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 on nch1-master-1 Oct 29 21:35:07.438736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:35:07.449781 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-aa2d9ea1-cdc8-4e79-ac07-3547e7a0301d req-46d7900c-0f86-4622-8082-be469cf4de91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044232 Oct 29 21:35:07.450657 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3254/6598] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:35:07.454133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:07.454771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:07.461767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:07.462268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:07.462807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:07.463476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:07.463951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:07.464395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:07.593336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:07.601619 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bd474156-f8d3-4f4e-ae53-2051c1ee1d5f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1511 microversion: 2.1 time: 0.151477 Oct 29 21:35:07.602216 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3345/6599] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:07 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:35:08.627093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:08.627822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:08.634013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:08.634499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:08.634936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:08.635627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:08.636079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:08.636504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:08.840583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:08.848619 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ba6f1d27-8707-43b6-a241-7ab2af6b771f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1511 microversion: 2.1 time: 0.227153 Oct 29 21:35:08.849219 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3255/6600] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:08 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:09.872301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:09.872942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:09.880450 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:09.880956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:09.881441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:09.882178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:09.882652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:09.883098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:10.013087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:10.020883 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f5bcf054-4933-4d16-a659-db5b933e8fbf tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1508 microversion: 2.1 time: 0.152651 Oct 29 21:35:10.021465 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3346/6601] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:09 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:10.043507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:10.044021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:10.050878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:10.051362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:10.051803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:10.052497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:10.052952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:10.053381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:10.079050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:35:10.127992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.compute.api [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Found an unconfirmed migration during delete, id: 16, status: finished Oct 29 21:35:11.311908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1a3026e7-57bb-46b0-8c23-e13dc77e4175 req-7f91ce9a-a670-4fdd-ace9-6ceec12494c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596a1ae4-eaf1-4db2-a310-fef05f4bcee2", "name": "network-vif-plugged", "status": "completed", "tag": "81d9b383-a27b-4ec7-b12c-2b767c13c43f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:11.321745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1a3026e7-57bb-46b0-8c23-e13dc77e4175 req-7f91ce9a-a670-4fdd-ace9-6ceec12494c6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:11.322241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1a3026e7-57bb-46b0-8c23-e13dc77e4175 req-7f91ce9a-a670-4fdd-ace9-6ceec12494c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:11.322690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1a3026e7-57bb-46b0-8c23-e13dc77e4175 req-7f91ce9a-a670-4fdd-ace9-6ceec12494c6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:11.334288 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1a3026e7-57bb-46b0-8c23-e13dc77e4175 req-7f91ce9a-a670-4fdd-ace9-6ceec12494c6 service nova] Creating event network-vif-plugged:81d9b383-a27b-4ec7-b12c-2b767c13c43f for instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 on nch1-master-1 Oct 29 21:35:11.339604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1a3026e7-57bb-46b0-8c23-e13dc77e4175 req-7f91ce9a-a670-4fdd-ace9-6ceec12494c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128356 Oct 29 21:35:11.340295 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3347/6602] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:35:11.596546 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-843a8429-5f71-4cdb-ad13-6489f6e2a11a tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "DELETE /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 204 len: 0 microversion: 2.1 time: 1.556646 Oct 29 21:35:11.597476 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3256/6603] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:35:10 2022] DELETE /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 0 bytes in 1558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:35:11.606614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:11.607340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:11.614555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:11.615123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:11.615584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:11.616301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:11.616774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:11.617249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:11.747922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:11.755726 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25b61768-8b66-49d8-889b-b93c7eabb30f tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1500 microversion: 2.1 time: 0.153921 Oct 29 21:35:11.756301 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3348/6604] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:11 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:12.779083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:12.779847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:12.786722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:12.787212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:12.787652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:12.788341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:12.788795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:12.789221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:12.919589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:12.927973 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6f8c00a3-4ab5-446f-904e-92c615368681 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1500 microversion: 2.1 time: 0.153138 Oct 29 21:35:12.928540 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3257/6605] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:12 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:13.751883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3a820dee-e503-4112-8c11-f3fe12e86a73 req-0434d8e2-7305-4346-8b4c-dedf1bedda2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596a1ae4-eaf1-4db2-a310-fef05f4bcee2", "name": "network-vif-deleted", "tag": "81d9b383-a27b-4ec7-b12c-2b767c13c43f"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:13.764720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3a820dee-e503-4112-8c11-f3fe12e86a73 req-0434d8e2-7305-4346-8b4c-dedf1bedda2d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:13.765151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3a820dee-e503-4112-8c11-f3fe12e86a73 req-0434d8e2-7305-4346-8b4c-dedf1bedda2d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:13.765730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3a820dee-e503-4112-8c11-f3fe12e86a73 req-0434d8e2-7305-4346-8b4c-dedf1bedda2d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:13.779105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3a820dee-e503-4112-8c11-f3fe12e86a73 req-0434d8e2-7305-4346-8b4c-dedf1bedda2d service nova] Creating event network-vif-deleted:81d9b383-a27b-4ec7-b12c-2b767c13c43f for instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 on nch1-master-1 Oct 29 21:35:13.786341 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3a820dee-e503-4112-8c11-f3fe12e86a73 req-0434d8e2-7305-4346-8b4c-dedf1bedda2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045038 Oct 29 21:35:13.786957 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3349/6606] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:35:13.952335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:13.952895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:13.959847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:13.960334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:13.960776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:13.961487 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:13.961949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:13.962372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:13.999285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:14.000114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:14.000799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:14.001390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lazy-loading 'fault' on Instance uuid 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:35:14.043391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec7a298ab975451c9169729bb19619ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ece1cf281544894a4f87499081414a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:14.051218 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-799fb7e3-bd3f-4682-b44b-4e9b39a2f371 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 200 len: 1304 microversion: 2.1 time: 0.103580 Oct 29 21:35:14.051795 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3258/6607] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:13 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:15.075864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:15.077183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:15.084292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:15.084795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:15.085245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:15.085978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:15.086449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:15.086893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:15.100542 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] HTTP exception thrown: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Request method failure captured: Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 HTTP/1.1 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZxfaGmzqE3J5u0SjmYbBkJm9poweLuAGcq4PvhCMAPopB1OM1RIpn86agKGMxI2TuLsx2T4BbwJkbMUw5gerOaPDtRWHaRb-0-nnUI2sDgQOxtFaWZ9-kUhlieMBldNz2BTjjCcpnNkH7-6CnzxDp-IJLZQb0wNl4t9uxoDvn_qyiU Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6ece1cf281544894a4f87499081414a1 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ece1cf281544894a4f87499081414a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ece1cf281544894a4f87499081414a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ece1cf281544894a4f87499081414a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ece1cf281544894a4f87499081414a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6ece1cf281544894a4f87499081414a1 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-1304678565-project Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ec7a298ab975451c9169729bb19619ef Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-1304678565-project Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '596a1ae4-eaf1-4db2-a310-fef05f4bcee2'} Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:35:15.102188 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Returning 404 to user: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bfe4b8bc-0f50-49b1-b58c-29b570d6145e tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 404 len: 111 microversion: 2.1 time: 0.031990 Oct 29 21:35:15.107306 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3350/6608] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:15 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:35:15.118541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:15.121373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:15.128953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:15.129466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:15.129928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:15.130635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:15.131138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:15.131580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:15.145663 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] HTTP exception thrown: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Request method failure captured: Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 HTTP/1.1 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZxfaGmzqE3J5u0SjmYbBkJm9poweLuAGcq4PvhCMAPopB1OM1RIpn86agKGMxI2TuLsx2T4BbwJkbMUw5gerOaPDtRWHaRb-0-nnUI2sDgQOxtFaWZ9-kUhlieMBldNz2BTjjCcpnNkH7-6CnzxDp-IJLZQb0wNl4t9uxoDvn_qyiU Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 6ece1cf281544894a4f87499081414a1 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ece1cf281544894a4f87499081414a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ece1cf281544894a4f87499081414a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ece1cf281544894a4f87499081414a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ece1cf281544894a4f87499081414a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 6ece1cf281544894a4f87499081414a1 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-DeleteServersTestJSON-1304678565-project Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: ec7a298ab975451c9169729bb19619ef Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-DeleteServersTestJSON-1304678565-project Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '596a1ae4-eaf1-4db2-a310-fef05f4bcee2'} Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:35:15.147363 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Returning 404 to user: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-28b35d18-78a1-4dad-8dad-17f6778eb651 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "DELETE /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 404 len: 111 microversion: 2.1 time: 0.034132 Oct 29 21:35:15.151960 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3259/6609] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:35:15 2022] DELETE /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:35:15.157437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:15.158098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] [instance: 596a1ae4-eaf1-4db2-a310-fef05f4bcee2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:15.164007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:15.164506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:15.164958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:15.165687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:15.166156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:15.166594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:15.183235 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] HTTP exception thrown: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Request method failure captured: Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 HTTP/1.1 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZxfaGmzqE3J5u0SjmYbBkJm9poweLuAGcq4PvhCMAPopB1OM1RIpn86agKGMxI2TuLsx2T4BbwJkbMUw5gerOaPDtRWHaRb-0-nnUI2sDgQOxtFaWZ9-kUhlieMBldNz2BTjjCcpnNkH7-6CnzxDp-IJLZQb0wNl4t9uxoDvn_qyiU Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 6ece1cf281544894a4f87499081414a1 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ece1cf281544894a4f87499081414a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ece1cf281544894a4f87499081414a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ece1cf281544894a4f87499081414a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ece1cf281544894a4f87499081414a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 6ece1cf281544894a4f87499081414a1 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1304678565 Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-DeleteServersTestJSON-1304678565-project Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: ec7a298ab975451c9169729bb19619ef Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-DeleteServersTestJSON-1304678565-project Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '596a1ae4-eaf1-4db2-a310-fef05f4bcee2'} Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:35:15.184768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] Returning 404 to user: Instance 596a1ae4-eaf1-4db2-a310-fef05f4bcee2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c216256e-2bca-4a60-bc18-87e3cf5560d5 tempest-DeleteServersTestJSON-1304678565 tempest-DeleteServersTestJSON-1304678565-project] 10.222.0.36 "GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2" status: 404 len: 111 microversion: 2.1 time: 0.032676 Oct 29 21:35:15.190029 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3351/6610] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:15 2022] GET /compute/v2.1/servers/596a1ae4-eaf1-4db2-a310-fef05f4bcee2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:35:23.477806 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:35:23.478374 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 29 21:35:23.600440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-585016010", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "492ade55-b19a-4b66-80dc-a0f3421186c2"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:23.660275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] validate_networks() for [('492ade55-b19a-4b66-80dc-a0f3421186c2', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:35:24.055641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:35:24.056068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:35:24.056574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:35:24.057599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:35:24.058025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:35:24.067343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:24.067833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:24.068272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:24.068999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:24.069473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:24.069906 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:24.088008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Getting quotas for project c13464632634450f891155723ad285d8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:35:24.093863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Getting quotas for user 3bd2b4fb23e9414489935a2059f9207a and project c13464632634450f891155723ad285d8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:35:24.106031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:35:24.108363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:35:24.154548 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d78e9267-5bd9-4571-9dad-aad92fc04df3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681506 Oct 29 21:35:24.155238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3260/6611] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:35:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:35:24.166791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5a8daf3-523d-4bf5-8f10-cafa2e9df52b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:24.167424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5a8daf3-523d-4bf5-8f10-cafa2e9df52b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:24.235271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d5a8daf3-523d-4bf5-8f10-cafa2e9df52b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:24.244048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5a8daf3-523d-4bf5-8f10-cafa2e9df52b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1217 microversion: 2.1 time: 0.081316 Oct 29 21:35:24.245088 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3352/6612] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:24 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:25.268933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:25.269581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:25.280982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:25.281512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:25.281956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:25.282708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:25.283139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:25.283574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:25.349818 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:25.359262 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-03bd12cc-d8eb-49d7-9d66-08967e27092a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1269 microversion: 2.1 time: 0.094066 Oct 29 21:35:25.359866 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3261/6613] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:25 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:26.383170 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:26.388109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:26.391532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=37 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:26.402103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:26.403463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:26.404110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:26.405650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:26.406415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:26.406852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:26.551108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:26.559386 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7cd4d996-2ce1-4fb3-b530-8152d6a0f192 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.180058 Oct 29 21:35:26.560151 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3353/6614] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:26 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:26.902890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7e6d35bd-8c17-4cd0-8805-f12a05b38d72 req-abb530b4-61d1-4e85-aa7e-1facfd955774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b24dfc-21b9-4a23-b02c-12def9934e56", "tag": "53a278ea-2966-4cd5-8c05-33dd53a75e72"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:26.916670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7e6d35bd-8c17-4cd0-8805-f12a05b38d72 req-abb530b4-61d1-4e85-aa7e-1facfd955774 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:26.917160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7e6d35bd-8c17-4cd0-8805-f12a05b38d72 req-abb530b4-61d1-4e85-aa7e-1facfd955774 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:26.917628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7e6d35bd-8c17-4cd0-8805-f12a05b38d72 req-abb530b4-61d1-4e85-aa7e-1facfd955774 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:26.938778 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7e6d35bd-8c17-4cd0-8805-f12a05b38d72 req-abb530b4-61d1-4e85-aa7e-1facfd955774 service nova] Creating event network-changed:53a278ea-2966-4cd5-8c05-33dd53a75e72 for instance b2b24dfc-21b9-4a23-b02c-12def9934e56 on nch2-master-1 Oct 29 21:35:26.944015 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7e6d35bd-8c17-4cd0-8805-f12a05b38d72 req-abb530b4-61d1-4e85-aa7e-1facfd955774 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046529 Oct 29 21:35:26.944717 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3262/6615] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:35:27.584325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:27.584960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:27.591984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:27.592466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:27.592920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:27.593728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:27.594203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:27.594647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:27.730634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:27.739221 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-449d0ec9-4a5d-49fd-be67-f8b9c8c89bc4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.158772 Oct 29 21:35:27.739818 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3354/6616] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:27 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:28.764930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:28.765606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:28.771848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:28.772337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:28.772782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:28.773505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:28.774143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:28.774581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:28.906033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:28.913767 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-833f4161-800d-4251-92b7-297b719cb820 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.154560 Oct 29 21:35:28.914341 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3263/6617] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:28 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:29.937560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:29.938366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:29.945591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:29.946091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:29.946544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:29.947254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:29.947717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:29.948163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:30.081015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:30.088921 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-efea9061-4d31-4586-aef6-983b06d272b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.155838 Oct 29 21:35:30.089571 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3355/6618] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:29 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:31.113559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:31.114207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:31.121069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:31.121601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:31.122150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:31.122851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:31.123368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:31.123836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:31.255333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:31.263107 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-897ee09b-b31b-4aab-b2b9-be5beeef891c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.153662 Oct 29 21:35:31.263677 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3264/6619] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:31 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:32.106709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-09160a58-f35d-4526-9cd1-e9d8628e9d1f req-74ec4c08-b934-424d-921e-e27fdea8207a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b24dfc-21b9-4a23-b02c-12def9934e56", "name": "network-vif-plugged", "status": "completed", "tag": "53a278ea-2966-4cd5-8c05-33dd53a75e72"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:32.118387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-09160a58-f35d-4526-9cd1-e9d8628e9d1f req-74ec4c08-b934-424d-921e-e27fdea8207a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:32.118886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-09160a58-f35d-4526-9cd1-e9d8628e9d1f req-74ec4c08-b934-424d-921e-e27fdea8207a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:32.119338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-09160a58-f35d-4526-9cd1-e9d8628e9d1f req-74ec4c08-b934-424d-921e-e27fdea8207a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:32.131329 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-09160a58-f35d-4526-9cd1-e9d8628e9d1f req-74ec4c08-b934-424d-921e-e27fdea8207a service nova] Creating event network-vif-plugged:53a278ea-2966-4cd5-8c05-33dd53a75e72 for instance b2b24dfc-21b9-4a23-b02c-12def9934e56 on nch2-master-1 Oct 29 21:35:32.136548 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-09160a58-f35d-4526-9cd1-e9d8628e9d1f req-74ec4c08-b934-424d-921e-e27fdea8207a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033618 Oct 29 21:35:32.137675 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3356/6620] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:35:32.286777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:32.287414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:32.294341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:32.294831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:32.295908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:32.296654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:32.297115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:32.297618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:32.431355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:32.439353 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d5034ca3-b16e-4277-a7aa-f50cd3c704b4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.156553 Oct 29 21:35:32.439953 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3265/6621] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:32 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:33.463877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:33.464507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:33.470798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:33.471297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:33.471751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:33.473477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:33.474140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:33.474589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:33.616829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:33.625481 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-95a522b2-f107-480c-baef-052876860c6d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1317 microversion: 2.1 time: 0.166759 Oct 29 21:35:33.626094 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3357/6622] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:33 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:34.650198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:34.650816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:34.653643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:34.654847 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:34.655798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:34.663017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:34.663503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:34.663942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:34.664645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:34.665102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:34.665562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:34.668660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:34.801304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:34.809355 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb253415-f145-496a-a724-49b471eda5bf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1507 microversion: 2.1 time: 0.163009 Oct 29 21:35:34.810075 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3266/6623] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:34 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:34.831716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:34.832349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:34.834434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:34.840901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:34.841397 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:34.842408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:34.843107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:34.843572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:34.844008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:34.975929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:34.984484 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ede5a75-2dfb-4fb3-9e11-b4d6b942b0e5 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1507 microversion: 2.1 time: 0.156705 Oct 29 21:35:34.985064 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3358/6624] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:34 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:35.006470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:35.008854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:35.015541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.016027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.016469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.017172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.017655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.018085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.082913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc8a7e9d-fd66-494e-bfc3-cc19e3717c9a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "PUT /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1079 microversion: 2.1 time: 0.080329 Oct 29 21:35:35.083538 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3267/6625] 10.222.0.36 () {60 vars in 1256 bytes} [Sat Oct 29 21:35:35 2022] PUT /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:35.102515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:35.103152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:35.105012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:35.110454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.110955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.111413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.112120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.112590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.113035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.244546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:35.252311 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b3f480a-347a-475d-b608-306e972418ab tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1505 microversion: 2.1 time: 0.153615 Oct 29 21:35:35.252899 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3359/6626] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:35 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:35.274747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:35.275305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:35.281967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.282450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.282888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.283580 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.284031 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.284454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.411982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:35.419718 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-561f0a53-539b-4f59-b214-ba6035412540 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1505 microversion: 2.1 time: 0.148905 Oct 29 21:35:35.420283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3268/6627] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:35 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:35.442482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:35:35.444681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:35.450924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.452023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.452476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.453181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.453688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.454133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.482042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:35.487453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Old instance type m1.heat2, new instance type m1.heat {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:35:35.494053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:35:35.494495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:35:35.494990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:35:35.495419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:35:35.495851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:35:35.557401 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d70608e3-548e-4fc8-bd71-094394be3640 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56/action" status: 202 len: 0 microversion: 2.1 time: 0.118815 Oct 29 21:35:35.558243 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3360/6628] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:35:35 2022] POST /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:35:35.567400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:35.567732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:35.574392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.574880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.575406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.576118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:35.577293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:35.577774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:35.745269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:35.754580 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-06e820e2-e8ba-406a-aa59-59fd345715b6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1516 microversion: 2.1 time: 0.191423 Oct 29 21:35:35.755154 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3269/6629] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:35 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:36.779287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:36.780516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:36.787426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:36.787925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:36.788383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:36.789087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:36.789596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:36.790043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:37.250493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:37.258842 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a71f0285-cbed-447b-8179-1121c2fd9b5f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1516 microversion: 2.1 time: 0.484404 Oct 29 21:35:37.259432 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3361/6630] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:36 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1516 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:38.282529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:38.283164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:38.290163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:38.290659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:38.291106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:38.291815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:38.292273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:38.292710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:38.422760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:38.430638 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4a3c3ebd-4326-408e-96c3-bb448ab07f06 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.152043 Oct 29 21:35:38.431209 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3270/6631] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:38 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:39.454956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:39.455588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:39.464261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:39.464711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:39.465172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:39.465911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:39.466387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:39.467366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:39.600457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:39.608395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b0cebe2-31fb-42da-985b-a7e777bf29c7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.157956 Oct 29 21:35:39.608976 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3362/6632] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:39 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:40.631787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:40.632418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:40.639049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:40.639532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:40.639969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:40.640659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:40.641112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:40.641567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:40.769910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:40.777834 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5a47f3c5-636c-41ff-af9f-5b6cbd242f86 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150125 Oct 29 21:35:40.778415 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3271/6633] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:40 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:41.802434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:41.803072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:41.809945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:41.810471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:41.811669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:41.812274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:41.812809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:41.813268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:41.947320 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:41.955175 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a2540ec1-f2c4-4ec9-9efd-0463c4c06b9e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.156679 Oct 29 21:35:41.955751 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3363/6634] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:41 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:42.978277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:42.978923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:42.985894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:42.986377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:42.986815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:42.987501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:42.987953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:42.988378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:43.116636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:43.124874 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-74d3b46f-59c9-4ed2-a1d8-143108a44829 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150503 Oct 29 21:35:43.125439 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3272/6635] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:42 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:44.148529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:44.149179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:44.156830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:44.157338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:44.157857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:44.158577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:44.159053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:44.159509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:44.287989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:44.295881 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-45290357-9b95-48d4-949d-44d298c0ce56 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.151248 Oct 29 21:35:44.296463 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3364/6636] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:44 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:45.319040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:45.319659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:45.326939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:45.327419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:45.327866 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:45.328575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:45.329009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:45.329434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:45.463257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:45.471652 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c8de7db-0632-4e54-8387-c88d0ab34115 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.156553 Oct 29 21:35:45.472238 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3273/6637] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:45 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:46.495439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:46.496074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:46.503371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:46.503875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:46.504333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:46.505046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:46.505547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:46.505992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:46.636637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:46.645016 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b983fdf9-105a-4720-a683-3edf097e703a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.153461 Oct 29 21:35:46.645620 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3365/6638] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:46 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:47.668185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:47.668803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:47.676344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:47.676827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:47.677267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:47.677997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:47.678474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:47.678898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:47.814207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:47.822420 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a4fae2a-a6b4-458d-bbfa-070def8b2657 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.158120 Oct 29 21:35:47.823001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3274/6639] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:47 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:48.846201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:48.846833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:48.853745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:48.854247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:48.854701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:48.855413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:48.855890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:48.856335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:48.985915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:48.993731 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-86c38426-4074-47ed-bb4c-f3c5a313dad3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.151391 Oct 29 21:35:48.994309 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3366/6640] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:48 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:50.016204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:50.016742 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:50.023650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:50.024133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:50.024571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:50.025294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:50.025781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:50.026213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:50.154227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:50.162261 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b5b6aa4-c0a3-4d50-a6fc-ba3c5d6fb341 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150038 Oct 29 21:35:50.162839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3275/6641] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:50 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:51.185064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:51.186255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:51.192594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:51.193090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:51.193662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:51.194366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:51.194857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:51.195304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:51.328726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:51.336486 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43cd3b44-8be9-4724-b20f-158ed00c5883 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.155340 Oct 29 21:35:51.337060 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3367/6642] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:51 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:52.359083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:52.359703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:52.366581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:52.367066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:52.367503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:52.368194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:52.368650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:52.369076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:52.497988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:52.505678 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3530e324-ab21-4257-be90-a13239b78c26 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150499 Oct 29 21:35:52.506249 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3276/6643] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:52 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:53.530063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:53.530601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:53.537603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:53.538099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:53.538555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:53.539253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:53.539720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:53.540187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:53.673685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:53.677169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:35:53.682614 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7b784330-37e2-43ba-9d82-deac6c60acba tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.157066 Oct 29 21:35:53.683185 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3368/6644] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:53 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:54.706194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:54.706810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:54.713749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:54.714234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:54.714673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:54.715364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:54.715822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:54.716249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:54.845750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:54.853606 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-546d8a87-3bea-477c-9fa8-f731f1e2e1be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.151268 Oct 29 21:35:54.854179 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3277/6645] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:54 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:55.877499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:55.878085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:55.886155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:55.886855 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:55.887311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:55.888046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:55.889162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:55.889639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:56.023332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:56.031202 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b879fdb3-4ac8-499f-870f-7d945c8f8622 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.158240 Oct 29 21:35:56.031787 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3369/6646] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:55 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:57.055084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:57.055729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:57.062828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:57.063311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:57.063751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:57.064440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:57.064896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:57.065351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:57.193299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:57.201434 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b296e78-4844-402e-ac91-f8450b5754f4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150270 Oct 29 21:35:57.202031 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3278/6647] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:57 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:58.224193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:58.224853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:58.231927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:58.232423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:58.232875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:58.234118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:58.234586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:58.235026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:58.363198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:58.370883 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8738025a-ae42-4c13-8896-eb93baf6f979 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150599 Oct 29 21:35:58.371492 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3370/6648] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:58 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:35:59.395327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:35:59.395894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:35:59.402944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:59.403442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:59.403895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:59.404633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:35:59.405100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:35:59.405568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:35:59.538012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:35:59.545902 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5caeeab1-c5e3-4a4c-8ff6-12e18842a9e3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.154607 Oct 29 21:35:59.546507 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3279/6649] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:35:59 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:00.570027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:00.570912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:00.577816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:00.578323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:00.578816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:00.579536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:00.580011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:00.580459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:00.708474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:00.716432 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f01cc47d-f77e-4ef0-b44b-aa30e5058c51 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.150372 Oct 29 21:36:00.717011 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3371/6650] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:00 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:01.739714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:01.740344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:01.747391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:01.747882 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:01.748331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:01.749597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:01.750066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:01.750504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:01.887061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:01.895385 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf4d8aac-1559-465d-b896-26beec4b382f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.159611 Oct 29 21:36:01.895975 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3280/6651] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:01 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:02.918726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:02.919352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:02.926362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:02.926858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:02.927310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:02.928013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:02.928482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:02.928923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:03.059151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:03.067070 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f0f0a2eb-be2f-4b43-9a14-e7c41841fea2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.152251 Oct 29 21:36:03.067717 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3372/6652] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:02 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:04.090047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:04.090664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:04.097620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:04.098102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:04.098540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:04.099233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:04.099688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:04.100119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:04.229076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:04.237417 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc008376-c5e5-437f-aeac-687d5f527be1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1521 microversion: 2.1 time: 0.151280 Oct 29 21:36:04.238004 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3281/6653] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:04 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:05.221932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b24dfc-21b9-4a23-b02c-12def9934e56", "name": "network-vif-unplugged", "status": "completed", "tag": "53a278ea-2966-4cd5-8c05-33dd53a75e72"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:05.227396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=32 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:05.233962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:05.234656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:05.235228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:05.247716 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] Creating event network-vif-unplugged:53a278ea-2966-4cd5-8c05-33dd53a75e72 for instance b2b24dfc-21b9-4a23-b02c-12def9934e56 on nch1-master-1 Oct 29 21:36:05.253113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:36:05.261779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:05.262507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:05.265705 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-1964a8bd-16a2-4690-97a6-05859f193305 req-41de3bf8-2c2f-4f7b-aec5-055087b3e795 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047806 Oct 29 21:36:05.266224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=32 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:05.266622 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3373/6654] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:05.271638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:05.272138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:05.272588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:05.273322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:05.273803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:05.274242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:05.277176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:05.491728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:05.500007 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f31db04b-a428-4830-8efc-aff2a7540a83 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1520 microversion: 2.1 time: 0.242381 Oct 29 21:36:05.500933 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3282/6655] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:05 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:36:06.524797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:06.525443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:06.533499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:06.534010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:06.534464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:06.535171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:06.535639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:06.536084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:06.664938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:06.672750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aff525c1-d543-41ea-9d1d-b64b9b582117 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1518 microversion: 2.1 time: 0.152277 Oct 29 21:36:06.673328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3374/6656] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:06 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:07.291549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b24dfc-21b9-4a23-b02c-12def9934e56", "tag": "53a278ea-2966-4cd5-8c05-33dd53a75e72"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:07.302592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:07.303080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:07.303520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:07.315907 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] Creating event network-changed:53a278ea-2966-4cd5-8c05-33dd53a75e72 for instance b2b24dfc-21b9-4a23-b02c-12def9934e56 on nch1-master-1 Oct 29 21:36:07.321736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:36:07.332247 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bed45015-7361-43ad-bafb-176d2e767b59 req-b015d22a-99bd-4427-b187-4321834e6687 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044444 Oct 29 21:36:07.332839 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3283/6657] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:07.696960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:07.697629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:07.704426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:07.704932 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:07.705392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:07.706137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:07.706614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:07.707059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:07.845617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:07.853577 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cc6d0e54-9fa5-4bfb-8d44-e2783ec8d8d4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1518 microversion: 2.1 time: 0.160921 Oct 29 21:36:07.854351 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3375/6658] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:07 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:08.880093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:08.881114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:08.887468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:08.888034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:08.888548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:08.889296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:08.890288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:08.890725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:09.051561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:09.059322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3ee0329-471a-48f0-a73c-709e48576fdd tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1518 microversion: 2.1 time: 0.184689 Oct 29 21:36:09.059894 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3284/6659] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:08 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:10.083190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:10.083823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:10.090915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:10.091415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:10.091876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:10.092585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:10.093059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:10.093529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:10.226685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:10.235077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b953798-9dd8-4840-8dd0-33449db0f7f1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1515 microversion: 2.1 time: 0.155801 Oct 29 21:36:10.235655 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3376/6660] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:10 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:10.257832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:10.258384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:10.265307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:10.265863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:10.266309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:10.267008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:10.267465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:10.267894 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:10.325513 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-062e186c-acda-4ec4-b8e6-012e3a119353 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56/action" status: 204 len: 0 microversion: 2.1 time: 0.071466 Oct 29 21:36:10.326150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3285/6661] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:36:10 2022] POST /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:36:10.334216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:10.334849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:10.340953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:10.341471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:10.342002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:10.342710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:10.343178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:10.343615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:10.475721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:10.484277 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96c2d17c-0b7a-4da5-a26e-395121103676 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1515 microversion: 2.1 time: 0.153888 Oct 29 21:36:10.484854 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3377/6662] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:10 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:11.471512 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b24dfc-21b9-4a23-b02c-12def9934e56", "name": "network-vif-plugged", "status": "completed", "tag": "53a278ea-2966-4cd5-8c05-33dd53a75e72"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:11.481160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:11.481651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:11.482178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:11.495146 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] Creating event network-vif-plugged:53a278ea-2966-4cd5-8c05-33dd53a75e72 for instance b2b24dfc-21b9-4a23-b02c-12def9934e56 on nch1-master-1 Oct 29 21:36:11.501189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:36:11.508041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:11.508669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:11.518265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:11.519128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:11.519854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:11.520874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:11.521593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:11.522373 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d35b4c39-11f3-49e8-a0b3-02e09d12ea5f req-6414221c-1d27-4fba-8d95-dd0666ddc3b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056635 Oct 29 21:36:11.522748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:11.523150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3286/6663] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:11.657013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:11.664804 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-47a1c0ef-c701-4ad6-83a8-adf1b1931556 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1515 microversion: 2.1 time: 0.160553 Oct 29 21:36:11.665380 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3378/6664] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:11 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:12.691198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:12.691915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:12.698506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:12.699153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:12.699595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:12.700284 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:12.700736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:12.701161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:12.834210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:12.842028 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c9de133-7761-4458-8816-2e1e1042f579 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1507 microversion: 2.1 time: 0.156765 Oct 29 21:36:12.842610 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3287/6665] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:12 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:36:12.864534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:12.865171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:12.872045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:12.872545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:12.873000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:12.873763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:12.874235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:12.875292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:13.006540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:13.014276 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6cd0cd0f-0cbd-42cc-81f6-91f06443d2a3 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1507 microversion: 2.1 time: 0.153633 Oct 29 21:36:13.014932 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3379/6666] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:12 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:13.039306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c2409d0-fe49-4f68-87ff-8d0714101c8f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'create', calling method: .version_select at 0x7fa1718661f0>, body: {"keypair": {"name": "tempest-keypair-1456095834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETtbTCWsYwu8rQbrg2RE65gp2z+TooUCB46j/SSs5XEBVugRT0uDTVhj1JHJxXAV5DG5GYAeMNAti63Dneuk3G5bNtNmqOnfc2qAnI243jsYsBQUQ2bk+RSREBI6OTILQ=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:13.055193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7c2409d0-fe49-4f68-87ff-8d0714101c8f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Getting quotas for project c13464632634450f891155723ad285d8. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:36:13.060431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7c2409d0-fe49-4f68-87ff-8d0714101c8f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Getting quotas for user 3bd2b4fb23e9414489935a2059f9207a and project c13464632634450f891155723ad285d8. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:36:13.088340 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c2409d0-fe49-4f68-87ff-8d0714101c8f tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052923 Oct 29 21:36:13.088939 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3288/6667] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:36:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:14.254610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:14.255229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:14.262299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:14.262802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:14.263260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:14.263969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:14.264441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:14.264885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:14.397889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:14.406105 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-421fe30f-c30d-43df-9491-d0737120d617 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 200 len: 1507 microversion: 2.1 time: 0.155071 Oct 29 21:36:14.406634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3380/6668] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:14 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:14.429591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:14.430096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:14.436918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:14.437985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:14.438436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:14.439140 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:14.439607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:14.440044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:14.464907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:36:14.542451 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14ed5d0d-c77b-4af1-b8af-e286abc3fbed tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 204 len: 0 microversion: 2.1 time: 0.117479 Oct 29 21:36:14.544059 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3289/6669] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:36:14 2022] DELETE /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:36:14.602523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1029068066", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "492ade55-b19a-4b66-80dc-a0f3421186c2"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:14.656287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] validate_networks() for [('492ade55-b19a-4b66-80dc-a0f3421186c2', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:36:15.023287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:36:15.023739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:36:15.024240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:36:15.024677 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:36:15.025115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:36:15.035000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:15.035500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:15.035955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:15.036693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:15.037162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:15.037646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:15.055142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Getting quotas for project c13464632634450f891155723ad285d8. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:36:15.060343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Getting quotas for user 3bd2b4fb23e9414489935a2059f9207a and project c13464632634450f891155723ad285d8. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:36:15.072854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:36:15.075207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:36:15.120836 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c2e60dbb-a38d-407d-850c-07174cba05ee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522042 Oct 29 21:36:15.121511 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3381/6670] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:36:15.133250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5079dfd0-8bd3-4b92-9c31-49f20e73b6b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:15.134682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5079dfd0-8bd3-4b92-9c31-49f20e73b6b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:15.190187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5079dfd0-8bd3-4b92-9c31-49f20e73b6b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:15.199378 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5079dfd0-8bd3-4b92-9c31-49f20e73b6b0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1218 microversion: 2.1 time: 0.068691 Oct 29 21:36:15.199378 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3290/6671] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:15 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:16.221478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:16.222133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:16.229949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:16.231092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:16.231570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:16.232309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:16.232788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:16.233268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:16.296956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:16.305257 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7911299d-ade4-4f3c-9116-956ff11d726a tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1270 microversion: 2.1 time: 0.088201 Oct 29 21:36:16.306063 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3382/6672] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:16 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:16.821723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c05223bc-82a8-4444-a4e9-e144feb572e4 req-694cbe1d-fde5-4c75-a5a0-f8f4ac90d6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b24dfc-21b9-4a23-b02c-12def9934e56", "name": "network-vif-deleted", "tag": "53a278ea-2966-4cd5-8c05-33dd53a75e72"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:16.834981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c05223bc-82a8-4444-a4e9-e144feb572e4 req-694cbe1d-fde5-4c75-a5a0-f8f4ac90d6bc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:16.835479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c05223bc-82a8-4444-a4e9-e144feb572e4 req-694cbe1d-fde5-4c75-a5a0-f8f4ac90d6bc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:16.836019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c05223bc-82a8-4444-a4e9-e144feb572e4 req-694cbe1d-fde5-4c75-a5a0-f8f4ac90d6bc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:16.849554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c05223bc-82a8-4444-a4e9-e144feb572e4 req-694cbe1d-fde5-4c75-a5a0-f8f4ac90d6bc service nova] Creating event network-vif-deleted:53a278ea-2966-4cd5-8c05-33dd53a75e72 for instance b2b24dfc-21b9-4a23-b02c-12def9934e56 on nch1-master-1 Oct 29 21:36:16.855977 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c05223bc-82a8-4444-a4e9-e144feb572e4 req-694cbe1d-fde5-4c75-a5a0-f8f4ac90d6bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038827 Oct 29 21:36:16.856837 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3291/6673] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:17.330016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:17.331275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:17.339205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:17.339720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:17.340181 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:17.340907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:17.341380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:17.341872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:17.487483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:17.495249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8e59467-c64c-4145-8141-507440c0c451 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.169741 Oct 29 21:36:17.495816 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3383/6674] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:17 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:18.075979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-fc3dc283-4d0b-4640-9283-8e06017df000 req-27bd72be-66da-4246-98e7-9015f0475398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e", "tag": "52dad8de-4799-43c3-9fdb-2e06c4b23ccc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:18.086229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fc3dc283-4d0b-4640-9283-8e06017df000 req-27bd72be-66da-4246-98e7-9015f0475398 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:18.086709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fc3dc283-4d0b-4640-9283-8e06017df000 req-27bd72be-66da-4246-98e7-9015f0475398 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:18.087146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fc3dc283-4d0b-4640-9283-8e06017df000 req-27bd72be-66da-4246-98e7-9015f0475398 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:18.098090 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-fc3dc283-4d0b-4640-9283-8e06017df000 req-27bd72be-66da-4246-98e7-9015f0475398 service nova] Creating event network-changed:52dad8de-4799-43c3-9fdb-2e06c4b23ccc for instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e on nch1-master-1 Oct 29 21:36:18.102854 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-fc3dc283-4d0b-4640-9283-8e06017df000 req-27bd72be-66da-4246-98e7-9015f0475398 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109712 Oct 29 21:36:18.103450 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3292/6675] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:18.518374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:18.519001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:18.525893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:18.526390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:18.526839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:18.527540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:18.528004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:18.528445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:18.658478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:18.666256 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad0d27c6-d48d-4af5-8da4-e64bb412baae tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.151796 Oct 29 21:36:18.666834 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3384/6676] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:18 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:19.691067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:19.691771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:19.698279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:19.698754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:19.699190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:19.699873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:19.700328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:19.700753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:19.832856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:19.840540 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b4daf052-fe2c-45eb-b6c8-5bb996b6de6e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.155224 Oct 29 21:36:19.841111 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3293/6677] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:19 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:20.863440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:20.864078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:20.870410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:20.870913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:20.871374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:20.872087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:20.872560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:20.873009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:21.002038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:21.009940 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1fdafe42-cb4c-4aed-9241-5e082fc7d4cb tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.150532 Oct 29 21:36:21.010510 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3385/6678] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:20 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:22.034205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:22.034832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:22.041777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:22.042269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:22.042715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:22.043417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:22.043879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:22.044345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:22.176527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:22.184302 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-de88ecb3-dc2d-47a5-a6b7-7bddcf0a80b2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.154683 Oct 29 21:36:22.184912 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3294/6679] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:22 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:23.207727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:23.208356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:23.215635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:23.216137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:23.216593 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:23.217310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:23.217811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:23.218767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:23.241101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:23.354026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:23.361835 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a8f72a6c-10a5-4db7-9ff4-d3fc9e224b27 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.158005 Oct 29 21:36:23.362414 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3386/6680] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:23 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:23.533370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-54db09fc-6eb1-4ab2-a932-41ba2aca35b7 req-1035bbfa-c249-4740-aa8c-06dc99b206b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e", "name": "network-vif-plugged", "status": "completed", "tag": "52dad8de-4799-43c3-9fdb-2e06c4b23ccc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:23.544958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-54db09fc-6eb1-4ab2-a932-41ba2aca35b7 req-1035bbfa-c249-4740-aa8c-06dc99b206b3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:23.545443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-54db09fc-6eb1-4ab2-a932-41ba2aca35b7 req-1035bbfa-c249-4740-aa8c-06dc99b206b3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:23.545911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-54db09fc-6eb1-4ab2-a932-41ba2aca35b7 req-1035bbfa-c249-4740-aa8c-06dc99b206b3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:23.556847 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-54db09fc-6eb1-4ab2-a932-41ba2aca35b7 req-1035bbfa-c249-4740-aa8c-06dc99b206b3 service nova] Creating event network-vif-plugged:52dad8de-4799-43c3-9fdb-2e06c4b23ccc for instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e on nch1-master-1 Oct 29 21:36:23.561875 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-54db09fc-6eb1-4ab2-a932-41ba2aca35b7 req-1035bbfa-c249-4740-aa8c-06dc99b206b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Oct 29 21:36:23.562468 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3295/6681] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:24.385558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:24.386193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:24.393061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:24.393599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:24.394063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:24.394772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:24.395243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:24.395712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:24.522606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:24.530329 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da07b0e5-e4f5-4390-a083-1475ab5298de tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1318 microversion: 2.1 time: 0.148864 Oct 29 21:36:24.531410 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3387/6682] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:24 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:25.551666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:25.555941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:25.556651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:25.563179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:25.563668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:25.564112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:25.564803 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:25.565261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:25.565727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:25.702209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:25.710608 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1faeaa5d-8dd5-4ab7-93aa-a1175be03ac0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1508 microversion: 2.1 time: 0.160867 Oct 29 21:36:25.711197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3296/6683] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:25 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:25.733826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:25.734499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:25.736418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:25.737213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:25.743861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:25.744370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:25.744829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:25.745587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:25.746067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:25.746518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:25.876377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:25.884219 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ccb61785-f12f-4ef4-bb9f-2afc7cfc25fa tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1508 microversion: 2.1 time: 0.154362 Oct 29 21:36:25.884799 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3388/6684] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:25 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:25.907394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:25.909758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:25.915806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:25.916291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:25.916734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:25.917417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:25.917897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:25.918333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:25.947288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:25.953517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Old instance type m1.heat2, new instance type m1.heat {{(pid=138884) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:36:25.960086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:36:25.960508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:36:25.960982 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:36:25.961389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:36:25.961834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:36:26.025478 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-500b4ed2-470d-47b5-be7f-0e1e8bdd4a85 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e/action" status: 202 len: 0 microversion: 2.1 time: 0.122583 Oct 29 21:36:26.026119 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3297/6685] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:36:25 2022] POST /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:36:26.034687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:26.035464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:26.041891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:26.042439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:26.042896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:26.043619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:26.044225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:26.044681 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:26.202973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:26.211119 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-50e4ae90-4be7-4385-a661-865925840a38 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1515 microversion: 2.1 time: 0.180512 Oct 29 21:36:26.211949 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3389/6686] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:26 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:27.236223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:27.236854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:27.243746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:27.244246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:27.244668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:27.245355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:27.245836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:27.246266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:27.389004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:27.396916 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b99f9d1-23d5-44b1-8131-c62a8c4f4884 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1515 microversion: 2.1 time: 0.166045 Oct 29 21:36:27.397519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3298/6687] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:27 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:28.420009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:28.420550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:28.427570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:28.428069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:28.428522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:28.429229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:28.429724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:28.430167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:28.558390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:28.566769 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-81d98a41-0caa-4bfd-9953-f9f7f41c4342 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.150760 Oct 29 21:36:28.567346 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3390/6688] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:28 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:29.590927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:29.591579 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:29.599116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:29.599596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:29.600035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:29.600728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:29.601182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:29.601642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:29.605703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:29.731381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:29.739129 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-30d831aa-38f1-4378-966b-05b9380d8ff4 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.152155 Oct 29 21:36:29.739702 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3299/6689] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:29 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:30.763064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:30.763692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:30.771292 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:30.771794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:30.772244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:30.772948 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:30.773408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:30.773873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:30.904555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:30.912930 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc951302-baf1-4bc0-b586-8f1ebb46c18e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.153798 Oct 29 21:36:30.913550 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3391/6690] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:30 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:31.935259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:31.935913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:31.943437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:31.943919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:31.944361 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:31.945054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:31.945529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:31.945961 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:32.076370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:32.084344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc11d602-749b-42a0-97b6-ef6f31b1fc3e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.153047 Oct 29 21:36:32.084930 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3300/6691] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:31 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:33.107808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:33.108446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:33.115811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:33.116391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:33.116771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:33.117505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:33.117982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:33.118426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:33.254601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:33.262395 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6df01d60-4f4f-4195-8be2-04c32be4f9be tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.158453 Oct 29 21:36:33.262975 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3392/6692] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:33 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:34.285010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:34.285665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:34.292993 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:34.293514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:34.293962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:34.294668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:34.295129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:34.295581 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:34.429674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:34.437526 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7b08f51b-682d-4992-be23-1adb15f94aee tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.156382 Oct 29 21:36:34.438103 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3301/6693] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:34 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:35.462538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:35.463102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:35.465892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:35.471459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:35.471956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:35.472407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:35.473110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:35.473629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:35.474071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:35.601271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:35.609129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0e47871d-245d-4e56-b8d6-86e21b996335 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.150579 Oct 29 21:36:35.609737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3393/6694] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:35 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:36.632598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:36.633316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:36.636114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:36.643227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:36.643796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:36.644244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:36.644942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:36.645397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:36.645843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:36.782591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:36.790486 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-622d0a18-5b50-4172-9c05-be67a5d36796 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.161692 Oct 29 21:36:36.791062 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3302/6695] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:36 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:37.814612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:37.815248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:37.822553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:37.823054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:37.823507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:37.824210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:37.824686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:37.825128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:37.955643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:37.963396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-707460d2-c67d-4b98-8752-e805fb18fe4b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.152732 Oct 29 21:36:37.963982 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3394/6696] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:37 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:36:38.986787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:38.987410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:38.993665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:38.994154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:38.994594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:38.995291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:38.995749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:38.996177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:39.128008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:39.135786 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff8d75a4-8536-4a32-b255-7db57161175d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.153165 Oct 29 21:36:39.136363 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3303/6697] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:38 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:40.159284 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:40.159911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:40.166873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:40.167363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:40.167810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:40.168508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:40.168975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:40.169411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:40.296861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:40.304609 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8e5afb85-bc5c-4a8e-82a6-38cb0367e7e7 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.149852 Oct 29 21:36:40.305187 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3395/6698] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:40 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:41.328336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:41.329151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:41.336728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:41.337213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:41.337696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:41.338399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:41.338860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:41.339290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:41.471120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:41.478906 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b2af3b4-cd86-4ea7-b2dd-ae12bda36f3c tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.154528 Oct 29 21:36:41.479476 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3304/6699] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:41 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:42.503252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:42.503805 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:42.510766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:42.511270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:42.511727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:42.512433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:42.512905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:42.513347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:42.645182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:42.653145 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-690bfc6c-6388-4d43-98e5-85c3ffe254b8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.154385 Oct 29 21:36:42.653757 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3396/6700] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:42 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:43.676812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:43.677476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:43.684304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:43.684792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:43.685231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:43.685952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:43.686408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:43.686837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:43.814299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:43.822322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02e6326d-5aed-4b5a-9062-b83c044eafd6 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.149899 Oct 29 21:36:43.822900 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3305/6701] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:43 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:44.845359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:44.846033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:44.852908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:44.853411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:44.853903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:44.854610 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:44.855081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:44.855528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:44.985243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:44.992978 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41305a48-cb7f-465e-a6c0-0d868b54a40d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.151555 Oct 29 21:36:44.993577 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3397/6702] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:44 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:46.016267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:46.016808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:46.023660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:46.024146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:46.024584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:46.025290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:46.025772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:46.026202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:46.155901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:46.163741 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8433e0be-341e-4f59-8b3e-72baa9ec3638 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.151425 Oct 29 21:36:46.164312 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3306/6703] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:46 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:47.188021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:47.189102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:47.196041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:47.196807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:47.197255 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:47.197988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:47.198457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:47.198897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:47.333239 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:47.340954 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4c4e4a7e-0bdb-4845-98aa-706e21b8e2df tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.156899 Oct 29 21:36:47.341554 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3398/6704] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:47 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:48.364781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:48.365411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:48.372445 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:48.372936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:48.373384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:48.374116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:48.374583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:48.375024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:48.505648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:48.513403 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-29ec578a-28ad-483e-84d2-35e9b6e452af tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.152543 Oct 29 21:36:48.514020 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3307/6705] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:48 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:49.537325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:49.538005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:49.544711 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:49.545214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:49.545701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:49.546408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:49.546882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:49.547325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:49.675412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:49.683228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1c503fc5-ff66-4cf6-8819-588f3d5d0265 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.149826 Oct 29 21:36:49.683811 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3399/6706] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:49 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:50.707596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:50.708222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:50.715172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:50.715665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:50.716115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:50.716815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:50.717283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:50.717748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:50.850062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:50.857934 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c2e21e88-fca3-4e84-add2-b719237a159d tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.154859 Oct 29 21:36:50.858529 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3308/6707] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:50 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:51.881733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:51.882318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:51.888802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:51.889282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:51.889773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:51.890478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:51.890949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:51.891391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:52.018311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:52.025958 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-068ca7b0-92eb-400e-991e-7d517c2fe5a2 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.148351 Oct 29 21:36:52.026540 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3400/6708] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:51 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:53.048514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:53.049137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:53.056189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:53.056681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:53.057124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:53.057975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:53.058439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:53.058876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:53.189986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:53.198187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eb0637ac-ef8f-43ae-90e2-617e746ea514 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.153607 Oct 29 21:36:53.198758 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3309/6709] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:53 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:54.223161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:54.223803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:54.230747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:54.231254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:54.231714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:54.232425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:54.232898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:54.233349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:54.237441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=87 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:36:54.361698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:54.369415 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8744402b-ee3b-4cbd-a99d-4c046ff39d3b tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1520 microversion: 2.1 time: 0.150928 Oct 29 21:36:54.370025 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3401/6710] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:54 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:55.392834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:55.393480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:55.400299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:55.400788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:55.401223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:55.401945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:55.402400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:55.402833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:55.539240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:55.547199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e91868f8-0868-45e7-b6e4-ac2eca761e55 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1519 microversion: 2.1 time: 0.158376 Oct 29 21:36:55.548365 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3310/6711] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:55 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:55.867667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e", "name": "network-vif-unplugged", "status": "completed", "tag": "52dad8de-4799-43c3-9fdb-2e06c4b23ccc"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:55.879022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:55.879519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:55.879971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:55.892629 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] Creating event network-vif-unplugged:52dad8de-4799-43c3-9fdb-2e06c4b23ccc for instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e on nch2-master-1 Oct 29 21:36:55.898124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:36:55.910202 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-4b8c906f-caaf-42fc-808d-2f6719bec712 req-a4f80eb9-3170-434c-b1b1-c2b5946695aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046542 Oct 29 21:36:55.910824 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3402/6712] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:36:56.572472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:56.573150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:56.580548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:56.581041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:56.581505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:56.582209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:56.582664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:56.583089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:56.715633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:56.724004 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f4b93142-6d31-4514-ae1e-8848e32e095e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1519 microversion: 2.1 time: 0.155782 Oct 29 21:36:56.724572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3311/6713] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:56 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:57.748256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:57.749101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:57.756819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:57.757319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:57.757809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:57.758543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:57.759019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:57.759466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:57.887612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:57.895471 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93495832-72bd-489c-bd4b-53622626f8cf tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1517 microversion: 2.1 time: 0.151539 Oct 29 21:36:57.896052 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3403/6714] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:57 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:57.933431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e", "tag": "52dad8de-4799-43c3-9fdb-2e06c4b23ccc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:57.944233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:57.944708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:57.945141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:57.956845 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] Creating event network-changed:52dad8de-4799-43c3-9fdb-2e06c4b23ccc for instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e on nch2-master-1 Oct 29 21:36:57.962138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:36:57.973037 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-671e6f38-e057-42fc-a88b-348b6e64195e req-5ac7e08f-e736-4a55-876a-72e8517624c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043436 Oct 29 21:36:57.973656 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3312/6715] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:36:58.920282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:58.921020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:58.927922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:58.928430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:58.928883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:58.929625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:58.930097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:58.930568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:59.379944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:59.387697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d8e6133-84b4-485c-9d5b-559255d1a40e tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1514 microversion: 2.1 time: 0.471367 Oct 29 21:36:59.388278 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3404/6716] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:58 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1514 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:36:59.411936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:36:59.412570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:59.418822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:59.419311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:59.419756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:59.420477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:59.420940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:59.421374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:59.478096 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab06e848-a53b-43ba-aeee-cdb7dcc361ca tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "POST /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e/action" status: 204 len: 0 microversion: 2.1 time: 0.071323 Oct 29 21:36:59.478735 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3313/6717] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:36:59 2022] POST /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:36:59.487628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:36:59.488272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:36:59.494334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:59.495057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:59.495317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:59.496042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:36:59.496496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:36:59.496945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:36:59.635800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:36:59.643756 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b8104a1-27e8-402a-b388-961bb8150441 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1514 microversion: 2.1 time: 0.160603 Oct 29 21:36:59.644342 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3405/6718] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:36:59 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:00.668424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:00.669312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:00.675680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:00.676247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:00.676763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:00.677561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:00.678095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:00.678600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:00.682799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:00.830793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:00.838613 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-214ba12d-ea4d-497e-86df-4152af825034 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1514 microversion: 2.1 time: 0.175441 Oct 29 21:37:00.839416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3314/6719] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:00 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:01.863030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:01.863670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:01.870625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:01.871158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:01.871614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:01.872324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:01.872796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:01.873242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.004974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:02.012752 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4ae2864-e69d-4f0a-95e1-c6623b6c8be0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1506 microversion: 2.1 time: 0.153686 Oct 29 21:37:02.013332 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3406/6720] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:01 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:02.035852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:02.036503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:02.043402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.043885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.044322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.045013 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.045484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.045917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.183572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:02.191823 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-106fc5ab-8817-42db-97d6-c02539c40717 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1506 microversion: 2.1 time: 0.159891 Oct 29 21:37:02.192401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3315/6721] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:02 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:02.214891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:02.215526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:02.221624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.222127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.222591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.223313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.223771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.224213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.351289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:02.359038 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-57ed8ce4-a12b-486d-a1f7-9ad494cf1423 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1506 microversion: 2.1 time: 0.148044 Oct 29 21:37:02.359613 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3407/6722] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:02 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:02.382170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:02.382684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:02.388715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.389194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.389679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.390377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.390837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.391271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.416875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:37:02.497905 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75e7dc78-25b4-4f6f-be55-34b9961b6942 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 204 len: 0 microversion: 2.1 time: 0.119188 Oct 29 21:37:02.498796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3316/6723] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:37:02 2022] DELETE /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:37:02.512358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:02.512918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:02.519837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.520598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.521220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.522147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.522782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.523425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.551557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:37:02.572631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-6ac77cd6-7ba7-4e2e-bb99-9c4924f5acbe req-e7b36cae-1251-44d3-8e83-77a53619f927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e", "name": "network-vif-plugged", "status": "completed", "tag": "52dad8de-4799-43c3-9fdb-2e06c4b23ccc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:02.582436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6ac77cd6-7ba7-4e2e-bb99-9c4924f5acbe req-e7b36cae-1251-44d3-8e83-77a53619f927 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.583003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6ac77cd6-7ba7-4e2e-bb99-9c4924f5acbe req-e7b36cae-1251-44d3-8e83-77a53619f927 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.583516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-6ac77cd6-7ba7-4e2e-bb99-9c4924f5acbe req-e7b36cae-1251-44d3-8e83-77a53619f927 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.595245 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-6ac77cd6-7ba7-4e2e-bb99-9c4924f5acbe req-e7b36cae-1251-44d3-8e83-77a53619f927 service nova] Creating event network-vif-plugged:52dad8de-4799-43c3-9fdb-2e06c4b23ccc for instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e on nch2-master-1 Oct 29 21:37:02.600395 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-6ac77cd6-7ba7-4e2e-bb99-9c4924f5acbe req-e7b36cae-1251-44d3-8e83-77a53619f927 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032052 Oct 29 21:37:02.601001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3317/6724] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:37:02.606718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.compute.api [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Instance is already in deleting state, ignoring this request Oct 29 21:37:02.607589 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd0f7c19-19eb-4094-a965-9f4db3df0a31 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 204 len: 0 microversion: 2.1 time: 0.099161 Oct 29 21:37:02.608317 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3408/6725] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:37:02 2022] DELETE /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:37:02.617108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:02.617855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:02.623959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.624457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.624898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.626193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:02.626657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:02.627090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:02.757657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:02.765486 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f001f393-f774-4e06-ab38-f3ae693cc7e1 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1512 microversion: 2.1 time: 0.152451 Oct 29 21:37:02.766064 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3318/6726] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:02 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:03.788121 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:03.788848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:03.795663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:03.796158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:03.796606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:03.797834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:03.798300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:03.798736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:03.929334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd2b4fb23e9414489935a2059f9207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13464632634450f891155723ad285d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:03.937148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a0d223d9-8de2-405a-bf28-593ffbb7d5ff tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 200 len: 1512 microversion: 2.1 time: 0.152926 Oct 29 21:37:03.937765 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3409/6727] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:03 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:04.445609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e5558877-1d5c-45fc-a761-511ec2c0840a req-9f50a1b9-8507-4ff8-ab13-9884dab93dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e", "name": "network-vif-deleted", "tag": "52dad8de-4799-43c3-9fdb-2e06c4b23ccc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:04.458330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e5558877-1d5c-45fc-a761-511ec2c0840a req-9f50a1b9-8507-4ff8-ab13-9884dab93dfc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:04.458752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e5558877-1d5c-45fc-a761-511ec2c0840a req-9f50a1b9-8507-4ff8-ab13-9884dab93dfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:04.459520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e5558877-1d5c-45fc-a761-511ec2c0840a req-9f50a1b9-8507-4ff8-ab13-9884dab93dfc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:04.473404 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e5558877-1d5c-45fc-a761-511ec2c0840a req-9f50a1b9-8507-4ff8-ab13-9884dab93dfc service nova] Creating event network-vif-deleted:52dad8de-4799-43c3-9fdb-2e06c4b23ccc for instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e on nch2-master-1 Oct 29 21:37:04.478739 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e5558877-1d5c-45fc-a761-511ec2c0840a req-9f50a1b9-8507-4ff8-ab13-9884dab93dfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036850 Oct 29 21:37:04.479497 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3319/6728] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:37:04.961240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:04.961901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:04.964332 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:37:04.964466 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:37:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e (ip 10.222.0.36) !!! Oct 29 21:37:04.971634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:04.972130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:04.972582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:04.973285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:04.973775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:04.974212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:04.988252 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] HTTP exception thrown: Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e could not be found. Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Request method failure captured: Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e HTTP/1.1 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZybzP9njbGr3XBTgOBs9Zlu8ux5UhovJou6fCHB028tXM2fdAPJClTuJYHDZETP7a9hi8JrEOncncn1L8udscde9s4giuFlauc1eYl5lJpZN6p8uhtweGsXVtPU3iNZNWOjPUd_CVI83CcW_7g47a-w6ATlwUfvHQAmdTi_J69loJc Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c13464632634450f891155723ad285d8 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c13464632634450f891155723ad285d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c13464632634450f891155723ad285d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c13464632634450f891155723ad285d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c13464632634450f891155723ad285d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c13464632634450f891155723ad285d8 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiskConfigTestJSON-691598496-project Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 3bd2b4fb23e9414489935a2059f9207a Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiskConfigTestJSON-691598496-project Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e could not be found. Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e'} Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e could not be found. Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e could not be found. Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:37:04.989911 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e could not be found. Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Returning 404 to user: Instance 9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7df02403-6ea8-4daa-a726-ccfc026a9a97 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e" status: 404 len: 111 microversion: 2.1 time: 0.034072 Oct 29 21:37:04.994883 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3410/6729] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:04 2022] GET /compute/v2.1/servers/9d9a0d3d-4dc6-40c8-afa9-3fddc36f924e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:37:05.001178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20c3d2a1-234b-4c2d-b290-128f11fed044 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '.version_select at 0x7fa171a07430>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:05.021491 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20c3d2a1-234b-4c2d-b290-128f11fed044 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456095834" status: 202 len: 0 microversion: 2.1 time: 0.025028 Oct 29 21:37:05.022060 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3320/6730] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456095834 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:37:05.619760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:05.620276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:05.622388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=36 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:05.628458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:05.628905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:05.629356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:05.630099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:05.630566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:05.631004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:05.644675 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] HTTP exception thrown: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Request method failure captured: Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 HTTP/1.1 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZybzP9njbGr3XBTgOBs9Zlu8ux5UhovJou6fCHB028tXM2fdAPJClTuJYHDZETP7a9hi8JrEOncncn1L8udscde9s4giuFlauc1eYl5lJpZN6p8uhtweGsXVtPU3iNZNWOjPUd_CVI83CcW_7g47a-w6ATlwUfvHQAmdTi_J69loJc Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c13464632634450f891155723ad285d8 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c13464632634450f891155723ad285d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c13464632634450f891155723ad285d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c13464632634450f891155723ad285d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c13464632634450f891155723ad285d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c13464632634450f891155723ad285d8 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerDiskConfigTestJSON-691598496-project Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 3bd2b4fb23e9414489935a2059f9207a Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerDiskConfigTestJSON-691598496-project Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b2b24dfc-21b9-4a23-b02c-12def9934e56'} Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:37:05.646349 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Returning 404 to user: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-edf5a6b4-940f-4ca6-9634-1d2e84ddadb0 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 404 len: 111 microversion: 2.1 time: 0.031862 Oct 29 21:37:05.650724 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3411/6731] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:37:05 2022] DELETE /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:37:05.657232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:05.657998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] [instance: b2b24dfc-21b9-4a23-b02c-12def9934e56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:05.664763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:05.665253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:05.665715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:05.666417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:05.666872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:05.667298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:05.680931 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] HTTP exception thrown: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Request method failure captured: Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 HTTP/1.1 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZybzP9njbGr3XBTgOBs9Zlu8ux5UhovJou6fCHB028tXM2fdAPJClTuJYHDZETP7a9hi8JrEOncncn1L8udscde9s4giuFlauc1eYl5lJpZN6p8uhtweGsXVtPU3iNZNWOjPUd_CVI83CcW_7g47a-w6ATlwUfvHQAmdTi_J69loJc Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c13464632634450f891155723ad285d8 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c13464632634450f891155723ad285d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c13464632634450f891155723ad285d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c13464632634450f891155723ad285d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c13464632634450f891155723ad285d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c13464632634450f891155723ad285d8 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-691598496 Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerDiskConfigTestJSON-691598496-project Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 3bd2b4fb23e9414489935a2059f9207a Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerDiskConfigTestJSON-691598496-project Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b2b24dfc-21b9-4a23-b02c-12def9934e56'} Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:37:05.682567 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] Returning 404 to user: Instance b2b24dfc-21b9-4a23-b02c-12def9934e56 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b05cc75-8f91-43c3-aabc-dec1ecec74f8 tempest-ServerDiskConfigTestJSON-691598496 tempest-ServerDiskConfigTestJSON-691598496-project] 10.222.0.36 "GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56" status: 404 len: 111 microversion: 2.1 time: 0.031615 Oct 29 21:37:05.687466 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3321/6732] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:05 2022] GET /compute/v2.1/servers/b2b24dfc-21b9-4a23-b02c-12def9934e56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:37:14.041227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2cd4ead8-79ca-4360-a65c-8d3f6db880ef tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'create', calling method: .version_select at 0x7fa1700749d0>, body: {"keypair": {"name": "tempest-keypair-1482632209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu0noqFBDeScelswdXhzbmh2miOO18endq4RRanKMMsRFpUbolb/7HT119OwEyi/FNXSbGN2OMF7i8G9Il4y7HmY28Lt9/eU646ga8DDcKSc6rRyyTp8cqRWqK8gPcrPA=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:14.058021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-2cd4ead8-79ca-4360-a65c-8d3f6db880ef tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:37:14.064512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-2cd4ead8-79ca-4360-a65c-8d3f6db880ef tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:37:14.096607 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2cd4ead8-79ca-4360-a65c-8d3f6db880ef tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189704 Oct 29 21:37:14.097221 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3412/6733] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:37:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:37:15.392238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-44151528", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10f180e8-dd1a-40a4-8139-14b06f7d5970"}], "security_groups": [{"name": "tempest-securitygroup--271797714"}], "key_name": "tempest-keypair-1482632209", "user_data": "}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:15.401622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:15.506601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] validate_networks() for [('10f180e8-dd1a-40a4-8139-14b06f7d5970', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:37:15.672034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:15.963313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:37:15.963712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:37:15.964383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:37:15.964964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:37:15.965404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:37:15.975353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:15.975844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:15.976294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:15.977041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:15.977534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:15.977973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:15.995267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:37:16.000723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:37:16.013888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:37:16.016741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:37:16.065016 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-620be40b-a4c3-4b64-a157-6a17e60cd707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.677861 Oct 29 21:37:16.065715 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3322/6734] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:37:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:37:16.078928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9bdd742b-ecff-4bf2-84b3-0a034aead1e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:16.080278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9bdd742b-ecff-4bf2-84b3-0a034aead1e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:16.087376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:16.147269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9bdd742b-ecff-4bf2-84b3-0a034aead1e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:16.155205 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9bdd742b-ecff-4bf2-84b3-0a034aead1e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1237 microversion: 2.1 time: 0.081592 Oct 29 21:37:16.155927 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3413/6735] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:16 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:37:17.180412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:17.181014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:17.190873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:17.191637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:17.192372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:17.193336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:17.194059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:17.194839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:17.268950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:17.278587 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8f5f3a7c-89dd-4072-836c-a08786177c30 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1297 microversion: 2.1 time: 0.103394 Oct 29 21:37:17.279501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3323/6736] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:17 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:18.305650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:18.306436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:18.315626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:18.316139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:18.317227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:18.317995 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:18.318493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:18.318944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:18.469674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:18.480078 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aaf477c3-f348-45cb-b2ea-6b9c641b56cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.179089 Oct 29 21:37:18.482504 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3414/6737] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:18 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:18.950710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e9654efd-3374-49d2-8de4-1b0d47237ba9 req-466e8610-012b-4d92-96a0-67172c39ebbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:18.962127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e9654efd-3374-49d2-8de4-1b0d47237ba9 req-466e8610-012b-4d92-96a0-67172c39ebbc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:18.962713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e9654efd-3374-49d2-8de4-1b0d47237ba9 req-466e8610-012b-4d92-96a0-67172c39ebbc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:18.963163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e9654efd-3374-49d2-8de4-1b0d47237ba9 req-466e8610-012b-4d92-96a0-67172c39ebbc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:18.975651 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e9654efd-3374-49d2-8de4-1b0d47237ba9 req-466e8610-012b-4d92-96a0-67172c39ebbc service nova] Creating event network-changed:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch2-master-1 Oct 29 21:37:18.980681 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e9654efd-3374-49d2-8de4-1b0d47237ba9 req-466e8610-012b-4d92-96a0-67172c39ebbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033987 Oct 29 21:37:18.981297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3324/6738] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:37:19.506496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:19.507124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:19.513721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:19.514220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:19.514669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:19.515369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:19.516441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:19.516885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:19.646977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:19.655064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-079d1575-35ac-4000-aa5e-8055b0ce8b0e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.152580 Oct 29 21:37:19.655570 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3415/6739] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:19 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:20.679537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:20.680299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:20.686609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:20.687097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:20.687542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:20.688751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:20.689211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:20.689678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:20.825216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:20.833722 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4bfb5a24-6fc7-4caf-a01e-5f6cade34ee3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.159384 Oct 29 21:37:20.834314 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3325/6740] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:20 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:21.856493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:21.857123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:21.864264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:21.864758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:21.865205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:21.865928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:21.866398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:21.866858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:21.994917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:22.003306 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ce864d40-f8d8-412f-8c75-59b0e4cbd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.150883 Oct 29 21:37:22.003892 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3416/6741] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:21 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:23.026060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:23.026677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:23.033481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:23.033966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:23.034405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:23.035136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:23.035593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:23.036023 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:23.168394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:23.176457 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b30d6975-72e8-483c-aa3c-277a2af7f66a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.154238 Oct 29 21:37:23.177039 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3326/6742] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:23 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:24.200151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:24.200782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:24.208437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:24.208943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:24.209392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:24.210136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:24.210602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:24.211042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:24.340305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:24.348601 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb66b768-17c9-40c2-935f-7e8474f33875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.152729 Oct 29 21:37:24.349174 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3417/6743] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:24 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:24.655876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-935441f4-7c6a-4c27-ad2a-63584303fe00 req-565be935-ac2f-46e2-9d99-9c58f64168d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "name": "network-vif-plugged", "status": "completed", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:24.666617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-935441f4-7c6a-4c27-ad2a-63584303fe00 req-565be935-ac2f-46e2-9d99-9c58f64168d9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:24.667147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-935441f4-7c6a-4c27-ad2a-63584303fe00 req-565be935-ac2f-46e2-9d99-9c58f64168d9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:24.667587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-935441f4-7c6a-4c27-ad2a-63584303fe00 req-565be935-ac2f-46e2-9d99-9c58f64168d9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:24.679211 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-935441f4-7c6a-4c27-ad2a-63584303fe00 req-565be935-ac2f-46e2-9d99-9c58f64168d9 service nova] Creating event network-vif-plugged:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch2-master-1 Oct 29 21:37:24.684269 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-935441f4-7c6a-4c27-ad2a-63584303fe00 req-565be935-ac2f-46e2-9d99-9c58f64168d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Oct 29 21:37:24.684868 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3327/6744] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:37:25.371550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:25.372177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:25.379087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:25.379585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:25.380037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:25.380750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:25.381227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:25.381694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:25.509936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:25.518303 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ca62893b-113f-4298-a261-ca8988c0b457 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1362 microversion: 2.1 time: 0.150126 Oct 29 21:37:25.518896 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3418/6745] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:25 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:26.540206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:26.540979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:26.545600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:26.546296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:26.553448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:26.553956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:26.554393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:26.555086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:26.555542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:26.555971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:26.687456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:37:26.695707 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec3b0b39-2a2a-4885-8a8c-abaf1f1fe91f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1549 microversion: 2.1 time: 0.157280 Oct 29 21:37:26.696277 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3328/6746] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:37:26 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:37:26.718767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:37:26.719304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:37:26.721202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:37:26.727525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:26.728028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:26.728481 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:26.729190 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:26.729701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:26.730146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:26.805693 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-78a2b600-c12d-4208-854e-d48ce5b5928f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090709 Oct 29 21:37:26.809863 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3419/6747] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:37:26 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:37:28.066035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-920df1e2-1778-40e9-9551-d84c927a90c3 req-715ebaad-4836-4c43-9107-d7269c83a3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:37:28.076500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-920df1e2-1778-40e9-9551-d84c927a90c3 req-715ebaad-4836-4c43-9107-d7269c83a3c1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:37:28.076980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-920df1e2-1778-40e9-9551-d84c927a90c3 req-715ebaad-4836-4c43-9107-d7269c83a3c1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:37:28.077411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-920df1e2-1778-40e9-9551-d84c927a90c3 req-715ebaad-4836-4c43-9107-d7269c83a3c1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:37:28.089573 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-920df1e2-1778-40e9-9551-d84c927a90c3 req-715ebaad-4836-4c43-9107-d7269c83a3c1 service nova] Creating event network-changed:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch2-master-1 Oct 29 21:37:28.094461 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-920df1e2-1778-40e9-9551-d84c927a90c3 req-715ebaad-4836-4c43-9107-d7269c83a3c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032173 Oct 29 21:37:28.095235 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3329/6748] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:38:04.048377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:04.049234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:04.053438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:04.054080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:04.061200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.061739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.062199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.062912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.063386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.063856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.193025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:04.201323 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee21441b-d710-4c13-a8da-3c5c03859708 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1667 microversion: 2.1 time: 0.154751 Oct 29 21:38:04.201937 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3420/6749] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:04 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:04.223059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:04.223824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=32 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:04.228306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:04.229047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:04.236593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.237150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.237628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.238327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.238790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.239222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.377959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:04.386370 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2451aeca-26fb-4217-8cc9-50716fcb668b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1667 microversion: 2.1 time: 0.165489 Oct 29 21:38:04.386951 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3330/6750] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:04 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:04.408835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:04.409515 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:04.416251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.416754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.417220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.417984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.418468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.418915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.549587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:04.557311 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07fa045c-5331-443d-b5b9-a8b123a16b47 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1667 microversion: 2.1 time: 0.152300 Oct 29 21:38:04.557923 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3421/6751] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:04 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:04.580063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:04.582825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:04.588760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.589240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.589709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.590400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.590855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.591282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.619717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:04.625516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Old instance type m1.heat2, new instance type m1.heat {{(pid=138884) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:38:04.632061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:38:04.632510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:38:04.632958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:38:04.633366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:38:04.633802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:38:04.698246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12f21d57-d5c4-42bc-b46e-6c5a0fa58ff1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a/action" status: 202 len: 0 microversion: 2.1 time: 0.121884 Oct 29 21:38:04.698924 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3331/6752] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:38:04 2022] POST /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:38:04.707893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:04.708569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:04.714768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.715282 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.715745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.716467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:04.716944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:04.717395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:04.875137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:04.883681 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26823eeb-0592-4725-b2e8-2e86ad7665d2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1676 microversion: 2.1 time: 0.180553 Oct 29 21:38:04.884329 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3422/6753] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:04 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:05.908570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:05.909249 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:05.916269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:05.916763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:05.917208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:05.918000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:05.918410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:05.918848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:06.055048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:06.063123 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c150e052-a249-4656-b55c-6aa523ad9110 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1676 microversion: 2.1 time: 0.159303 Oct 29 21:38:06.063719 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3332/6754] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:05 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:07.088007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:07.088647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:07.095621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:07.096126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:07.096580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:07.097290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:07.097793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:07.098241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:07.230093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:07.237861 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94ee1812-2608-4e5d-aa0e-3b215a5f30ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.153733 Oct 29 21:38:07.238460 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3423/6755] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:07 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:08.262409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:08.263032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:08.270466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:08.270983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:08.271429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:08.272125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:08.272587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:08.273019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:08.401552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:08.409253 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a70c169-2e7e-4a25-a90d-81dd8b72f115 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.150876 Oct 29 21:38:08.409858 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3333/6756] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:08 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:09.433882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:09.434508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:09.441922 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:09.442426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:09.442875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:09.443574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:09.444047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:09.444485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:09.577253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:09.585840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a82ef342-06e3-4d9c-b805-883bfa3093e0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.155830 Oct 29 21:38:09.586409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3424/6757] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:09 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:10.608447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:10.609087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:10.615264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:10.615750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:10.616185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:10.616875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:10.617330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:10.617787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:10.748321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:10.756761 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5711d27d-f3b8-4ccc-88e2-d480183385ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.152467 Oct 29 21:38:10.757344 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3334/6758] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:10 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:11.780919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:11.781582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:11.789021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:11.789559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:11.790018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:11.790726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:11.791201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:11.791646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:11.922509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:11.930409 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-72525b61-f758-4372-bdac-eb28ce092e77 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.153416 Oct 29 21:38:11.930989 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3425/6759] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:11 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:12.954680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:12.955308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:12.962668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:12.963159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:12.963604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:12.964303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:12.964765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:12.965199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:13.097760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:13.105537 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4a43c0b-4ddf-4046-83de-019fbb0f879a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.154800 Oct 29 21:38:13.106120 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3335/6760] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:12 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:14.128882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:14.129533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:14.136527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:14.137022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:14.137486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:14.138194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:14.138661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:14.139107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:14.267555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:14.275796 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-90ea02c0-c98c-47c6-9687-9207d72e59af tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.150846 Oct 29 21:38:14.276373 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3426/6761] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:14 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:15.298983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:15.299627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:15.306641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:15.307120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:15.307559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:15.308247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:15.308707 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:15.309136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:15.447121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:15.455123 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9db413b2-75dd-4661-b748-d4f0aff78147 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.160021 Oct 29 21:38:15.455714 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3336/6762] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:15 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:16.479791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:16.480342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:16.487687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:16.489688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:16.490231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:16.490974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:16.491460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:16.491907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:16.623153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:16.630891 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4910359-58e0-45f3-9f5a-e17e5b3778b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.155122 Oct 29 21:38:16.631466 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3427/6763] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:16 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:17.654876 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:17.655509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:17.662951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:17.663439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:17.663885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:17.664584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:17.665045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:17.665502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:17.799501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:17.807863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52f16594-7988-439a-8276-d5c88a608c33 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.156947 Oct 29 21:38:17.808441 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3337/6764] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:17 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:18.831672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:18.833192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:18.840505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:18.841010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:18.841499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:18.842249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:18.842725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:18.843188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:18.973738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:18.981520 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-10c88521-bc84-4292-b4d8-72f14b8a8b76 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.153768 Oct 29 21:38:18.982100 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3428/6765] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:18 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:20.006070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:20.006650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:20.013834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:20.014344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:20.014805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:20.015506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:20.015973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:20.016411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:20.145811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:20.153659 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6c1071ac-d6b0-4c56-b841-6984bcc2d23b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.152159 Oct 29 21:38:20.154233 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3338/6766] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:20 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:21.177525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:21.178271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:21.184330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:21.184861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:21.185315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:21.186055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:21.186530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:21.186977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:21.319457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:21.327425 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07674a83-6fa3-4146-9f46-c2ebc5d84235 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.154167 Oct 29 21:38:21.328002 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3429/6767] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:21 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:22.351798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:22.352342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:22.359256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:22.359739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:22.360174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:22.360888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:22.361343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:22.361789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:22.492458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:22.501013 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a35fce9d-0a0c-478d-8220-216b8bed2b09 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.153757 Oct 29 21:38:22.501696 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3339/6768] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:22 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:23.527089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:23.527651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:23.534615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:23.535721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:23.536174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:23.536882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:23.537356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:23.537827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:23.668299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:23.676073 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-548cd557-a399-4e40-be97-242398746b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1681 microversion: 2.1 time: 0.152971 Oct 29 21:38:23.676727 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3430/6769] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:23 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:24.446807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "name": "network-vif-unplugged", "status": "completed", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:24.458336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:24.458817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:24.459529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:24.471481 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] Creating event network-vif-unplugged:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch1-master-1 Oct 29 21:38:24.477345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] Instance efefb619-9b2f-476c-a143-81c8784a7b7a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:38:24.488856 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-db218514-39db-4ac0-8a0b-6f55c93e0bec req-a4e3aba6-01cf-47b3-8be2-45b35df6bd92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045509 Oct 29 21:38:24.489484 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3340/6770] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:38:24.700627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:24.701202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:24.708842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:24.709343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:24.709818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:24.710532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:24.711003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:24.711443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:24.849440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:24.858829 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-33251714-6fc4-47d1-9d5c-3c5eaed3eb41 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1680 microversion: 2.1 time: 0.162333 Oct 29 21:38:24.859453 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3431/6771] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:24 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:25.886146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:25.886872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:25.892976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:25.893466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:25.893925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:25.895292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:25.895777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:25.896206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:26.026577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:26.034307 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae1197cc-23bc-408e-9b10-a7927840194b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1678 microversion: 2.1 time: 0.153440 Oct 29 21:38:26.034880 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3341/6772] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:25 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:26.522846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:26.533623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:26.534132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:26.534586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:26.546206 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] Creating event network-changed:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch1-master-1 Oct 29 21:38:26.552017 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] Instance efefb619-9b2f-476c-a143-81c8784a7b7a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:38:26.562883 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-17704c48-2a87-497d-9608-c7c41e8acfc6 req-25395b41-a62d-42b0-9c87-cd357ea0562a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044579 Oct 29 21:38:26.563472 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3432/6773] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:38:27.057787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:27.058407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:27.065280 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:27.065753 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:27.066807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:27.067514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:27.067966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:27.068434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:27.205598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:27.213912 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-56aea95d-1449-4ab7-bbd6-bcd78fca8cae tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1678 microversion: 2.1 time: 0.160058 Oct 29 21:38:27.214525 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3342/6774] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:27 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:28.239883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:28.240613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:28.246982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:28.247492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:28.247951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:28.248683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:28.249150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:28.249628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:28.389576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:28.397915 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61b9653b-8eac-47a6-9c32-ddd9823043ca tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1678 microversion: 2.1 time: 0.162966 Oct 29 21:38:28.409482 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3433/6775] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:28 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:29.423245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:29.423855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:29.430937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:29.431434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:29.431883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:29.432589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:29.433055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:29.433518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:29.574646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:29.582821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1932d48f-f4a7-43d3-b365-be30d5085805 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1675 microversion: 2.1 time: 0.163511 Oct 29 21:38:29.583415 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3343/6776] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:29 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:29.606199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:29.606850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:29.614802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:29.615314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:29.615780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:29.616509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:29.616987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:29.617440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:29.677348 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31aa6603-43e4-4798-88d3-3fcab1052d8b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a/action" status: 204 len: 0 microversion: 2.1 time: 0.073561 Oct 29 21:38:29.677701 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3434/6777] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:38:29 2022] POST /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:38:29.689757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:29.690386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:29.696533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:29.697105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:29.697584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:29.698552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:29.699014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:29.699448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:29.833365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:29.841222 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-528f255d-56dc-4788-87af-37b65a6eb98e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1675 microversion: 2.1 time: 0.155419 Oct 29 21:38:29.842053 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3344/6778] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:29 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:30.453189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "name": "network-vif-plugged", "status": "completed", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:30.464636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:30.465152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:30.465801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:30.481642 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] Creating event network-vif-plugged:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch1-master-1 Oct 29 21:38:30.488915 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] Instance efefb619-9b2f-476c-a143-81c8784a7b7a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:38:30.500896 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d3d101a5-bf44-4696-b1f9-3a84e4d92199 req-78d990e7-fe05-4ff5-9188-889366d0b9a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052505 Oct 29 21:38:30.501981 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3435/6779] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:38:30.865347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:30.865968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:30.872953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:30.873447 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:30.873945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:30.874644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:30.875101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:30.875534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:30.896531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:31.017291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:31.027179 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-21051fe1-6f5e-4037-9c6e-c020ea919037 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1675 microversion: 2.1 time: 0.166590 Oct 29 21:38:31.027780 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3345/6780] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:30 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:32.052904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:32.053647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:32.060670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.061160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.061653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.062360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.062831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.063269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.068823 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:32.198577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:32.207415 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1900f1c-6d2c-4f9d-95fc-b90a6c15aee4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1667 microversion: 2.1 time: 0.158729 Oct 29 21:38:32.207997 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3436/6781] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:32 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:32.230455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:32.231079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:32.238156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.238643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.239080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.239772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.240227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.241311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.369434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:32.377203 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-68f12af9-3478-4aab-8553-a4c26acd8c1c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1667 microversion: 2.1 time: 0.150608 Oct 29 21:38:32.377808 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3346/6782] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:32 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:38:32.399753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:32.400385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:32.406471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.406974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.407425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.408129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.408600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.409047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.542007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:32.549777 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-53d3c69c-3cb0-4751-8567-550cce51aa73 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1667 microversion: 2.1 time: 0.153909 Oct 29 21:38:32.550353 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3437/6783] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:32 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:32.572782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:32.573531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:32.579607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.580101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.580553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.581248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.581797 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.582231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.607549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:38:32.683650 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae0ae884-3727-43a0-a8ad-cd877e103d75 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 204 len: 0 microversion: 2.1 time: 0.114568 Oct 29 21:38:32.684259 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3347/6784] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:38:32 2022] DELETE /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:38:32.692594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:32.693228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:32.699510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.700011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.700466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.701169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:32.701672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:32.702115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:32.832497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:32.842329 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2f08a9a-6b22-458b-9bff-199ce30b0380 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1673 microversion: 2.1 time: 0.153556 Oct 29 21:38:32.842914 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3438/6785] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:32 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:33.867855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:33.868602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:33.875773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:33.876267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:33.876714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:33.877426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:33.877920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:33.879123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:34.012473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:34.020757 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b734a66c-147c-43c9-b21d-36bc7f97d76d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1673 microversion: 2.1 time: 0.157654 Oct 29 21:38:34.021752 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3348/6786] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:33 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:35.044377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:35.045364 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:35.049686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=39 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:35.054012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:35.054516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:35.054980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:35.055699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:35.056177 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:35.056619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:35.122402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:35.131653 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1b525cc6-2bc1-49a7-b52f-babcc93fc38c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 200 len: 1606 microversion: 2.1 time: 0.091146 Oct 29 21:38:35.132702 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3439/6787] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:35 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 1606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:35.225890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-00c498f6-8952-47f4-af74-d3035aa7dd00 req-923ee655-21ce-414c-82fc-ce7ea2aee59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efefb619-9b2f-476c-a143-81c8784a7b7a", "name": "network-vif-deleted", "tag": "feddc0d4-21f8-4461-89b3-cb6e91f3f12a"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:35.233307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:35.240436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-00c498f6-8952-47f4-af74-d3035aa7dd00 req-923ee655-21ce-414c-82fc-ce7ea2aee59c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:35.241229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-00c498f6-8952-47f4-af74-d3035aa7dd00 req-923ee655-21ce-414c-82fc-ce7ea2aee59c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:35.241891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-00c498f6-8952-47f4-af74-d3035aa7dd00 req-923ee655-21ce-414c-82fc-ce7ea2aee59c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:35.256537 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-00c498f6-8952-47f4-af74-d3035aa7dd00 req-923ee655-21ce-414c-82fc-ce7ea2aee59c service nova] Creating event network-vif-deleted:feddc0d4-21f8-4461-89b3-cb6e91f3f12a for instance efefb619-9b2f-476c-a143-81c8784a7b7a on nch1-master-1 Oct 29 21:38:35.262197 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-00c498f6-8952-47f4-af74-d3035aa7dd00 req-923ee655-21ce-414c-82fc-ce7ea2aee59c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041081 Oct 29 21:38:35.262867 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3349/6788] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:38:36.156586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:36.157134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:36.164484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:36.165000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:36.165643 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:36.166374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:36.166849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:36.167293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:36.181793 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a HTTP/1.1 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'efefb619-9b2f-476c-a143-81c8784a7b7a'} Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:38:36.183510 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e5c0f42-0c7a-457c-b841-d5cd4020d83c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 404 len: 111 microversion: 2.1 time: 0.032485 Oct 29 21:38:36.188547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3440/6789] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:36 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:38:36.203501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:36.204245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:36.210965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:36.211462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:36.211903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:36.212608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:36.213090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:36.213670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:36.229885 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a HTTP/1.1 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'efefb619-9b2f-476c-a143-81c8784a7b7a'} Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:38:36.231535 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-210341cf-5f3e-421e-b82a-6b2cd78fc2cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 404 len: 111 microversion: 2.1 time: 0.033873 Oct 29 21:38:36.236300 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3350/6790] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:36 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:38:36.284078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1110653798", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "10f180e8-dd1a-40a4-8139-14b06f7d5970"}], "security_groups": [{"name": "tempest-securitygroup--271797714"}], "key_name": "tempest-keypair-1482632209", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:36.393524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] validate_networks() for [('10f180e8-dd1a-40a4-8139-14b06f7d5970', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:38:36.820891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:38:36.821340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:38:36.821865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:38:36.822299 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:38:36.822729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:38:36.832078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:36.832584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:36.833061 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:36.833833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:36.834305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:36.834745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:36.851934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:38:36.857273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:38:36.871877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:38:36.874308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:38:36.922339 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3b8a3acf-da60-4453-bf94-fa25b77b968a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.642055 Oct 29 21:38:36.923117 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3441/6791] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:38:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:38:36.937615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7894a924-ffa5-438d-88bf-2415c22cc102 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:36.939090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7894a924-ffa5-438d-88bf-2415c22cc102 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:37.074950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7894a924-ffa5-438d-88bf-2415c22cc102 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:37.082905 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7894a924-ffa5-438d-88bf-2415c22cc102 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1239 microversion: 2.1 time: 0.151237 Oct 29 21:38:37.083484 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3351/6792] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:36 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1239 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:38.107416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:38.108058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:38.115967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:38.116426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:38.116893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:38.117658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:38.118135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:38.118582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:38.241376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:38.249651 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-41e7e4a5-7523-4601-a5b4-dce09cc48550 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1297 microversion: 2.1 time: 0.146960 Oct 29 21:38:38.250237 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3442/6793] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:38 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:39.274333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:39.274955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:39.281250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:39.281759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:39.282203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:39.282899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:39.283356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:39.283783 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:39.413497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7de63c9b-8ef0-4da3-b234-b63de0888fbb req-b30167de-2172-4589-9f8d-fccde0379a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:39.417636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:39.427801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7de63c9b-8ef0-4da3-b234-b63de0888fbb req-b30167de-2172-4589-9f8d-fccde0379a8b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:39.428554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e5d09beb-8607-4d6e-a14a-e539ebd06dcc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1364 microversion: 2.1 time: 0.158140 Oct 29 21:38:39.428709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7de63c9b-8ef0-4da3-b234-b63de0888fbb req-b30167de-2172-4589-9f8d-fccde0379a8b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:39.429271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7de63c9b-8ef0-4da3-b234-b63de0888fbb req-b30167de-2172-4589-9f8d-fccde0379a8b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:39.437882 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3352/6794] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:39 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:39.442682 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7de63c9b-8ef0-4da3-b234-b63de0888fbb req-b30167de-2172-4589-9f8d-fccde0379a8b service nova] Creating event network-changed:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch1-master-1 Oct 29 21:38:39.447946 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7de63c9b-8ef0-4da3-b234-b63de0888fbb req-b30167de-2172-4589-9f8d-fccde0379a8b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038902 Oct 29 21:38:39.448834 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3443/6795] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:38:40.453121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:40.453772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:40.461279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:40.461751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:40.462200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:40.462904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:40.463396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:40.463833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:40.592761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:40.601051 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-13f90132-93b6-4131-a443-2cb6391d8691 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1364 microversion: 2.1 time: 0.151953 Oct 29 21:38:40.601652 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3353/6796] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:40 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:41.625837 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:41.626553 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:41.632822 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:41.633321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:41.633799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:41.634498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:41.634969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:41.635408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:41.769175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:41.777114 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2cc8d92-3258-40ae-a158-419cb6a75dfc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1364 microversion: 2.1 time: 0.156415 Oct 29 21:38:41.777736 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3444/6797] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:41 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:42.800907 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:42.801553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:42.808476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:42.808965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:42.809412 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:42.810143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:42.810596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:42.811028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:42.942237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:42.950705 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-24119594-8331-4d93-b114-718ecb27be2d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1364 microversion: 2.1 time: 0.154114 Oct 29 21:38:42.951307 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3354/6798] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:42 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:43.974979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:43.975560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:43.982492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:43.983097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:43.983549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:43.984249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:43.984716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:43.985158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:44.116802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:44.124559 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8b1d2fcd-7e0d-4fdf-b438-05f48bacd15d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1364 microversion: 2.1 time: 0.154261 Oct 29 21:38:44.125140 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3445/6799] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:43 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:44.555626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-94a91882-3b8d-4493-a496-4b1a3df65a8f req-3f7f9412-6d7c-46c4-8cf9-61393098bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "name": "network-vif-plugged", "status": "completed", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:44.567186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94a91882-3b8d-4493-a496-4b1a3df65a8f req-3f7f9412-6d7c-46c4-8cf9-61393098bc70 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:44.567669 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94a91882-3b8d-4493-a496-4b1a3df65a8f req-3f7f9412-6d7c-46c4-8cf9-61393098bc70 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:44.568111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-94a91882-3b8d-4493-a496-4b1a3df65a8f req-3f7f9412-6d7c-46c4-8cf9-61393098bc70 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:44.579549 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-94a91882-3b8d-4493-a496-4b1a3df65a8f req-3f7f9412-6d7c-46c4-8cf9-61393098bc70 service nova] Creating event network-vif-plugged:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch1-master-1 Oct 29 21:38:44.585176 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-94a91882-3b8d-4493-a496-4b1a3df65a8f req-3f7f9412-6d7c-46c4-8cf9-61393098bc70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033405 Oct 29 21:38:44.585833 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3355/6800] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:38:45.148389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:45.149018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:45.156721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:45.157238 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:45.157719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:45.158424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:45.158921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:45.159362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:45.288387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:45.296067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-673b7d2c-1c3a-48bb-8da6-1ec9774990d8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1364 microversion: 2.1 time: 0.152125 Oct 29 21:38:45.296641 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3446/6801] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:45 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:46.321633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:46.322035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:46.328248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:46.328735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:46.329178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:46.329913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:46.330376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:46.330809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:46.464831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:38:46.472614 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1dfcc898-2bb8-4428-ba14-7e32ae880e24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1552 microversion: 2.1 time: 0.156813 Oct 29 21:38:46.473190 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3356/6802] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:38:46 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:38:46.497236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:38:46.497773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:38:46.504954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:46.505475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:46.505954 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:46.506723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:46.507204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:46.507656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:46.591098 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fb81af45-3140-4ef6-b0f3-e748127c2f12 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097784 Oct 29 21:38:46.591709 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3447/6803] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:38:46 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:38:47.507944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:38:47.577631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-fd8974ec-8229-422e-af9c-da311b500eeb req-47783d6d-b687-4acf-9d71-9223772ddbfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:38:47.587703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fd8974ec-8229-422e-af9c-da311b500eeb req-47783d6d-b687-4acf-9d71-9223772ddbfb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:38:47.588186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fd8974ec-8229-422e-af9c-da311b500eeb req-47783d6d-b687-4acf-9d71-9223772ddbfb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:38:47.588619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fd8974ec-8229-422e-af9c-da311b500eeb req-47783d6d-b687-4acf-9d71-9223772ddbfb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:38:47.599635 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-fd8974ec-8229-422e-af9c-da311b500eeb req-47783d6d-b687-4acf-9d71-9223772ddbfb service nova] Creating event network-changed:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch1-master-1 Oct 29 21:38:47.604635 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-fd8974ec-8229-422e-af9c-da311b500eeb req-47783d6d-b687-4acf-9d71-9223772ddbfb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101722 Oct 29 21:38:47.605296 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3357/6804] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:39:59.556854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:39:59.557775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:39:59.560451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:39:59.561093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=57 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:39:59.566465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8559d11c-46b1-4361-91e2-7b6934009a6d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:39:59.575785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8559d11c-46b1-4361-91e2-7b6934009a6d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:39:59.576289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8559d11c-46b1-4361-91e2-7b6934009a6d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:39:59.576739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8559d11c-46b1-4361-91e2-7b6934009a6d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:39:59.600110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8559d11c-46b1-4361-91e2-7b6934009a6d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Going to try to stop instance {{(pid=138885) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:39:59.640666 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8559d11c-46b1-4361-91e2-7b6934009a6d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action" status: 202 len: 0 microversion: 2.1 time: 0.084690 Oct 29 21:39:59.641367 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3448/6805] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:39:59 2022] POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:39:59.649229 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=19 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:39:59.650004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:39:59.654460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:39:59.655175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:39:59.662889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:39:59.663384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:39:59.663851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:39:59.664562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:39:59.665020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:39:59.665480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:39:59.806114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:39:59.813875 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e110439e-8d70-4f3b-841b-f5ec1d5b5672 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.167938 Oct 29 21:39:59.814401 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3358/6806] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:39:59 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:40:00.840049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:00.840758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:00.847028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:00.847529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:00.847980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:00.848686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:00.849152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:00.849634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:00.977134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:00.984802 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0d18a756-23da-4796-8eef-748d478851a3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.150402 Oct 29 21:40:00.985375 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3449/6807] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:00 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:02.008574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:02.009134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:02.016062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:02.016549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:02.016994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:02.017719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:02.018178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:02.018633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:02.154217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:02.162218 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6a92847b-56ed-45dd-a594-284a73d22707 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.157705 Oct 29 21:40:02.162802 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3359/6808] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:02 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:03.187600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:03.188230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:03.195214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:03.195726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:03.196187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:03.197571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:03.198051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:03.198501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:03.329329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:03.337284 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3704af56-99f6-42ec-8154-3fc9dd193310 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.153555 Oct 29 21:40:03.337930 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3450/6809] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:03 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:04.361489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:04.362121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:04.369612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:04.370107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:04.370560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:04.371266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:04.371733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:04.372171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:04.506427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:04.514974 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5392bcbd-4fae-4768-bf59-e492135885c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.157509 Oct 29 21:40:04.515557 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3360/6810] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:04 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:05.538674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:05.539202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:05.546066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:05.546560 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:05.547007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:05.547707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:05.548173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:05.548612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:05.676318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:05.684010 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83822229-1ef1-4eea-9b61-990713d3df38 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.149387 Oct 29 21:40:05.684582 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3451/6811] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:05 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:40:06.707552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:06.708192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:06.715602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:06.716089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:06.716531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:06.717226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:06.717714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:06.718147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:06.845910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:06.854291 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4fc2300a-7f0c-4b44-944b-b456d8412aa3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.150647 Oct 29 21:40:06.854870 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3361/6812] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:06 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:07.877533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:07.878196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:07.885620 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:07.886118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:07.886570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:07.887277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:07.887750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:07.888195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:08.019123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:08.027457 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a00ccf7f-c54b-451a-9616-c7e93f404094 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.153868 Oct 29 21:40:08.028031 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3452/6813] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:07 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:09.050975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:09.051599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:09.057942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:09.058427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:09.058869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:09.059568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:09.060027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:09.060459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:09.187569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:09.195418 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-27143b86-49e6-4e65-b95e-d61c99a4e8d6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.148570 Oct 29 21:40:09.196003 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3362/6814] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:09 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:10.220375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:10.221012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:10.228735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:10.229231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:10.229706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:10.230408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:10.230873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:10.231318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:10.363760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:10.371530 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f2c07f7d-c71a-4080-ab65-515d30aabcdb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1657 microversion: 2.1 time: 0.155298 Oct 29 21:40:10.372103 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3453/6815] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:10 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:10.393835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:10.396193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:10.403639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:10.404121 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:10.404558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:10.405243 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:10.405762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:10.406193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:10.435850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:10.441177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Old instance type m1.heat2, new instance type m1.heat {{(pid=138884) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:40:10.447661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:40:10.448083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:40:10.448555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:40:10.448970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:40:10.449680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:40:10.511893 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52834a6c-5d0d-4ede-a790-c3b7d87fc9c0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action" status: 202 len: 0 microversion: 2.1 time: 0.121927 Oct 29 21:40:10.512423 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3363/6816] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:40:10 2022] POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:40:10.520505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:10.521370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:10.528048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:10.528546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:10.528994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:10.529730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:10.530200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:10.530639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:10.690846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:10.703522 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4d05e2dd-5fb4-4a22-8dc0-67a110a8581f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.186760 Oct 29 21:40:10.704414 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3454/6817] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:10 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:11.728606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:11.729225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:11.736888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:11.737372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:11.737851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:11.738526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:11.738983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:11.739409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:11.872358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:11.883578 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-63d34d87-6f8a-406e-a81e-b34a26681c83 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1680 microversion: 2.1 time: 0.158913 Oct 29 21:40:11.884751 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3364/6818] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:11 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:12.907886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:12.908540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:12.916157 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:12.916659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:12.917115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:12.917852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:12.918324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:12.918765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:13.045135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:13.052877 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e8f4614-b9a6-4deb-a7a5-c6798bbee195 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1685 microversion: 2.1 time: 0.148955 Oct 29 21:40:13.053464 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3455/6819] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:12 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:40:14.077720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:14.078344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:14.085233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:14.085870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:14.086320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:14.087022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:14.087488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:14.087922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:14.220264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:14.228022 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7a6bc1ad-9149-47f5-8b0d-228050cea442 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1685 microversion: 2.1 time: 0.154557 Oct 29 21:40:14.228590 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3365/6820] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:14 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:15.233234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "name": "network-vif-unplugged", "status": "completed", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:15.243675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:15.244427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:15.245058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:15.251106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:15.251736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:15.262682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:15.263182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:15.263631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:15.264342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:15.264799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:15.265475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:15.269083 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] Creating event network-vif-unplugged:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch2-master-1 Oct 29 21:40:15.276275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] Instance a3598885-0be0-4f84-9485-df65613ad543 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:40:15.288626 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2ffd0c14-e56d-444d-b390-325924a34140 req-e19f6429-c722-4355-a9d7-db5544b4acaf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059216 Oct 29 21:40:15.289253 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3456/6821] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:15.403972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:15.411918 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d79c65d5-5aa5-4055-af56-056c5a64c287 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1684 microversion: 2.1 time: 0.164612 Oct 29 21:40:15.412508 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3366/6822] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:15 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:40:16.436663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:16.437388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:16.444546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:16.445049 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:16.445535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:16.446244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:16.446718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:16.447165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:16.580750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:16.589055 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f7a75926-3625-45c7-b2a7-2eb0bcfb55f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1682 microversion: 2.1 time: 0.156646 Oct 29 21:40:16.589678 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3457/6823] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:16 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:17.324994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:17.335042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:17.335521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:17.335951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:17.347855 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] Creating event network-changed:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch2-master-1 Oct 29 21:40:17.353144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] Instance a3598885-0be0-4f84-9485-df65613ad543 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:40:17.364752 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-fd687372-c34d-48ff-9169-f8d5ec83eb2d req-b4796691-62aa-4ffe-a43c-b8c40bbba9f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044410 Oct 29 21:40:17.365557 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3367/6824] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:17.613510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:17.614500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:17.622623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:17.623342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:17.623801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:17.624519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:17.624989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:17.625485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:17.774123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:17.785081 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a94db169-8b7d-44b6-acce-2dd56440e2a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1682 microversion: 2.1 time: 0.175460 Oct 29 21:40:17.785960 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3458/6825] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:17 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:18.809102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:18.809840 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:18.818003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:18.818505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:18.818965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:18.819663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:18.820119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:18.820546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:18.952542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:18.960318 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e7a7eb46-0ad7-4c5a-89ec-7059d36fe207 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1678 microversion: 2.1 time: 0.155535 Oct 29 21:40:18.960897 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3368/6826] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:18 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:18.983528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:18.984087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:18.990936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:18.991436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:18.991891 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:18.992626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:18.993097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:18.993572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:19.050787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad66ad8c-53f5-4261-87e4-843e075a33dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action" status: 204 len: 0 microversion: 2.1 time: 0.070945 Oct 29 21:40:19.051424 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3459/6827] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:40:18 2022] POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:40:19.060551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:19.061175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:19.067224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:19.067727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:19.068255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:19.069322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:19.069944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:19.070446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:19.204943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:19.214104 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-12bbc2de-e874-414d-9ab8-2a313f7e5255 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1678 microversion: 2.1 time: 0.158458 Oct 29 21:40:19.214907 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3369/6828] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:19 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:20.240091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:20.240841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:20.248240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:20.248734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:20.249188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:20.249926 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:20.250393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:20.250839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:20.383207 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:20.392129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a21706e7-ae0a-46ef-81b2-83233c795702 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1678 microversion: 2.1 time: 0.157212 Oct 29 21:40:20.392699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3460/6829] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:20 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:21.415502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:21.416285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:21.423419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:21.423914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:21.424363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:21.425071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:21.425570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:21.426010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:21.536512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-90695637-8e04-45e7-b5cc-0b69f32658f0 req-1a895cd8-56b2-4308-b30b-a7ac429e2bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "name": "network-vif-plugged", "status": "completed", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:21.553726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-90695637-8e04-45e7-b5cc-0b69f32658f0 req-1a895cd8-56b2-4308-b30b-a7ac429e2bea service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:21.554226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-90695637-8e04-45e7-b5cc-0b69f32658f0 req-1a895cd8-56b2-4308-b30b-a7ac429e2bea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:21.554739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-90695637-8e04-45e7-b5cc-0b69f32658f0 req-1a895cd8-56b2-4308-b30b-a7ac429e2bea service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:21.567396 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-90695637-8e04-45e7-b5cc-0b69f32658f0 req-1a895cd8-56b2-4308-b30b-a7ac429e2bea service nova] Creating event network-vif-plugged:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch2-master-1 Oct 29 21:40:21.573193 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-90695637-8e04-45e7-b5cc-0b69f32658f0 req-1a895cd8-56b2-4308-b30b-a7ac429e2bea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113241 Oct 29 21:40:21.574107 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3461/6830] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:21.876271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:21.884021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d5433ba-ff10-46a7-be74-c52f11e909ce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1657 microversion: 2.1 time: 0.472504 Oct 29 21:40:21.885198 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3370/6831] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:21 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1657 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:21.907468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:21.908235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:21.914443 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:21.914961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:21.915440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:21.916139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:21.916604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:21.917044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:22.047027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:22.054903 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0239a767-6a74-4131-bdaf-c88eee259c66 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1657 microversion: 2.1 time: 0.151618 Oct 29 21:40:22.055476 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3462/6832] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:21 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:22.078920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82637c85-386a-47e2-a1ea-77fb72c637fe tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:22.086082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82637c85-386a-47e2-a1ea-77fb72c637fe tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:22.086615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82637c85-386a-47e2-a1ea-77fb72c637fe tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:22.087150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-82637c85-386a-47e2-a1ea-77fb72c637fe tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:22.110767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-82637c85-386a-47e2-a1ea-77fb72c637fe tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Going to try to start instance {{(pid=138884) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 21:40:22.155633 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82637c85-386a-47e2-a1ea-77fb72c637fe tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action" status: 202 len: 0 microversion: 2.1 time: 0.081420 Oct 29 21:40:22.156494 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3371/6833] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:40:22 2022] POST /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:40:22.165402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:22.166580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:22.173153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:22.173821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:22.174412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:22.175262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:22.175769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:22.176171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:22.192328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:40:22.319235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:22.327387 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c832f0ff-9110-4bc9-816f-aed8636ca851 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1666 microversion: 2.1 time: 0.165927 Oct 29 21:40:22.327971 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3463/6834] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:22 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:23.352386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:23.353101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:23.359401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:23.359897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:23.360347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:23.361048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:23.361540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:23.361976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:23.382154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:40:23.492680 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:23.501111 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c8255828-2140-4542-b6ea-59f680f9bfdc tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1670 microversion: 2.1 time: 0.153928 Oct 29 21:40:23.501720 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3372/6835] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:23 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:23.523524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:23.524028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:23.530783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:23.531288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:23.531741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:23.532439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:23.532904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:23.533343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:23.561314 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:40:23.636040 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7830c547-d197-4593-a16f-48b00adf685e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 204 len: 0 microversion: 2.1 time: 0.115993 Oct 29 21:40:23.637286 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3464/6836] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:40:23 2022] DELETE /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:40:23.645931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:23.646652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:23.652844 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:23.653333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:23.653806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:23.654508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:23.654972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:23.655429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:23.788845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:23.796743 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7f8dbecf-461d-4b2a-8257-00d8773a3ddd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1676 microversion: 2.1 time: 0.154891 Oct 29 21:40:23.797329 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3373/6837] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:23 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:24.820753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:24.821496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:24.828616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:24.829146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:24.829634 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:24.830340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:24.830808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:24.831248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:24.963410 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:24.971280 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-590b46d2-d1f7-4c5c-8429-2b6398be3d58 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1676 microversion: 2.1 time: 0.154826 Oct 29 21:40:24.971852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3465/6838] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:24 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:25.995359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:25.996109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:25.999584 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:40:25.999798 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 (ip 10.222.0.36) !!! Oct 29 21:40:26.006354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:26.006936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:26.007388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:26.008124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:26.008601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:26.009044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:26.081862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:26.090370 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-daad5279-0e20-49b8-bcb5-0e41e21524de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 200 len: 1609 microversion: 2.1 time: 0.099260 Oct 29 21:40:26.091288 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3374/6839] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:25 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 1609 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:26.187202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-fdc02259-c393-4a38-af43-2b77089116b7 req-dbbcc486-e337-4fc9-a91b-425d626a349a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3598885-0be0-4f84-9485-df65613ad543", "name": "network-vif-deleted", "tag": "6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:26.194517 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:40:26.194891 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:40:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 29 21:40:26.212022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fdc02259-c393-4a38-af43-2b77089116b7 req-dbbcc486-e337-4fc9-a91b-425d626a349a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:26.212854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fdc02259-c393-4a38-af43-2b77089116b7 req-dbbcc486-e337-4fc9-a91b-425d626a349a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:26.212977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fdc02259-c393-4a38-af43-2b77089116b7 req-dbbcc486-e337-4fc9-a91b-425d626a349a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:26.225191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-fdc02259-c393-4a38-af43-2b77089116b7 req-dbbcc486-e337-4fc9-a91b-425d626a349a service nova] Creating event network-vif-deleted:6c952160-2e9e-45e6-bf5f-2aeeb45f0bfc for instance a3598885-0be0-4f84-9485-df65613ad543 on nch2-master-1 Oct 29 21:40:26.231103 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-fdc02259-c393-4a38-af43-2b77089116b7 req-dbbcc486-e337-4fc9-a91b-425d626a349a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047744 Oct 29 21:40:26.231717 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3466/6840] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:27.114672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:27.115299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:27.122892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:27.123386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:27.123829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:27.124537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:27.124997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:27.125428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:27.140050 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 HTTP/1.1 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'a3598885-0be0-4f84-9485-df65613ad543'} Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:40:27.141749 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-05d8f840-2927-43cc-ad42-d6fff5ea239b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 404 len: 111 microversion: 2.1 time: 0.032550 Oct 29 21:40:27.146836 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3375/6841] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:27 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:40:27.160210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:27.160939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:27.167265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:27.167769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:27.168221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:27.168928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:27.169399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:27.169867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:27.183483 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 HTTP/1.1 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a3598885-0be0-4f84-9485-df65613ad543'} Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:40:27.185094 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55228184-f530-4f34-84c6-3ab2aa08ee49 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 404 len: 111 microversion: 2.1 time: 0.030613 Oct 29 21:40:27.190782 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3467/6842] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:27 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:40:27.236778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-106096344", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "10f180e8-dd1a-40a4-8139-14b06f7d5970"}], "security_groups": [{"name": "tempest-securitygroup--271797714"}], "key_name": "tempest-keypair-1482632209", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:27.339206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] validate_networks() for [('10f180e8-dd1a-40a4-8139-14b06f7d5970', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:40:27.720738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:40:27.721170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:40:27.721704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:40:27.722118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:40:27.722534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:40:27.732610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:27.732610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:27.733283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:27.734054 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:27.734620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:27.734940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:27.752136 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:40:27.757828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:40:27.770519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:40:27.772854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:40:27.818912 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-60d63529-78d1-4b2a-be61-889c4a62ff05 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.586014 Oct 29 21:40:27.819576 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3376/6843] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:40:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:40:27.831057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-13541b02-d8a3-4491-b421-ed632966bbc0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:27.831773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-13541b02-d8a3-4491-b421-ed632966bbc0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:27.887912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-13541b02-d8a3-4491-b421-ed632966bbc0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:27.895736 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-13541b02-d8a3-4491-b421-ed632966bbc0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1238 microversion: 2.1 time: 0.068503 Oct 29 21:40:27.896308 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3468/6844] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:27 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:28.922157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:28.922867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:28.929705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:28.930203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:28.930656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:28.932022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:28.932496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:28.932937 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:29.002918 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:29.010981 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a00c20c4-a5ea-46ce-94d4-34a42933406a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1298 microversion: 2.1 time: 0.094877 Oct 29 21:40:29.011664 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3377/6845] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:28 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:30.036321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:30.037573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:30.040570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:40:30.046906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:30.047417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:30.047877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:30.048601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:30.049080 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:30.049572 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:30.180880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:30.188813 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-586588e5-1649-48e1-88a6-862c961a2f40 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1363 microversion: 2.1 time: 0.156967 Oct 29 21:40:30.189287 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3469/6846] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:30 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:30.319786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-62b137df-e156-4402-a83e-1bafa29edfb6 req-8bdf28b5-054c-4dba-9050-05eadc9e9db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:30.325693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:40:30.332014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-62b137df-e156-4402-a83e-1bafa29edfb6 req-8bdf28b5-054c-4dba-9050-05eadc9e9db3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:30.332643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-62b137df-e156-4402-a83e-1bafa29edfb6 req-8bdf28b5-054c-4dba-9050-05eadc9e9db3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:30.333163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-62b137df-e156-4402-a83e-1bafa29edfb6 req-8bdf28b5-054c-4dba-9050-05eadc9e9db3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:30.345735 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-62b137df-e156-4402-a83e-1bafa29edfb6 req-8bdf28b5-054c-4dba-9050-05eadc9e9db3 service nova] Creating event network-changed:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:40:30.350554 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-62b137df-e156-4402-a83e-1bafa29edfb6 req-8bdf28b5-054c-4dba-9050-05eadc9e9db3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035412 Oct 29 21:40:30.351299 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3378/6847] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:31.214051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:31.214683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:31.221613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:31.222112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:31.222557 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:31.223258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:31.223731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:31.224169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:31.356850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:31.364502 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3be846dc-fce2-4b8c-b3e6-ab8d1c9ed19b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1363 microversion: 2.1 time: 0.155020 Oct 29 21:40:31.365065 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3470/6848] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:31 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:32.389427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:32.390173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:32.396568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:32.397055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:32.397531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:32.398228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:32.398686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:32.399118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:32.529649 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:32.537338 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79aa7366-4bb6-4960-8a09-d2a9a1f8e3fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1363 microversion: 2.1 time: 0.153746 Oct 29 21:40:32.538253 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3379/6849] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:32 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:33.560870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:33.561517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:33.568425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:33.568921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:33.569368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:33.570122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:33.570587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:33.571023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:33.705107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:33.713545 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2bcaea3-2aad-4451-a721-84e3cc8fbb39 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1363 microversion: 2.1 time: 0.157121 Oct 29 21:40:33.714124 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3471/6850] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:33 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:34.738386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:34.739021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:34.745934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:34.746413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:34.746850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:34.747541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:34.747995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:34.748423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:34.877292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:34.885605 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca6b50fc-2844-4bb2-b2a3-833c5b6041e2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1363 microversion: 2.1 time: 0.151076 Oct 29 21:40:34.886185 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3380/6851] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:34 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:35.484180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-fe2aa035-08d1-4cb7-9423-fe32fec9ad74 req-a0137d4d-246e-4612-b2c7-e78616624c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "name": "network-vif-plugged", "status": "completed", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:35.496588 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fe2aa035-08d1-4cb7-9423-fe32fec9ad74 req-a0137d4d-246e-4612-b2c7-e78616624c71 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:35.497082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fe2aa035-08d1-4cb7-9423-fe32fec9ad74 req-a0137d4d-246e-4612-b2c7-e78616624c71 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:35.497579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fe2aa035-08d1-4cb7-9423-fe32fec9ad74 req-a0137d4d-246e-4612-b2c7-e78616624c71 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:35.509258 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-fe2aa035-08d1-4cb7-9423-fe32fec9ad74 req-a0137d4d-246e-4612-b2c7-e78616624c71 service nova] Creating event network-vif-plugged:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:40:35.514542 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-fe2aa035-08d1-4cb7-9423-fe32fec9ad74 req-a0137d4d-246e-4612-b2c7-e78616624c71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034132 Oct 29 21:40:35.515142 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3472/6852] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:35.909608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:35.910238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:35.917838 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:35.918330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:35.918779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:35.919483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:35.919949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:35.920385 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:36.047593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:36.055433 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3c23da83-9444-438a-bd42-c7d4e4312401 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1363 microversion: 2.1 time: 0.149815 Oct 29 21:40:36.056022 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3381/6853] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:35 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:37.079599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:37.080328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:37.087478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:37.087976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:37.088442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:37.089155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:37.089657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:37.090108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:37.222395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:40:37.230799 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-964df82a-ba35-41dd-a7da-60c34732e219 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1550 microversion: 2.1 time: 0.155529 Oct 29 21:40:37.231369 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3473/6854] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:40:37 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:40:37.254527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:40:37.255038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:40:37.261991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:37.262484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:37.262935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:37.263646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:37.264114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:37.264558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:37.342013 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c27f1db5-9178-4699-9a57-9d60dbdf15ea tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091110 Oct 29 21:40:37.342628 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3382/6855] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:40:37 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:40:38.276097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5ea9f2a3-71da-4c81-a6ee-d879ce44c8fc req-3ca35d38-0bca-491b-9918-e6d3bb686547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:40:38.281612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:40:38.288885 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5ea9f2a3-71da-4c81-a6ee-d879ce44c8fc req-3ca35d38-0bca-491b-9918-e6d3bb686547 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:40:38.289384 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5ea9f2a3-71da-4c81-a6ee-d879ce44c8fc req-3ca35d38-0bca-491b-9918-e6d3bb686547 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:40:38.289845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5ea9f2a3-71da-4c81-a6ee-d879ce44c8fc req-3ca35d38-0bca-491b-9918-e6d3bb686547 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:40:38.301144 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5ea9f2a3-71da-4c81-a6ee-d879ce44c8fc req-3ca35d38-0bca-491b-9918-e6d3bb686547 service nova] Creating event network-changed:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:40:38.307066 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5ea9f2a3-71da-4c81-a6ee-d879ce44c8fc req-3ca35d38-0bca-491b-9918-e6d3bb686547 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034767 Oct 29 21:40:38.307833 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3474/6856] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:19.047373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:19.048164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:19.050101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=9 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:19.050735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=48 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:19.054712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:19.057005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:19.065688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:19.066182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:19.066629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:19.067330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:19.067791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:19.068225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:19.096453 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:19.102100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Old instance type m1.heat2, new instance type m1.heat {{(pid=138884) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:41:19.109377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:41:19.109835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:41:19.110322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:41:19.110738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:41:19.111152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:41:19.173366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36032333-118a-47fe-84b1-5a9036c20f45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.126745 Oct 29 21:41:19.176937 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3383/6857] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:41:19 2022] POST /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:41:19.182906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:19.183637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:19.187856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=11 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:19.188576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:19.194453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:19.195597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:19.196381 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:19.197377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:19.197979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:19.198391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:19.366541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:19.374469 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df07af6f-0be4-42cd-9a68-540ec55a15c2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1677 microversion: 2.1 time: 0.196055 Oct 29 21:41:19.375049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3475/6858] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:19 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:20.399191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:20.399741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:20.406620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:20.407105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:20.407544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:20.408233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:20.408690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:20.409122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:20.539068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:20.546925 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c857667-ac53-4ba5-878e-834dcf6649a2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1677 microversion: 2.1 time: 0.152573 Oct 29 21:41:20.547496 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3384/6859] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:20 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:21.571399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:21.572029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:21.579621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:21.580120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:21.580573 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:21.581275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:21.581770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:21.582212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:21.714474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:21.722246 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cedf75ce-d2d9-4b98-b52e-bc04e5984013 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.154733 Oct 29 21:41:21.722839 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3476/6860] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:21 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:22.745785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:22.746449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:22.753473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:22.753977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:22.754423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:22.755129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:22.755592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:22.756028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:22.894473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:22.903121 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6341edc2-20cb-44d9-a98c-dea9cb1117b5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.160716 Oct 29 21:41:22.903863 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3385/6861] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:22 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:23.927054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:23.927731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:23.934698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:23.935199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:23.935657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:23.936368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:23.936838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:23.937283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:24.064735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:24.072514 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c53873b5-5c38-45b3-a2d8-b431aa131197 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.149390 Oct 29 21:41:24.073096 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3477/6862] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:23 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:25.096171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:25.096786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:25.103595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:25.104078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:25.104514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:25.105204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:25.106230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:25.106658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:25.238928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:25.246816 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d6d6f2b7-2b19-4654-9aad-ce8ed39a000a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.154487 Oct 29 21:41:25.247389 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3386/6863] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:25 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:26.270208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:26.270869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:26.277876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:26.278376 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:26.278836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:26.279540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:26.280012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:26.280457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:26.407825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:26.415631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20b15dfd-a7d6-4472-acaa-2e728ba0d369 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.149333 Oct 29 21:41:26.416201 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3478/6864] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:26 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:27.438646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:27.439267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:27.446935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:27.447419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:27.447861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:27.448561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:27.449015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:27.449977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:27.586212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:27.593963 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6914e71b-9050-45ed-af1a-dec388ae93f6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.159232 Oct 29 21:41:27.594539 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3387/6865] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:27 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:28.616990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:28.617678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:28.625078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:28.625619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:28.626074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:28.626779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:28.627256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:28.627699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:28.759115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:28.767479 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-02782f86-c244-4029-828a-28e62c98a5b2 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.154399 Oct 29 21:41:28.768069 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3479/6866] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:28 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:29.791382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:29.792012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:29.799781 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:29.800275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:29.800721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:29.801476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:29.801940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:29.802376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:29.934578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:29.942440 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbad50e4-b6eb-4db1-9147-ce9870bb0bff tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.155001 Oct 29 21:41:29.943029 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3388/6867] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:29 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:41:30.966402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:30.967026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:30.974002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:30.974496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:30.974944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:30.975641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:30.976106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:30.976546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:31.107113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:31.115430 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f095c2e-d00b-4199-b7dd-548e9f779bce tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.152482 Oct 29 21:41:31.115851 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3480/6868] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:30 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:32.139108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:32.139724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:32.146550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:32.147033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:32.147473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:32.148160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:32.148616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:32.149038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:32.280393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:32.288187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-20424a02-1160-47f3-b1fb-b7c0be9f151f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1682 microversion: 2.1 time: 0.153118 Oct 29 21:41:32.288781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3389/6869] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:32 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:33.314263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:33.315001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:33.322248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:33.322773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:33.323270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:33.324028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:33.324442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:33.324890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:33.465273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:33.474027 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-76eca5f0-8ae4-4732-9113-819734a376b4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1681 microversion: 2.1 time: 0.165715 Oct 29 21:41:33.474712 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3481/6870] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:33 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:34.030741 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "name": "network-vif-unplugged", "status": "completed", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:34.040726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:34.041219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:34.041708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:34.054621 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] Creating event network-vif-unplugged:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch1-master-1 Oct 29 21:41:34.060870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:41:34.072056 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ddfd6f68-2d2e-4631-a1ed-768df5349992 req-6e8a9da7-5f0f-4e0d-a4cf-f8687c2e5745 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121287 Oct 29 21:41:34.072680 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3390/6871] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:34.499613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:34.500872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:34.507856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:34.508358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:34.508844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:34.509589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:34.510066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:34.510510 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:34.646672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:34.654596 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-671d7d50-5824-4e03-8c80-7de5434ae6fb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1681 microversion: 2.1 time: 0.159596 Oct 29 21:41:34.655206 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3482/6872] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:34 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:35.679965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:35.680694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:35.687351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:35.687834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:35.688270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:35.688955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:35.689409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:35.689867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:35.820073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:35.828695 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d8d71d0f-4b85-43dc-b613-3f46af0769de tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1679 microversion: 2.1 time: 0.153860 Oct 29 21:41:35.829265 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3391/6873] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:35 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:36.095325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:36.105693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:36.106196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:36.106653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:36.118753 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] Creating event network-changed:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch1-master-1 Oct 29 21:41:36.124752 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:41:36.135509 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ad8c175c-e4af-4272-9949-640516c8e231 req-9d6fa590-88e5-48dc-9887-d5302c49795d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043793 Oct 29 21:41:36.136044 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3483/6874] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:36.852100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:36.852727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:36.860303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:36.860796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:36.861244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:36.861981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:36.862446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:36.862883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:37.002342 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:37.010158 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f1994f2d-65ca-40a6-9dd2-1f904e7aa795 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1679 microversion: 2.1 time: 0.161940 Oct 29 21:41:37.010745 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3392/6875] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:36 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:38.034887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:38.035617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:38.042031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.042541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.043023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.043737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.044211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.044660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.179307 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:38.188077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4b960ca-73a3-42d1-92a0-47ca173017a9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1676 microversion: 2.1 time: 0.158556 Oct 29 21:41:38.188663 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3484/6876] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:38 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:38.212697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:38.213253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:38.220345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.220842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.221290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.222035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.222503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.222943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.260588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.261076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.261549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.262292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.262758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.263193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.284303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:41:38.289551 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:41:38.390788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7fcd877d-8d4f-44b6-b6f1-f7c7ae717ef1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.181860 Oct 29 21:41:38.391587 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3393/6877] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:41:38 2022] POST /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:41:38.399787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:38.400723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:38.407003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.407508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.407965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.408690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:38.409211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:38.409789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:38.544161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:38.552443 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-354b162b-d600-4074-891c-ec0f800d9b24 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1675 microversion: 2.1 time: 0.156568 Oct 29 21:41:38.553049 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3485/6878] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:38 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:39.580687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:39.581403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:39.587986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:39.588570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:39.589022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:39.589751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:39.590227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:39.590788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:39.724966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:39.732952 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0cb1cc0d-932f-49c6-9fed-b56268702a00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1675 microversion: 2.1 time: 0.157645 Oct 29 21:41:39.733753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3394/6879] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:39 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:40.757074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:40.757875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:40.765420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:40.765940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:40.766571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:40.767608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:40.768089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:40.768532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:40.897483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:40.905951 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b02a5412-3ad0-4e50-a886-1cbffded2d60 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1675 microversion: 2.1 time: 0.153831 Oct 29 21:41:40.906533 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3486/6880] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:40 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:41.456425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "name": "network-vif-plugged", "status": "completed", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:41.468387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:41.469111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:41.469653 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:41.484166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] Creating event network-vif-plugged:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:41:41.486971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:41.490657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:41:41.504648 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-85339d70-b3ec-4ffb-a7a3-86df8e080b06 req-8ec10467-4f76-4a5d-9a3c-113fcb9ec56c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051605 Oct 29 21:41:41.505729 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3395/6881] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:41.844598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "name": "network-vif-unplugged", "status": "completed", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:41.855313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:41.855806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:41.856342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:41.869934 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] Creating event network-vif-unplugged:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:41:41.876164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:41:41.887080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a3550fcf-ec25-45a7-abe1-caeea08316d8 req-61df277f-5bcd-4d05-8b8d-e81d83423a3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047189 Oct 29 21:41:41.887703 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3487/6882] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:41.933257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:41.934527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:41.942799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:41.943296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:41.943962 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:41.944681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:41.945152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:41.945627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:42.094736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:42.105537 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-88bc4572-38f1-432c-9b97-b4bf87a083ab tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1675 microversion: 2.1 time: 0.179198 Oct 29 21:41:42.106380 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3396/6883] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:41 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:43.131691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:43.132448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:43.138684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:43.139189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:43.139646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:43.140349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:43.140820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:43.141263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:43.274494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:43.282743 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-394dfa80-2df7-47dc-99b3-015a818a7c3e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1675 microversion: 2.1 time: 0.156124 Oct 29 21:41:43.283318 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3488/6884] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:43 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:43.908565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:43.918857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:43.919329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:43.919771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:43.931341 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] Creating event network-changed:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:41:43.937094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:41:43.947469 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d16acfc0-10ca-4007-9984-09b35e612e0b req-a01a6a97-721d-4d29-b60b-c509e466350c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043213 Oct 29 21:41:43.948054 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3397/6885] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:44.306669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:44.307302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:44.315040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:44.315544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:44.316000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:44.316704 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:44.317171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:44.317640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:44.451325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:44.459309 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-248479db-b054-4d8f-bc3e-ae81848c039d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1675 microversion: 2.1 time: 0.156594 Oct 29 21:41:44.459889 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3489/6886] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:44 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:41:45.484828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:45.485484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:45.491678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:45.492156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:45.492596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:45.493279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:45.493764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:45.494185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:45.627391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:45.635565 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f08b1b61-696a-4c64-a017-56c44116aae1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1668 microversion: 2.1 time: 0.155855 Oct 29 21:41:45.636162 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3398/6887] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:45 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:45.658464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:45.659214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:45.666035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:45.666535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:45.666987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:45.667693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:45.668165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:45.668605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:45.799567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:45.808116 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-819b32f7-aac7-44dc-a53a-e1b7b7d50e9b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1668 microversion: 2.1 time: 0.153514 Oct 29 21:41:45.808697 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3490/6888] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:45 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:45.833508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:45.834124 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:45.839930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:45.840415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:45.840853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:45.841568 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:45.842068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:45.842494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:45.972733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:45.980678 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-388f0aa6-77be-49df-a4d3-fff19437ceb9 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1668 microversion: 2.1 time: 0.151048 Oct 29 21:41:45.981250 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3399/6889] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:45 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:46.004875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:46.005423 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:46.011566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:46.012069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:46.012525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:46.013234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:46.013852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:46.014625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:46.039587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:41:46.053730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=100 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:46.117334 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a5b99982-3ae5-4014-bb8f-7cb1f68a50a0 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 204 len: 0 microversion: 2.1 time: 0.115953 Oct 29 21:41:46.118388 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3491/6890] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:41:45 2022] DELETE /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:41:46.127480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:46.128119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:46.136489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:46.136980 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:46.137430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:46.138194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:46.138691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:46.139190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:46.269128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:46.276985 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04e9ca37-18ee-458e-889e-a0ca19c84f95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1674 microversion: 2.1 time: 0.154334 Oct 29 21:41:46.277579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3400/6891] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:46 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:41:47.301280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:47.302066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:47.308900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:47.309402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:47.309884 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:47.311232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:47.311705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:47.312156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:47.445772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:47.453885 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5dfaae5-054a-4b02-bfd6-53b789906783 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1674 microversion: 2.1 time: 0.156938 Oct 29 21:41:47.454470 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3492/6892] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:47 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:47.823566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c97567fd-3a7b-4e06-9b4e-27be497541db req-5bf4fd40-a2de-49cf-9c51-938c6859db02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "name": "network-vif-plugged", "status": "completed", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:47.836566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c97567fd-3a7b-4e06-9b4e-27be497541db req-5bf4fd40-a2de-49cf-9c51-938c6859db02 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:47.838664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c97567fd-3a7b-4e06-9b4e-27be497541db req-5bf4fd40-a2de-49cf-9c51-938c6859db02 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:47.839307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c97567fd-3a7b-4e06-9b4e-27be497541db req-5bf4fd40-a2de-49cf-9c51-938c6859db02 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:47.852177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c97567fd-3a7b-4e06-9b4e-27be497541db req-5bf4fd40-a2de-49cf-9c51-938c6859db02 service nova] Creating event network-vif-plugged:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:41:47.858819 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c97567fd-3a7b-4e06-9b4e-27be497541db req-5bf4fd40-a2de-49cf-9c51-938c6859db02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038890 Oct 29 21:41:47.859708 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3401/6893] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:48.331850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2cc83b8f-f047-4992-b489-21312574f5f8 req-bd7dae80-6a47-4d92-ae5a-8ab51c72d609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a84aa3-eca6-4242-9515-38be9b019ce4", "name": "network-vif-deleted", "tag": "be084c06-0c35-4505-8052-45ba3f44f738"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:48.344107 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2cc83b8f-f047-4992-b489-21312574f5f8 req-bd7dae80-6a47-4d92-ae5a-8ab51c72d609 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:48.344600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2cc83b8f-f047-4992-b489-21312574f5f8 req-bd7dae80-6a47-4d92-ae5a-8ab51c72d609 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:48.345067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2cc83b8f-f047-4992-b489-21312574f5f8 req-bd7dae80-6a47-4d92-ae5a-8ab51c72d609 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:48.357446 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2cc83b8f-f047-4992-b489-21312574f5f8 req-bd7dae80-6a47-4d92-ae5a-8ab51c72d609 service nova] Creating event network-vif-deleted:be084c06-0c35-4505-8052-45ba3f44f738 for instance 96a84aa3-eca6-4242-9515-38be9b019ce4 on nch2-master-1 Oct 29 21:41:48.363100 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2cc83b8f-f047-4992-b489-21312574f5f8 req-bd7dae80-6a47-4d92-ae5a-8ab51c72d609 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035154 Oct 29 21:41:48.364095 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3493/6894] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:48.474258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:48.478682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:48.479401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:48.486266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:48.486671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:48.487116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:48.487822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:48.488283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:48.488712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:48.524735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:48.525225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:48.525728 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:48.526181 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lazy-loading 'fault' on Instance uuid 96a84aa3-eca6-4242-9515-38be9b019ce4 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:41:48.574198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:48.582848 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-52de8005-2ff4-43ff-983c-e9d0540206c3 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 200 len: 1328 microversion: 2.1 time: 0.109618 Oct 29 21:41:48.583405 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3402/6895] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:48 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:49.607614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:49.608341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:49.610327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:49.616077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:49.616613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:49.617068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:49.617825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:49.618298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:49.618747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:49.632504 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 HTTP/1.1 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '96a84aa3-eca6-4242-9515-38be9b019ce4'} Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:41:49.634159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7020745d-6526-4a20-ac1e-df2c02e56f96 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 404 len: 111 microversion: 2.1 time: 0.033192 Oct 29 21:41:49.640245 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3494/6896] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:49 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:41:49.652746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:49.653483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:49.656905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:41:49.662538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:49.663061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:49.663505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:49.664202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:49.664659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:49.665088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:49.679503 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 HTTP/1.1 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '96a84aa3-eca6-4242-9515-38be9b019ce4'} Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:41:49.681160 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f66e7ec8-681b-40e0-938e-90bf21ed1776 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 404 len: 111 microversion: 2.1 time: 0.033643 Oct 29 21:41:49.685670 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3403/6897] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:49 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:41:49.730796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-349252843", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "10f180e8-dd1a-40a4-8139-14b06f7d5970"}], "security_groups": [{"name": "tempest-securitygroup--271797714"}], "key_name": "tempest-keypair-1482632209", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:49.833446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] validate_networks() for [('10f180e8-dd1a-40a4-8139-14b06f7d5970', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:41:50.197789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:41:50.198237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:41:50.198733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:41:50.199168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:41:50.199605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:41:50.209513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:50.210021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:50.210474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:50.211568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:50.211673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:50.212104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:50.228985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:41:50.234266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:41:50.246648 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:41:50.249516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:41:50.296067 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-720fe150-b35d-4f7f-a5de-27b2d55b6f63 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.569112 Oct 29 21:41:50.296719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3495/6898] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:41:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:41:50.308110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ab24f20d-2a5a-478a-bd7a-645326679262 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:50.308867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ab24f20d-2a5a-478a-bd7a-645326679262 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:50.364905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ab24f20d-2a5a-478a-bd7a-645326679262 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:50.372169 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ab24f20d-2a5a-478a-bd7a-645326679262 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1238 microversion: 2.1 time: 0.067906 Oct 29 21:41:50.372782 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3404/6899] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:50 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:51.397316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:51.398041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:51.405592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:51.406355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:51.407004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:51.407894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:51.408519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:51.409128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:51.475524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:51.483323 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d5a66c1-fec6-4c00-9759-61cc3730fb3a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1308 microversion: 2.1 time: 0.090950 Oct 29 21:41:51.483970 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3496/6900] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:51 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:52.507796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:52.508423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:52.516106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:52.516719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:52.517178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:52.517913 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:52.518378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:52.518813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:52.662705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:52.670989 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc66a652-e287-4532-ad96-576234366d37 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.166913 Oct 29 21:41:52.671831 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3405/6901] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:52 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:53.047861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-094a9ebf-34a5-4a73-bb4e-eb51a87f81e3 req-4a8139a8-bf8a-4e95-978a-38d061b078be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:53.059129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-094a9ebf-34a5-4a73-bb4e-eb51a87f81e3 req-4a8139a8-bf8a-4e95-978a-38d061b078be service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:53.059627 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-094a9ebf-34a5-4a73-bb4e-eb51a87f81e3 req-4a8139a8-bf8a-4e95-978a-38d061b078be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:53.060077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-094a9ebf-34a5-4a73-bb4e-eb51a87f81e3 req-4a8139a8-bf8a-4e95-978a-38d061b078be service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:53.071849 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-094a9ebf-34a5-4a73-bb4e-eb51a87f81e3 req-4a8139a8-bf8a-4e95-978a-38d061b078be service nova] Creating event network-changed:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:41:53.077766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-094a9ebf-34a5-4a73-bb4e-eb51a87f81e3 req-4a8139a8-bf8a-4e95-978a-38d061b078be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033666 Oct 29 21:41:53.078565 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3497/6902] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:41:53.694200 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:53.694752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:53.701916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:53.702399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:53.702842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:53.703538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:53.703996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:53.704427 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:53.831438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:53.839251 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-38f1fa6e-8921-40b4-b492-7a21947afe3f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.149009 Oct 29 21:41:53.839833 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3406/6903] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:53 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:54.864746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:54.865488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:54.871811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:54.872315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:54.872768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:54.874103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:54.874578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:54.875020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:55.004821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:55.012554 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7fb84894-81a6-409e-a3f7-f58eac06690f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.152981 Oct 29 21:41:55.013134 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3498/6904] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:54 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:56.035977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:56.036644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:56.044002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:56.044569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:56.045661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:56.046369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:56.046858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:56.047285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:56.175122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:56.182861 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec8cc816-00a7-4dab-9fd3-1ae2275e0a95 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.150832 Oct 29 21:41:56.183431 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3407/6905] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:56 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:57.206880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:57.207594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:57.214962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:57.215479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:57.215930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:57.216663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:57.217115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:57.217587 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:57.347569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:57.355535 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07792969-2d66-45ec-9bec-57e5c2cfd51c tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.152559 Oct 29 21:41:57.356136 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3499/6906] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:57 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:58.379470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:58.380083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:58.386949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:58.387430 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:58.387870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:58.388596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:58.389052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:58.389501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:58.522609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:58.530851 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1fe44a22-0ef5-49fe-8cd3-efc6652da0fa tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.155286 Oct 29 21:41:58.531457 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3408/6907] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:58 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:41:59.344085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-10f29fe5-5309-4aad-8dc8-831eca6c9dd1 req-4783f82b-437f-4691-b246-6daf41446020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "name": "network-vif-plugged", "status": "completed", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:41:59.356346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-10f29fe5-5309-4aad-8dc8-831eca6c9dd1 req-4783f82b-437f-4691-b246-6daf41446020 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:59.356853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-10f29fe5-5309-4aad-8dc8-831eca6c9dd1 req-4783f82b-437f-4691-b246-6daf41446020 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:59.357473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-10f29fe5-5309-4aad-8dc8-831eca6c9dd1 req-4783f82b-437f-4691-b246-6daf41446020 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:59.373153 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-10f29fe5-5309-4aad-8dc8-831eca6c9dd1 req-4783f82b-437f-4691-b246-6daf41446020 service nova] Creating event network-vif-plugged:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:41:59.378260 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-10f29fe5-5309-4aad-8dc8-831eca6c9dd1 req-4783f82b-437f-4691-b246-6daf41446020 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041140 Oct 29 21:41:59.379154 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3500/6908] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:41:59.554851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:41:59.555497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:41:59.562537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:59.563027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:59.563475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:59.564180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:41:59.564640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:41:59.565071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:41:59.694029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:41:59.702589 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4fdf584a-9624-4043-b241-5d634796f78e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.151646 Oct 29 21:41:59.703157 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3409/6909] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:41:59 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:42:00.724009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:42:00.724841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:42:00.730067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:42:00.730812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:42:00.738513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:00.739028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:00.739490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:00.740212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:00.740700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:00.741158 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:00.874050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:42:00.881853 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-127aacab-8588-46cc-a242-309d0060fb00 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1363 microversion: 2.1 time: 0.158745 Oct 29 21:42:00.882375 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3501/6910] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:42:00 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:42:01.906289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:42:01.906914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:42:01.908802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:42:01.914904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:01.915394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:01.915839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:01.916539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:01.917000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:01.917488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:02.046330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:42:02.054120 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ae66a89a-1153-4916-b6ac-7bb7271a32dd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1550 microversion: 2.1 time: 0.152405 Oct 29 21:42:02.054706 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3410/6911] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:42:01 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:42:02.078621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:42:02.079189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:42:02.086389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:02.087160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:02.087861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:02.088602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:02.089084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:02.089563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:02.165968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-893721a1-b895-4d7c-8f5d-a64f3d442abd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092143 Oct 29 21:42:02.166574 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3502/6912] 10.222.0.36 () {58 vars in 1275 bytes} [Sat Oct 29 21:42:02 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:42:03.395231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f85e980a-19a6-4956-a142-61b06ace63ff req-36ea5664-6afd-4e01-a0b9-231f8d443d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:42:03.406397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f85e980a-19a6-4956-a142-61b06ace63ff req-36ea5664-6afd-4e01-a0b9-231f8d443d1d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:42:03.406887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f85e980a-19a6-4956-a142-61b06ace63ff req-36ea5664-6afd-4e01-a0b9-231f8d443d1d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:42:03.407329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f85e980a-19a6-4956-a142-61b06ace63ff req-36ea5664-6afd-4e01-a0b9-231f8d443d1d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:42:03.418494 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f85e980a-19a6-4956-a142-61b06ace63ff req-36ea5664-6afd-4e01-a0b9-231f8d443d1d service nova] Creating event network-changed:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:42:03.425402 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f85e980a-19a6-4956-a142-61b06ace63ff req-36ea5664-6afd-4e01-a0b9-231f8d443d1d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033687 Oct 29 21:42:03.426147 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3411/6913] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:43:17.948024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:17.948928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:17.954801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:17.955430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:17.963274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:17.963836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:17.964288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:17.964992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:17.965485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:17.965924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:18.098417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:18.106217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db1365fc-0519-4b8f-8742-af83520f1d21 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1668 microversion: 2.1 time: 0.161439 Oct 29 21:43:18.106800 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3503/6914] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:17 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:18.129286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=19 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:18.130068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=78 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:18.134945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0026573f-81c4-40a0-9ab5-63da7bdac5f3"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:18.137370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:18.144628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:18.145122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:18.145606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:18.146317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:18.146785 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:18.147221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:18.402343 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ceee43e9-083e-481b-9f14-85ffff51518f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276992 Oct 29 21:43:18.402958 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3412/6915] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:43:18 2022] POST /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:43:21.702467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:21.705279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:21.711270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:21.711765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:21.712217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:21.712916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:21.713382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:21.713852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:21.742020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:21.747674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Old instance type m1.heat2, new instance type m1.heat {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:43:21.755447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:43:21.755890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:43:21.756387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:43:21.756816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:43:21.757249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:43:21.819217 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b8b007a-1709-4875-ad32-9ba84aee958d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/action" status: 202 len: 0 microversion: 2.1 time: 0.121309 Oct 29 21:43:21.820178 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3504/6916] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:43:21 2022] POST /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:43:21.829631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:21.831716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:21.837646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:21.838076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:21.838521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:21.839246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:21.839691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:21.840129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:21.995451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:22.004166 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f0d2f80c-957a-4df9-8e49-eca9834ba9b8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1723 microversion: 2.1 time: 0.179905 Oct 29 21:43:22.004764 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3413/6917] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:21 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:43:23.028974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:23.029577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:23.037011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:23.037544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:23.038023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:23.038736 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:23.039206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:23.039646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:23.178192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:23.186766 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e4fba241-90c2-4c9b-b549-b45982ed493b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1723 microversion: 2.1 time: 0.162611 Oct 29 21:43:23.187361 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3505/6918] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:23 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:24.211233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:24.212268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:24.218674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:24.219164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:24.219609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:24.220303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:24.220762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:24.221192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:24.352644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:24.361672 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c62f47d6-aa27-4a4b-a2c2-bfd96b702e78 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.154404 Oct 29 21:43:24.362263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3414/6919] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:24 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:25.385365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:25.386057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:25.393594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:25.394099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:25.394554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:25.395258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:25.395730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:25.396171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:25.533546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:25.541992 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8c91550d-45ef-41c9-be6a-4be83827c655 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.160353 Oct 29 21:43:25.542575 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3506/6920] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:25 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:26.567398 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:26.568019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:26.574863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:26.575351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:26.575796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:26.576495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:26.577215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:26.577686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:26.704404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:26.712773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-35695aa6-05b6-48c8-961b-cc468c2200e8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.149355 Oct 29 21:43:26.713345 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3415/6921] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:26 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:27.737427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:27.738076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:27.744862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:27.745356 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:27.745854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:27.746546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:27.747007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:27.747441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:27.881044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:27.889361 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-371e6d77-3b1a-4368-90ce-e4cedbc78f84 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.156345 Oct 29 21:43:27.889967 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3507/6922] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:27 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:28.913253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:28.913895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:28.920930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:28.921416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:28.921885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:28.922586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:28.923049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:28.923474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:29.050152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:29.058351 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5123fdfc-95e8-4ad0-927b-9c995f8af57f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.150061 Oct 29 21:43:29.058935 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3416/6923] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:28 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:30.082864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:30.083496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:30.090835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:30.091334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:30.091784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:30.092489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:30.092956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:30.094137 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:30.222180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:30.230478 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fea12b07-fd8b-437a-aa36-4c409c41b059 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.151537 Oct 29 21:43:30.231055 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3508/6924] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:30 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:31.254231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:31.254853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:31.261705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:31.262195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:31.262640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:31.263338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:31.263796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:31.264231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:31.398046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:31.407372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-11bb8d69-4d9b-4419-8154-8ebc354ea5df tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.157560 Oct 29 21:43:31.408277 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3417/6925] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:31 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:32.430930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:32.431559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:32.440101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:32.440667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:32.441267 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:32.442150 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:32.442621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:32.443302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:32.573176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:32.581818 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-792af682-5ea9-4902-bb06-229b0ac3b59d tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.154861 Oct 29 21:43:32.582396 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3509/6926] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:32 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:33.606134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:33.606764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:33.614304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:33.614822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:33.615265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:33.615966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:33.616431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:33.616874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:33.749265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:33.757648 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0e4492d3-12bb-45d9-a2db-cdf270ef2302 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.155411 Oct 29 21:43:33.758226 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3418/6927] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:33 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:34.781571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:34.782261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:34.789070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:34.789608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:34.790067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:34.790777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:34.791246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:34.791689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:34.920425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:34.929353 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dc7ec10e-9cdf-4d60-a4fb-be30385f0fc1 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.151798 Oct 29 21:43:34.929949 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3510/6928] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:34 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:35.952469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:35.953688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:35.960605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:35.961087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:35.961577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:35.962272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:35.962726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:35.963155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:36.143242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:36.151470 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0eafc999-0320-4c63-993d-c13c8a07eaa4 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.203214 Oct 29 21:43:36.152050 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3419/6929] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:35 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:37.175014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:37.175632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:37.182666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:37.183148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:37.183599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:37.184301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:37.184771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:37.185210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:37.314998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:37.323367 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-df2760c4-dc79-45e2-99d4-579f3f08dae8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.152238 Oct 29 21:43:37.323956 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3511/6930] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:37 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:38.347241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:38.347857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:38.354663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:38.355147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:38.355583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:38.356275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:38.356729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:38.357156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:38.489381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:38.497647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cf65b308-b032-42b7-b453-a745ba8ece0f tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.154891 Oct 29 21:43:38.498223 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3420/6931] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:38 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:39.520925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:39.521502 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:39.529112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:39.529660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:39.530124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:39.530870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:39.531339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:39.531781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:39.714493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:39.723032 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aba73539-aef5-4375-b8bb-838d62b23623 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.206070 Oct 29 21:43:39.723624 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3512/6932] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:39 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:40.747166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:40.747791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:40.754886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:40.755382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:40.755825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:40.756528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:40.757177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:40.757643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:40.889631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:40.898072 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90e439e4-a98b-48fa-aa8b-c39907567156 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1728 microversion: 2.1 time: 0.154997 Oct 29 21:43:40.898680 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3421/6933] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:40 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:41.921960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:41.922592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:41.929738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:41.930244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:41.930698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:41.931413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:41.931894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:41.932337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:42.069004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:42.077989 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0bfdeacf-8913-4bff-acac-80133509f104 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1727 microversion: 2.1 time: 0.159811 Oct 29 21:43:42.078508 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3513/6934] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:41 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:42.323550 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "name": "network-vif-unplugged", "status": "completed", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:42.334423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:42.334886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:42.335335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:42.348506 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] Creating event network-vif-unplugged:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch2-master-1 Oct 29 21:43:42.354188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:43:42.365798 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-057456d6-3551-4a3c-a6d0-617f667ae0fb req-e680ac05-0537-4594-a02b-edf3505ca32d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045939 Oct 29 21:43:42.366587 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3422/6935] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:43:43.101958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:43.102602 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:43.109367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:43.109905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:43.110358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:43.111068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:43.111569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:43.112011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:43.248032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:43.257359 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b702aee-7e2d-4e0a-bc72-edd152849885 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1727 microversion: 2.1 time: 0.159142 Oct 29 21:43:43.257988 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3514/6936] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:43 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:44.284339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:44.285086 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:44.291425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:44.291914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:44.292357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:44.293059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:44.293562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:44.293997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:44.408768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:44.420382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:44.421098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:44.421578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:44.424204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:44.432742 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d9331afb-2586-49b1-96b1-bacef44c5422 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1725 microversion: 2.1 time: 0.154087 Oct 29 21:43:44.433957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3423/6937] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:44 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:44.434148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] Creating event network-changed:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch2-master-1 Oct 29 21:43:44.440110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:43:44.458451 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-66005a6c-80fe-4e51-a782-156987590996 req-397d3544-9e90-4af1-8db8-8892bcefb872 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054457 Oct 29 21:43:44.459048 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3515/6938] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:43:45.458820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:45.459446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:45.466327 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:45.466815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:45.467258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:45.467957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:45.468415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:45.469343 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:45.607752 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:45.616183 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d98f270-26e4-4f3b-87bc-0d0e377dd14a tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1725 microversion: 2.1 time: 0.161242 Oct 29 21:43:45.616761 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3424/6939] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:45 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:46.642500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:46.643225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:46.649483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:46.649983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:46.650442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:46.651148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:46.651623 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:46.652070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:46.780971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:46.789865 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-883f969b-a269-45ca-bb73-3bc2bf9574cb tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1725 microversion: 2.1 time: 0.153026 Oct 29 21:43:46.790440 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3516/6940] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:46 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:47.812872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:47.813510 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:47.820946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:47.821474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:47.821908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:47.822604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:47.823067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:47.823499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:47.957335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:47.965682 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce8f907d-f982-4664-bb5f-a21f5316c128 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1725 microversion: 2.1 time: 0.156749 Oct 29 21:43:47.966263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3425/6941] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:47 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:48.988187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:48.988944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:48.991904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=33 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:48.997875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:48.998392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:48.998853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:48.999580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.000056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.000505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.005365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:49.132676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:49.141031 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-43853fe6-d2e2-4e17-b70f-405a7b976796 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1722 microversion: 2.1 time: 0.156866 Oct 29 21:43:49.141646 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3517/6942] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:48 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:49.164101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:49.164630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:49.167521 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=29 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:49.172778 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.173303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.173779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.174480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.174944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.175378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.178164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:43:49.218690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.219180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.219620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.220387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.220845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.221279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.241582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:43:49.246677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Getting quotas for user c7ce87715e2c43cc987a8ed466f9e83d and project e145894c36ae430fab13ece197e3eb8f. Resources: {'ram', 'cores'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:43:49.346869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-595f5543-4a89-43ba-b3ed-f10baf4b8709 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "POST /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/action" status: 202 len: 0 microversion: 2.1 time: 0.186400 Oct 29 21:43:49.347485 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3426/6943] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:43:49 2022] POST /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:43:49.356583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:49.357227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:49.363799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.364249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.364788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.365518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:49.365998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:49.366449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:49.504375 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:49.512803 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f9f87921-3aca-44e6-88a2-08141f650ece tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.160859 Oct 29 21:43:49.513386 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3518/6944] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:49 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:50.538216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:50.539722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:50.545988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:50.546483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:50.546929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:50.547635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:50.548095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:50.549170 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:50.606033 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "name": "network-vif-plugged", "status": "completed", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:50.617186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:50.617860 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:50.618357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:50.634060 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] Creating event network-vif-plugged:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch2-master-1 Oct 29 21:43:50.640495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:43:50.652226 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-5f24dc3e-bf3d-404b-a896-89548140df77 req-ec9d9a13-fb64-459e-958c-f9bdbd1fbc6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050202 Oct 29 21:43:50.652953 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3519/6945] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:43:50.696158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:50.704913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d6916be-af57-4522-bc71-dd0145b2c912 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.172447 Oct 29 21:43:50.705509 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3427/6946] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:50 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:51.729802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:51.730518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:51.736766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:51.737264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:51.737758 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:51.738460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:51.738929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:51.739386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:51.872161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:51.880722 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c50bad90-3761-4cbc-8608-0e3e92578a59 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.155952 Oct 29 21:43:51.881290 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3520/6947] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:51 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:52.904235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:52.904857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:52.911829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:52.912320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:52.912763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:52.913482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:52.913998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:52.914484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:53.051428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:53.059996 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f2ce86e3-7223-47e7-86ed-73faefdb1107 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.159728 Oct 29 21:43:53.060578 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3428/6948] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:52 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:53.237360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "name": "network-vif-unplugged", "status": "completed", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:53.248540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:53.249100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:53.249545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:53.262373 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] Creating event network-vif-unplugged:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:43:53.267835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:43:53.278507 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d9432718-069f-4828-93ce-aca4d9831886 req-d32f3480-25ba-4700-b2ac-ff442f70cac9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046490 Oct 29 21:43:53.279110 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3521/6949] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:43:54.084330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:54.084953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:54.091850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:54.092340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:54.092777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:54.093499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:54.093958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:54.094390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:54.228172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:54.237114 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c1ff6542-4792-4b20-875d-91446a1b8f1e tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.156716 Oct 29 21:43:54.238269 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3429/6950] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:54 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:55.262606 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:55.263329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:55.270247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:55.270750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:55.271206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:55.271911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:55.272385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:55.272829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:55.296599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:43:55.306874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:55.307360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:55.307798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:55.320219 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] Creating event network-changed:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:43:55.325822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:43:55.337519 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-df61d5b5-03bc-45a1-be3b-ca63244de5b8 req-8bd63652-bca4-4bd1-b45c-9e37bbcb3a78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044644 Oct 29 21:43:55.338142 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3430/6951] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:43:55.410520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:55.418968 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-160d1fd5-ccff-4abc-976e-591d7579f090 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.161650 Oct 29 21:43:55.419544 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3522/6952] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:55 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:56.443881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:56.444626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:56.451118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:56.451603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:56.452307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:56.452998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:56.453508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:56.453926 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:56.584253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:56.592620 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-28324f5f-28ed-461f-b6c7-d64159aff474 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.154040 Oct 29 21:43:56.593190 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3431/6953] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:56 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:57.616607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:57.617234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:57.624133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:57.624632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:57.625084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:57.625810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:57.626311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:57.626751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:57.755430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:57.763827 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d6a08896-6119-4069-88c7-5882f1a35150 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.151096 Oct 29 21:43:57.764402 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3523/6954] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:57 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:58.788400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:58.789740 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:58.796673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:58.797695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:58.798202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:58.799159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:58.799628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:58.800060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:58.935120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:43:58.943926 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2bad666f-526c-46c6-8248-bb66c3a56ca6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1721 microversion: 2.1 time: 0.159572 Oct 29 21:43:58.944556 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3432/6955] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:58 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:43:59.969661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:43:59.970411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:43:59.978614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:59.979126 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:59.979799 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:43:59.980701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:43:59.981343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:43:59.981972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.118047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:00.126957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-91bbb041-5c32-4e22-becb-125359e55835 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1714 microversion: 2.1 time: 0.161830 Oct 29 21:44:00.127561 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3524/6956] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:43:59 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:00.150713 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:00.151338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:00.153292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:00.159389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.159855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.160294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.160990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.161449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.161911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.296316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:00.305252 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1aa54aa9-abb0-4a85-8e26-cb5c567dcca5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1714 microversion: 2.1 time: 0.158357 Oct 29 21:44:00.305862 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3433/6957] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:00 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:00.327624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:00.328260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:00.334425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.334927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.335479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.336187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.336869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.337323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.464953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:00.474043 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b61cbdd4-5607-40ca-b2c6-43a965d7d3cf tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1714 microversion: 2.1 time: 0.150425 Oct 29 21:44:00.474625 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3525/6958] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:00 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:00.497553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:00.498096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:00.504186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.504747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.505254 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.506053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.506576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.507068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.531849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:44:00.609794 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 204 len: 0 microversion: 2.1 time: 0.115841 Oct 29 21:44:00.610439 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3434/6959] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:00 2022] DELETE /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:44:00.619235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:00.619875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:00.626863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.627380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.627839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.628555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:00.629028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:00.629564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:00.761111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:00.769943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec408327-ca4b-4237-a88a-bd851c0074be tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1720 microversion: 2.1 time: 0.154611 Oct 29 21:44:00.770525 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3526/6960] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:00 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:01.794687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:01.795401 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:01.802966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:01.803452 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:01.803896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:01.804593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:01.805055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:01.805508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:01.937922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:01.946396 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-99979899-2fa6-4975-9ee9-d06073de542b tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1720 microversion: 2.1 time: 0.155953 Oct 29 21:44:01.946982 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3435/6961] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:01 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:02.033641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a541e0a9-a76b-4cbb-927c-51ebc864c299 req-a7acf4d3-3bec-4ee7-95a0-aaac5775fbb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "name": "network-vif-plugged", "status": "completed", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:02.044268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a541e0a9-a76b-4cbb-927c-51ebc864c299 req-a7acf4d3-3bec-4ee7-95a0-aaac5775fbb3 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:02.044770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a541e0a9-a76b-4cbb-927c-51ebc864c299 req-a7acf4d3-3bec-4ee7-95a0-aaac5775fbb3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:02.045226 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a541e0a9-a76b-4cbb-927c-51ebc864c299 req-a7acf4d3-3bec-4ee7-95a0-aaac5775fbb3 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:02.059759 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a541e0a9-a76b-4cbb-927c-51ebc864c299 req-a7acf4d3-3bec-4ee7-95a0-aaac5775fbb3 service nova] Creating event network-vif-plugged:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:44:02.064781 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a541e0a9-a76b-4cbb-927c-51ebc864c299 req-a7acf4d3-3bec-4ee7-95a0-aaac5775fbb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Oct 29 21:44:02.065395 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3527/6962] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:02.970995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:02.971572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:02.978432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:02.978920 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:02.979364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:02.980071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:02.980528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:02.980960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:03.112815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce87715e2c43cc987a8ed466f9e83d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e145894c36ae430fab13ece197e3eb8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:03.121486 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a47c8ee5-cb20-42a0-b2e7-c97056448a93 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 200 len: 1720 microversion: 2.1 time: 0.155080 Oct 29 21:44:03.122209 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3436/6963] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:02 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:03.484567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-88dbfc89-220b-46c8-9340-0757f90fa055 req-acea0237-4941-4a89-90af-8218d679a55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f725d934-c109-4e7c-a245-72c1fa1d9c44", "name": "network-vif-deleted", "tag": "effdcac7-cfb5-434b-b532-4c79d93f2fa0"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:03.495105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-88dbfc89-220b-46c8-9340-0757f90fa055 req-acea0237-4941-4a89-90af-8218d679a55b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:03.495608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-88dbfc89-220b-46c8-9340-0757f90fa055 req-acea0237-4941-4a89-90af-8218d679a55b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:03.496063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-88dbfc89-220b-46c8-9340-0757f90fa055 req-acea0237-4941-4a89-90af-8218d679a55b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:03.508017 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-88dbfc89-220b-46c8-9340-0757f90fa055 req-acea0237-4941-4a89-90af-8218d679a55b service nova] Creating event network-vif-deleted:effdcac7-cfb5-434b-b532-4c79d93f2fa0 for instance f725d934-c109-4e7c-a245-72c1fa1d9c44 on nch1-master-1 Oct 29 21:44:03.513437 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-88dbfc89-220b-46c8-9340-0757f90fa055 req-acea0237-4941-4a89-90af-8218d679a55b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033780 Oct 29 21:44:03.514129 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3528/6964] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:04.146387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:04.147233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:04.154800 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:04.155389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:04.155911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:04.156715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:04.157991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:04.158497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:04.173604 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 HTTP/1.1 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f725d934-c109-4e7c-a245-72c1fa1d9c44'} Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:04.175544 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-841342a6-6358-4424-b184-b345bcc53fb5 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 404 len: 111 microversion: 2.1 time: 0.035378 Oct 29 21:44:04.182037 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3437/6965] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:04 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:04.246551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:04.248865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:04.255478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:04.256204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:04.256663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:04.257402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:04.257903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:04.258348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:04.272407 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-volume_attachments HTTP/1.1 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': 'f725d934-c109-4e7c-a245-72c1fa1d9c44'} Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:04.274198 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9cc78e6-0fd8-4a9a-a054-111ea83f7bf6 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034362 Oct 29 21:44:04.278807 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3529/6966] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:44:04 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.481146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.481694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.489083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.489605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.490056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.490790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.491259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.491699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.505895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 HTTP/1.1 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'f725d934-c109-4e7c-a245-72c1fa1d9c44'} Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.507455 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5f8cfdb3-002b-4fa9-b55e-c02ffc50cd90 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 404 len: 111 microversion: 2.1 time: 0.031580 Oct 29 21:44:05.512637 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3438/6967] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:05 2022] DELETE /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.518209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.518879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: f725d934-c109-4e7c-a245-72c1fa1d9c44] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.525775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.526277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.526733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.527441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.527913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.528359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.542220 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 HTTP/1.1 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'f725d934-c109-4e7c-a245-72c1fa1d9c44'} Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.543741 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance f725d934-c109-4e7c-a245-72c1fa1d9c44 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f71dd6cf-657e-499c-80dc-6e10cca4fdbd tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44" status: 404 len: 111 microversion: 2.1 time: 0.030830 Oct 29 21:44:05.549992 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3530/6968] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:05 2022] GET /compute/v2.1/servers/f725d934-c109-4e7c-a245-72c1fa1d9c44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.554214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.554773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.560705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.561193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.561667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.562367 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.562826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.563256 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.576570 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 HTTP/1.1 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '96a84aa3-eca6-4242-9515-38be9b019ce4'} Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.578391 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-049bbc8d-8b38-416e-886b-902efdad51ed tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 404 len: 111 microversion: 2.1 time: 0.029496 Oct 29 21:44:05.583573 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3439/6969] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:05 2022] DELETE /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.588151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.588786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: 96a84aa3-eca6-4242-9515-38be9b019ce4] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.595361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.596185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.596770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.597509 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.597989 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.598436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.612325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 HTTP/1.1 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '96a84aa3-eca6-4242-9515-38be9b019ce4'} Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.613935 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance 96a84aa3-eca6-4242-9515-38be9b019ce4 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e447ff97-283c-4d29-8c85-24842279c593 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4" status: 404 len: 111 microversion: 2.1 time: 0.030979 Oct 29 21:44:05.619416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3531/6970] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:05 2022] GET /compute/v2.1/servers/96a84aa3-eca6-4242-9515-38be9b019ce4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:44:05.624786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.625299 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.631364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.631854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.632301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.633004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.633490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.633933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.649895 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 HTTP/1.1 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'a3598885-0be0-4f84-9485-df65613ad543'} Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.651437 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5858dd9c-ad34-4877-9a61-d84c2d2e4875 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 404 len: 111 microversion: 2.1 time: 0.032112 Oct 29 21:44:05.656639 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3440/6971] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:05 2022] DELETE /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.661816 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.662455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: a3598885-0be0-4f84-9485-df65613ad543] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.668461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.668962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.669422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.670227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.670701 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.671148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.685086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 HTTP/1.1 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'a3598885-0be0-4f84-9485-df65613ad543'} Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.686638 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance a3598885-0be0-4f84-9485-df65613ad543 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cb2c9c87-9cd9-4a0d-868a-0093086a9fd8 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543" status: 404 len: 111 microversion: 2.1 time: 0.030596 Oct 29 21:44:05.691789 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3532/6972] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:05 2022] GET /compute/v2.1/servers/a3598885-0be0-4f84-9485-df65613ad543 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.696369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.696868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.703113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.703600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.704043 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.704731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.705190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.705652 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.708339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:05.722813 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: request: DELETE /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a HTTP/1.1 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'efefb619-9b2f-476c-a143-81c8784a7b7a'} Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.724502 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2bbe24b6-1331-4420-88bc-c52afdac4a45 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 404 len: 111 microversion: 2.1 time: 0.033357 Oct 29 21:44:05.729835 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3441/6973] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:05 2022] DELETE /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.734352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.734991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [instance: efefb619-9b2f-476c-a143-81c8784a7b7a] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:05.741699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.742301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.742761 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.743475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:05.743953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:05.744399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:05.758056 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] HTTP exception thrown: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Request method failure captured: Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a HTTP/1.1 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ0JlOFhWemlCUuqZZTPjurb7XzdBLEgPDRDnxrOYfLALsMaRXxng92HqKPSjsyvdPfOBdczCmEj5IqknD6vTpzLnVWRlxd9uIqBgr_1DLidgGNuTqJPSRMBRrFHWaIbkThCECqVZy1iCV-FsTbE7_ROReUFaBSAr3aW59UScUPptaY Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e145894c36ae430fab13ece197e3eb8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: e145894c36ae430fab13ece197e3eb8f Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1032116884 Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: c7ce87715e2c43cc987a8ed466f9e83d Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServerActionsTestJSON-1032116884-project Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'efefb619-9b2f-476c-a143-81c8784a7b7a'} Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:05.759532 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Returning 404 to user: Instance efefb619-9b2f-476c-a143-81c8784a7b7a could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5f047a5c-96d7-480a-9d39-627f479658f7 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a" status: 404 len: 111 microversion: 2.1 time: 0.030535 Oct 29 21:44:05.764919 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3533/6974] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:05 2022] GET /compute/v2.1/servers/efefb619-9b2f-476c-a143-81c8784a7b7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:05.769700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87dcfde9-e427-4bc4-9263-6a66d3c07258 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] Calling method '.version_select at 0x7fa171a37700>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:05.774040 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-87dcfde9-e427-4bc4-9263-6a66d3c07258 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [637b60ea-6cc0-4d1a-84f9-8e2ac1df387b] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:44:06.780716 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [None req-87dcfde9-e427-4bc4-9263-6a66d3c07258 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] [637b60ea-6cc0-4d1a-84f9-8e2ac1df387b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 42466. Oct 29 21:44:06.799967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87dcfde9-e427-4bc4-9263-6a66d3c07258 tempest-ServerActionsTestJSON-1032116884 tempest-ServerActionsTestJSON-1032116884-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482632209" status: 202 len: 0 microversion: 2.1 time: 1.034396 Oct 29 21:44:06.800560 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3442/6975] 10.222.0.36 () {58 vars in 1221 bytes} [Sat Oct 29 21:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482632209 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:44:16.124826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=33 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:16.126865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=69 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:16.259595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1760865180", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3094d537-8d99-48ee-a42c-d5045e642de0"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:16.320034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] validate_networks() for [('3094d537-8d99-48ee-a42c-d5045e642de0', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:44:16.762131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:44:16.762576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:44:16.763074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:44:16.763505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:44:16.763938 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:44:16.773803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:16.774315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:16.774778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:16.775548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:16.776003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:16.776517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:16.794968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Getting quotas for project c8e84833e934459082f2dd7b1763b2a8. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:44:16.801173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Getting quotas for user 88bffac8528b45458dafdb6dc870b1cf and project c8e84833e934459082f2dd7b1763b2a8. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:44:16.814787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:44:16.817171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:44:16.863850 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-db6a30ca-ac03-4348-a2ed-c8410517b72f tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745471 Oct 29 21:44:16.864696 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3534/6976] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:44:16.873947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:16.875090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:16.879305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5653c6a0-bc16-4f6d-8aac-8daa24f62120 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:16.879935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5653c6a0-bc16-4f6d-8aac-8daa24f62120 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:16.937622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5653c6a0-bc16-4f6d-8aac-8daa24f62120 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:16.944858 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5653c6a0-bc16-4f6d-8aac-8daa24f62120 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1217 microversion: 2.1 time: 0.072833 Oct 29 21:44:16.945493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3443/6977] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:16 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:17.974185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:17.974991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:17.982924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:17.983775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:17.984558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:17.986018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:17.986669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:17.987144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:18.054747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:18.066064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b4ca11e9-9657-4d40-bf53-26c79cb8856b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1277 microversion: 2.1 time: 0.097506 Oct 29 21:44:18.067172 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3535/6978] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:17 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:19.096514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:19.097317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:19.104814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:19.105307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:19.106042 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:19.107072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:19.107703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:19.108316 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:19.271981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:19.279913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0a2e76a4-ca52-4b49-8dfc-ace9b95001aa tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.188053 Oct 29 21:44:19.280501 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3444/6979] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:19 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:19.482949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0c89d676-136d-4186-8d69-38de6bd0e4ca req-5e5ad0fe-d98a-42e2-879e-1b0f2205332c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d029da3-bcf2-45b7-a47b-53a3b6b5de49", "tag": "c0409eee-c528-4e57-84af-eb23b21ab566"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:19.497564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c89d676-136d-4186-8d69-38de6bd0e4ca req-5e5ad0fe-d98a-42e2-879e-1b0f2205332c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:19.498653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c89d676-136d-4186-8d69-38de6bd0e4ca req-5e5ad0fe-d98a-42e2-879e-1b0f2205332c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:19.499180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0c89d676-136d-4186-8d69-38de6bd0e4ca req-5e5ad0fe-d98a-42e2-879e-1b0f2205332c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:19.513443 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0c89d676-136d-4186-8d69-38de6bd0e4ca req-5e5ad0fe-d98a-42e2-879e-1b0f2205332c service nova] Creating event network-changed:c0409eee-c528-4e57-84af-eb23b21ab566 for instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 on nch2-master-1 Oct 29 21:44:19.519104 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0c89d676-136d-4186-8d69-38de6bd0e4ca req-5e5ad0fe-d98a-42e2-879e-1b0f2205332c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040191 Oct 29 21:44:19.519746 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3536/6980] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:20.303807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:20.304432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:20.311309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:20.311792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:20.312231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:20.312965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:20.314053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:20.314486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:20.443027 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:20.451344 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f469a056-5874-4d29-9a0d-929a92c2adfc tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.151433 Oct 29 21:44:20.451916 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3445/6981] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:20 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:21.476485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:21.477346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:21.484082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:21.484585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:21.485110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:21.486403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:21.486876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:21.487353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:21.621644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:21.629714 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5e1ee3a6-3a8f-4589-a1e4-44aecf0aeca8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.158434 Oct 29 21:44:21.630296 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3537/6982] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:21 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:22.651974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:22.652630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:22.659613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:22.660106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:22.660547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:22.661240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:22.661798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:22.662232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:22.793052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:22.801533 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5e22b22c-d8c3-40b3-847f-69fd248d77e0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.153452 Oct 29 21:44:22.805670 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3446/6983] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:22 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:23.824659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:23.825286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:23.833476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:23.833982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:23.834433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:23.835133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:23.835601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:23.836044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:23.963698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:23.971463 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-284cffcc-db4d-40dd-b0f5-db8b0315dd1c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.150681 Oct 29 21:44:23.972035 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3538/6984] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:23 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:24.926399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f38c2397-46e2-429b-a144-b4813a3ad2d0 req-79263065-7b6c-4b74-87c7-5da0626d6947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d029da3-bcf2-45b7-a47b-53a3b6b5de49", "name": "network-vif-plugged", "status": "completed", "tag": "c0409eee-c528-4e57-84af-eb23b21ab566"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:24.937484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f38c2397-46e2-429b-a144-b4813a3ad2d0 req-79263065-7b6c-4b74-87c7-5da0626d6947 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:24.937979 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f38c2397-46e2-429b-a144-b4813a3ad2d0 req-79263065-7b6c-4b74-87c7-5da0626d6947 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:24.938419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f38c2397-46e2-429b-a144-b4813a3ad2d0 req-79263065-7b6c-4b74-87c7-5da0626d6947 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:24.949993 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f38c2397-46e2-429b-a144-b4813a3ad2d0 req-79263065-7b6c-4b74-87c7-5da0626d6947 service nova] Creating event network-vif-plugged:c0409eee-c528-4e57-84af-eb23b21ab566 for instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 on nch2-master-1 Oct 29 21:44:24.955721 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f38c2397-46e2-429b-a144-b4813a3ad2d0 req-79263065-7b6c-4b74-87c7-5da0626d6947 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032551 Oct 29 21:44:24.956500 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3447/6985] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:25.002475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:25.003118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:25.010544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:25.011055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:25.011517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:25.012271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:25.012749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:25.013193 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:25.155656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:25.164250 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8d43009c-24c1-4b43-bc55-492c7ff70cc3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.173440 Oct 29 21:44:25.164854 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3539/6986] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:24 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:26.188943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:26.189594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:26.195806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:26.196288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:26.196727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:26.197420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:26.197898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:26.198418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:26.331273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:26.338980 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-96c943d3-9771-4e30-b818-d73e142bd022 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1317 microversion: 2.1 time: 0.155305 Oct 29 21:44:26.339553 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3448/6987] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:26 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:27.363095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:27.363731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:27.366607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:27.367380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:27.373764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:27.374275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:27.374741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:27.375495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:27.376005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:27.376453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:27.510175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:27.517997 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9543c864-e102-42d7-a379-7bebd30ea0d0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.159353 Oct 29 21:44:27.518581 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3540/6988] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:27 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:27.579255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359061121", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "3094d537-8d99-48ee-a42c-d5045e642de0"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:27.588700 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:27.637719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] validate_networks() for [('3094d537-8d99-48ee-a42c-d5045e642de0', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:44:28.065573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:44:28.066006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:44:28.066513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:44:28.066958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:44:28.067377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:44:28.076494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:28.076919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:28.077659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:28.078402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:28.078863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:28.079297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:28.096608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Getting quotas for project c8e84833e934459082f2dd7b1763b2a8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:44:28.101889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Getting quotas for user 88bffac8528b45458dafdb6dc870b1cf and project c8e84833e934459082f2dd7b1763b2a8. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:44:28.114237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:44:28.116538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:44:28.158932 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [fb0abed2-83dd-4853-9c69-eaa8fac1135c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:44:29.166280 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [fb0abed2-83dd-4853-9c69-eaa8fac1135c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 42596. Oct 29 21:44:29.170139 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af852db5-31d9-41bf-bccf-a08e646191c0 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595173 Oct 29 21:44:29.172626 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3449/6989] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:44:29.182036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e894da7c-f2d3-4b63-b5ca-b0fc23ba0f9b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:29.182699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e894da7c-f2d3-4b63-b5ca-b0fc23ba0f9b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:29.244351 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e894da7c-f2d3-4b63-b5ca-b0fc23ba0f9b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:29.251527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e894da7c-f2d3-4b63-b5ca-b0fc23ba0f9b tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1217 microversion: 2.1 time: 0.073452 Oct 29 21:44:29.252119 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3541/6990] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:29 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:30.275570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:30.276217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:30.283897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:30.284392 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:30.284839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:30.285792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:30.286266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:30.286704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:30.355107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:30.363575 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2d342f79-b2b3-4599-aee8-7adaeafb501d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1287 microversion: 2.1 time: 0.092817 Oct 29 21:44:30.364150 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3450/6991] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:30 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:44:31.386819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:31.387459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:31.395686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:31.396182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:31.396638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:31.397361 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:31.397869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:31.398318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:31.532076 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:31.540030 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-04e3d1fd-4e54-4204-bf0d-a42a33142dc6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1317 microversion: 2.1 time: 0.157072 Oct 29 21:44:31.540624 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3542/6992] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:31 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:31.546255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3e6da344-2ec9-46c6-a72b-1795e552d770 req-cdd4f902-6d9f-4a5a-b62d-4e6c2fae5983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be37416-8eca-41e4-a339-b3fd4cf5759d", "tag": "4e1dab99-5e4d-40bd-a0ff-350552963a8b"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:31.557973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3e6da344-2ec9-46c6-a72b-1795e552d770 req-cdd4f902-6d9f-4a5a-b62d-4e6c2fae5983 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:31.558548 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3e6da344-2ec9-46c6-a72b-1795e552d770 req-cdd4f902-6d9f-4a5a-b62d-4e6c2fae5983 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:31.559063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3e6da344-2ec9-46c6-a72b-1795e552d770 req-cdd4f902-6d9f-4a5a-b62d-4e6c2fae5983 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:31.571740 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3e6da344-2ec9-46c6-a72b-1795e552d770 req-cdd4f902-6d9f-4a5a-b62d-4e6c2fae5983 service nova] Creating event network-changed:4e1dab99-5e4d-40bd-a0ff-350552963a8b for instance 8be37416-8eca-41e4-a339-b3fd4cf5759d on nch1-master-1 Oct 29 21:44:31.577190 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3e6da344-2ec9-46c6-a72b-1795e552d770 req-cdd4f902-6d9f-4a5a-b62d-4e6c2fae5983 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034587 Oct 29 21:44:31.578259 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3451/6993] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:32.563149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:32.563787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:32.570977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:32.571483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:32.571942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:32.572709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:32.573191 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:32.573673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:32.701022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:32.708943 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4087d8ab-a26d-4cbf-87d6-9a2df9f99c6e tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1317 microversion: 2.1 time: 0.149639 Oct 29 21:44:32.709542 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3543/6994] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:32 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:33.733724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:33.734466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:33.741222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:33.741776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:33.742221 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:33.742914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:33.743478 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:33.743921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:33.879079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:33.887746 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95f61268-ca4c-4c07-be1c-18ed8bf070a2 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1317 microversion: 2.1 time: 0.159119 Oct 29 21:44:33.888328 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3452/6995] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:33 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:34.911617 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:34.912261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:34.919355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:34.919865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:34.920327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:34.921055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:34.921555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:34.922004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:35.059953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:35.068062 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2ca541dc-db8a-4693-8188-bd5e04622c03 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1317 microversion: 2.1 time: 0.160894 Oct 29 21:44:35.068745 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3544/6996] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:34 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:44:36.091632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:36.092378 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:36.099276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:36.099775 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:36.100207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:36.101058 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:36.101546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:36.101975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:36.169380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-c100f8b7-155c-49c4-a3c3-9726869834b5 req-205abac9-e906-4eef-ba91-1a14f76ec7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be37416-8eca-41e4-a339-b3fd4cf5759d", "name": "network-vif-plugged", "status": "completed", "tag": "4e1dab99-5e4d-40bd-a0ff-350552963a8b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:36.185887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c100f8b7-155c-49c4-a3c3-9726869834b5 req-205abac9-e906-4eef-ba91-1a14f76ec7d8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:36.187864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c100f8b7-155c-49c4-a3c3-9726869834b5 req-205abac9-e906-4eef-ba91-1a14f76ec7d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:36.188488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-c100f8b7-155c-49c4-a3c3-9726869834b5 req-205abac9-e906-4eef-ba91-1a14f76ec7d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:36.244411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:36.258280 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51392569-91d2-4d28-81b9-c138c26fc0c7 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1317 microversion: 2.1 time: 0.170570 Oct 29 21:44:36.258888 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3453/6997] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:36 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:36.498866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-c100f8b7-155c-49c4-a3c3-9726869834b5 req-205abac9-e906-4eef-ba91-1a14f76ec7d8 service nova] Creating event network-vif-plugged:4e1dab99-5e4d-40bd-a0ff-350552963a8b for instance 8be37416-8eca-41e4-a339-b3fd4cf5759d on nch1-master-1 Oct 29 21:44:36.504095 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-c100f8b7-155c-49c4-a3c3-9726869834b5 req-205abac9-e906-4eef-ba91-1a14f76ec7d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339189 Oct 29 21:44:36.504976 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3545/6998] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:44:37.280556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:37.281185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:37.288109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:37.288601 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:37.289053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:37.289786 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:37.290255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:37.290690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:37.421849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:37.430183 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff9ee862-1ea9-4e4d-a9b3-f7de8ca8d424 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1317 microversion: 2.1 time: 0.153561 Oct 29 21:44:37.430758 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3454/6999] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:37 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:38.455695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:38.456411 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:38.463911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:38.464357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:38.464847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:38.465599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:38.466077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:38.466523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:38.596089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:38.603904 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8a2d611c-84d5-43b2-802a-c8587028872d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1507 microversion: 2.1 time: 0.153378 Oct 29 21:44:38.604462 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3546/7000] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:38 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:38.626482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:38.627491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:38.629488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:38.630168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:38.636650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:38.637138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:38.637611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:38.638310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:38.638779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:38.639210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:38.665185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:44:38.742322 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-623470b9-8856-41be-a312-03227e4e8e47 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 204 len: 0 microversion: 2.1 time: 0.119075 Oct 29 21:44:38.742934 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3455/7001] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:38 2022] DELETE /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:44:38.751301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:38.752484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:38.758519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:38.759022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:38.759477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:38.760188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:38.760668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:38.761114 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:38.893395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:38.901228 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3724b2cc-275c-47ea-b4db-4ef2c599eea8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1513 microversion: 2.1 time: 0.153899 Oct 29 21:44:38.901850 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3547/7002] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:38 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:39.924928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:39.925668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:39.931890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:39.932371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:39.932809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:39.933528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:39.933991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:39.934419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:40.062410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:40.070704 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-48e3ac5c-12aa-402c-af9a-caf793f51013 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1513 microversion: 2.1 time: 0.150240 Oct 29 21:44:40.071285 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3456/7003] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:39 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:40.733808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-30c9ed1d-55f1-49b5-96b1-c9d8479d9f7b req-be0b8027-0afb-4533-813c-a6c804d4e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be37416-8eca-41e4-a339-b3fd4cf5759d", "name": "network-vif-deleted", "tag": "4e1dab99-5e4d-40bd-a0ff-350552963a8b"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:40.744419 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:40.752507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-30c9ed1d-55f1-49b5-96b1-c9d8479d9f7b req-be0b8027-0afb-4533-813c-a6c804d4e5fd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:40.753427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-30c9ed1d-55f1-49b5-96b1-c9d8479d9f7b req-be0b8027-0afb-4533-813c-a6c804d4e5fd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:40.754130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-30c9ed1d-55f1-49b5-96b1-c9d8479d9f7b req-be0b8027-0afb-4533-813c-a6c804d4e5fd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:40.769090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-30c9ed1d-55f1-49b5-96b1-c9d8479d9f7b req-be0b8027-0afb-4533-813c-a6c804d4e5fd service nova] Creating event network-vif-deleted:4e1dab99-5e4d-40bd-a0ff-350552963a8b for instance 8be37416-8eca-41e4-a339-b3fd4cf5759d on nch1-master-1 Oct 29 21:44:40.775963 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-30c9ed1d-55f1-49b5-96b1-c9d8479d9f7b req-be0b8027-0afb-4533-813c-a6c804d4e5fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046266 Oct 29 21:44:40.777134 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3548/7004] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:41.094633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:41.095253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:41.102772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:41.103257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:41.103697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:41.104386 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:41.104843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:41.105270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:41.136283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:41.136758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:41.137198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:41.137673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lazy-loading 'fault' on Instance uuid 8be37416-8eca-41e4-a339-b3fd4cf5759d {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:44:41.178890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:41.186908 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5bb045a3-070a-4720-99a1-122e81c5c238 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 200 len: 1307 microversion: 2.1 time: 0.096167 Oct 29 21:44:41.187493 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3457/7005] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:41 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:42.211344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:42.212417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.220250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.220811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.221295 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.222056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.222527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.222965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.236631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] HTTP exception thrown: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d HTTP/1.1 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8be37416-8eca-41e4-a339-b3fd4cf5759d'} Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:42.238327 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 404 to user: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-167ea0cf-775f-4a1d-878b-7723ccf2e2e5 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 404 len: 111 microversion: 2.1 time: 0.032696 Oct 29 21:44:42.244120 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3549/7006] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:42 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:42.249350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:42.250012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.257633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.258122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.258565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.259260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.259719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.260150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.391315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:42.399153 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-580d0aac-ab40-46c3-8393-aa6fd86c8069 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.153881 Oct 29 21:44:42.399723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3458/7007] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:42 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:42.421796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d63ec9eb-2dbb-4286-a6b5-9f3fcd799758 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:42.424640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d63ec9eb-2dbb-4286-a6b5-9f3fcd799758 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: d80fe0ed-05d7-402f-a77c-4cf8d83929a2] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.430205 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d63ec9eb-2dbb-4286-a6b5-9f3fcd799758 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] HTTP exception thrown: Instance d80fe0ed-05d7-402f-a77c-4cf8d83929a2 could not be found. Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d63ec9eb-2dbb-4286-a6b5-9f3fcd799758 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/d80fe0ed-05d7-402f-a77c-4cf8d83929a2/action HTTP/1.1 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 32 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: {"resize": {"flavorRef": "452"}} Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance d80fe0ed-05d7-402f-a77c-4cf8d83929a2 could not be found. Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'd80fe0ed-05d7-402f-a77c-4cf8d83929a2', 'body': {'resize': {'flavorRef': '452'}}} Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80fe0ed-05d7-402f-a77c-4cf8d83929a2 could not be found. Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:42.431776 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80fe0ed-05d7-402f-a77c-4cf8d83929a2 could not be found. Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80fe0ed-05d7-402f-a77c-4cf8d83929a2 could not be found. Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d63ec9eb-2dbb-4286-a6b5-9f3fcd799758 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 404 to user: Instance d80fe0ed-05d7-402f-a77c-4cf8d83929a2 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d63ec9eb-2dbb-4286-a6b5-9f3fcd799758 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "POST /compute/v2.1/servers/d80fe0ed-05d7-402f-a77c-4cf8d83929a2/action" status: 404 len: 111 microversion: 2.1 time: 0.015467 Oct 29 21:44:42.437501 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3550/7008] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:44:42 2022] POST /compute/v2.1/servers/d80fe0ed-05d7-402f-a77c-4cf8d83929a2/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:42.441656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:42.442341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.448473 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.448954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.449393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.450117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.450573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.450999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.580304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:42.588021 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe1892c8-e703-4979-ac12-5b8bc49e0679 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.150273 Oct 29 21:44:42.588586 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3459/7009] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:42 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:44:42.611862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:42.612503 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.619417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.619934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.620396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.621113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.621632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.622087 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.749146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:42.757009 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7dcb2dfa-829b-4598-81cd-dbb63f2c495c tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.149703 Oct 29 21:44:42.757621 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3551/7010] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:42 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:42.780330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "32aba490-1a5b-4c5f-a850-18be40567466"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:42.782630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.789861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.790348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.790791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.791495 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.791953 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.792382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.813701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:42.834045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:42.839119 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] HTTP exception thrown: Flavor 32aba490-1a5b-4c5f-a850-18be40567466 could not be found. Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: request: POST /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49/action HTTP/1.1 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 65 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: {"resize": {"flavorRef": "32aba490-1a5b-4c5f-a850-18be40567466"}} Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: exception: Flavor 32aba490-1a5b-4c5f-a850-18be40567466 could not be found. Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '0d029da3-bcf2-45b7-a47b-53a3b6b5de49', 'body': {'resize': {'flavorRef': '32aba490-1a5b-4c5f-a850-18be40567466'}}} Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:42.841006 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 32aba490-1a5b-4c5f-a850-18be40567466 could not be found. Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 32aba490-1a5b-4c5f-a850-18be40567466 could not be found. Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 32aba490-1a5b-4c5f-a850-18be40567466 could not be found. Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 400 to user: Flavor 32aba490-1a5b-4c5f-a850-18be40567466 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d606f30a-84bc-4514-8145-4cffa2ed09a8 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "POST /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49/action" status: 400 len: 107 microversion: 2.1 time: 0.066269 Oct 29 21:44:42.846390 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3460/7011] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:44:42 2022] POST /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:44:42.853067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:42.853737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:42.859751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.860275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.860731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.861439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:42.861939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:42.862386 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:42.994558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:43.002957 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6760f407-091e-491d-bbed-e4556ad74ba1 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.153689 Oct 29 21:44:43.003520 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3552/7012] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:42 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:43.027192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:43.027434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:43.033477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.033925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.035773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.036535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.037010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.037475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.166618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:43.174372 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-307be97d-b7f5-4824-baea-e1068728ee04 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.151576 Oct 29 21:44:43.174935 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3461/7013] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:43 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:44:43.199487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d7045ed-ee57-4254-9337-e2b1e3e835c3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d7045ed-ee57-4254-9337-e2b1e3e835c3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: request: POST /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49/action HTTP/1.1 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 29 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: {"resize": {"flavorRef": ""}} Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '0d029da3-bcf2-45b7-a47b-53a3b6b5de49', 'body': {'resize': {'flavorRef': ''}}} Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise error Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi '' Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.202287 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2d7045ed-ee57-4254-9337-e2b1e3e835c3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2d7045ed-ee57-4254-9337-e2b1e3e835c3 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "POST /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49/action" status: 400 len: 113 microversion: 2.1 time: 0.011132 Oct 29 21:44:43.209195 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3553/7014] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:44:43 2022] POST /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49/action => generated 113 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 21:44:43.214923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:43.217583 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:43.223744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.224352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.225082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.226442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.226928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.227369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.362792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:43.371351 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f1b2807f-2dcf-4e61-8f95-ee1dbd36e474 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1506 microversion: 2.1 time: 0.160293 Oct 29 21:44:43.371926 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3462/7015] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:43 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:43.398900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:43.399435 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:43.408117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.410102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.410562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.411280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.411756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.412205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.426172 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] HTTP exception thrown: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d HTTP/1.1 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '8be37416-8eca-41e4-a339-b3fd4cf5759d'} Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:43.427768 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 404 to user: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1d17db8e-9a77-449d-80ab-6d08557b5162 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 404 len: 111 microversion: 2.1 time: 0.035165 Oct 29 21:44:43.432545 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3554/7016] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:43 2022] DELETE /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:43.438177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:43.438796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 8be37416-8eca-41e4-a339-b3fd4cf5759d] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:43.445733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.446235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.446677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.447381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.447839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.448268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.462546 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] HTTP exception thrown: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d HTTP/1.1 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '8be37416-8eca-41e4-a339-b3fd4cf5759d'} Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:43.464092 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 404 to user: Instance 8be37416-8eca-41e4-a339-b3fd4cf5759d could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d7a650b7-19ba-4976-a3e3-1b4971d366ad tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d" status: 404 len: 111 microversion: 2.1 time: 0.031383 Oct 29 21:44:43.469864 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3463/7017] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:43 2022] GET /compute/v2.1/servers/8be37416-8eca-41e4-a339-b3fd4cf5759d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:44:43.473968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:43.474484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:43.480564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.481064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.481543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.482250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.482740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.483183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.508924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:44:43.559441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:43.588441 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b254bcf-b250-4507-8e77-fea3064fd640 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 204 len: 0 microversion: 2.1 time: 0.117799 Oct 29 21:44:43.588932 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3555/7018] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:44:43 2022] DELETE /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:44:43.601559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:43.602185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:43.608261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.608751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.609192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.609922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:43.610381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:43.610813 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:43.742038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:43.750020 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-81fcd5fa-71b3-48d6-be9f-f17cdfb5c908 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1512 microversion: 2.1 time: 0.156700 Oct 29 21:44:43.750595 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3464/7019] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:43 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:44.775132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:44.775779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:44.782725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:44.783250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:44.783700 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:44.784399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:44.784862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:44.785300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:44.918229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:44.926410 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-376ba554-25ec-4340-bede-8fa827b27f4d tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1512 microversion: 2.1 time: 0.155611 Oct 29 21:44:44.926970 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3556/7020] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:44 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:45.543849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c9ebeac5-be9e-4b20-8ed4-7c2a8cf08c15 req-bd61ef20-4bbf-4172-92bb-b01e83b13165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d029da3-bcf2-45b7-a47b-53a3b6b5de49", "name": "network-vif-deleted", "tag": "c0409eee-c528-4e57-84af-eb23b21ab566"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:44:45.555476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c9ebeac5-be9e-4b20-8ed4-7c2a8cf08c15 req-bd61ef20-4bbf-4172-92bb-b01e83b13165 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:45.556094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c9ebeac5-be9e-4b20-8ed4-7c2a8cf08c15 req-bd61ef20-4bbf-4172-92bb-b01e83b13165 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:45.556618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c9ebeac5-be9e-4b20-8ed4-7c2a8cf08c15 req-bd61ef20-4bbf-4172-92bb-b01e83b13165 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:45.569424 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c9ebeac5-be9e-4b20-8ed4-7c2a8cf08c15 req-bd61ef20-4bbf-4172-92bb-b01e83b13165 service nova] Creating event network-vif-deleted:c0409eee-c528-4e57-84af-eb23b21ab566 for instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 on nch2-master-1 Oct 29 21:44:45.576957 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c9ebeac5-be9e-4b20-8ed4-7c2a8cf08c15 req-bd61ef20-4bbf-4172-92bb-b01e83b13165 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Oct 29 21:44:45.578183 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3465/7021] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:44:45.950219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:45.950775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:45.957931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:45.958467 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:45.958911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:45.959619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:45.960085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:45.960523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:45.992345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:45.992846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:45.993291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:45.993785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lazy-loading 'fault' on Instance uuid 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:44:46.036103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bffac8528b45458dafdb6dc870b1cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e84833e934459082f2dd7b1763b2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:44:46.044133 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-65d35710-bf71-4b71-9a64-0954d57617b6 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 200 len: 1307 microversion: 2.1 time: 0.097849 Oct 29 21:44:46.044715 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3557/7022] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:45 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:44:47.069171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:44:47.069909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] [instance: 0d029da3-bcf2-45b7-a47b-53a3b6b5de49] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:44:47.071862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:44:47.078196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:47.078687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:47.079135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:47.080465 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:44:47.080930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:44:47.081370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:44:47.095919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] HTTP exception thrown: Instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 could not be found. Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Request method failure captured: Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 HTTP/1.1 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXZ6vrUvUOvRHHoCDM-iDiMcoH-2DooijS_wLuUTwsR8QpV2mowS6OOrllg0QweCyfcsTcdWuO809rt8Uyqcpk6SxC_IwmKpFXorCvnuB_RZGCt6F1EXxbukF2K5BYpTbHH8Z2rfxto49reQRXr1aWYC1l1ELX1cMM23QL2l0PWEjYXg Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c8e84833e934459082f2dd7b1763b2a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: c8e84833e934459082f2dd7b1763b2a8 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-ServersNegativeTestJSON-237199878 Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 88bffac8528b45458dafdb6dc870b1cf Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-ServersNegativeTestJSON-237199878-project Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 could not be found. Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '0d029da3-bcf2-45b7-a47b-53a3b6b5de49'} Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 could not be found. Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 could not be found. Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:44:47.097546 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 could not be found. Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] Returning 404 to user: Instance 0d029da3-bcf2-45b7-a47b-53a3b6b5de49 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-622d090b-41ed-413c-a964-52b1b1c78140 tempest-ServersNegativeTestJSON-237199878 tempest-ServersNegativeTestJSON-237199878-project] 10.222.0.36 "GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49" status: 404 len: 111 microversion: 2.1 time: 0.035627 Oct 29 21:44:47.102730 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3466/7023] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:44:47 2022] GET /compute/v2.1/servers/0d029da3-bcf2-45b7-a47b-53a3b6b5de49 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:45:27.442963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d8189462-bc1f-4adc-b2b8-f03b231b83b7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'create', calling method: .version_select at 0x7fa168754310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2123964269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnnWmWeidpM3OjS6BAbytrA0yc4TF0HXJYLZgoBYYc9kfIzg7P5RefsEF8/KZPyAHN57/hij/8YVthPAZLrCfqy+4d1YN0+Uf+lEXUWAISBlLLEmpaRspgCHn0BEbJldQ=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:27.448851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:27.449555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=14 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:27.450391 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:45:27.450548 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:45:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 29 21:45:27.468892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d8189462-bc1f-4adc-b2b8-f03b231b83b7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:45:27.474086 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-d8189462-bc1f-4adc-b2b8-f03b231b83b7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for user fbe1b153b6874923a1b7640fbc793e65 and project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:45:27.512869 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d8189462-bc1f-4adc-b2b8-f03b231b83b7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.074827 Oct 29 21:45:27.513512 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3558/7024] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:45:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:45:27.578549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1410253662", "imageRef": "f5f0b791-130d-4a45-8a70-bc834520c866", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2123964269", "networks": [{"uuid": "2e19651d-f0d2-4ab6-b68b-9285b6855805"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:27.588244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=24 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:27.588901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:27.841959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] validate_networks() for [('2e19651d-f0d2-4ab6-b68b-9285b6855805', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:45:28.660294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:45:28.660888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:45:28.661225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:45:28.661677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:45:28.662096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:45:28.671004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:28.671490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:28.671932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:28.672664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:28.673119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:28.673573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:28.690204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:45:28.695418 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for user fbe1b153b6874923a1b7640fbc793e65 and project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:45:28.708388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:45:28.710637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5f0b791-130d-4a45-8a70-bc834520c866',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:45:28.755888 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b28d66d0-8cf8-4f3e-b979-e665aa3fc048 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181771 Oct 29 21:45:28.756551 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3467/7025] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:45:28.768987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-37f296d3-b346-4c21-bed1-48e9770dd539 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:28.769668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-37f296d3-b346-4c21-bed1-48e9770dd539 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:28.943912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-37f296d3-b346-4c21-bed1-48e9770dd539 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:28.951047 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-37f296d3-b346-4c21-bed1-48e9770dd539 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1259 microversion: 2.1 time: 0.187559 Oct 29 21:45:28.951668 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3559/7026] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:28 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:29.976529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:29.977164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:29.984413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:29.984946 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:29.985434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:29.986178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:29.986644 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:29.987084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:30.058744 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:30.067239 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e91bb185-e3b4-4ca5-a351-1195263f5b67 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1319 microversion: 2.1 time: 0.095510 Oct 29 21:45:30.067969 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3468/7027] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:29 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:31.094144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:31.095856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:31.104301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:31.105003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:31.105672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:31.106415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:31.106935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:31.107390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:31.257293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:31.267106 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d1baa6ba-bd0c-44a0-9ad1-32272a10b067 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.176997 Oct 29 21:45:31.282660 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3560/7028] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:31 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:32.294122 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:32.295553 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:32.302197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:32.302694 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:32.303177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:32.304629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:32.305203 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:32.305823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:32.507576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:32.517976 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4a58939f-ec5b-4bd7-b332-af4df2d8eabe tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.229363 Oct 29 21:45:32.519393 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3469/7029] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:32 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:33.542854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:33.544175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:33.551797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:33.552266 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:33.552699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:33.553755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:33.554309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:33.554754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:33.728192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:33.736362 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-31cb4c4d-2c63-4de5-a198-4602638be88d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.197658 Oct 29 21:45:33.749919 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3561/7030] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:33 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:34.768697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:34.770941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:34.781211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:34.782097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:34.782846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:34.783837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:34.784304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:34.784745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:34.930696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:34.948588 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-518df153-ee84-405a-a73f-92d129f13a20 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.192116 Oct 29 21:45:34.949197 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3470/7031] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:34 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:35.994106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:35.994750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:36.001709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:36.002574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:36.003310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:36.004442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:36.004987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:36.005524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:36.149801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:36.159610 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9ae7842f-fcf8-40d2-9d9f-905f92b70eb8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.191063 Oct 29 21:45:36.160291 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3562/7032] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:35 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:37.184231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:37.184905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:37.192959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:37.193476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:37.193994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:37.194772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:37.195927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:37.196390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:37.347795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:37.360863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d301fe57-7f50-463d-93de-fde8b7cb58a6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.179851 Oct 29 21:45:37.361709 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3471/7033] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:37 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:38.384172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:38.384836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:38.391906 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:38.392406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:38.392867 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:38.393614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:38.394090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:38.394536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:38.527451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:38.535720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbab0f4b-6165-4335-b60b-06ec56bf778e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.155480 Oct 29 21:45:38.536295 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3563/7034] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:38 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:39.559914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:39.560529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:39.562444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:39.563110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:39.569833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:39.570318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:39.570760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:39.571451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:39.571908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:39.572338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:39.701143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:39.709127 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5212f502-27bf-4e57-b5c5-334122e79c66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.153429 Oct 29 21:45:39.709725 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3472/7035] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:39 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:40.731277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:40.731945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:40.733828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:40.740373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:40.740951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:40.741571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:40.742321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:40.742896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:40.743350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:40.872118 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:40.879873 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d49a08a8-73f7-4a0b-9cc3-46dd83d755a4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.152545 Oct 29 21:45:40.880437 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3564/7036] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:40 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:41.902537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:41.903179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:41.910208 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:41.910709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:41.911158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:41.911911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:41.912375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:41.912832 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:42.051147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:42.059086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3eee08ce-e3a2-4cdb-b453-b4997071f833 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.160709 Oct 29 21:45:42.059668 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3473/7037] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:41 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:42.392675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-7a27efdc-83bc-4006-9035-d8096e7c4d9b req-efdb1c4f-5326-4614-8abd-b577dc8c9b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:42.402635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7a27efdc-83bc-4006-9035-d8096e7c4d9b req-efdb1c4f-5326-4614-8abd-b577dc8c9b61 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:42.403219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7a27efdc-83bc-4006-9035-d8096e7c4d9b req-efdb1c4f-5326-4614-8abd-b577dc8c9b61 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:42.403750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-7a27efdc-83bc-4006-9035-d8096e7c4d9b req-efdb1c4f-5326-4614-8abd-b577dc8c9b61 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:42.415370 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-7a27efdc-83bc-4006-9035-d8096e7c4d9b req-efdb1c4f-5326-4614-8abd-b577dc8c9b61 service nova] Creating event network-changed:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:45:42.420753 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-7a27efdc-83bc-4006-9035-d8096e7c4d9b req-efdb1c4f-5326-4614-8abd-b577dc8c9b61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090612 Oct 29 21:45:42.421360 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3565/7038] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:45:43.083557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:43.084190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:43.091161 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:43.091660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:43.092109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:43.092817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:43.093283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:43.093748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:43.222667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:43.231841 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0cdca6eb-27c2-4c1e-963b-b1c438b4708c tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.152510 Oct 29 21:45:43.232429 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3474/7039] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:43 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:44.256247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:44.256975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:44.264250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:44.264751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:44.265205 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:44.265936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:44.266461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:44.266907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:44.399810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:44.407800 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d0d1f7bd-9626-4830-a655-cbfa0392a982 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.155809 Oct 29 21:45:44.408611 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3566/7040] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:44 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:45.431527 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:45.432158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:45.439134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:45.439627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:45.440147 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:45.440853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:45.441321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:45.441799 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:45.571423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:45.579468 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bc0b771c-7dc5-491d-a04a-729fdf55d398 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.151860 Oct 29 21:45:45.580078 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3475/7041] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:45 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:46.595591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-fb8509cb-6627-4e52-a4e1-b4cea80985f5 req-f27f6fca-f8f5-4dca-9d71-d48f78045019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "name": "network-vif-plugged", "status": "completed", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:46.603145 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:46.603708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:46.605842 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fb8509cb-6627-4e52-a4e1-b4cea80985f5 req-f27f6fca-f8f5-4dca-9d71-d48f78045019 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:46.606337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fb8509cb-6627-4e52-a4e1-b4cea80985f5 req-f27f6fca-f8f5-4dca-9d71-d48f78045019 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:46.606785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fb8509cb-6627-4e52-a4e1-b4cea80985f5 req-f27f6fca-f8f5-4dca-9d71-d48f78045019 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:46.610516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:46.611010 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:46.611471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:46.612197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:46.612657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:46.613119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:46.617798 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-fb8509cb-6627-4e52-a4e1-b4cea80985f5 req-f27f6fca-f8f5-4dca-9d71-d48f78045019 service nova] Creating event network-vif-plugged:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:45:46.622825 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-fb8509cb-6627-4e52-a4e1-b4cea80985f5 req-f27f6fca-f8f5-4dca-9d71-d48f78045019 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079474 Oct 29 21:45:46.623409 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3567/7042] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:45:46.746565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:46.755425 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1b27aa23-57ed-41c4-8f47-f43900b9e6e3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.156004 Oct 29 21:45:46.756018 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3476/7043] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:46 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:45:47.781202 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:47.781950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:47.788693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:47.789198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:47.789694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:47.790408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:47.790883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:47.791332 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:47.923325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:47.931196 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ad0eaff-61ad-4e53-ba1b-33fdb969cd72 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1359 microversion: 2.1 time: 0.155118 Oct 29 21:45:47.931790 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3568/7044] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:47 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:48.953605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:48.954205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:48.961041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:48.961549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:48.961991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:48.962688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:48.963146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:48.963575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.092789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:49.101040 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fc85ab72-72ba-43eb-941a-33f689bc2422 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1549 microversion: 2.1 time: 0.151579 Oct 29 21:45:49.101643 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3477/7045] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:48 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:45:49.124186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:49.124845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:49.131659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:49.132152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:49.132603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.133304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:49.133804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:49.134243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.268216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:49.276152 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d31fab1e-1bee-492c-ba2a-387acb8c58b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1549 microversion: 2.1 time: 0.155874 Oct 29 21:45:49.276731 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3569/7046] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:49 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:49.298860 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:49.304375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:49.305138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Searching by: {'deleted': False, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b'} {{(pid=138884) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:45:49.310511 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:49.310987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:49.311421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.312166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:49.312617 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:49.313045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.337101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.multi_cell_list [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138884) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:45:49.363565 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a206e011-630f-46d4-abc1-40c522b9ddbb tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068521 Oct 29 21:45:49.364148 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3478/7047] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 21:45:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:45:49.375821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:49.376460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:49.382611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:49.383123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:49.383584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.384298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:49.384777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:49.385229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:49.512441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:49.520825 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c3e2c10f-667c-484a-b1d7-52e8683a39ba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1549 microversion: 2.1 time: 0.148970 Oct 29 21:45:49.521408 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3570/7048] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:49 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:51.061193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cda8ab19-025c-4b7b-a201-d5774ac83d8a"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:51.063592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:51.070538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:51.071030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:51.071476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:51.072174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:51.072635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:51.073070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:51.327957 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e142656e-cda7-405c-9147-1182e27589b9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270594 Oct 29 21:45:51.328840 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3479/7049] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:45:51 2022] POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:45:56.947621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:45:56.948263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:56.955372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:56.955886 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:56.956348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:56.957065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:56.957569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:56.958019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:57.093614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:45:57.102012 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d84c0082-1170-4fe2-a235-79718b402ae3 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1595 microversion: 2.1 time: 0.158283 Oct 29 21:45:57.102607 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3571/7050] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:45:56 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:45:58.807422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f14fc418-0199-4011-b49c-0824f5b0fbe2 req-1a3b4d65-2285-45c4-aba4-cb8d158ba343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:58.819076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:58.823291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f14fc418-0199-4011-b49c-0824f5b0fbe2 req-1a3b4d65-2285-45c4-aba4-cb8d158ba343 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:58.823846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f14fc418-0199-4011-b49c-0824f5b0fbe2 req-1a3b4d65-2285-45c4-aba4-cb8d158ba343 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:58.824264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f14fc418-0199-4011-b49c-0824f5b0fbe2 req-1a3b4d65-2285-45c4-aba4-cb8d158ba343 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:58.829395 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:58.848126 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f14fc418-0199-4011-b49c-0824f5b0fbe2 req-1a3b4d65-2285-45c4-aba4-cb8d158ba343 service nova] Creating event network-changed:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:45:58.854712 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f14fc418-0199-4011-b49c-0824f5b0fbe2 req-1a3b4d65-2285-45c4-aba4-cb8d158ba343 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107417 Oct 29 21:45:58.855487 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3480/7051] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:45:59.699689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-972263864"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:45:59.700340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:45:59.703709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:59.710766 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:59.711277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:59.711739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:59.712464 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:45:59.712943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:45:59.713395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:45:59.716104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=65 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:45:59.854813 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Adding security group 70952982-cc97-4622-bf2b-e6016fbfc0fe to port c846b797-dbb0-4a8e-8a39-ec0c8d33e134 Oct 29 21:46:00.173557 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-dbbe3246-f8c2-4066-b3d7-37dcfb109607 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action" status: 202 len: 0 microversion: 2.1 time: 0.477798 Oct 29 21:46:00.174205 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3572/7052] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:45:59 2022] POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:46:00.180515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:46:00.185496 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:46:00.186230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:46:00.193077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:46:00.193613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:46:00.194067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:46:00.194784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:46:00.195350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:46:00.195976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:46:00.353099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:46:00.361583 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b3e4fe4-6617-4112-a4d0-8958990c192f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1759 microversion: 2.1 time: 0.182422 Oct 29 21:46:00.362423 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3481/7053] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:46:00 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:46:00.880542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-d81d2897-ee53-42a7-a182-281328220b4d req-d64fbb8c-8ea3-46e5-9048-da02697f510d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:46:00.890501 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d81d2897-ee53-42a7-a182-281328220b4d req-d64fbb8c-8ea3-46e5-9048-da02697f510d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:46:00.891183 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d81d2897-ee53-42a7-a182-281328220b4d req-d64fbb8c-8ea3-46e5-9048-da02697f510d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:46:00.891637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-d81d2897-ee53-42a7-a182-281328220b4d req-d64fbb8c-8ea3-46e5-9048-da02697f510d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:46:00.903520 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-d81d2897-ee53-42a7-a182-281328220b4d req-d64fbb8c-8ea3-46e5-9048-da02697f510d service nova] Creating event network-changed:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:46:00.908661 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-d81d2897-ee53-42a7-a182-281328220b4d req-d64fbb8c-8ea3-46e5-9048-da02697f510d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040640 Oct 29 21:46:00.909440 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3573/7054] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:48:53.124324 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 21:48:53.125542 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 21:48:53.126053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:48:53.127383 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=7 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:48:53.128652 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 21:48:53.128797 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action (ip 10.222.0.36) !!! Oct 29 21:48:53.130821 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 21:48:53.130951 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action (ip 10.222.0.36) !!! Oct 29 21:48:53.132040 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:48:53.132174 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action (ip 10.222.0.36) !!! Oct 29 21:48:53.140810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:48:53.143790 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:48:53.163505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:48:53.164000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:48:53.164471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:48:53.165178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:48:53.165693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:48:53.166133 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:48:53.241283 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-76436498-cebd-482a-929b-6801d10e22ae tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action" status: 202 len: 0 microversion: 2.1 time: 0.118441 Oct 29 21:48:53.241964 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3482/7055] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:48:53 2022] POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:48:53.249963 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 21:48:53.251014 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 21:48:53.251706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:48:53.253036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=5 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:48:53.254147 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:48:53.254297 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 (ip 10.222.0.36) !!! Oct 29 21:48:53.257015 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 21:48:53.257182 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 (ip 10.222.0.36) !!! Oct 29 21:48:53.259151 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 21:48:53.259308 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 (ip 10.222.0.36) !!! Oct 29 21:48:53.277242 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:48:53.277988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:48:53.294985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:48:53.295729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:48:53.296194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:48:53.296916 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:48:53.298047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:48:53.298731 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:48:53.459810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:48:53.468459 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a06fae89-0beb-4f7e-a236-cfc841a8530b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1761 microversion: 2.1 time: 0.222039 Oct 29 21:48:53.469041 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3574/7056] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:48:53 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1761 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:48:54.494304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:48:54.495012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:48:54.506372 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43452. Oct 29 21:48:54.508715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:48:54.509193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:48:54.509665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:48:54.510364 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:48:54.511022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:48:54.511456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:48:54.512060 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43454. Oct 29 21:48:54.661890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:48:54.670374 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4c41a18e-e7db-48f2-9100-8457d6e8cfcc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1759 microversion: 2.1 time: 0.181699 Oct 29 21:48:54.670938 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3483/7057] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:48:54 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:50:30.914696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:30.915471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:30.929483 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43542. Oct 29 21:50:30.933126 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43544. Oct 29 21:50:30.975454 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-972263864"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:30.976098 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:30.984551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:30.985057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:30.985539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:30.986261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:30.986741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:30.987222 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:31.169153 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Removing security group 70952982-cc97-4622-bf2b-e6016fbfc0fe from port c846b797-dbb0-4a8e-8a39-ec0c8d33e134 Oct 29 21:50:31.469970 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-773eb46d-0c12-4e2c-a15f-a8b161f02ac6 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action" status: 202 len: 0 microversion: 2.1 time: 0.558877 Oct 29 21:50:31.470602 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3575/7058] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:50:30 2022] POST /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:50:31.479250 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-85efa94e-a86c-4642-8368-9ce385cbe3c4 req-6692c764-f3ae-4bbc-87d0-71fb6feec4af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:31.485111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:31.486296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:31.496524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-85efa94e-a86c-4642-8368-9ce385cbe3c4 req-6692c764-f3ae-4bbc-87d0-71fb6feec4af service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:31.497222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-85efa94e-a86c-4642-8368-9ce385cbe3c4 req-6692c764-f3ae-4bbc-87d0-71fb6feec4af service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:31.497726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-85efa94e-a86c-4642-8368-9ce385cbe3c4 req-6692c764-f3ae-4bbc-87d0-71fb6feec4af service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:31.510869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-85efa94e-a86c-4642-8368-9ce385cbe3c4 req-6692c764-f3ae-4bbc-87d0-71fb6feec4af service nova] Creating event network-changed:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:50:31.516651 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-85efa94e-a86c-4642-8368-9ce385cbe3c4 req-6692c764-f3ae-4bbc-87d0-71fb6feec4af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042619 Oct 29 21:50:31.517263 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3484/7059] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:50:32.923073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:32.923625 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:32.931936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:32.932438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:32.932895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:32.933636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:32.934112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:32.934566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:33.014966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lazy-loading 'services' on Instance uuid b07b10b2-2826-4d0d-919d-a78801480b56 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:50:33.092422 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments/cda8ab19-025c-4b7b-a201-d5774ac83d8a" status: 202 len: 0 microversion: 2.1 time: 0.174005 Oct 29 21:50:33.093115 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3576/7060] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:50:32 2022] DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments/cda8ab19-025c-4b7b-a201-d5774ac83d8a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:50:33.104263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:33.107241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:33.114560 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:33.115167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:33.115704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:33.116573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:33.117038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:33.117499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:33.155598 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c1195fb-1c47-4cb4-8239-2e5d5e3a81bc tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057049 Oct 29 21:50:33.156212 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3485/7061] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:50:33 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:50:33.539874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ddaa8b34-3166-4363-8e34-2cd178380215 req-6c655922-d57e-4c68-8086-5735eff1af31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:33.550844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ddaa8b34-3166-4363-8e34-2cd178380215 req-6c655922-d57e-4c68-8086-5735eff1af31 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:33.551350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ddaa8b34-3166-4363-8e34-2cd178380215 req-6c655922-d57e-4c68-8086-5735eff1af31 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:33.551802 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ddaa8b34-3166-4363-8e34-2cd178380215 req-6c655922-d57e-4c68-8086-5735eff1af31 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:33.564012 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ddaa8b34-3166-4363-8e34-2cd178380215 req-6c655922-d57e-4c68-8086-5735eff1af31 service nova] Creating event network-changed:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:50:33.569846 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ddaa8b34-3166-4363-8e34-2cd178380215 req-6c655922-d57e-4c68-8086-5735eff1af31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034720 Oct 29 21:50:33.570461 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3577/7062] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:50:34.168846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:34.170956 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:34.179584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:34.180073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:34.180509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:34.181218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:34.181706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:34.182166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:34.214768 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ca9a1ee-fe96-4c63-8800-3c5436b21075 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050110 Oct 29 21:50:34.215365 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3486/7063] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:50:34 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:50:34.228294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:34.228889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:34.235574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:34.236082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:34.236543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:34.237271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:34.238407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:34.238856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:34.319449 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] HTTP exception thrown: Instance b07b10b2-2826-4d0d-919d-a78801480b56 is not attached to volume cda8ab19-025c-4b7b-a201-d5774ac83d8a Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Request method failure captured: Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments/cda8ab19-025c-4b7b-a201-d5774ac83d8a HTTP/1.1 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ7o3qvAK_qjsaQRSJdhO5OqPwaqGMmwttf_OskdBvcaDyJ8sD00CjtAybcY_hivkLghSX2hjO0GWZRGoK_vDVZMzTVH0yxLKszUzU4ZGdCzGIslFNkxhWg7MTnuqBBQNGqTBaBIl5PEZMO-GTzFd5ugNZGzqHZnp4yH_G52vY6A4GI Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: fbe1b153b6874923a1b7640fbc793e65 Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b07b10b2-2826-4d0d-919d-a78801480b56 is not attached to volume cda8ab19-025c-4b7b-a201-d5774ac83d8a Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': 'b07b10b2-2826-4d0d-919d-a78801480b56', 'id': 'cda8ab19-025c-4b7b-a201-d5774ac83d8a'} Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cda8ab19-025c-4b7b-a201-d5774ac83d8a. Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07b10b2-2826-4d0d-919d-a78801480b56 is not attached to volume cda8ab19-025c-4b7b-a201-d5774ac83d8a Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:50:34.340075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07b10b2-2826-4d0d-919d-a78801480b56 is not attached to volume cda8ab19-025c-4b7b-a201-d5774ac83d8a Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Returning 404 to user: Instance b07b10b2-2826-4d0d-919d-a78801480b56 is not attached to volume cda8ab19-025c-4b7b-a201-d5774ac83d8a {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64c5a1dc-1001-456b-a9f6-325547457d13 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments/cda8ab19-025c-4b7b-a201-d5774ac83d8a" status: 404 len: 154 microversion: 2.1 time: 0.118820 Oct 29 21:50:34.349669 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3578/7064] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:50:34 2022] DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56/os-volume_attachments/cda8ab19-025c-4b7b-a201-d5774ac83d8a => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 21:50:35.493891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:35.494716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:35.501190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:35.501718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:35.502162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:35.502862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:35.503317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:35.503747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:35.529437 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:50:35.608673 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-45860d97-4b74-4ce4-8c16-cae2cd40d066 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 204 len: 0 microversion: 2.1 time: 0.118461 Oct 29 21:50:35.609273 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3487/7065] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:50:35 2022] DELETE /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:50:35.618482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:35.619127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:35.626669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:35.627176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:35.627639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:35.628390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:35.628873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:35.629420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:35.758444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:35.766151 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c1c9283a-6a28-4619-b1f4-5be34053137d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1555 microversion: 2.1 time: 0.151692 Oct 29 21:50:35.766729 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3579/7066] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:35 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:50:36.790480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:36.791111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:36.798558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:36.799038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:36.799475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:36.800165 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:36.800620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:36.801575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:36.976901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:36.985175 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fb2d021d-dc50-44e1-a01d-d252bc5a8b35 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1555 microversion: 2.1 time: 0.198973 Oct 29 21:50:36.985800 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3488/7067] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:36 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:38.009389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:38.010053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:38.016914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:38.017417 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:38.017902 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:38.018624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:38.019094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:38.019538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:38.170429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:38.180319 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-55e191a2-fd10-49fd-b2b0-ccf156547805 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 200 len: 1555 microversion: 2.1 time: 0.174807 Oct 29 21:50:38.181404 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3580/7068] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:38 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:38.195966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-eaf2c049-649e-4db9-9f9a-6ff3ca1a4322 req-282a7037-5065-49eb-90ad-c9067479c0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07b10b2-2826-4d0d-919d-a78801480b56", "name": "network-vif-deleted", "tag": "c846b797-dbb0-4a8e-8a39-ec0c8d33e134"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:38.209183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-eaf2c049-649e-4db9-9f9a-6ff3ca1a4322 req-282a7037-5065-49eb-90ad-c9067479c0b2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:38.209998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-eaf2c049-649e-4db9-9f9a-6ff3ca1a4322 req-282a7037-5065-49eb-90ad-c9067479c0b2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:38.210461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-eaf2c049-649e-4db9-9f9a-6ff3ca1a4322 req-282a7037-5065-49eb-90ad-c9067479c0b2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:38.227151 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-eaf2c049-649e-4db9-9f9a-6ff3ca1a4322 req-282a7037-5065-49eb-90ad-c9067479c0b2 service nova] Creating event network-vif-deleted:c846b797-dbb0-4a8e-8a39-ec0c8d33e134 for instance b07b10b2-2826-4d0d-919d-a78801480b56 on nch1-master-1 Oct 29 21:50:38.234028 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-eaf2c049-649e-4db9-9f9a-6ff3ca1a4322 req-282a7037-5065-49eb-90ad-c9067479c0b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041646 Oct 29 21:50:38.234865 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3489/7069] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:50:39.205583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:39.206644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: b07b10b2-2826-4d0d-919d-a78801480b56] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:39.214530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:39.214530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:39.215018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:39.215650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:39.216172 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:39.217756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:39.232581 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] HTTP exception thrown: Instance b07b10b2-2826-4d0d-919d-a78801480b56 could not be found. Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Request method failure captured: Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 HTTP/1.1 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ7o3qvAK_qjsaQRSJdhO5OqPwaqGMmwttf_OskdBvcaDyJ8sD00CjtAybcY_hivkLghSX2hjO0GWZRGoK_vDVZMzTVH0yxLKszUzU4ZGdCzGIslFNkxhWg7MTnuqBBQNGqTBaBIl5PEZMO-GTzFd5ugNZGzqHZnp4yH_G52vY6A4GI Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: fbe1b153b6874923a1b7640fbc793e65 Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance b07b10b2-2826-4d0d-919d-a78801480b56 could not be found. Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': 'b07b10b2-2826-4d0d-919d-a78801480b56'} Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07b10b2-2826-4d0d-919d-a78801480b56 could not be found. Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07b10b2-2826-4d0d-919d-a78801480b56 could not be found. Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:50:39.234213 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07b10b2-2826-4d0d-919d-a78801480b56 could not be found. Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Returning 404 to user: Instance b07b10b2-2826-4d0d-919d-a78801480b56 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07d873dc-a4b2-4d71-b734-158239c42fb2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56" status: 404 len: 111 microversion: 2.1 time: 0.034358 Oct 29 21:50:39.241947 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3581/7070] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:39 2022] GET /compute/v2.1/servers/b07b10b2-2826-4d0d-919d-a78801480b56 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:50:39.246217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-82766467-2d9f-481d-8108-d1365730400f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '.version_select at 0x7fa1708368b0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:39.271025 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-82766467-2d9f-481d-8108-d1365730400f tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2123964269" status: 202 len: 0 microversion: 2.1 time: 0.029434 Oct 29 21:50:39.271630 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3490/7071] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:50:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2123964269 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 21:50:48.446010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-77294ebc-1b4f-4643-ba09-ac11881f2e83 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'create', calling method: .version_select at 0x7fa171276d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2116277791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQgoXDGk/1z0cLaWNEqMzzOHY02cnmTFf0ZMOcQiwJIbu6IjYp5OVj2zyrTdagzpRt2VeKHNZyWiiLNT6Hb6stSGTlM+1TLmK1zfFJAPrcjRATjKH9CxHDvJTPa/4gxIA=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:48.465586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-77294ebc-1b4f-4643-ba09-ac11881f2e83 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:50:48.471531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-77294ebc-1b4f-4643-ba09-ac11881f2e83 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for user fbe1b153b6874923a1b7640fbc793e65 and project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:50:48.497799 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-77294ebc-1b4f-4643-ba09-ac11881f2e83 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055681 Oct 29 21:50:48.498390 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3582/7072] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:50:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:50:48.553257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:48.557503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-417774400", "imageRef": "1ed3e6c9-55c0-4d18-996c-596f12f7dd2b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2116277791", "networks": [{"uuid": "2e19651d-f0d2-4ab6-b68b-9285b6855805"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:48.610708 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] validate_networks() for [('2e19651d-f0d2-4ab6-b68b-9285b6855805', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:50:49.015201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:50:49.015627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:50:49.016104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:50:49.016513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:50:49.016950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:50:49.028697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:49.029178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:49.029663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:49.030400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:49.030854 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:49.031281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:49.050910 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:50:49.056175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Getting quotas for user fbe1b153b6874923a1b7640fbc793e65 and project 18b20a3ad12b44529120efb74b4d8e8b. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:50:49.069123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:50:49.071506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1ed3e6c9-55c0-4d18-996c-596f12f7dd2b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:50:49.119758 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e0a83fb6-b0b4-48a1-affa-058d483c4237 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568204 Oct 29 21:50:49.120589 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3491/7073] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:50:49.132141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6159fb19-32ce-4e79-94ff-d4ff01e09bba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:49.132775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6159fb19-32ce-4e79-94ff-d4ff01e09bba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:49.186431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6159fb19-32ce-4e79-94ff-d4ff01e09bba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:49.194239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6159fb19-32ce-4e79-94ff-d4ff01e09bba tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1258 microversion: 2.1 time: 0.066732 Oct 29 21:50:49.194811 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3583/7074] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:49 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:50.219479 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:50.220120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:50.227508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:50.228006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:50.228456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:50.229179 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:50.229682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:50.230123 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:50.299891 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:50.311992 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32c5f8bb-ed9f-4405-87bd-d2409ff2f94a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1318 microversion: 2.1 time: 0.096949 Oct 29 21:50:50.313696 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3492/7075] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:50 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:51.337924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:51.338733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:51.340958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:51.348007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:51.348536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:51.348990 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:51.349797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:51.350455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:51.350907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:51.502382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:51.514253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cac279ac-cdae-406d-bfb3-9fa399eb76ec tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.180060 Oct 29 21:50:51.515317 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3584/7076] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:51 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:52.538796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:52.540408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:52.547969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:52.548615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:52.549164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:52.550017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:52.550599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:52.551150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:52.702623 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:52.712808 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5fc8f67a-2cf2-4a52-ae16-766d4ce7ae1a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.178389 Oct 29 21:50:52.713731 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3493/7077] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:52 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:53.738334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:53.739541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:53.746147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:53.746684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:53.747140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:53.747866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:53.748350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:53.748779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:53.895592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:53.903706 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ffe8a6d7-7412-4ea2-a3ba-6198e8ac05da tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.170870 Oct 29 21:50:53.904316 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3585/7078] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:53 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:54.928853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:54.930549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:54.937092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:54.937656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:54.938105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:54.938925 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:54.939391 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:54.939826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:55.085352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:55.093315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cc47a7f0-f1e8-4c36-b9c1-7dbb2196c0a8 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.168949 Oct 29 21:50:55.093990 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3494/7079] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:54 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:56.117795 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:56.118426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:56.126102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:56.127140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:56.127917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:56.129042 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:56.130540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:56.131300 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:56.275688 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:56.283772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16750a08-16db-4c22-85e7-3aba0971325a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.170888 Oct 29 21:50:56.284354 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3586/7080] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:56 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:57.307703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:57.308374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:57.315439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:57.315939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:57.316424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:57.317128 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:57.317721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:57.318156 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:57.482451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:57.490722 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-15c108b4-0804-4c45-b046-3074af30f3f9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.186888 Oct 29 21:50:57.491313 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3495/7081] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:57 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:58.515100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:58.515847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:58.523977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:58.524605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:58.525154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:58.525997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:58.526547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:58.527072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:58.665779 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:58.673512 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b1e26c63-2468-41d3-a9b1-f5e33a021e12 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.162424 Oct 29 21:50:58.674105 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3587/7082] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:58 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:59.698087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:50:59.698691 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:50:59.701387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:59.702240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:59.708311 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:59.708798 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:59.709312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:59.710049 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:59.710509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:59.710938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:59.847375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:50:59.858310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:50:59.866941 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fb2276fb-5e87-4ffb-8aa5-57143d6c68d0 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.172707 Oct 29 21:50:59.867654 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3496/7083] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:50:59 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:50:59.921442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e35e8eaa-52d3-4a9b-aa9d-e81d39f26a2d req-c3f1a1ee-10b0-42cb-8afc-081f3a87cccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:50:59.931892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e35e8eaa-52d3-4a9b-aa9d-e81d39f26a2d req-c3f1a1ee-10b0-42cb-8afc-081f3a87cccc service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:50:59.932390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e35e8eaa-52d3-4a9b-aa9d-e81d39f26a2d req-c3f1a1ee-10b0-42cb-8afc-081f3a87cccc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:50:59.932834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e35e8eaa-52d3-4a9b-aa9d-e81d39f26a2d req-c3f1a1ee-10b0-42cb-8afc-081f3a87cccc service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:50:59.944652 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e35e8eaa-52d3-4a9b-aa9d-e81d39f26a2d req-c3f1a1ee-10b0-42cb-8afc-081f3a87cccc service nova] Creating event network-changed:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:50:59.949710 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e35e8eaa-52d3-4a9b-aa9d-e81d39f26a2d req-c3f1a1ee-10b0-42cb-8afc-081f3a87cccc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099446 Oct 29 21:50:59.950328 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3588/7084] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:51:00.891828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:00.892449 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:00.900135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:00.900618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:00.901059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:00.901841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:00.902297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:00.902726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:01.035119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:01.043032 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcf4b03c-4c74-440f-8112-90a56ac27378 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.155463 Oct 29 21:51:01.043610 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3497/7085] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:00 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:02.068392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:02.069127 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:02.071148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:02.076763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:02.077270 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:02.077755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:02.078479 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:02.078957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:02.079407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:02.215070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:02.223049 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-572ee89e-28c0-4cef-b192-754e18606256 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.160513 Oct 29 21:51:02.223640 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3589/7086] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:02 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:03.246963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:03.247592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:03.250357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:03.256952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:03.257446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:03.258059 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:03.258767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:03.259227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:03.259665 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:03.392102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:03.400402 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5d377b2f-5c29-49f8-8c13-1d245a369999 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.157331 Oct 29 21:51:03.400975 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3498/7087] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:03 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:04.423829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:04.424632 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:04.431859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:04.432369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:04.432831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:04.433598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:04.434077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:04.434529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:04.496132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3cb148b6-b51a-4dfe-a368-f8dbd9ab5de8 req-709b066c-9dcb-44db-9488-b3741a230326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "name": "network-vif-plugged", "status": "completed", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:51:04.507095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3cb148b6-b51a-4dfe-a368-f8dbd9ab5de8 req-709b066c-9dcb-44db-9488-b3741a230326 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:04.507627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3cb148b6-b51a-4dfe-a368-f8dbd9ab5de8 req-709b066c-9dcb-44db-9488-b3741a230326 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:04.508075 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3cb148b6-b51a-4dfe-a368-f8dbd9ab5de8 req-709b066c-9dcb-44db-9488-b3741a230326 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:04.519771 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3cb148b6-b51a-4dfe-a368-f8dbd9ab5de8 req-709b066c-9dcb-44db-9488-b3741a230326 service nova] Creating event network-vif-plugged:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:51:04.525690 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3cb148b6-b51a-4dfe-a368-f8dbd9ab5de8 req-709b066c-9dcb-44db-9488-b3741a230326 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094133 Oct 29 21:51:04.526300 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3499/7088] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:51:04.576586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:04.585319 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-597c2fe5-71ab-43fa-9f49-97fb1aa87683 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.165714 Oct 29 21:51:04.585973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3590/7089] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:04 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:05.609687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:05.610414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:05.617215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:05.617730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:05.618185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:05.618887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:05.619353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:05.619791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:05.750355 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:05.758182 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-813cbcf6-b28e-40ef-8fb9-d19c18effe5e tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1358 microversion: 2.1 time: 0.153690 Oct 29 21:51:05.758753 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3500/7090] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:05 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:06.782182 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:06.782776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:06.789834 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:06.790339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:06.790828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:06.791551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:06.792023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:06.792468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:06.928039 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:06.935768 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cbff5699-3573-41ff-87b1-52d9c3e34e00 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1547 microversion: 2.1 time: 0.157604 Oct 29 21:51:06.936356 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3591/7091] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:06 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:51:06.959288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:06.959991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:06.967387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:06.967387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:06.967714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:06.968407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:06.968861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:06.969321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:07.097715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:07.105618 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-87914b3f-c24b-4509-a448-4cd201d4d8a2 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1547 microversion: 2.1 time: 0.150978 Oct 29 21:51:07.106189 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3501/7092] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:06 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:07.127511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:07.132965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:07.133778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Searching by: {'deleted': False, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b'} {{(pid=138885) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 21:51:07.139072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:07.139569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:07.140029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:07.140772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:07.141248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:07.141727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:07.168589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.multi_cell_list [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=138885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 21:51:07.197484 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f027da03-26af-4a9a-a45f-0fbb2fdfc121 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073739 Oct 29 21:51:07.198081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3592/7093] 10.222.0.36 () {58 vars in 1125 bytes} [Sat Oct 29 21:51:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:51:07.210175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:07.210806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:07.216758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:07.217251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:07.217731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:07.218433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:07.218897 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:07.219332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:07.346892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:07.355011 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-bf8c8b22-cd4b-455a-bedf-15fb46a6c0d4 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1547 microversion: 2.1 time: 0.148982 Oct 29 21:51:07.355615 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3502/7094] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:07 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:08.864399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12516987-791a-477f-8a6e-12c0fbeefd32"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:51:08.866825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:08.873738 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:08.874245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:08.874712 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:08.875429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:08.875905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:08.876353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:09.115151 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-89df391b-36c3-43e4-a880-bc69ca6dfe71 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255184 Oct 29 21:51:09.115804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3593/7095] 10.222.0.36 () {60 vars in 1323 bytes} [Sat Oct 29 21:51:08 2022] POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:51:12.477113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:12.477750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:12.484905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:12.485433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:12.486052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:12.486764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:12.487231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:12.487697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:12.621258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:12.630259 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a3f5a2e8-aec2-4635-b5f0-3bdc5f2dbe47 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1593 microversion: 2.1 time: 0.157593 Oct 29 21:51:12.630977 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3503/7096] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:12 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:14.291772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-6ff2ad42-6279-4dee-98b9-13dc83f4aab5 req-f4a56603-c49c-4ae3-af17-821ff60443a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:51:14.303327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ff2ad42-6279-4dee-98b9-13dc83f4aab5 req-f4a56603-c49c-4ae3-af17-821ff60443a8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:14.304196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ff2ad42-6279-4dee-98b9-13dc83f4aab5 req-f4a56603-c49c-4ae3-af17-821ff60443a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:14.304920 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-6ff2ad42-6279-4dee-98b9-13dc83f4aab5 req-f4a56603-c49c-4ae3-af17-821ff60443a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:14.320308 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-6ff2ad42-6279-4dee-98b9-13dc83f4aab5 req-f4a56603-c49c-4ae3-af17-821ff60443a8 service nova] Creating event network-changed:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:51:14.325884 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-6ff2ad42-6279-4dee-98b9-13dc83f4aab5 req-f4a56603-c49c-4ae3-af17-821ff60443a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093392 Oct 29 21:51:14.326875 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3594/7097] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:51:15.367205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1584458125"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:51:15.367795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:15.374965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:15.375464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:15.375965 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:15.376629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:15.377093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:15.377554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:15.513292 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.network.security_group_api [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Adding security group 8e0687fe-183b-40c8-b63f-f6697d7d9086 to port afbc7622-d6b0-4030-8997-df67568a54ea Oct 29 21:51:15.824018 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3f749417-b29b-4ca0-929e-6e4297cc56cd tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action" status: 202 len: 0 microversion: 2.1 time: 0.461402 Oct 29 21:51:15.828081 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3504/7098] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:51:15 2022] POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:51:15.836526 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:15.837436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:15.845790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:15.846310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:15.846796 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:15.847667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:15.848173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:15.849179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:16.009407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:16.017767 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-96fef30a-7ba0-41e4-b5ec-9a2b25b188a7 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1759 microversion: 2.1 time: 0.187685 Oct 29 21:51:16.018350 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3595/7099] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:15 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:16.340795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-2522167b-715c-4b18-b6e4-44f14175754a req-5057b621-92e6-440f-8e37-326288588874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:51:16.350491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2522167b-715c-4b18-b6e4-44f14175754a req-5057b621-92e6-440f-8e37-326288588874 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:16.350973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2522167b-715c-4b18-b6e4-44f14175754a req-5057b621-92e6-440f-8e37-326288588874 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:16.351413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-2522167b-715c-4b18-b6e4-44f14175754a req-5057b621-92e6-440f-8e37-326288588874 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:16.362511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-2522167b-715c-4b18-b6e4-44f14175754a req-5057b621-92e6-440f-8e37-326288588874 service nova] Creating event network-changed:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:51:16.368412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-2522167b-715c-4b18-b6e4-44f14175754a req-5057b621-92e6-440f-8e37-326288588874 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031309 Oct 29 21:51:16.369634 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3505/7100] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:51:41.649073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:51:41.651489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:41.653940 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:41.654849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=13 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:41.655392 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:41.662057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:41.662584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:41.663036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:41.663746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:41.664212 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:41.664654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:41.737368 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2fc568e5-9519-4386-afb2-782d7a246b87 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action" status: 202 len: 0 microversion: 2.1 time: 0.092241 Oct 29 21:51:41.738132 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3596/7101] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:51:41 2022] POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:51:41.746879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:41.747619 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:41.750318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=15 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:41.750977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=76 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:51:41.758062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:41.758555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:41.759029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:41.759787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:41.760253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:41.760687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:41.907831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:41.917315 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b85bd6e5-1d4b-48bb-9917-4dd049286d66 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1751 microversion: 2.1 time: 0.174711 Oct 29 21:51:41.917944 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3506/7102] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:41 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:42.942508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:42.943234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:42.949360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:42.949895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:42.950355 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:42.951065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:42.951531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:42.951971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:43.103139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:43.111400 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be5c5c8a-4ef5-4df3-916e-43dfdb591b61 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.174795 Oct 29 21:51:43.111965 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3597/7103] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:42 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:44.135187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:44.135815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:44.142889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:44.143377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:44.143820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:44.145026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:44.145509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:44.145942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:44.289751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:44.298148 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f2e7c24-e5c4-483d-98c7-624811ab1ee9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.166878 Oct 29 21:51:44.298734 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3507/7104] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:44 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:45.322897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:45.323569 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:45.330445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:45.330957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:45.331676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:45.333048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:45.333558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:45.334014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:45.478029 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:45.487672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7884edb4-25d2-4e93-b4d8-0d1652016e25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.168755 Oct 29 21:51:45.488245 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3598/7105] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:45 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:46.511585 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:46.512217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:46.518995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:46.519491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:46.519938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:46.520640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:46.521104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:46.521566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:46.661341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:46.669669 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b9397a1a-9f54-424f-a1db-8ff458810d2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.162020 Oct 29 21:51:46.670246 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3508/7106] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:46 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:47.694215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:47.694850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:47.703987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:47.704485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:47.704934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:47.705673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:47.706144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:47.706858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:47.846769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:47.855045 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b5fa2267-4c6e-456f-980d-6df3e5c1b6c5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.165353 Oct 29 21:51:47.855612 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3599/7107] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:47 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:48.878890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:48.880047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:48.886801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:48.887281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:48.887721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:48.888442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:48.888886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:48.889313 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:49.032371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:49.040878 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c16d38c7-4fc5-4925-9d89-5b9dd91c9c25 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.165929 Oct 29 21:51:49.041483 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3509/7108] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:48 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:50.064508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:50.065186 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:50.072630 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:50.073131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:50.073618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:50.074487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:50.074791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:50.075235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:50.216275 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:50.224720 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f8c88c9-a2ce-4450-a83a-3c83469a232d tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.164177 Oct 29 21:51:50.225293 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3600/7109] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:50 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:51.248604 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:51.249224 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:51.256150 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:51.256637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:51.257076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:51.257792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:51.258247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:51.258676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:51.408017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:51.417038 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-892ad5a8-851b-4aa5-b28b-08a40beb2494 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.172376 Oct 29 21:51:51.417649 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3510/7110] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:51 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:52.440329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:52.440880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:52.448535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:52.449040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:52.449518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:52.450271 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:52.450748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:52.451198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:52.595909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:52.604780 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c4ee563-57e5-4d81-a91a-960b93759525 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1756 microversion: 2.1 time: 0.168530 Oct 29 21:51:52.605368 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3601/7111] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:52 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:51:53.629085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:51:53.629735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:51:53.636631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:53.637117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:53.637597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:53.638296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:51:53.638758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:51:53.639189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:51:53.788125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:51:53.796366 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eaf9e3dd-4438-453f-adb1-4d5280d3cba1 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1759 microversion: 2.1 time: 0.171193 Oct 29 21:51:53.796957 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3511/7112] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:51:53 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:26.330726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1584458125"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:26.331350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:26.334143 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=12 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:26.334829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:26.336134 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:52:26.336315 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action (ip 10.222.0.36) !!! Oct 29 21:52:26.343928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:26.344367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:26.344827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:26.345576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:26.346055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:26.346506 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:26.473035 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.network.security_group_api [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Removing security group 8e0687fe-183b-40c8-b63f-f6697d7d9086 from port afbc7622-d6b0-4030-8997-df67568a54ea Oct 29 21:52:26.774966 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ba239ad-af0a-4d06-95dd-cb1a7b12b471 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action" status: 202 len: 0 microversion: 2.1 time: 0.448187 Oct 29 21:52:26.775832 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3602/7113] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:52:26 2022] POST /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:52:26.788434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-dffeb016-b573-4284-aa67-c35a7cb45c1c req-0e2a355f-0e1e-4934-97b0-e3d074433610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:26.799988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:26.803796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=36 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:26.811606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dffeb016-b573-4284-aa67-c35a7cb45c1c req-0e2a355f-0e1e-4934-97b0-e3d074433610 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:26.812090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dffeb016-b573-4284-aa67-c35a7cb45c1c req-0e2a355f-0e1e-4934-97b0-e3d074433610 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:26.812528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-dffeb016-b573-4284-aa67-c35a7cb45c1c req-0e2a355f-0e1e-4934-97b0-e3d074433610 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:27.121187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-dffeb016-b573-4284-aa67-c35a7cb45c1c req-0e2a355f-0e1e-4934-97b0-e3d074433610 service nova] Creating event network-changed:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:52:27.126511 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-dffeb016-b573-4284-aa67-c35a7cb45c1c req-0e2a355f-0e1e-4934-97b0-e3d074433610 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.342884 Oct 29 21:52:27.127240 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3512/7114] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:52:28.562611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:28.563142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:28.569311 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:28.569843 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:28.570297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:28.571012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:28.571482 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:28.571927 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:28.655558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lazy-loading 'services' on Instance uuid 02d214bf-6d5c-45f2-a8d4-2586d5de3996 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:52:28.727121 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9b939433-1aef-408e-8e44-dcaf1759af99 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments/12516987-791a-477f-8a6e-12c0fbeefd32" status: 202 len: 0 microversion: 2.1 time: 0.169309 Oct 29 21:52:28.727718 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3603/7115] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:52:28 2022] DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments/12516987-791a-477f-8a6e-12c0fbeefd32 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:52:28.737476 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:28.739688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:28.750472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:28.751012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:28.751666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:28.752599 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:28.753101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:28.753544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:28.788057 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-02b2c7fe-bc2e-4807-87a6-e7ad922442e5 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055687 Oct 29 21:52:28.788646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3513/7116] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:52:28 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:52:29.142862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3dcfbd25-6942-476b-8bf7-7d644b8b0bc5 req-ba29e550-03dd-4c45-9ece-2ba95e3f6722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:29.153168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3dcfbd25-6942-476b-8bf7-7d644b8b0bc5 req-ba29e550-03dd-4c45-9ece-2ba95e3f6722 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:29.153697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3dcfbd25-6942-476b-8bf7-7d644b8b0bc5 req-ba29e550-03dd-4c45-9ece-2ba95e3f6722 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:29.154152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3dcfbd25-6942-476b-8bf7-7d644b8b0bc5 req-ba29e550-03dd-4c45-9ece-2ba95e3f6722 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:29.166582 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3dcfbd25-6942-476b-8bf7-7d644b8b0bc5 req-ba29e550-03dd-4c45-9ece-2ba95e3f6722 service nova] Creating event network-changed:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:52:29.171750 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3dcfbd25-6942-476b-8bf7-7d644b8b0bc5 req-ba29e550-03dd-4c45-9ece-2ba95e3f6722 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033017 Oct 29 21:52:29.172349 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3604/7117] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:52:29.800755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:29.803686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:29.810515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:29.811001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:29.811443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:29.812134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:29.812591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:29.813033 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:29.842667 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1a3fd844-4823-4ce9-bd4a-b9984ffc2719 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045943 Oct 29 21:52:29.843220 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3514/7118] 10.222.0.36 () {58 vars in 1302 bytes} [Sat Oct 29 21:52:29 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 21:52:29.854541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:29.855179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:29.862232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:29.862733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:29.863192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:29.863909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:29.864404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:29.865394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:29.939328 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] HTTP exception thrown: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 is not attached to volume 12516987-791a-477f-8a6e-12c0fbeefd32 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Request method failure captured: Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: request: DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments/12516987-791a-477f-8a6e-12c0fbeefd32 HTTP/1.1 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ7o3qvAK_qjsaQRSJdhO5OqPwaqGMmwttf_OskdBvcaDyJ8sD00CjtAybcY_hivkLghSX2hjO0GWZRGoK_vDVZMzTVH0yxLKszUzU4ZGdCzGIslFNkxhWg7MTnuqBBQNGqTBaBIl5PEZMO-GTzFd5ugNZGzqHZnp4yH_G52vY6A4GI Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: fbe1b153b6874923a1b7640fbc793e65 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 is not attached to volume 12516987-791a-477f-8a6e-12c0fbeefd32 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'server_id': '02d214bf-6d5c-45f2-a8d4-2586d5de3996', 'id': '12516987-791a-477f-8a6e-12c0fbeefd32'} Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12516987-791a-477f-8a6e-12c0fbeefd32. Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 is not attached to volume 12516987-791a-477f-8a6e-12c0fbeefd32 Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:52:29.940986 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 is not attached to volume 12516987-791a-477f-8a6e-12c0fbeefd32 Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Returning 404 to user: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 is not attached to volume 12516987-791a-477f-8a6e-12c0fbeefd32 {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e9f3045f-1530-46f8-b143-080d9bea9b57 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments/12516987-791a-477f-8a6e-12c0fbeefd32" status: 404 len: 154 microversion: 2.1 time: 0.092457 Oct 29 21:52:29.947631 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3605/7119] 10.222.0.36 () {58 vars in 1416 bytes} [Sat Oct 29 21:52:29 2022] DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996/os-volume_attachments/12516987-791a-477f-8a6e-12c0fbeefd32 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:52:31.092706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:31.093242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:31.100488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:31.100969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:31.101409 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:31.102129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:31.102587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:31.103015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:31.127626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:52:31.205964 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32438722-96a2-4d13-bea4-c9fef49bb441 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 204 len: 0 microversion: 2.1 time: 0.115965 Oct 29 21:52:31.207058 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3515/7120] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:52:31 2022] DELETE /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:52:31.216110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:31.216869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:31.222946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:31.223445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:31.223895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:31.225198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:31.225698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:31.226159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:31.355786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:31.363690 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b658397a-c25c-4f1c-9d6c-9b04e524cd2b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1553 microversion: 2.1 time: 0.151996 Oct 29 21:52:31.364254 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3606/7121] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:31 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:32.387712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:32.388408 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:32.395852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:32.396373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:32.396823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:32.397558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:32.398025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:32.398462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:32.530720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:32.539092 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca1376ec-7a3d-47c0-a7b0-2962dedf206b tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1553 microversion: 2.1 time: 0.155778 Oct 29 21:52:32.539668 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3516/7122] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:32 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:33.554159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a6d8e383-5d22-44a5-9d6f-3ee540992524 req-cc05f06c-4a03-44c5-95d0-2db040a95598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d214bf-6d5c-45f2-a8d4-2586d5de3996", "name": "network-vif-deleted", "tag": "afbc7622-d6b0-4030-8997-df67568a54ea"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:33.563402 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:33.564173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:33.565772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a6d8e383-5d22-44a5-9d6f-3ee540992524 req-cc05f06c-4a03-44c5-95d0-2db040a95598 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:33.566326 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a6d8e383-5d22-44a5-9d6f-3ee540992524 req-cc05f06c-4a03-44c5-95d0-2db040a95598 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:33.566791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a6d8e383-5d22-44a5-9d6f-3ee540992524 req-cc05f06c-4a03-44c5-95d0-2db040a95598 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:33.571353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:33.572169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:33.572874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:33.574070 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:33.574613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:33.575127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:33.579475 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a6d8e383-5d22-44a5-9d6f-3ee540992524 req-cc05f06c-4a03-44c5-95d0-2db040a95598 service nova] Creating event network-vif-deleted:afbc7622-d6b0-4030-8997-df67568a54ea for instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 on nch2-master-1 Oct 29 21:52:33.587911 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a6d8e383-5d22-44a5-9d6f-3ee540992524 req-cc05f06c-4a03-44c5-95d0-2db040a95598 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037545 Oct 29 21:52:33.588520 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3607/7123] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:52:33.643808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe1b153b6874923a1b7640fbc793e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b20a3ad12b44529120efb74b4d8e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:33.652301 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6299173c-a1ce-45bf-88ec-6caa03d288a9 tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 200 len: 1511 microversion: 2.1 time: 0.092715 Oct 29 21:52:33.652889 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3517/7124] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:33 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:52:34.678994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:34.679716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] [instance: 02d214bf-6d5c-45f2-a8d4-2586d5de3996] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:34.685950 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:34.686446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:34.686900 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:34.687601 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:34.688070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:34.688513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:34.701485 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] HTTP exception thrown: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 could not be found. Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Request method failure captured: Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 HTTP/1.1 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXZ7o3qvAK_qjsaQRSJdhO5OqPwaqGMmwttf_OskdBvcaDyJ8sD00CjtAybcY_hivkLghSX2hjO0GWZRGoK_vDVZMzTVH0yxLKszUzU4ZGdCzGIslFNkxhWg7MTnuqBBQNGqTBaBIl5PEZMO-GTzFd5ugNZGzqHZnp4yH_G52vY6A4GI Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/18b20a3ad12b44529120efb74b4d8e8b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 18b20a3ad12b44529120efb74b4d8e8b Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-652419777 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: fbe1b153b6874923a1b7640fbc793e65 Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestMinimumBasicScenario-652419777-project Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 could not be found. Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '02d214bf-6d5c-45f2-a8d4-2586d5de3996'} Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 could not be found. Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 could not be found. Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:52:34.703159 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 could not be found. Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Returning 404 to user: Instance 02d214bf-6d5c-45f2-a8d4-2586d5de3996 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94d5704d-4d31-4ed8-a57b-0a0fe4d7af2a tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996" status: 404 len: 111 microversion: 2.1 time: 0.031597 Oct 29 21:52:34.709579 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3608/7125] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:34 2022] GET /compute/v2.1/servers/02d214bf-6d5c-45f2-a8d4-2586d5de3996 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:52:34.714094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8fa1c0e7-06ae-4595-a9a2-0b5fa85e0bef tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] Calling method '.version_select at 0x7fa170e9eb80>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:34.733892 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8fa1c0e7-06ae-4595-a9a2-0b5fa85e0bef tempest-TestMinimumBasicScenario-652419777 tempest-TestMinimumBasicScenario-652419777-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2116277791" status: 202 len: 0 microversion: 2.1 time: 0.023677 Oct 29 21:52:34.734465 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3518/7126] 10.222.0.36 () {58 vars in 1272 bytes} [Sat Oct 29 21:52:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2116277791 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:52:43.942301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f856b9ad-0e1a-41bf-93d2-b98e71755fbd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: .version_select at 0x7fa170251310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1484607947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8RmngFL32brL9fLlDMmDVO5LyDUx5ZGJnxu0Ye09If8ntqTBe8vzQusWDtxu2/CdM4apS8Krq11OCbLyBLMu5WIIchaNCUFs0R31VyEw/oY5sG/H/OEznMyurSQRgE6Q=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:43.958389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f856b9ad-0e1a-41bf-93d2-b98e71755fbd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:52:43.964476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-f856b9ad-0e1a-41bf-93d2-b98e71755fbd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:52:43.988298 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f856b9ad-0e1a-41bf-93d2-b98e71755fbd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.225900 Oct 29 21:52:43.988905 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3609/7127] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:52:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:52:49.797867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:49.799184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:49.804238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1890140582", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "25d73a4c-2532-4221-a57e-a34fe6ce6d7e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1484607947", "security_groups": [{"name": "tempest-secgroup-smoke-632196873"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:49.918297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] validate_networks() for [('25d73a4c-2532-4221-a57e-a34fe6ce6d7e', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:52:50.382480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:52:50.382921 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:52:50.383555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:52:50.384132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:52:50.384562 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:52:50.398382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:50.398886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:50.404515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:50.405681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:50.406350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:50.407052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:50.429670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:52:50.435109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:52:50.449334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:52:50.451732 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:52:50.504410 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-32a01759-e531-414b-bf00-28967fd09b0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709525 Oct 29 21:52:50.505073 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3519/7128] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:52:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:52:50.513871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:50.520872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad175d7c-e00e-4810-a097-47f84f9af3cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:50.521936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad175d7c-e00e-4810-a097-47f84f9af3cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:50.621976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad175d7c-e00e-4810-a097-47f84f9af3cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:50.629151 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad175d7c-e00e-4810-a097-47f84f9af3cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1267 microversion: 2.1 time: 0.116138 Oct 29 21:52:50.644604 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3610/7129] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:50 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:51.653024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:51.653773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:51.660674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:51.661176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:51.661654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:51.662368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:51.662833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:51.663270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:51.726153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:51.734194 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-51e8df92-4127-48cb-9218-736e7678d654 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1319 microversion: 2.1 time: 0.085870 Oct 29 21:52:51.734777 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3520/7130] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:51 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1319 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:52.760497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:52.761934 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:52.773670 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:52.774425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:52.775065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:52.776249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:52.777352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:52.787856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:52.965865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:52.976099 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d39eef3c-29a7-4ee9-9a12-9b843185e6b8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.221881 Oct 29 21:52:52.977157 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3611/7131] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:52 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:53.478014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b1dcfb84-005f-4ccf-ad4e-c66530f45f15 req-6d8af7ea-857c-4ed8-b0a0-cbb5cde31106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed94f35-0c68-40b0-8a04-0a332960360f", "tag": "a9c1e1bb-a6a5-4822-b737-93ee32c68369"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:53.496526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b1dcfb84-005f-4ccf-ad4e-c66530f45f15 req-6d8af7ea-857c-4ed8-b0a0-cbb5cde31106 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:53.497192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b1dcfb84-005f-4ccf-ad4e-c66530f45f15 req-6d8af7ea-857c-4ed8-b0a0-cbb5cde31106 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:53.497827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b1dcfb84-005f-4ccf-ad4e-c66530f45f15 req-6d8af7ea-857c-4ed8-b0a0-cbb5cde31106 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:53.512892 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b1dcfb84-005f-4ccf-ad4e-c66530f45f15 req-6d8af7ea-857c-4ed8-b0a0-cbb5cde31106 service nova] Creating event network-changed:a9c1e1bb-a6a5-4822-b737-93ee32c68369 for instance 6ed94f35-0c68-40b0-8a04-0a332960360f on nch2-master-1 Oct 29 21:52:53.518337 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b1dcfb84-005f-4ccf-ad4e-c66530f45f15 req-6d8af7ea-857c-4ed8-b0a0-cbb5cde31106 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046154 Oct 29 21:52:53.518951 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3521/7132] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:52:54.000672 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:54.001329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:54.008635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:54.009141 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:54.009705 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:54.010484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:54.010999 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:54.011459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:54.150517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:54.158549 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8f64966e-4034-4f2f-ad77-e7ae7dc10adb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.161797 Oct 29 21:52:54.159356 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3612/7133] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:53 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:55.183100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:55.183814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:55.190332 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:55.190820 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:55.191258 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:55.192032 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:55.192546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:55.193001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:55.330525 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:55.339441 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-99b71902-862b-42e5-a4ab-9d8f23ed5a9a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.160701 Oct 29 21:52:55.340033 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3522/7134] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:55 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:56.363007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:56.363563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:56.366846 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:52:56.372130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:56.372640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:56.373101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:56.373848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:56.374325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:56.374775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:56.507208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:56.515074 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e092e139-a1b3-4412-8cd5-43c33d08ee69 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.156106 Oct 29 21:52:56.515653 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3613/7135] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:56 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:57.538346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:57.538904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:57.545738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:57.546230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:57.546677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:57.547369 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:57.547826 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:57.548270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:57.683336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:57.691092 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9cd9c648-cc82-4c98-963d-67e4324880bc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.156851 Oct 29 21:52:57.691667 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3523/7136] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:57 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:58.715393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:58.716040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:58.723214 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:58.723737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:58.724199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:58.724961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:58.725442 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:58.725984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:58.861783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:52:58.870522 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0f80bf75-fbb4-45ba-8f2c-be2889b096fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.159176 Oct 29 21:52:58.871102 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3614/7137] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:58 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:52:58.895480 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9a48fc5a-809b-4ce1-9475-f13733f85a90 req-8c0d6386-59a1-44e2-b4b6-5834863c71f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed94f35-0c68-40b0-8a04-0a332960360f", "name": "network-vif-plugged", "status": "completed", "tag": "a9c1e1bb-a6a5-4822-b737-93ee32c68369"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:52:58.906485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a48fc5a-809b-4ce1-9475-f13733f85a90 req-8c0d6386-59a1-44e2-b4b6-5834863c71f9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:58.906975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a48fc5a-809b-4ce1-9475-f13733f85a90 req-8c0d6386-59a1-44e2-b4b6-5834863c71f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:58.907417 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9a48fc5a-809b-4ce1-9475-f13733f85a90 req-8c0d6386-59a1-44e2-b4b6-5834863c71f9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:58.918703 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9a48fc5a-809b-4ce1-9475-f13733f85a90 req-8c0d6386-59a1-44e2-b4b6-5834863c71f9 service nova] Creating event network-vif-plugged:a9c1e1bb-a6a5-4822-b737-93ee32c68369 for instance 6ed94f35-0c68-40b0-8a04-0a332960360f on nch2-master-1 Oct 29 21:52:58.923690 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9a48fc5a-809b-4ce1-9475-f13733f85a90 req-8c0d6386-59a1-44e2-b4b6-5834863c71f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031948 Oct 29 21:52:58.924290 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3524/7138] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:52:59.894907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:52:59.895577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:52:59.902460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:59.902967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:59.903433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:52:59.904148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:52:59.904626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:52:59.905074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:00.039287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:00.046908 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-986a7893-b0b3-4b62-8f5f-21588b092153 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1392 microversion: 2.1 time: 0.155979 Oct 29 21:53:00.047516 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3615/7139] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:52:59 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:01.068916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:01.069718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:01.074259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:01.075039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:01.082380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:01.082902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:01.083346 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:01.084679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:01.085139 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:01.085598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:01.220886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:01.229043 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2f401ec0-9726-476e-b166-c6bc93d981e6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1564 microversion: 2.1 time: 0.162419 Oct 29 21:53:01.229677 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3525/7140] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:01 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:01.252850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:01.253524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:01.255418 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:01.261686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:01.262200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:01.262665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:01.263390 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:01.263874 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:01.264329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:01.398778 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:01.406654 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-42a5edfb-bd4d-4181-ae34-1a77c1abf50f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1564 microversion: 2.1 time: 0.158148 Oct 29 21:53:01.407235 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3616/7141] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:01 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:03.303251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:03.303885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:03.306276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3615e0e0-4cdd-493c-852f-b4d499797862 req-bc2a2a99-c0f4-4cad-8a83-994c202c859b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed94f35-0c68-40b0-8a04-0a332960360f", "tag": "a9c1e1bb-a6a5-4822-b737-93ee32c68369"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:03.310966 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:03.311704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:03.312155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:03.312874 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:03.313340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:03.313809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:03.317721 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3615e0e0-4cdd-493c-852f-b4d499797862 req-bc2a2a99-c0f4-4cad-8a83-994c202c859b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:03.318285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3615e0e0-4cdd-493c-852f-b4d499797862 req-bc2a2a99-c0f4-4cad-8a83-994c202c859b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:03.319563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3615e0e0-4cdd-493c-852f-b4d499797862 req-bc2a2a99-c0f4-4cad-8a83-994c202c859b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:03.331529 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3615e0e0-4cdd-493c-852f-b4d499797862 req-bc2a2a99-c0f4-4cad-8a83-994c202c859b service nova] Creating event network-changed:a9c1e1bb-a6a5-4822-b737-93ee32c68369 for instance 6ed94f35-0c68-40b0-8a04-0a332960360f on nch2-master-1 Oct 29 21:53:03.340070 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3615e0e0-4cdd-493c-852f-b4d499797862 req-bc2a2a99-c0f4-4cad-8a83-994c202c859b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 Oct 29 21:53:03.341081 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3617/7142] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:53:03.458779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:03.467938 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cfb5f2b4-cd85-4bf3-9329-4bc22461eb3f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1564 microversion: 2.1 time: 0.168693 Oct 29 21:53:03.468730 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3526/7143] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:03 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:28.756951 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:28.759345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:28.762358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=9 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:28.763024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=38 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:28.769695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:28.770208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:28.770673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:28.771991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:28.772477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:28.772933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:28.825844 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1e929be9-e851-4c78-b425-0b8873fd6fe1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action" status: 200 len: 24567 microversion: 2.1 time: 0.073495 Oct 29 21:53:28.826495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3618/7144] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:53:28 2022] POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:53:39.890712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:39.891371 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:39.893259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:39.893942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=36 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:39.901607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:39.902096 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:39.902536 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:39.903231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:39.903688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:39.904118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:39.970342 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2e7fd5a-2c71-44c6-ab16-c3d21764b329 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action" status: 202 len: 0 microversion: 2.1 time: 0.083452 Oct 29 21:53:39.971261 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3527/7145] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:53:39 2022] POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:53:39.980259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:39.980980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:39.985040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:39.985829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:39.992734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:39.993241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:39.993737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:39.995131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:39.995660 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:39.996277 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:40.137537 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:40.146369 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c145e686-c3cc-41ec-ac14-11bd5a48fb56 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1687 microversion: 2.1 time: 0.170026 Oct 29 21:53:40.147012 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3619/7146] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:39 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:41.171656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:41.172374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:41.179514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:41.180037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:41.180488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:41.181192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:41.181688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:41.182126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:41.313533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:41.322390 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2df19aa0-66f9-4a7e-8bfd-83e1b0414074 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1667 microversion: 2.1 time: 0.155081 Oct 29 21:53:41.322969 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3528/7147] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:41 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:42.420899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:42.423149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:42.430959 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:42.431471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:42.431936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:42.432658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:42.433140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:42.433880 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:42.493779 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b53985f2-e74d-4a97-b203-909522cfaaa9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action" status: 200 len: 32638 microversion: 2.1 time: 0.076780 Oct 29 21:53:42.494725 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3620/7148] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:53:42 2022] POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:53:42.506014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:42.506561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:42.513429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:42.513955 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:42.514407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:42.515109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:42.515573 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:42.516014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:42.580178 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f95c9d86-ed44-494f-a7df-bfc8410adc51 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action" status: 202 len: 0 microversion: 2.1 time: 0.077882 Oct 29 21:53:42.584667 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3529/7149] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:53:42 2022] POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:53:42.590533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:42.591265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:42.598574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:42.599772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:42.600196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:42.601069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:42.601665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:42.602123 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:42.739283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:42.747826 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d5c27019-1ca3-4fe2-9632-dca0f64ff8a9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1674 microversion: 2.1 time: 0.161624 Oct 29 21:53:42.748404 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3621/7150] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:42 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:53:43.774438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:43.775159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:43.781359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:43.781954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:43.782400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:43.783100 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:43.783563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:43.783998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:43.915065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:43.922963 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-91b48691-b038-4e69-aef6-e4594fe5b9fd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1682 microversion: 2.1 time: 0.154333 Oct 29 21:53:43.923546 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3530/7151] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:43 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:44.021393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:44.023696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:44.031555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:44.032008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:44.032473 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:44.033194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:44.033715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:44.034171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:44.096080 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b26fae20-8fb7-4cee-a62e-ac0029717570 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action" status: 200 len: 38407 microversion: 2.1 time: 0.078552 Oct 29 21:53:44.096750 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3622/7152] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:53:44 2022] POST /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f/action => generated 38407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:53:45.733414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:45.733974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:45.736368 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-863be5c7-e09a-4286-960f-582a991d3bb0 req-03e6a5a7-3298-4947-a63d-680bf2777641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed94f35-0c68-40b0-8a04-0a332960360f", "tag": "a9c1e1bb-a6a5-4822-b737-93ee32c68369"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:45.740985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:45.741733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:45.742380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:45.743094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:45.743561 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:45.743995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:45.747591 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-863be5c7-e09a-4286-960f-582a991d3bb0 req-03e6a5a7-3298-4947-a63d-680bf2777641 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:45.748093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-863be5c7-e09a-4286-960f-582a991d3bb0 req-03e6a5a7-3298-4947-a63d-680bf2777641 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:45.748545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-863be5c7-e09a-4286-960f-582a991d3bb0 req-03e6a5a7-3298-4947-a63d-680bf2777641 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:45.764325 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-863be5c7-e09a-4286-960f-582a991d3bb0 req-03e6a5a7-3298-4947-a63d-680bf2777641 service nova] Creating event network-changed:a9c1e1bb-a6a5-4822-b737-93ee32c68369 for instance 6ed94f35-0c68-40b0-8a04-0a332960360f on nch2-master-1 Oct 29 21:53:45.770106 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-863be5c7-e09a-4286-960f-582a991d3bb0 req-03e6a5a7-3298-4947-a63d-680bf2777641 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037905 Oct 29 21:53:45.772112 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3623/7153] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:53:45.774466 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:53:45.861884 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3ff3b721-df72-42e8-aa85-b84a6f2f2d26 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 204 len: 0 microversion: 2.1 time: 0.132080 Oct 29 21:53:45.865925 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3531/7154] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:53:45 2022] DELETE /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:53:45.871921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:45.873996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:45.882788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:45.883304 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:45.883768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:45.884536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:45.885037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:45.885519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:46.024463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:46.032271 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-295dbcfe-1132-4d2e-9cd7-89d6c03cf44e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1688 microversion: 2.1 time: 0.164874 Oct 29 21:53:46.032984 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3624/7155] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:45 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:47.056933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:47.057683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:47.064411 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:47.064895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:47.065338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:47.066056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:47.066513 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:47.066941 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:47.202766 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:47.211563 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dcb74f86-5cc1-44f9-9bc5-168efc953e3b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1688 microversion: 2.1 time: 0.158868 Oct 29 21:53:47.212148 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3532/7156] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:47 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:48.104735 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-62e35547-2e4a-44eb-acbf-c4c5c90da21d req-7dd1ca74-57ff-44a1-95b4-33b889fea8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed94f35-0c68-40b0-8a04-0a332960360f", "name": "network-vif-deleted", "tag": "a9c1e1bb-a6a5-4822-b737-93ee32c68369"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:48.119153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-62e35547-2e4a-44eb-acbf-c4c5c90da21d req-7dd1ca74-57ff-44a1-95b4-33b889fea8cb service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:48.119726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-62e35547-2e4a-44eb-acbf-c4c5c90da21d req-7dd1ca74-57ff-44a1-95b4-33b889fea8cb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:48.120354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-62e35547-2e4a-44eb-acbf-c4c5c90da21d req-7dd1ca74-57ff-44a1-95b4-33b889fea8cb service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:48.131712 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-62e35547-2e4a-44eb-acbf-c4c5c90da21d req-7dd1ca74-57ff-44a1-95b4-33b889fea8cb service nova] Creating event network-vif-deleted:a9c1e1bb-a6a5-4822-b737-93ee32c68369 for instance 6ed94f35-0c68-40b0-8a04-0a332960360f on nch2-master-1 Oct 29 21:53:48.138372 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-62e35547-2e4a-44eb-acbf-c4c5c90da21d req-7dd1ca74-57ff-44a1-95b4-33b889fea8cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037340 Oct 29 21:53:48.139206 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3625/7157] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:53:48.235353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:48.235914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:48.244079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:48.244657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:48.245192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:48.245967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:48.246433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:48.246869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:48.278279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:48.278773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:48.279219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:48.279671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lazy-loading 'fault' on Instance uuid 6ed94f35-0c68-40b0-8a04-0a332960360f {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:53:48.321174 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:48.330161 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-764ccc0d-45f6-417b-ba53-850f8d47f0d6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 200 len: 1357 microversion: 2.1 time: 0.098778 Oct 29 21:53:48.330737 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3533/7158] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:48 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:49.354966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:49.355737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 6ed94f35-0c68-40b0-8a04-0a332960360f] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:49.362987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:49.363498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:49.363963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:49.365200 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:49.365716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:49.366175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:49.379520 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] HTTP exception thrown: Instance 6ed94f35-0c68-40b0-8a04-0a332960360f could not be found. Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Request method failure captured: Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f HTTP/1.1 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXaCrjH68_3cWXO3KTmpsanXE7DrSGcFx2MBXqVLDFpo78gcJJ2WjIbzUDPONXYo-JIeg78oeiMDhXMEE3etuXmP7ndrZHCVNaJXQUulGzUbvL-0k3MHnBYBrMuQH5MaZG3fI4tMmcAX7gh951eue9dVO4yHkgQ533Rf4Y3A_OORT26A Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 13935e9e808b461599903c800dfa1ded Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13935e9e808b461599903c800dfa1ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13935e9e808b461599903c800dfa1ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 13935e9e808b461599903c800dfa1ded Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4974b30378694c8b9f92e5a36b5ea53b Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 6ed94f35-0c68-40b0-8a04-0a332960360f could not be found. Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '6ed94f35-0c68-40b0-8a04-0a332960360f'} Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed94f35-0c68-40b0-8a04-0a332960360f could not be found. Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed94f35-0c68-40b0-8a04-0a332960360f could not be found. Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:53:49.381909 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed94f35-0c68-40b0-8a04-0a332960360f could not be found. Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Returning 404 to user: Instance 6ed94f35-0c68-40b0-8a04-0a332960360f could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4593e276-aa22-43df-8543-8e6b50e65e0f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f" status: 404 len: 111 microversion: 2.1 time: 0.032745 Oct 29 21:53:49.387646 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3626/7159] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:49 2022] GET /compute/v2.1/servers/6ed94f35-0c68-40b0-8a04-0a332960360f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:53:52.701388 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2ec3a490-efcf-4b8b-ba3e-c2c97bd82f46 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '.version_select at 0x7fa170a174c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:52.722944 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2ec3a490-efcf-4b8b-ba3e-c2c97bd82f46 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1484607947" status: 202 len: 0 microversion: 2.1 time: 0.025244 Oct 29 21:53:52.723355 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3534/7160] 10.222.0.36 () {58 vars in 1284 bytes} [Sat Oct 29 21:53:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1484607947 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:53:52.752751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-332fe09e-3d2e-4d30-94f8-ed7a086f6c64 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: .version_select at 0x7fa1711f7670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-765492258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIeifhUYnxmkekYpaFTmis6UdJ3787ErWxXbwUcPGJ4UsCYot84aSLg6AlVjBdhXJZiSQI+wqY27HvFw6crX2dvA5vSGjLB6V+drFtfBCysGDjrOC50R0dqaJTH98AooA=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:52.773720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-332fe09e-3d2e-4d30-94f8-ed7a086f6c64 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:53:52.778944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-332fe09e-3d2e-4d30-94f8-ed7a086f6c64 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:53:52.803148 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-332fe09e-3d2e-4d30-94f8-ed7a086f6c64 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054682 Oct 29 21:53:52.804399 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3627/7161] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:53:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:53:57.980420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-667243146", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "77c9931e-cc02-4069-9d2e-b9118cca6235"}], "key_name": "tempest-TestNetworkAdvancedServerOps-765492258", "security_groups": [{"name": "tempest-secgroup-smoke-1894554499"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:53:58.102611 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] validate_networks() for [('77c9931e-cc02-4069-9d2e-b9118cca6235', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:53:58.326184 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:53:58.613166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:53:58.613703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:53:58.614362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:53:58.615463 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:53:58.616071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:53:58.625677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:58.626537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:58.627352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:58.628115 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:58.628587 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:58.629025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:58.648904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:53:58.655524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:53:58.669934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:53:58.672308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:53:58.724578 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-04149278-1b29-46df-8489-85dd2317e5ac tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748734 Oct 29 21:53:58.731812 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3535/7162] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:53:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:53:58.737113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c4b7e922-9388-4987-b3f8-7db03955c6b6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:58.737773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c4b7e922-9388-4987-b3f8-7db03955c6b6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:58.820523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c4b7e922-9388-4987-b3f8-7db03955c6b6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:58.827787 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c4b7e922-9388-4987-b3f8-7db03955c6b6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1265 microversion: 2.1 time: 0.094552 Oct 29 21:53:58.828816 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3628/7163] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:58 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:53:59.854755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:53:59.855310 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:53:59.862515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:59.863022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:59.863472 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:59.866444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:53:59.867654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:53:59.868275 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:53:59.948666 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:53:59.957349 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d61bfe6f-f8fe-4180-a68a-769f6981f51f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1325 microversion: 2.1 time: 0.108443 Oct 29 21:53:59.959350 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3536/7164] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:53:59 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1325 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:00.981923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:00.982574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:00.988649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=32 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:00.992261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:00.993597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:00.993597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:00.994166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:00.994793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:00.995178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:01.148912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:01.157843 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab3acd82-2d2a-4275-b179-a35fdea8d9f2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.179569 Oct 29 21:54:01.158676 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3629/7165] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:00 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:01.547856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f311349f-4d56-4dd4-bdf9-15ea324e3d18 req-b3bb159b-d7ba-4598-a464-ee7dd8bfe629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13e998e-1990-44c6-b66e-8d68e1680e64", "tag": "49b16a14-7418-4604-a9dc-c5331cfa1842"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:54:01.560668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f311349f-4d56-4dd4-bdf9-15ea324e3d18 req-b3bb159b-d7ba-4598-a464-ee7dd8bfe629 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:01.561152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f311349f-4d56-4dd4-bdf9-15ea324e3d18 req-b3bb159b-d7ba-4598-a464-ee7dd8bfe629 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:01.561811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f311349f-4d56-4dd4-bdf9-15ea324e3d18 req-b3bb159b-d7ba-4598-a464-ee7dd8bfe629 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:01.573531 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f311349f-4d56-4dd4-bdf9-15ea324e3d18 req-b3bb159b-d7ba-4598-a464-ee7dd8bfe629 service nova] Creating event network-changed:49b16a14-7418-4604-a9dc-c5331cfa1842 for instance b13e998e-1990-44c6-b66e-8d68e1680e64 on nch1-master-1 Oct 29 21:54:01.579751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f311349f-4d56-4dd4-bdf9-15ea324e3d18 req-b3bb159b-d7ba-4598-a464-ee7dd8bfe629 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037865 Oct 29 21:54:01.580541 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3537/7166] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:54:02.182388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:02.183109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:02.190398 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:02.190975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:02.191500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:02.192288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:02.193421 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:02.193979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:02.332003 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:02.340334 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e709231-5fbe-4ecf-8f85-17b778bcc7d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.162054 Oct 29 21:54:02.340924 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3630/7167] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:02 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:03.365263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:03.366037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:03.373129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:03.373657 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:03.374106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:03.374810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:03.375269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:03.375699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:03.513429 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:03.521132 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6e3d8dda-44d1-4395-8737-ffb6d71dd85f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.160731 Oct 29 21:54:03.521752 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3538/7168] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:03 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:54:04.545048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:04.546722 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:04.558030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:04.559567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:04.560219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:04.561171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:04.561767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:04.562276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:04.696754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:04.705604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b43cebfa-758b-4d07-9650-389153224cec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.164706 Oct 29 21:54:04.706140 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3631/7169] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:04 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:05.732187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:05.733743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:05.741651 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:05.742248 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:05.742768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:05.743544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:05.744094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:05.744592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:05.882074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:05.890081 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fbe4f803-036f-4b1f-ac30-b05d582179a7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.165746 Oct 29 21:54:05.890660 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3539/7170] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:05 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:06.912289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:06.912930 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:06.920505 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:06.921012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:06.921489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:06.922209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:06.922685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:06.923135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:07.055310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:07.063203 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3fe86cdf-bfff-4f30-9198-223f5049512c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.154886 Oct 29 21:54:07.063784 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3632/7171] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:06 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:07.331735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-28e93911-304e-4c6e-ac8c-9802500961c3 req-4ec8292a-49a9-4cf4-b25b-7635dcdb6cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13e998e-1990-44c6-b66e-8d68e1680e64", "name": "network-vif-plugged", "status": "completed", "tag": "49b16a14-7418-4604-a9dc-c5331cfa1842"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:54:07.343911 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-28e93911-304e-4c6e-ac8c-9802500961c3 req-4ec8292a-49a9-4cf4-b25b-7635dcdb6cc5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:07.344384 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-28e93911-304e-4c6e-ac8c-9802500961c3 req-4ec8292a-49a9-4cf4-b25b-7635dcdb6cc5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:07.344821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-28e93911-304e-4c6e-ac8c-9802500961c3 req-4ec8292a-49a9-4cf4-b25b-7635dcdb6cc5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:07.356733 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-28e93911-304e-4c6e-ac8c-9802500961c3 req-4ec8292a-49a9-4cf4-b25b-7635dcdb6cc5 service nova] Creating event network-vif-plugged:49b16a14-7418-4604-a9dc-c5331cfa1842 for instance b13e998e-1990-44c6-b66e-8d68e1680e64 on nch1-master-1 Oct 29 21:54:07.361764 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-28e93911-304e-4c6e-ac8c-9802500961c3 req-4ec8292a-49a9-4cf4-b25b-7635dcdb6cc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Oct 29 21:54:07.362359 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3540/7172] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:54:08.087525 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:08.088166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:08.095152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:08.095661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:08.096124 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:08.096844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:08.097323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:08.097812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:08.231830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:08.240124 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7190b946-a0bb-4e3f-8ad5-6f21d09ec756 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1391 microversion: 2.1 time: 0.155913 Oct 29 21:54:08.240704 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3633/7173] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:08 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:09.262285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:09.263129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:09.267565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:09.268319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:09.276192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:09.276676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:09.277118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:09.277863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:09.278324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:09.278758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:09.410195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:09.418075 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9f05509d-841e-4837-9d86-8165d4fcf86d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1562 microversion: 2.1 time: 0.157594 Oct 29 21:54:09.418658 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3541/7174] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:09 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:09.440832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:09.441507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:09.444023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:09.450383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:09.450898 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:09.451363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:09.452097 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:09.452581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:09.453037 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:09.588740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:09.596585 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-310a8a2e-679c-41ea-b7b3-cc39f2a711ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1562 microversion: 2.1 time: 0.159657 Oct 29 21:54:09.597219 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3634/7175] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:09 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:11.170842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:54:11.171859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:11.176485 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-2ecb3e46-899a-4266-9da2-b63a66e6b75f req-97054b8e-3cc3-4384-a90c-b3036574c0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13e998e-1990-44c6-b66e-8d68e1680e64", "tag": "49b16a14-7418-4604-a9dc-c5331cfa1842"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:54:11.178734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:11.180143 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:11.180642 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:11.181188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:11.181852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:11.182322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:11.182758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:11.184520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:11.189928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ecb3e46-899a-4266-9da2-b63a66e6b75f req-97054b8e-3cc3-4384-a90c-b3036574c0d8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:11.190518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ecb3e46-899a-4266-9da2-b63a66e6b75f req-97054b8e-3cc3-4384-a90c-b3036574c0d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:11.191071 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-2ecb3e46-899a-4266-9da2-b63a66e6b75f req-97054b8e-3cc3-4384-a90c-b3036574c0d8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:11.204014 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-2ecb3e46-899a-4266-9da2-b63a66e6b75f req-97054b8e-3cc3-4384-a90c-b3036574c0d8 service nova] Creating event network-changed:49b16a14-7418-4604-a9dc-c5331cfa1842 for instance b13e998e-1990-44c6-b66e-8d68e1680e64 on nch1-master-1 Oct 29 21:54:11.211006 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-2ecb3e46-899a-4266-9da2-b63a66e6b75f req-97054b8e-3cc3-4384-a90c-b3036574c0d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038164 Oct 29 21:54:11.212304 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3635/7176] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:54:11.340359 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:54:11.349616 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b7b133e6-3aff-4872-90b4-8d1566ff37d4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1562 microversion: 2.1 time: 0.182126 Oct 29 21:54:11.350346 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3542/7177] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:54:11 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:54:44.955352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=38 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:44.956050 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:54:44.961305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:54:44.963659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:54:44.970715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:44.971228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:44.971695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:44.972426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:54:44.972909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:54:44.973369 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:54:45.038479 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a024794e-fb0c-41f5-aad8-f8d2f319e784 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action" status: 200 len: 24566 microversion: 2.1 time: 0.085216 Oct 29 21:54:45.039141 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3636/7178] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:54:44 2022] POST /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action => generated 24566 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:55:15.520588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:55:15.521260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=36 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:55:15.526141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:55:15.528454 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:15.535131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:15.535620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:15.536064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:15.536758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:15.537281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:15.537748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:15.610455 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f8d54872-34fc-46d4-b129-ac28b8cadd2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action" status: 202 len: 0 microversion: 2.1 time: 0.091568 Oct 29 21:55:15.611402 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3543/7179] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:55:15 2022] POST /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:55:15.622010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:15.622734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:15.625303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:55:15.626162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:55:15.634793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:15.635306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:15.635783 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:15.636488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:15.636957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:15.637404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:15.776970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:15.785032 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9651f6d8-24e0-4971-a415-fec7a30b6811 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1673 microversion: 2.1 time: 0.167625 Oct 29 21:55:15.785642 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3637/7180] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:15 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:16.809930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:16.810661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:16.818198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:16.819262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:16.819706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:16.820400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:16.820857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:16.821286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:16.954130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:16.962153 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3bf68800-3b33-4f62-8f54-83c790364f21 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.156613 Oct 29 21:55:16.962728 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3544/7181] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:16 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:17.986904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:17.987547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:17.994856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:17.995362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:17.995826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:17.996542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:17.997024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:17.997496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:18.125641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:18.133976 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2c4cbd6f-d211-4793-9b18-12549216844b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.151081 Oct 29 21:55:18.134547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3638/7182] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:17 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:19.158008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:19.158638 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:19.166173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:19.166668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:19.167119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:19.167825 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:19.168290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:19.168729 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:19.305822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:19.313751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-79288436-6dad-46e2-9693-fef75cbfb400 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.159729 Oct 29 21:55:19.314347 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3545/7183] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:19 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:20.337638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:20.338310 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:20.345147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:20.345687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:20.346147 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:20.346854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:20.347328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:20.347768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:20.477449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:20.485298 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-971e247b-f090-40aa-931e-407017669900 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.151916 Oct 29 21:55:20.486021 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3639/7184] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:20 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:21.510007 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:21.510662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:21.517439 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:21.517958 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:21.518399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:21.519095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:21.519554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:21.519983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:21.650582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:21.658362 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-be0ed034-cfe3-48cb-90b8-cb0f36fd1f75 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.152363 Oct 29 21:55:21.658933 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3546/7185] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:21 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:22.682231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:22.682905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:22.689839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:22.690347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:22.690809 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:22.691524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:22.692001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:22.692452 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:22.826666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:22.835210 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-932631d7-6571-4098-acb2-33d161e316cd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.157610 Oct 29 21:55:22.835783 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3640/7186] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:22 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:23.859370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:23.859942 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:23.867317 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:23.867812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:23.868333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:23.869045 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:23.869555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:23.869994 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:23.999193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:24.007181 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b1310fe-1e39-42e6-a051-4bf150e3f275 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.151850 Oct 29 21:55:24.007768 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3547/7187] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:23 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:25.030649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:25.031317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:25.038819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:25.039327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:25.039790 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:25.040507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:25.040985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:25.041437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:25.177269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:25.185179 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-929d9aff-8b8c-4cd5-abae-91560d4c9122 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.158516 Oct 29 21:55:25.185821 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3641/7188] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:25 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:26.208896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:26.209494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:26.215745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:26.216230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:26.216674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:26.217377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:26.217869 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:26.218302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:26.349078 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:26.357346 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1e52231e-ff2f-4f06-b8c1-68bc05a405de tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1678 microversion: 2.1 time: 0.153008 Oct 29 21:55:26.357948 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3548/7189] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:26 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:27.380416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:55:27.381051 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:27.388070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:27.388571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:27.389026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:27.389769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:27.390247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:27.390691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:27.523090 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:55:27.530868 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-be047cef-370d-47d1-b17f-63e413bc8ea5 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1681 microversion: 2.1 time: 0.154583 Oct 29 21:55:27.531423 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3642/7190] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:55:27 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:55:59.750873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:55:59.753025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:55:59.755485 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:55:59.756155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:55:59.757731 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:55:59.757904 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 21:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action (ip 10.222.0.36) !!! Oct 29 21:55:59.766003 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:59.766494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:59.766935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:59.767635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:55:59.768093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:55:59.768519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:55:59.841765 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c0798394-0836-45c4-a941-29d9b9ab8b5a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action" status: 200 len: 69081 microversion: 2.1 time: 0.094677 Oct 29 21:55:59.842437 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3549/7191] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:55:59 2022] POST /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64/action => generated 69081 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:56:23.395291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:23.395833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:23.399651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=12 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:23.400449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=36 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:23.401917 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:56:23.402089 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 (ip 10.222.0.36) !!! Oct 29 21:56:23.403165 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 21:56:23.403502 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 21:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 (ip 10.222.0.36) !!! Oct 29 21:56:23.406556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:23.410500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:23.416388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:23.416894 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:23.417594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:23.418530 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:23.419007 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:23.419605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:23.450041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:56:23.498329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-5d15c2b9-01d3-4110-8282-e37c815163f1 req-f51586dd-609b-435d-9c2d-93600dac48cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13e998e-1990-44c6-b66e-8d68e1680e64", "tag": "49b16a14-7418-4604-a9dc-c5331cfa1842"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:23.512780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5d15c2b9-01d3-4110-8282-e37c815163f1 req-f51586dd-609b-435d-9c2d-93600dac48cd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:23.513186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5d15c2b9-01d3-4110-8282-e37c815163f1 req-f51586dd-609b-435d-9c2d-93600dac48cd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:23.514108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-5d15c2b9-01d3-4110-8282-e37c815163f1 req-f51586dd-609b-435d-9c2d-93600dac48cd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:23.525411 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-5d15c2b9-01d3-4110-8282-e37c815163f1 req-f51586dd-609b-435d-9c2d-93600dac48cd service nova] Creating event network-changed:49b16a14-7418-4604-a9dc-c5331cfa1842 for instance b13e998e-1990-44c6-b66e-8d68e1680e64 on nch1-master-1 Oct 29 21:56:23.532113 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-5d15c2b9-01d3-4110-8282-e37c815163f1 req-f51586dd-609b-435d-9c2d-93600dac48cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137586 Oct 29 21:56:23.533091 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3550/7192] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:56:23.542382 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7ead3183-d619-4eb9-a153-a76cb652863b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 204 len: 0 microversion: 2.1 time: 0.150623 Oct 29 21:56:23.543349 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3643/7193] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:56:23 2022] DELETE /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 21:56:23.552436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:23.553144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:23.560021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:23.560522 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:23.560954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:23.561692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:23.562155 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:23.562584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:23.765113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:23.773085 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c4b557d1-fe1e-4f1a-a7a3-ac0e0072ea8c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1687 microversion: 2.1 time: 0.225357 Oct 29 21:56:23.773694 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3551/7194] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:23 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1687 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:56:24.797988 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:24.798640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:24.805817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:24.806335 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:24.806803 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:24.808131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:24.808612 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:24.809070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:24.999845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:25.008003 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-456c5a5f-6830-4b85-81d9-0006795f3e90 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1687 microversion: 2.1 time: 0.214507 Oct 29 21:56:25.008635 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3644/7195] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:24 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1687 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:26.020837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a4185b76-a042-40c9-bcd6-c1a7f177a710 req-6e8fe92a-2dbb-4f5b-8175-ada7ef694ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13e998e-1990-44c6-b66e-8d68e1680e64", "name": "network-vif-deleted", "tag": "49b16a14-7418-4604-a9dc-c5331cfa1842"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:26.032737 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:26.033374 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:26.034368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a4185b76-a042-40c9-bcd6-c1a7f177a710 req-6e8fe92a-2dbb-4f5b-8175-ada7ef694ce1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:26.034889 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a4185b76-a042-40c9-bcd6-c1a7f177a710 req-6e8fe92a-2dbb-4f5b-8175-ada7ef694ce1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:26.035366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a4185b76-a042-40c9-bcd6-c1a7f177a710 req-6e8fe92a-2dbb-4f5b-8175-ada7ef694ce1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:26.041743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:26.042628 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:26.043093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:26.043852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:26.044325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:26.044775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:26.049707 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a4185b76-a042-40c9-bcd6-c1a7f177a710 req-6e8fe92a-2dbb-4f5b-8175-ada7ef694ce1 service nova] Creating event network-vif-deleted:49b16a14-7418-4604-a9dc-c5331cfa1842 for instance b13e998e-1990-44c6-b66e-8d68e1680e64 on nch1-master-1 Oct 29 21:56:26.056754 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a4185b76-a042-40c9-bcd6-c1a7f177a710 req-6e8fe92a-2dbb-4f5b-8175-ada7ef694ce1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039758 Oct 29 21:56:26.058215 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3552/7196] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:56:26.111924 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:26.120515 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f409f7ef-422b-42d6-b71c-96eb6e1de03a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 200 len: 1500 microversion: 2.1 time: 0.091677 Oct 29 21:56:26.121775 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3645/7197] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:26 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 1500 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:27.145791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:27.146508 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: b13e998e-1990-44c6-b66e-8d68e1680e64] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:27.153636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:27.154167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:27.154620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:27.155329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:27.155796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:27.156235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:27.172244 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] HTTP exception thrown: Instance b13e998e-1990-44c6-b66e-8d68e1680e64 could not be found. Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Request method failure captured: Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 HTTP/1.1 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXaCrjH68_3cWXO3KTmpsanXE7DrSGcFx2MBXqVLDFpo78gcJJ2WjIbzUDPONXYo-JIeg78oeiMDhXMEE3etuXmP7ndrZHCVNaJXQUulGzUbvL-0k3MHnBYBrMuQH5MaZG3fI4tMmcAX7gh951eue9dVO4yHkgQ533Rf4Y3A_OORT26A Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 13935e9e808b461599903c800dfa1ded Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13935e9e808b461599903c800dfa1ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13935e9e808b461599903c800dfa1ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 13935e9e808b461599903c800dfa1ded Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 4974b30378694c8b9f92e5a36b5ea53b Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance b13e998e-1990-44c6-b66e-8d68e1680e64 could not be found. Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': 'b13e998e-1990-44c6-b66e-8d68e1680e64'} Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13e998e-1990-44c6-b66e-8d68e1680e64 could not be found. Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13e998e-1990-44c6-b66e-8d68e1680e64 could not be found. Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:56:27.173900 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13e998e-1990-44c6-b66e-8d68e1680e64 could not be found. Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Returning 404 to user: Instance b13e998e-1990-44c6-b66e-8d68e1680e64 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-685f68d7-1e69-4e85-b748-4638fe2d10db tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64" status: 404 len: 111 microversion: 2.1 time: 0.035012 Oct 29 21:56:27.179405 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3553/7198] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:27 2022] GET /compute/v2.1/servers/b13e998e-1990-44c6-b66e-8d68e1680e64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:56:30.187324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-3f2d2abd-8213-4022-b002-8786db195759 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '.version_select at 0x7fa176384af0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:30.219853 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-3f2d2abd-8213-4022-b002-8786db195759 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-765492258" status: 202 len: 0 microversion: 2.1 time: 0.036356 Oct 29 21:56:30.220519 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3646/7199] 10.222.0.36 () {58 vars in 1281 bytes} [Sat Oct 29 21:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-765492258 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:56:30.249584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-eec7577e-730b-49b4-8c82-494980bd58cb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: .version_select at 0x7fa171879790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1408786131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFektzqqLSVkX8wCPcFwpoM76bnGdowYe+R10LPnafVfvk/lrMjv0BE7/B6DAUlaKTH1fQB+HHUBH1RiX674Mf41zR42vgx4Y4btPHTrFbh7aronqPvRXYySmoo3IEWk/Q=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:30.265556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-eec7577e-730b-49b4-8c82-494980bd58cb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:56:30.271503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-eec7577e-730b-49b4-8c82-494980bd58cb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:56:30.306951 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-eec7577e-730b-49b4-8c82-494980bd58cb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058675 Oct 29 21:56:30.307705 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3554/7200] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:56:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:56:35.717798 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1226841272", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "4336f4d2-409c-43fb-955e-79931eb8f6dc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1408786131", "security_groups": [{"name": "tempest-secgroup-smoke-1270437733"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:35.837956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] validate_networks() for [('4336f4d2-409c-43fb-955e-79931eb8f6dc', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:56:36.116580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:36.446251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:56:36.446893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:56:36.447597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:56:36.448285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:56:36.449604 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:56:36.460717 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:36.461345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:36.461947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:36.462797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:36.463909 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:36.464774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:36.485907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:56:36.493025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:56:36.507253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:56:36.510723 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:56:36.585494 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-11d729ac-7647-48da-9e5b-ed079f11d067 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.873304 Oct 29 21:56:36.589657 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3647/7201] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:56:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:56:36.602877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-56c91314-9143-44bd-bd0b-f3442953908f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:36.603842 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-56c91314-9143-44bd-bd0b-f3442953908f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:36.676484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-56c91314-9143-44bd-bd0b-f3442953908f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:36.686785 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-56c91314-9143-44bd-bd0b-f3442953908f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1267 microversion: 2.1 time: 0.090263 Oct 29 21:56:36.688542 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3555/7202] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:36 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:37.714444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:37.715156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:37.731470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:37.732149 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:37.732772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:37.733584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:37.734296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:37.734780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:37.850429 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:37.861562 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-aef4134b-507c-4a76-aa16-facb765e18c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1327 microversion: 2.1 time: 0.153055 Oct 29 21:56:37.862772 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3648/7203] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:37 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:38.886557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:38.888080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:38.891341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:38.899377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:38.900087 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:38.900811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:38.902065 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:38.902702 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:38.903374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:39.134612 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:39.143766 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a551a236-50dc-44bc-9c0d-989550237f36 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.261703 Oct 29 21:56:39.144429 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3556/7204] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:38 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:39.508457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e48dd098-be86-4c39-9feb-7b11017196e1 req-85eb4b55-4db3-4d61-a3be-31aabab36643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:39.520362 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e48dd098-be86-4c39-9feb-7b11017196e1 req-85eb4b55-4db3-4d61-a3be-31aabab36643 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:39.520966 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e48dd098-be86-4c39-9feb-7b11017196e1 req-85eb4b55-4db3-4d61-a3be-31aabab36643 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:39.521518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e48dd098-be86-4c39-9feb-7b11017196e1 req-85eb4b55-4db3-4d61-a3be-31aabab36643 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:39.534571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e48dd098-be86-4c39-9feb-7b11017196e1 req-85eb4b55-4db3-4d61-a3be-31aabab36643 service nova] Creating event network-changed:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch2-master-1 Oct 29 21:56:39.540147 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e48dd098-be86-4c39-9feb-7b11017196e1 req-85eb4b55-4db3-4d61-a3be-31aabab36643 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 Oct 29 21:56:39.541183 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3649/7205] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:56:40.168061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:40.168685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:40.175489 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:40.175981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:40.176433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:40.177138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:40.177646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:40.178081 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:40.720590 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:40.728350 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1cf21887-ac32-4b82-b265-b269faab6714 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.564252 Oct 29 21:56:40.729546 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3557/7206] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:40 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:41.754424 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:41.755059 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:41.761811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:41.762318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:41.762770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:41.763478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:41.763949 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:41.764389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:41.899120 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:41.908071 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fa495219-483d-461f-adf2-f4e045dc95fb tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.158882 Oct 29 21:56:41.908656 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3650/7207] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:41 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:42.931113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:42.931733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:42.938570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:42.939052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:42.939494 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:42.940189 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:42.940675 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:42.941107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:43.070761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:43.078568 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ebb1ae56-820e-4a08-861f-668b7b3933b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.151375 Oct 29 21:56:43.079137 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3558/7208] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:42 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:44.102379 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:44.103020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:44.111548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:44.112052 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:44.112512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:44.113227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:44.113728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:44.114274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:44.257009 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:44.264979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-0507ecf9-d02a-4c37-b429-b398479c668c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.166527 Oct 29 21:56:44.265587 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3651/7209] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:44 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:45.288085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:45.288712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:45.295971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:45.296464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:45.296909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:45.297639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:45.298103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:45.298528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:45.427999 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:45.436270 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9437ccf-52de-4708-a710-92f0c995f581 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.152197 Oct 29 21:56:45.436855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3559/7210] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:45 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:45.958341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3c9c4f01-8b32-4093-a15a-056e5a9b5f95 req-2f436c97-e942-4126-851c-2687dec4e353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "name": "network-vif-plugged", "status": "completed", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:45.968819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c9c4f01-8b32-4093-a15a-056e5a9b5f95 req-2f436c97-e942-4126-851c-2687dec4e353 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:45.969315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c9c4f01-8b32-4093-a15a-056e5a9b5f95 req-2f436c97-e942-4126-851c-2687dec4e353 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:45.969807 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c9c4f01-8b32-4093-a15a-056e5a9b5f95 req-2f436c97-e942-4126-851c-2687dec4e353 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:45.981509 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3c9c4f01-8b32-4093-a15a-056e5a9b5f95 req-2f436c97-e942-4126-851c-2687dec4e353 service nova] Creating event network-vif-plugged:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch2-master-1 Oct 29 21:56:45.986706 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3c9c4f01-8b32-4093-a15a-056e5a9b5f95 req-2f436c97-e942-4126-851c-2687dec4e353 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091270 Oct 29 21:56:45.987315 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3652/7211] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:56:46.459935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:46.460576 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:46.468486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:46.468916 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:46.469360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:46.470157 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:46.470625 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:46.471056 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:46.605363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:46.613149 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c3703ef7-81b4-4d14-9f54-7c4f67099c2e tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1393 microversion: 2.1 time: 0.157393 Oct 29 21:56:46.613755 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3560/7212] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:46 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:47.633542 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:47.634344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:47.640129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:47.640862 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:47.648054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:47.648561 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:47.649019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:47.649775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:47.650259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:47.650706 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:47.783727 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:47.792115 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ab130960-d322-424d-8628-6ae398f013bd tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1564 microversion: 2.1 time: 0.159573 Oct 29 21:56:47.792692 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3653/7213] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:47 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:47.814915 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:47.815534 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:47.817406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:56:47.823724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:47.824210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:47.824654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:47.825345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:47.825831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:47.826261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:47.964287 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:47.972067 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ac579648-128a-41c1-9739-6253b10b9033 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1564 microversion: 2.1 time: 0.161034 Oct 29 21:56:47.972652 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3561/7214] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:47 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:56:49.541985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:56:49.543879 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:56:49.544315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-4e65b06f-3899-40b0-9190-438c89fe01ec req-7a705573-97ff-4d55-a80c-012e866469f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:56:49.551498 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:49.552065 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:49.552531 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:49.553523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:49.554013 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:49.554470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:49.555172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4e65b06f-3899-40b0-9190-438c89fe01ec req-7a705573-97ff-4d55-a80c-012e866469f6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:56:49.555924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4e65b06f-3899-40b0-9190-438c89fe01ec req-7a705573-97ff-4d55-a80c-012e866469f6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:56:49.556667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-4e65b06f-3899-40b0-9190-438c89fe01ec req-7a705573-97ff-4d55-a80c-012e866469f6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:56:49.568773 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-4e65b06f-3899-40b0-9190-438c89fe01ec req-7a705573-97ff-4d55-a80c-012e866469f6 service nova] Creating event network-changed:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch2-master-1 Oct 29 21:56:49.575036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-4e65b06f-3899-40b0-9190-438c89fe01ec req-7a705573-97ff-4d55-a80c-012e866469f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Oct 29 21:56:49.576431 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3562/7215] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:56:49.788800 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:56:49.797216 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-933a85be-52d4-4301-95ce-5f36b3d311d9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1564 microversion: 2.1 time: 0.260027 Oct 29 21:56:49.798070 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3654/7216] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:56:49 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1564 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:15.098557 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:57:15.099322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=38 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:57:15.103791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:57:15.106108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:15.114118 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:15.114606 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:15.115055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:15.115757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:15.116223 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:15.116658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:15.170237 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-63c4935b-ddfb-4506-a5ed-ec47cf94cbf9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action" status: 200 len: 24551 microversion: 2.1 time: 0.073608 Oct 29 21:57:15.170879 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3563/7217] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:57:15 2022] POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action => generated 24551 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:57:26.124652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:57:26.127046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:26.129280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:57:26.129996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=36 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:57:26.137115 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:26.137693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:26.138167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:26.138890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:26.139373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:26.139829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:26.185337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:26.191558 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Old instance type m1.heat2, new instance type m1.heat {{(pid=138885) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 21:57:26.198308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:57:26.198759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:57:26.199756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:57:26.200188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:57:26.200629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:57:26.266086 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-767a33db-aa4d-434c-b21a-62f15c0f412c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action" status: 202 len: 0 microversion: 2.1 time: 0.145534 Oct 29 21:57:26.269746 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3655/7218] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:57:26 2022] POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:57:26.275695 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:26.276416 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:26.279541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:57:26.280381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:57:26.286552 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:26.287098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:26.287518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:26.288234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:26.288802 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:26.289334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:26.463274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:26.471401 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-718f61e1-22cc-4815-bc29-d4d30cd75006 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1691 microversion: 2.1 time: 0.200145 Oct 29 21:57:26.472035 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3564/7219] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:26 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:27.498174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:27.498821 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:27.506487 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:27.506998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:27.507746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:27.508820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:27.509117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:27.510301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:27.644045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:27.651850 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5669f248-7765-41e1-91e8-32b25de23afc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1691 microversion: 2.1 time: 0.159102 Oct 29 21:57:27.652424 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3656/7220] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:27 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:28.675222 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:28.675878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:28.682863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:28.683871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:28.684319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:28.685022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:28.685514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:28.685954 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:28.828827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:28.838017 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-31fe4526-26fb-4132-87f9-0d23d497de47 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.166732 Oct 29 21:57:28.838594 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3565/7221] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:28 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:29.861694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:29.862333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:29.871624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:29.872132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:29.872592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:29.873336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:29.873838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:29.874286 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:30.004305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:30.012538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-08a6f16d-6e3d-4881-8b9f-c9ced0a2d142 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.154882 Oct 29 21:57:30.013116 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3657/7222] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:29 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:31.036425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:31.037028 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:31.044595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:31.045077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:31.045545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:31.046246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:31.046734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:31.047167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:31.175380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:31.183187 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c595406-0f76-4e82-b826-9ca8a2061c29 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.150665 Oct 29 21:57:31.183775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3566/7223] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:31 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:32.207516 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:32.208165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:32.214787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:32.215301 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:32.215765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:32.216489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:32.216970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:32.217444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:32.352389 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:32.360793 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fbbf1ca1-2a7c-4a52-b94b-f9a844819194 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.157510 Oct 29 21:57:32.361366 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3658/7224] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:32 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:57:33.384162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:33.384793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:33.392436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:33.392930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:33.393396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:33.394113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:33.394582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:33.395024 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:33.525162 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:33.533047 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16255b06-3d66-42fe-b7df-40d86cd357f3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.152915 Oct 29 21:57:33.533650 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3567/7225] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:33 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:34.556211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:34.556852 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:34.563857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:34.564358 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:34.564818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:34.565624 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:34.566100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:34.566547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:34.699845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:34.707647 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4ceda73f-6927-4e0d-828c-10cb1ffddc2d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.155390 Oct 29 21:57:34.708230 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3659/7226] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:34 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:35.732158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:35.732784 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:35.739692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:35.740187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:35.740634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:35.741341 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:35.741834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:35.742272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:35.873692 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:35.881571 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cb8c6625-6f39-4229-ab10-295772b69847 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.153449 Oct 29 21:57:35.882166 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3568/7227] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:35 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:36.906734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:36.907367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:36.914387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:36.914892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:36.915347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:36.916055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:36.916527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:36.916975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:37.048905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:37.056802 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-490b1c7d-a434-4b52-ad36-1b0b7a7fd143 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.154569 Oct 29 21:57:37.057381 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3660/7228] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:36 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:38.080720 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:38.081329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:38.088586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:38.089084 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:38.089566 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:38.090302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:38.090808 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:38.091244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:38.223621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:38.231967 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e91f5e41-0cce-491c-8684-18225122fce6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.154788 Oct 29 21:57:38.232547 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3569/7229] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:38 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:39.256132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:39.256793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:39.264232 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:39.264734 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:39.265195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:39.265941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:39.266414 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:39.266858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:39.399971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:39.408305 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5fd6fc8f-42f0-4738-a9ed-94821cbf6420 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.156113 Oct 29 21:57:39.408875 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3661/7230] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:39 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:40.432185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:40.432804 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:40.440912 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:40.441425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:40.441904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:40.442589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:40.443051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:40.443504 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:40.576415 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:40.584240 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b224001f-3e8b-48d3-b5a9-2ea758fdf835 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.155967 Oct 29 21:57:40.585084 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3570/7231] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:40 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:41.608316 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:41.608977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:41.615881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:41.616636 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:41.617096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:41.617830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:41.618306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:41.618747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:41.749541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:41.757408 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f84e58bc-5bd1-4fc1-b8a9-adb1b4dec297 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.153146 Oct 29 21:57:41.758002 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3662/7232] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:41 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:42.780782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:42.781372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:42.788244 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:42.788725 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:42.789164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:42.789880 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:42.790335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:42.790762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:42.923077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:42.930845 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1719b095-f028-45f0-a4f8-08f94890a877 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.154595 Oct 29 21:57:42.931421 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3571/7233] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:42 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:43.997651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:43.999000 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:44.005048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:44.005657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:44.006113 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:44.006851 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:44.007323 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:44.007772 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:44.141650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:44.149514 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f6d46769-2dd6-4cf0-b0a6-e720dea8aeb1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.199985 Oct 29 21:57:44.150101 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3663/7234] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:43 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:45.172076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:45.172698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:45.179582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:45.180055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:45.180498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:45.181196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:45.181684 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:45.182117 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:45.314436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:45.322209 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-836ec4c3-48a6-4cd8-9a38-bbb8d11bb079 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1696 microversion: 2.1 time: 0.154074 Oct 29 21:57:45.322781 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3572/7235] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:45 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:46.347285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:46.348085 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:46.354946 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:46.355449 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:46.355905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:46.356622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:46.357094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:46.357565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:46.616272 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:46.624355 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d42ec11c-d1ef-45d8-b6ba-231ebe8648d1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1695 microversion: 2.1 time: 0.281529 Oct 29 21:57:46.624936 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3664/7236] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:46 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1695 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:57:46.688102 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "name": "network-vif-unplugged", "status": "completed", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:57:46.698064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:46.698624 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:46.699201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:46.712622 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] Creating event network-vif-unplugged:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch1-master-1 Oct 29 21:57:46.718363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] Instance 5594f4cb-6a97-465c-baa8-93b612f81288 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:57:46.730147 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-cf1bff71-5471-4309-baa3-8da827618926 req-5248adb7-cdab-42f0-ba8b-8d7a1a2d880b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046676 Oct 29 21:57:46.730760 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3573/7237] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:57:47.648437 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:47.649082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:47.656695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:47.657209 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:47.657693 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:47.658420 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:47.658904 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:47.659354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:47.796041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:47.804433 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2af3f5bb-035d-4711-a7ee-b212481e2bfc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1695 microversion: 2.1 time: 0.159960 Oct 29 21:57:47.805005 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3665/7238] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:47 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:48.769279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:57:48.778981 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:48.779459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:48.779892 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:48.791196 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] Creating event network-changed:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch1-master-1 Oct 29 21:57:48.796933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] Instance 5594f4cb-6a97-465c-baa8-93b612f81288 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=138884) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 21:57:48.807789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-178e96fc-6612-4c64-a9b7-4ba1eaf99529 req-ff136e21-0232-486a-8c49-91cae05c54a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043547 Oct 29 21:57:48.808365 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3574/7239] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:57:48.832180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:48.833568 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:48.842536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:48.843046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:48.843520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:48.844247 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:48.844743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:48.845197 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:49.052598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:49.060398 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9a5a4ba-6937-463f-8f4c-0e9998e36d80 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1693 microversion: 2.1 time: 0.235746 Oct 29 21:57:49.061221 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3666/7240] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:48 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:50.086584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:50.087298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:50.093574 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:50.094061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:50.094497 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:50.095196 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:50.095670 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:50.096098 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:50.231605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:50.240120 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ec6ff8c4-6717-4d2b-94cf-0e89d1b866be tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1693 microversion: 2.1 time: 0.158981 Oct 29 21:57:50.240704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3575/7241] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:50 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:51.264404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:51.265045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:51.272455 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.272967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.273430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.274169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.274641 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.275088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.415644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:51.423662 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87475b87-59ec-41ed-b8d9-ae12a371ab04 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1690 microversion: 2.1 time: 0.163214 Oct 29 21:57:51.424258 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3667/7242] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:51 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:51.446770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:57:51.447328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:51.454787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.455283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.455734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.456443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.456909 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.457350 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.514128 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9b22a69b-2295-421f-bcd0-443342316ec4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action" status: 204 len: 0 microversion: 2.1 time: 0.070967 Oct 29 21:57:51.514703 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3576/7243] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:57:51 2022] POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:57:51.523512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:51.524294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:51.531555 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.532056 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.532508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.533220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.533718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.534164 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.743102 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:51.751717 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-64990d70-f6fd-4035-ab8e-5d2233346103 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1690 microversion: 2.1 time: 0.232147 Oct 29 21:57:51.752312 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3668/7244] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:51 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:51.775696 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:51.776340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:51.782569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.783053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.783492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.784192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:51.784648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:51.785817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:51.997705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:52.006314 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe2d3578-6182-4513-bf9e-35e6cae865b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1690 microversion: 2.1 time: 0.235335 Oct 29 21:57:52.006879 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3577/7245] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:51 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:53.030541 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:57:53.032203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:57:53.039582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:53.040360 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:53.040987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:53.041936 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:53.042580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:53.043201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:53.263674 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:57:53.271573 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63ec088c-7b7a-46c3-b13a-09702ae28259 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1682 microversion: 2.1 time: 0.245494 Oct 29 21:57:53.272146 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3669/7246] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:57:53 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:57:54.385271 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-9bf53d5d-fd39-44fb-9813-433938110753 req-d383b70a-0d97-47ff-9967-2cf99ba14de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "name": "network-vif-plugged", "status": "completed", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:57:54.396444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9bf53d5d-fd39-44fb-9813-433938110753 req-d383b70a-0d97-47ff-9967-2cf99ba14de4 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:57:54.397005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9bf53d5d-fd39-44fb-9813-433938110753 req-d383b70a-0d97-47ff-9967-2cf99ba14de4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:57:54.397668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-9bf53d5d-fd39-44fb-9813-433938110753 req-d383b70a-0d97-47ff-9967-2cf99ba14de4 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:57:54.410070 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-9bf53d5d-fd39-44fb-9813-433938110753 req-d383b70a-0d97-47ff-9967-2cf99ba14de4 service nova] Creating event network-vif-plugged:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch1-master-1 Oct 29 21:57:54.415699 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-9bf53d5d-fd39-44fb-9813-433938110753 req-d383b70a-0d97-47ff-9967-2cf99ba14de4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Oct 29 21:57:54.417258 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3578/7247] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:58:25.489256 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:58:25.491564 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:58:25.493686 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:58:25.494370 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:58:25.502647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:25.503162 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:25.503622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:25.504347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:25.504827 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:25.505279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:25.572650 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-25713e2b-0182-42a2-82a0-77a314068a45 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action" status: 200 len: 24580 microversion: 2.1 time: 0.088144 Oct 29 21:58:25.573495 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3670/7248] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:58:25 2022] POST /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288/action => generated 24580 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:58:49.743351 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:58:49.745043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:58:49.745499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:58:49.745839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:58:49.755870 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=30 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:58:49.757314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:58:49.763213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:49.763723 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:49.764225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:49.765166 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:49.766859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:49.767563 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:49.798881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 21:58:49.809477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ecf49b3f-5c78-43b2-b879-f415aea386c6 req-aca93d75-3ebe-41ea-b789-f0f1c26c3cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:58:49.822153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ecf49b3f-5c78-43b2-b879-f415aea386c6 req-aca93d75-3ebe-41ea-b789-f0f1c26c3cbd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:49.822762 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ecf49b3f-5c78-43b2-b879-f415aea386c6 req-aca93d75-3ebe-41ea-b789-f0f1c26c3cbd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:49.823290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ecf49b3f-5c78-43b2-b879-f415aea386c6 req-aca93d75-3ebe-41ea-b789-f0f1c26c3cbd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:49.835688 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ecf49b3f-5c78-43b2-b879-f415aea386c6 req-aca93d75-3ebe-41ea-b789-f0f1c26c3cbd service nova] Creating event network-changed:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch1-master-1 Oct 29 21:58:49.841398 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ecf49b3f-5c78-43b2-b879-f415aea386c6 req-aca93d75-3ebe-41ea-b789-f0f1c26c3cbd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101650 Oct 29 21:58:49.842439 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3671/7249] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:58:49.892445 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5c1fc504-2119-4bfd-81db-0acc248d05d2 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 204 len: 0 microversion: 2.1 time: 0.154908 Oct 29 21:58:49.896217 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3579/7250] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 21:58:49 2022] DELETE /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 21:58:49.914196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:58:49.915865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:58:49.922237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:49.922749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:49.923249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:49.923981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:49.924461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:49.924910 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:50.065997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:58:50.074142 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba7bfef5-f2c9-4cff-a528-6ad3654a4ce3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1688 microversion: 2.1 time: 0.164828 Oct 29 21:58:50.074958 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3672/7251] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:58:49 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:58:51.100247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:58:51.100978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:58:51.108867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:51.109358 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:51.109902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:51.110607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:51.111071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:51.111503 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:51.256543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:58:51.265291 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-530dd9be-3066-412a-badd-5ef2c13694b1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1688 microversion: 2.1 time: 0.169353 Oct 29 21:58:51.266723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3580/7252] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:58:51 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:58:51.947876 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-55c39d6d-a844-4c29-b4e3-d022edfdbe91 req-6e63b32a-9bb1-4a0f-8563-868918e5816e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5594f4cb-6a97-465c-baa8-93b612f81288", "name": "network-vif-deleted", "tag": "c1ebeec9-2c11-4c64-8e8a-230758a66f1e"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:58:51.958584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-55c39d6d-a844-4c29-b4e3-d022edfdbe91 req-6e63b32a-9bb1-4a0f-8563-868918e5816e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:51.959125 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-55c39d6d-a844-4c29-b4e3-d022edfdbe91 req-6e63b32a-9bb1-4a0f-8563-868918e5816e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:51.959562 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-55c39d6d-a844-4c29-b4e3-d022edfdbe91 req-6e63b32a-9bb1-4a0f-8563-868918e5816e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:51.971386 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-55c39d6d-a844-4c29-b4e3-d022edfdbe91 req-6e63b32a-9bb1-4a0f-8563-868918e5816e service nova] Creating event network-vif-deleted:c1ebeec9-2c11-4c64-8e8a-230758a66f1e for instance 5594f4cb-6a97-465c-baa8-93b612f81288 on nch1-master-1 Oct 29 21:58:51.976961 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-55c39d6d-a844-4c29-b4e3-d022edfdbe91 req-6e63b32a-9bb1-4a0f-8563-868918e5816e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032889 Oct 29 21:58:51.977591 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3673/7253] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:58:52.290924 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:58:52.291559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:58:52.298789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:52.299297 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:52.299765 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:52.300488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:52.301051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:52.301377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:52.339148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:52.339658 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:52.340101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:52.340565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lazy-loading 'fault' on Instance uuid 5594f4cb-6a97-465c-baa8-93b612f81288 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 21:58:52.382791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:58:52.391675 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-5dcab53f-a73d-4eb2-841c-d31789c2d326 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 200 len: 1357 microversion: 2.1 time: 0.104877 Oct 29 21:58:52.392266 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3581/7254] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:58:52 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:58:53.416748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:58:53.417491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 5594f4cb-6a97-465c-baa8-93b612f81288] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:58:53.423748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:53.424251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:53.424708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:53.425422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:58:53.425919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:58:53.426366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:58:53.439714 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] HTTP exception thrown: Instance 5594f4cb-6a97-465c-baa8-93b612f81288 could not be found. Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Request method failure captured: Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 HTTP/1.1 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXaCrjH68_3cWXO3KTmpsanXE7DrSGcFx2MBXqVLDFpo78gcJJ2WjIbzUDPONXYo-JIeg78oeiMDhXMEE3etuXmP7ndrZHCVNaJXQUulGzUbvL-0k3MHnBYBrMuQH5MaZG3fI4tMmcAX7gh951eue9dVO4yHkgQ533Rf4Y3A_OORT26A Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 13935e9e808b461599903c800dfa1ded Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13935e9e808b461599903c800dfa1ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13935e9e808b461599903c800dfa1ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 13935e9e808b461599903c800dfa1ded Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4974b30378694c8b9f92e5a36b5ea53b Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 5594f4cb-6a97-465c-baa8-93b612f81288 could not be found. Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '5594f4cb-6a97-465c-baa8-93b612f81288'} Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5594f4cb-6a97-465c-baa8-93b612f81288 could not be found. Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5594f4cb-6a97-465c-baa8-93b612f81288 could not be found. Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:58:53.441352 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5594f4cb-6a97-465c-baa8-93b612f81288 could not be found. Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Returning 404 to user: Instance 5594f4cb-6a97-465c-baa8-93b612f81288 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b3f05603-148a-4cc4-9d82-d529634e58e9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288" status: 404 len: 111 microversion: 2.1 time: 0.031332 Oct 29 21:58:53.447048 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3674/7255] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:58:53 2022] GET /compute/v2.1/servers/5594f4cb-6a97-465c-baa8-93b612f81288 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 21:58:56.827565 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-859c0b23-18cd-4c78-bab5-b29b36fbbe4d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '.version_select at 0x7fa1721b74c0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:58:56.849006 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-859c0b23-18cd-4c78-bab5-b29b36fbbe4d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1408786131" status: 202 len: 0 microversion: 2.1 time: 0.025322 Oct 29 21:58:56.849582 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3582/7256] 10.222.0.36 () {58 vars in 1284 bytes} [Sat Oct 29 21:58:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1408786131 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:58:56.876882 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b00ff412-f2f6-4fd0-b4e3-47dd513eb707 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: .version_select at 0x7fa1701c40d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1241767791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPX20FCo39AkEtoKpmKzJcDN0MmNfru+YGNSNOT1alW5qZoWYJN3KtkvhHV+e3bCkdQ7SPnRBPImDH/UwFdL/gy/YYNpES5jEhmFTgACiHLlYCrm+Rz36gKmYjss0jtBw=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:58:56.894257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b00ff412-f2f6-4fd0-b4e3-47dd513eb707 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:58:56.899372 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-b00ff412-f2f6-4fd0-b4e3-47dd513eb707 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:58:56.923711 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b00ff412-f2f6-4fd0-b4e3-47dd513eb707 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050298 Oct 29 21:58:56.924291 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3675/7257] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 21:58:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:59:02.474689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:02.479932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1699346961", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "bfcacd5e-969b-4f4c-8371-529acd6e010c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1241767791", "security_groups": [{"name": "tempest-secgroup-smoke-524702980"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:59:02.639423 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] validate_networks() for [('bfcacd5e-969b-4f4c-8371-529acd6e010c', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 21:59:03.155368 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 21:59:03.155875 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 21:59:03.156492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 21:59:03.157006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 21:59:03.157433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 21:59:03.166458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:03.166957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:03.167406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:03.168154 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:03.168616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:03.169269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:03.187022 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 21:59:03.192792 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 21:59:03.205957 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 21:59:03.208376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 21:59:03.254800 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [fb0abed2-83dd-4853-9c69-eaa8fac1135c] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 21:59:04.262740 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [fb0abed2-83dd-4853-9c69-eaa8fac1135c] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45054. Oct 29 21:59:04.268257 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4ad8415d-a06c-4d28-81ba-5db74278d608 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.795048 Oct 29 21:59:04.275023 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3583/7258] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 21:59:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 21:59:04.278594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=12 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:04.283680 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-88c691c0-ecc1-47dd-9b1e-42b07734a700 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:04.284391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-88c691c0-ecc1-47dd-9b1e-42b07734a700 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:04.350835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-88c691c0-ecc1-47dd-9b1e-42b07734a700 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:04.358141 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-88c691c0-ecc1-47dd-9b1e-42b07734a700 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1267 microversion: 2.1 time: 0.081493 Oct 29 21:59:04.358792 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3676/7259] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:04 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:05.382845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:05.383559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:05.390125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:05.390690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:05.391755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:05.392555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:05.393089 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:05.393621 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:05.460006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:05.468214 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-26515ebf-66b7-44a6-b765-52b7f5f02bce tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1319 microversion: 2.1 time: 0.090142 Oct 29 21:59:05.468803 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3584/7260] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:05 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:06.492444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:06.493861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:06.505160 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:06.505982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:06.506446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:06.507338 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:06.507994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:06.508448 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:06.729178 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:06.738044 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6819912c-0e7d-4f47-b4b1-573166acbef7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.249557 Oct 29 21:59:06.738772 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3677/7261] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:06 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:07.043018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-50c89db7-e588-4be0-a9c0-dbd87402feb1 req-21b42bee-5e06-4e53-bf4c-eaad6598d9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c267cdd-2e94-4cf0-b5f8-436514a852db", "tag": "d53f5b6e-e03c-4e93-ad0a-061508813104"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:59:07.054709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-50c89db7-e588-4be0-a9c0-dbd87402feb1 req-21b42bee-5e06-4e53-bf4c-eaad6598d9b9 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:07.055192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-50c89db7-e588-4be0-a9c0-dbd87402feb1 req-21b42bee-5e06-4e53-bf4c-eaad6598d9b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:07.055628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-50c89db7-e588-4be0-a9c0-dbd87402feb1 req-21b42bee-5e06-4e53-bf4c-eaad6598d9b9 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:07.067914 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-50c89db7-e588-4be0-a9c0-dbd87402feb1 req-21b42bee-5e06-4e53-bf4c-eaad6598d9b9 service nova] Creating event network-changed:d53f5b6e-e03c-4e93-ad0a-061508813104 for instance 2c267cdd-2e94-4cf0-b5f8-436514a852db on nch2-master-1 Oct 29 21:59:07.072655 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-50c89db7-e588-4be0-a9c0-dbd87402feb1 req-21b42bee-5e06-4e53-bf4c-eaad6598d9b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Oct 29 21:59:07.073283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3585/7262] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 21:59:07.762868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:07.763513 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:07.770480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:07.770985 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:07.771447 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:07.772161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:07.772637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:07.773094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:07.906146 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:07.914344 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a394b481-c1bf-41ef-84e4-17eb26d8c0a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.155530 Oct 29 21:59:07.914925 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3678/7263] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:07 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:08.940137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:08.940986 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:08.947613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:08.948109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:08.948558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:08.949282 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:08.949780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:08.950214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:09.310668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:09.319325 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ce19f867-95c2-410e-9c65-c3cf50fa3687 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.384874 Oct 29 21:59:09.319912 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3586/7264] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:08 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 21:59:10.342756 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:10.343385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:10.350324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:10.350824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:10.351281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:10.351987 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:10.352459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:10.352903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:10.485642 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:10.493389 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f3fdd02-41a1-4ff7-8d14-37ff0343db7f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.154655 Oct 29 21:59:10.494003 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3679/7265] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:10 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:11.517198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:11.517747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:11.524629 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:11.525105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:11.525582 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:11.526309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:11.526772 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:11.527204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:11.661932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:11.669750 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2cce0545-98e5-4058-8209-d62a392edb15 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.157097 Oct 29 21:59:11.670328 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3587/7266] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:11 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:12.588931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-eb36d287-693b-4ad7-a3b4-563fc3755834 req-458ccced-8b3c-429e-a4c3-d020e7c8278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c267cdd-2e94-4cf0-b5f8-436514a852db", "name": "network-vif-plugged", "status": "completed", "tag": "d53f5b6e-e03c-4e93-ad0a-061508813104"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:59:12.599753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-eb36d287-693b-4ad7-a3b4-563fc3755834 req-458ccced-8b3c-429e-a4c3-d020e7c8278a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:12.600436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-eb36d287-693b-4ad7-a3b4-563fc3755834 req-458ccced-8b3c-429e-a4c3-d020e7c8278a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:12.600905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-eb36d287-693b-4ad7-a3b4-563fc3755834 req-458ccced-8b3c-429e-a4c3-d020e7c8278a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:12.612866 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-eb36d287-693b-4ad7-a3b4-563fc3755834 req-458ccced-8b3c-429e-a4c3-d020e7c8278a service nova] Creating event network-vif-plugged:d53f5b6e-e03c-4e93-ad0a-061508813104 for instance 2c267cdd-2e94-4cf0-b5f8-436514a852db on nch2-master-1 Oct 29 21:59:12.618246 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-eb36d287-693b-4ad7-a3b4-563fc3755834 req-458ccced-8b3c-429e-a4c3-d020e7c8278a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033292 Oct 29 21:59:12.618847 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3680/7267] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:59:12.692839 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:12.693529 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:12.700588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:12.701172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:12.701726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:12.702515 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:12.703057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:12.704114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:12.866976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:12.874789 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c042b98c-354b-4c9c-860f-5ae13f217c57 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.186110 Oct 29 21:59:12.875372 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3588/7268] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:12 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:13.899388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:13.900128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:13.906583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:13.907099 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:13.907567 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:13.908291 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:13.908775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:13.909229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:14.042225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:14.050110 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5adc938a-9cee-49ac-ad9e-7bad8e88f5ef tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1392 microversion: 2.1 time: 0.155880 Oct 29 21:59:14.050707 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3681/7269] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:13 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:15.074091 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:15.074712 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:15.076668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:15.077505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:15.084610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:15.085092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:15.085819 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:15.086517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:15.086976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:15.087407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:15.226995 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:15.235521 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0875541a-af4d-4a95-af7d-34808173a6b9 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1565 microversion: 2.1 time: 0.165369 Oct 29 21:59:15.236105 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3589/7270] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:15 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:15.258366 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:15.258998 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:15.261048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:15.267032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:15.267532 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:15.267992 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:15.268699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:15.269169 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:15.269715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:15.400047 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:15.408352 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ad46f636-db6d-4ddd-864b-0b002d0ea671 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1565 microversion: 2.1 time: 0.153840 Oct 29 21:59:15.408929 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3682/7271] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:15 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:16.985771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:16.991274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-36f0c054-f908-43e3-9093-5b53b500753e req-a8ef0342-431c-48e7-a2a0-b228bd98c85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c267cdd-2e94-4cf0-b5f8-436514a852db", "tag": "d53f5b6e-e03c-4e93-ad0a-061508813104"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:59:16.997801 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:17.007173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:17.009030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:17.011759 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-36f0c054-f908-43e3-9093-5b53b500753e req-a8ef0342-431c-48e7-a2a0-b228bd98c85a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:17.012234 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-36f0c054-f908-43e3-9093-5b53b500753e req-a8ef0342-431c-48e7-a2a0-b228bd98c85a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:17.012970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-36f0c054-f908-43e3-9093-5b53b500753e req-a8ef0342-431c-48e7-a2a0-b228bd98c85a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:17.018263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:17.019072 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:17.019539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:17.019972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:17.031732 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-36f0c054-f908-43e3-9093-5b53b500753e req-a8ef0342-431c-48e7-a2a0-b228bd98c85a service nova] Creating event network-changed:d53f5b6e-e03c-4e93-ad0a-061508813104 for instance 2c267cdd-2e94-4cf0-b5f8-436514a852db on nch2-master-1 Oct 29 21:59:17.037253 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-36f0c054-f908-43e3-9093-5b53b500753e req-a8ef0342-431c-48e7-a2a0-b228bd98c85a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049615 Oct 29 21:59:17.038275 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3683/7272] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 21:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 21:59:17.262459 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:17.271726 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-209cd04b-c9b4-4efc-b96c-b40a38f0b213 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1565 microversion: 2.1 time: 0.289855 Oct 29 21:59:17.272283 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3590/7273] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:16 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1565 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:40.568378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:40.569223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=34 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:40.573426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:59:40.575754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:40.583613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:40.584128 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:40.584595 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:40.585319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:40.586092 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:40.586548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:40.640283 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d4a940b8-0057-491c-afe6-e3b2b37f9773 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action" status: 200 len: 24575 microversion: 2.1 time: 0.073909 Oct 29 21:59:40.640968 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3684/7274] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:59:40 2022] POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action => generated 24575 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 21:59:51.560329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-71b9aadd-4ce6-460c-b5b0-8e8144a982c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 21:59:51.563044 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:51.563930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=40 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:51.570655 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b9aadd-4ce6-460c-b5b0-8e8144a982c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:51.571245 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b9aadd-4ce6-460c-b5b0-8e8144a982c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:51.571690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71b9aadd-4ce6-460c-b5b0-8e8144a982c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:51.596113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-71b9aadd-4ce6-460c-b5b0-8e8144a982c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Going to try to stop instance {{(pid=138884) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 21:59:51.637441 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-71b9aadd-4ce6-460c-b5b0-8e8144a982c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action" status: 202 len: 0 microversion: 2.1 time: 0.081256 Oct 29 21:59:51.638079 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3591/7275] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 21:59:51 2022] POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 21:59:51.647001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:51.647746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:51.653939 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:51.654616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=4 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 21:59:51.658352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:51.658921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:51.659391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:51.660136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:51.660619 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:51.661103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:51.801649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:51.809421 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e804489-59ff-46a3-8722-3ec63e14fe93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.166804 Oct 29 21:59:51.810045 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3685/7276] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:51 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:52.834345 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:52.835085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:52.841754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:52.842242 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:52.842688 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:52.843896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:52.844389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:52.844828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:52.974176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:52.981998 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f9f2fe5c-92fa-4cec-9d52-5d632ffcb841 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.153076 Oct 29 21:59:52.982572 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3592/7277] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:52 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:54.007751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:54.008388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:54.015396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:54.015903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:54.016363 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:54.017077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:54.017583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:54.018036 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:54.150306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:54.158144 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4759a60b-9fd6-46f9-a789-84612e6c14f6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.154396 Oct 29 21:59:54.158728 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3686/7278] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:54 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:55.182190 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:55.182862 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:55.189709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:55.190197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:55.190640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:55.191333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:55.191788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:55.192214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:55.322017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:55.330541 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e76b57a5-6a61-4706-9b3e-0dfcf377ec1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.152297 Oct 29 21:59:55.331122 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3593/7279] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:55 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:56.354497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:56.355136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:56.362064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:56.362574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:56.363032 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:56.363780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:56.364257 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:56.364709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:56.494341 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:56.502054 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-07a6e914-45fd-4d79-95ac-e1682b424d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.151569 Oct 29 21:59:56.502634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3687/7280] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:56 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:57.525983 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:57.526608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:57.533405 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:57.533934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:57.534382 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:57.535080 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:57.535540 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:57.535972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:57.670900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:57.678717 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-247ee90a-4301-41f4-ab40-f039d0ef5d7c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.156634 Oct 29 21:59:57.679296 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3594/7281] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:57 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:58.702586 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:58.703220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:58.710288 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:58.711055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:58.711511 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:58.712246 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:58.712719 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:58.713163 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:58.844425 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 21:59:58.852230 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38fc2962-6bc3-49d9-820d-38ce16389a11 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.153622 Oct 29 21:59:58.852803 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3688/7282] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:58 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 21:59:59.875451 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 21:59:59.876076 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 21:59:59.883036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:59.883528 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:59.883973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 21:59:59.884706 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 21:59:59.885169 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 21:59:59.885636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:00.025159 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:00.033791 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-34ed704a-7121-41df-8b3d-f3ffbc02af67 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.162304 Oct 29 22:00:00.034368 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3595/7283] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 21:59:59 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:01.056472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:01.057122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:01.064235 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:01.064751 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:01.065221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:01.066067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:01.066857 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:01.067317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:01.200659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:01.209382 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6b04ca1c-f6cb-4ae0-8c05-9f63d6b7433a tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1694 microversion: 2.1 time: 0.157048 Oct 29 22:00:01.210034 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3689/7284] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:01 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:02.232083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:02.232791 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:02.239755 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:02.240235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:02.240681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:02.241381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:02.241871 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:02.242307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:02.371976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:02.379788 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4de51b84-8c96-45f8-9db1-c2418872b9aa tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1671 microversion: 2.1 time: 0.151601 Oct 29 22:00:02.380374 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3596/7285] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:02 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:03.474342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:03.476507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:03.483728 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:03.484231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:03.484690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:03.485401 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:03.485901 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:03.486348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:03.553742 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ed0307a9-2b2a-4107-b15a-48c8ac8d94cf tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action" status: 200 len: 37395 microversion: 2.1 time: 0.083192 Oct 29 22:00:03.554578 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3690/7286] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:00:03 2022] POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action => generated 37395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 22:00:03.566789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8a4821b6-e567-4690-9e59-fd7fd6bc9b10 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:03.573736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a4821b6-e567-4690-9e59-fd7fd6bc9b10 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:03.574227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a4821b6-e567-4690-9e59-fd7fd6bc9b10 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:03.574668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8a4821b6-e567-4690-9e59-fd7fd6bc9b10 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:03.597356 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8a4821b6-e567-4690-9e59-fd7fd6bc9b10 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Going to try to start instance {{(pid=138884) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 22:00:03.637670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8a4821b6-e567-4690-9e59-fd7fd6bc9b10 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action" status: 202 len: 0 microversion: 2.1 time: 0.074569 Oct 29 22:00:03.638265 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3597/7287] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:00:03 2022] POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:00:03.647896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:03.648640 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:03.655745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:03.656263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:03.656730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:03.657534 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:03.658026 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:03.658535 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:03.886221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:03.894102 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-5b189e25-28b3-4b7b-8920-a0b55a0e6606 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1680 microversion: 2.1 time: 0.250597 Oct 29 22:00:03.894717 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3691/7288] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:03 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:04.919873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:04.920589 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:04.926928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:04.927414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:04.927859 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:04.928558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:04.929018 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:04.929471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:05.064088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:05.072083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-71ed2b05-864b-4fac-b713-22f19e7bfd6d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1684 microversion: 2.1 time: 0.157200 Oct 29 22:00:05.072667 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3598/7289] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:04 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:31.299409 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:31.301838 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:31.304788 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:00:31.304947 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action (ip 10.222.0.36) !!! Oct 29 22:00:31.306570 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=14 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:00:31.308040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=40 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:00:31.316718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:31.317229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:31.317718 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:31.318438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:31.318919 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:31.319367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:31.378214 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-01f6f557-e3b1-42aa-80ac-07401d1452b7 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action" status: 200 len: 61954 microversion: 2.1 time: 0.083407 Oct 29 22:00:31.378868 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3692/7290] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:00:31 2022] POST /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db/action => generated 61954 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 22:00:38.395830 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:38.401500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-ce592787-ae08-4b96-83c8-d616aa880aea req-443f9f97-5fb6-4c9d-8494-bbd6d7116241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c267cdd-2e94-4cf0-b5f8-436514a852db", "tag": "d53f5b6e-e03c-4e93-ad0a-061508813104"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:38.406039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:38.408505 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=16 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:00:38.409232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:00:38.414421 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:38.416434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:38.416887 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ce592787-ae08-4b96-83c8-d616aa880aea req-443f9f97-5fb6-4c9d-8494-bbd6d7116241 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:38.417239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:38.417571 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ce592787-ae08-4b96-83c8-d616aa880aea req-443f9f97-5fb6-4c9d-8494-bbd6d7116241 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:38.418276 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-ce592787-ae08-4b96-83c8-d616aa880aea req-443f9f97-5fb6-4c9d-8494-bbd6d7116241 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:38.418578 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:38.419182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:38.419935 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:38.433697 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-ce592787-ae08-4b96-83c8-d616aa880aea req-443f9f97-5fb6-4c9d-8494-bbd6d7116241 service nova] Creating event network-changed:d53f5b6e-e03c-4e93-ad0a-061508813104 for instance 2c267cdd-2e94-4cf0-b5f8-436514a852db on nch2-master-1 Oct 29 22:00:38.439909 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-ce592787-ae08-4b96-83c8-d616aa880aea req-443f9f97-5fb6-4c9d-8494-bbd6d7116241 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042139 Oct 29 22:00:38.440699 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3693/7291] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:00:38.452851 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 22:00:38.543945 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-09bf4aab-bd20-4929-b4f8-fe0d1c27be00 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 204 len: 0 microversion: 2.1 time: 0.152063 Oct 29 22:00:38.546192 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3599/7292] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 22:00:38 2022] DELETE /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 22:00:38.556189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:38.556929 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:38.564014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:38.564580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:38.565031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:38.565889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:38.566365 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:38.566773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:38.722794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:38.730831 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a44f0204-1fb4-40da-8ed4-dc2af6ea0369 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1690 microversion: 2.1 time: 0.179921 Oct 29 22:00:38.731416 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3694/7293] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:38 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:39.756615 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:39.757240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:39.764149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:39.765261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:39.765733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:39.766441 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:39.766903 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:39.767336 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:39.897226 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:39.906140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e9126f1c-3e40-4823-9ef7-7b0cdfa1a825 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1690 microversion: 2.1 time: 0.153955 Oct 29 22:00:39.917484 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3600/7294] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:39 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:40.791974 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-a2e79073-ff8c-4ad1-bd7b-d7a25065d5fe req-1a39b012-e377-4489-b9b7-931d0f877570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c267cdd-2e94-4cf0-b5f8-436514a852db", "name": "network-vif-deleted", "tag": "d53f5b6e-e03c-4e93-ad0a-061508813104"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:40.802729 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a2e79073-ff8c-4ad1-bd7b-d7a25065d5fe req-1a39b012-e377-4489-b9b7-931d0f877570 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:40.803229 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a2e79073-ff8c-4ad1-bd7b-d7a25065d5fe req-1a39b012-e377-4489-b9b7-931d0f877570 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:40.803683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-a2e79073-ff8c-4ad1-bd7b-d7a25065d5fe req-1a39b012-e377-4489-b9b7-931d0f877570 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:40.815973 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-a2e79073-ff8c-4ad1-bd7b-d7a25065d5fe req-1a39b012-e377-4489-b9b7-931d0f877570 service nova] Creating event network-vif-deleted:d53f5b6e-e03c-4e93-ad0a-061508813104 for instance 2c267cdd-2e94-4cf0-b5f8-436514a852db on nch2-master-1 Oct 29 22:00:40.820985 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-a2e79073-ff8c-4ad1-bd7b-d7a25065d5fe req-1a39b012-e377-4489-b9b7-931d0f877570 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Oct 29 22:00:40.821608 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3695/7295] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:00:40.932827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:40.933486 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:40.941103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:40.941814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:40.942366 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:40.943202 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:40.944021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:40.944099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:40.980335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:40.980827 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:40.981274 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:40.981779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lazy-loading 'fault' on Instance uuid 2c267cdd-2e94-4cf0-b5f8-436514a852db {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 22:00:41.022114 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:41.029863 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af6fcea6-a431-4483-af05-9880f4be21ff tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 200 len: 1357 microversion: 2.1 time: 0.100970 Oct 29 22:00:41.031106 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3601/7296] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:40 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 1357 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:42.054730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:42.055457 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 2c267cdd-2e94-4cf0-b5f8-436514a852db] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:42.061839 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:42.062371 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:42.062831 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:42.063538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:42.064015 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:42.064468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:42.078238 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] HTTP exception thrown: Instance 2c267cdd-2e94-4cf0-b5f8-436514a852db could not be found. Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Request method failure captured: Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db HTTP/1.1 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXaCrjH68_3cWXO3KTmpsanXE7DrSGcFx2MBXqVLDFpo78gcJJ2WjIbzUDPONXYo-JIeg78oeiMDhXMEE3etuXmP7ndrZHCVNaJXQUulGzUbvL-0k3MHnBYBrMuQH5MaZG3fI4tMmcAX7gh951eue9dVO4yHkgQ533Rf4Y3A_OORT26A Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 13935e9e808b461599903c800dfa1ded Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13935e9e808b461599903c800dfa1ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13935e9e808b461599903c800dfa1ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 13935e9e808b461599903c800dfa1ded Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4974b30378694c8b9f92e5a36b5ea53b Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 2c267cdd-2e94-4cf0-b5f8-436514a852db could not be found. Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '2c267cdd-2e94-4cf0-b5f8-436514a852db'} Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c267cdd-2e94-4cf0-b5f8-436514a852db could not be found. Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c267cdd-2e94-4cf0-b5f8-436514a852db could not be found. Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:00:42.079907 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c267cdd-2e94-4cf0-b5f8-436514a852db could not be found. Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Returning 404 to user: Instance 2c267cdd-2e94-4cf0-b5f8-436514a852db could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-869dba43-c3df-4d8b-b171-8921b0cdcbf1 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db" status: 404 len: 111 microversion: 2.1 time: 0.031945 Oct 29 22:00:42.083871 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3696/7297] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:42 2022] GET /compute/v2.1/servers/2c267cdd-2e94-4cf0-b5f8-436514a852db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 22:00:45.459246 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1bcff5db-8d83-42ba-a4ca-aa965e3e2112 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '.version_select at 0x7fa172040d30>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:45.484531 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1bcff5db-8d83-42ba-a4ca-aa965e3e2112 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1241767791" status: 202 len: 0 microversion: 2.1 time: 0.029232 Oct 29 22:00:45.485120 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3602/7298] 10.222.0.36 () {58 vars in 1284 bytes} [Sat Oct 29 22:00:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1241767791 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:00:45.515273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-75948556-15e4-4920-a91f-e9a95774a75d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: .version_select at 0x7fa17631b3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-500858476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDni50PMybVjnKr/CF6Q7+SA++nARO3IJRku+miN59B5+ZjAamaNBR0+aGzGuWI5K/I2H/+N0gtkZLWlaxFs/IZy22D5pQ5lanA7Br3YqnMkZinoQ1VSK2flScQ4vZpFAA=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:45.532868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-75948556-15e4-4920-a91f-e9a95774a75d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:00:45.538088 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-75948556-15e4-4920-a91f-e9a95774a75d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:00:45.564184 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-75948556-15e4-4920-a91f-e9a95774a75d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052764 Oct 29 22:00:45.564798 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3697/7299] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 22:00:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:00:51.307456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1535394183", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "networks": [{"uuid": "4779e241-c96c-434b-9d25-63ff6d830c6b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-500858476", "security_groups": [{"name": "tempest-secgroup-smoke-2002631788"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:51.319095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:00:51.433605 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] validate_networks() for [('4779e241-c96c-434b-9d25-63ff6d830c6b', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 22:00:51.854110 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 22:00:51.854549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 22:00:51.855038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 22:00:51.855570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 22:00:51.857325 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 22:00:51.870135 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:51.871000 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:51.871632 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:51.872613 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:51.873516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:51.874328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:51.894718 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:00:51.900964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Getting quotas for user 4974b30378694c8b9f92e5a36b5ea53b and project 13935e9e808b461599903c800dfa1ded. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:00:51.918618 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 22:00:51.921608 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 22:00:51.974516 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-40924dd0-c43e-4c50-a851-894735857186 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.670900 Oct 29 22:00:51.975579 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3603/7300] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 22:00:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 22:00:51.989474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-83b9f1a6-9046-4eb4-bb37-71c8bdd6fac3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:51.990129 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-83b9f1a6-9046-4eb4-bb37-71c8bdd6fac3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:52.069483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=16 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:00:52.087563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-83b9f1a6-9046-4eb4-bb37-71c8bdd6fac3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:52.095062 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-83b9f1a6-9046-4eb4-bb37-71c8bdd6fac3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1266 microversion: 2.1 time: 0.111623 Oct 29 22:00:52.096146 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3698/7301] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:51 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:53.118923 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:53.119558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:53.127727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:53.128235 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:53.128686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:53.129734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:53.130303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:53.130751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:53.221404 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:53.230035 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2c45f03d-9c0f-4999-a29c-6a876635a119 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1326 microversion: 2.1 time: 0.114931 Oct 29 22:00:53.231137 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3604/7302] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:53 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:54.257661 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:54.258412 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:54.271811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:54.272343 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:54.272814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:54.273600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:54.274091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:54.274582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:54.433294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:54.442112 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a882cc42-b641-41e8-bcdb-c43767e0b404 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1392 microversion: 2.1 time: 0.188537 Oct 29 22:00:54.443055 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3699/7303] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:54 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:54.753773 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a19c3dfc-9ea2-4e5e-b084-a5ca2c5985d2 req-c2a62357-490d-47c9-9e84-5cfb0f4d0abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46604381-1730-4502-be9d-baeb044f9043", "tag": "471e849e-19eb-4443-9f27-38a660bb3ba6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:54.788006 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a19c3dfc-9ea2-4e5e-b084-a5ca2c5985d2 req-c2a62357-490d-47c9-9e84-5cfb0f4d0abf service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:54.789509 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a19c3dfc-9ea2-4e5e-b084-a5ca2c5985d2 req-c2a62357-490d-47c9-9e84-5cfb0f4d0abf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:54.790339 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a19c3dfc-9ea2-4e5e-b084-a5ca2c5985d2 req-c2a62357-490d-47c9-9e84-5cfb0f4d0abf service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:54.813634 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a19c3dfc-9ea2-4e5e-b084-a5ca2c5985d2 req-c2a62357-490d-47c9-9e84-5cfb0f4d0abf service nova] Creating event network-changed:471e849e-19eb-4443-9f27-38a660bb3ba6 for instance 46604381-1730-4502-be9d-baeb044f9043 on nch2-master-1 Oct 29 22:00:54.846844 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a19c3dfc-9ea2-4e5e-b084-a5ca2c5985d2 req-c2a62357-490d-47c9-9e84-5cfb0f4d0abf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097684 Oct 29 22:00:54.848499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3605/7304] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:00:55.466329 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:55.466964 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:55.474357 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:55.474859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:55.475342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:55.476048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:55.476524 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:55.476967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:55.612044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:55.619874 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-344fd785-af6d-4965-84fc-dea9245a8cee tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1392 microversion: 2.1 time: 0.157795 Oct 29 22:00:55.620470 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3700/7305] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:55 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:56.644746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:56.645484 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:56.652234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:56.652736 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:56.653185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:56.653936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:56.654399 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:56.654835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:56.789849 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:56.798186 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0c1e9579-0588-4460-8c3a-3a5ec3ff02ec tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1392 microversion: 2.1 time: 0.158653 Oct 29 22:00:56.798775 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3606/7306] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:56 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:57.821694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:57.822339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:57.830432 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:57.830944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:57.831431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:57.832176 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:57.832654 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:57.833103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:57.966453 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:57.974260 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-b574c2db-196a-4c71-98b3-2aa41e591669 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1392 microversion: 2.1 time: 0.156581 Oct 29 22:00:57.974843 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3701/7307] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:57 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:58.997004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:00:58.997661 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:00:59.005750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:59.006261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:59.006709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:59.007542 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:59.008008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:59.008491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:59.150841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:00:59.158867 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dc734593-8ae7-4896-86ac-b7f2e69cf44b tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1392 microversion: 2.1 time: 0.165755 Oct 29 22:00:59.159453 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3607/7308] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:00:58 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:00:59.245905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-53705609-0a3e-4b28-abb4-2b779087e1db req-f34a6dd5-4698-47c5-906b-869a39a2e132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46604381-1730-4502-be9d-baeb044f9043", "name": "network-vif-plugged", "status": "completed", "tag": "471e849e-19eb-4443-9f27-38a660bb3ba6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:00:59.256775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-53705609-0a3e-4b28-abb4-2b779087e1db req-f34a6dd5-4698-47c5-906b-869a39a2e132 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:00:59.257289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-53705609-0a3e-4b28-abb4-2b779087e1db req-f34a6dd5-4698-47c5-906b-869a39a2e132 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:00:59.257841 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-53705609-0a3e-4b28-abb4-2b779087e1db req-f34a6dd5-4698-47c5-906b-869a39a2e132 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:00:59.269064 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-53705609-0a3e-4b28-abb4-2b779087e1db req-f34a6dd5-4698-47c5-906b-869a39a2e132 service nova] Creating event network-vif-plugged:471e849e-19eb-4443-9f27-38a660bb3ba6 for instance 46604381-1730-4502-be9d-baeb044f9043 on nch2-master-1 Oct 29 22:00:59.274155 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-53705609-0a3e-4b28-abb4-2b779087e1db req-f34a6dd5-4698-47c5-906b-869a39a2e132 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Oct 29 22:00:59.274762 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3702/7309] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:01:00.182817 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:00.184014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:00.192643 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:00.193232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:00.193721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:00.194432 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:00.194919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:00.195352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:00.334481 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:00.342913 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fe4529dd-dd22-462c-b7ca-1d43813e750c tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1392 microversion: 2.1 time: 0.163955 Oct 29 22:01:00.343499 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3608/7310] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:00 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:01.369203 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:01.370279 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:01.373211 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:01.380206 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:01.381008 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:01.381556 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:01.382309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:01.382786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:01.383237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:01.522220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:01.531008 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-57e1d927-b5b8-4ab8-9da6-24e2e1f59d93 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1564 microversion: 2.1 time: 0.168143 Oct 29 22:01:01.531558 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3703/7311] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:01 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:01.555927 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:01.556555 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:01.563531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:01.564026 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:01.564470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:01.565176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:01.565686 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:01.566125 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:01.706960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:01.716657 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-124d27b5-b306-42e6-839f-77e40d3657c0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1564 microversion: 2.1 time: 0.164657 Oct 29 22:01:01.717780 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3609/7312] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:01 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:03.646228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-c6acc544-6884-488a-961e-a103f623ecbd req-96a5ab6c-db25-4c7e-81f2-eaa8616f4606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46604381-1730-4502-be9d-baeb044f9043", "tag": "471e849e-19eb-4443-9f27-38a660bb3ba6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:03.650043 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:03.650764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:03.651319 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:03.651998 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:03.654244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:03.659187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c6acc544-6884-488a-961e-a103f623ecbd req-96a5ab6c-db25-4c7e-81f2-eaa8616f4606 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:03.659337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:03.659664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c6acc544-6884-488a-961e-a103f623ecbd req-96a5ab6c-db25-4c7e-81f2-eaa8616f4606 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:03.660152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:03.660273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-c6acc544-6884-488a-961e-a103f623ecbd req-96a5ab6c-db25-4c7e-81f2-eaa8616f4606 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:03.660494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:03.661422 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:03.661933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:03.662471 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:03.673596 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-c6acc544-6884-488a-961e-a103f623ecbd req-96a5ab6c-db25-4c7e-81f2-eaa8616f4606 service nova] Creating event network-changed:471e849e-19eb-4443-9f27-38a660bb3ba6 for instance 46604381-1730-4502-be9d-baeb044f9043 on nch2-master-1 Oct 29 22:01:03.678719 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-c6acc544-6884-488a-961e-a103f623ecbd req-96a5ab6c-db25-4c7e-81f2-eaa8616f4606 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036182 Oct 29 22:01:03.679325 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3610/7313] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:01:03.818928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:03.828595 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f943b69d-f481-4acb-abf3-14b6b19ccb87 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1564 microversion: 2.1 time: 0.189078 Oct 29 22:01:03.829503 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3704/7314] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:03 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:27.125758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:27.126743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=36 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:27.130919 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:27.133241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:27.140950 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:27.141438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:27.141908 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:27.142610 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:27.143071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:27.143502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:27.197670 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a4fef529-9fd0-47ef-a569-1d6e93d79d38 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action" status: 200 len: 24573 microversion: 2.1 time: 0.073678 Oct 29 22:01:27.199998 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3611/7315] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:01:27 2022] POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 22:01:38.136218 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:38.136844 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:38.138866 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:38.140108 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=32 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:38.145794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:38.146306 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:38.146769 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:38.147494 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:38.147981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:38.148436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:38.171947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lazy-loading 'flavor' on Instance uuid 46604381-1730-4502-be9d-baeb044f9043 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 22:01:38.238300 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-17758c91-2b2e-45c2-ac2e-6070edf3f0c3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action" status: 202 len: 0 microversion: 2.1 time: 0.106189 Oct 29 22:01:38.242000 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3705/7316] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:01:38 2022] POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:01:38.247749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:38.248456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:38.252428 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:38.253064 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=4 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:01:38.261549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:38.262040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:38.262482 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:38.263192 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:38.263650 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:38.264083 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:38.451647 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:38.460227 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e371c64b-e9c8-468b-850b-bf0e2434ee1f tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1691 microversion: 2.1 time: 0.216748 Oct 29 22:01:38.460804 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3612/7317] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:38 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:39.485347 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:39.486021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:39.492297 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:39.492806 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:39.493269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:39.494011 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:39.494491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:39.494941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:39.675764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:39.683621 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a38f2723-9667-45b3-b4ed-cec3245e5cfe tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1674 microversion: 2.1 time: 0.203668 Oct 29 22:01:39.684201 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3706/7318] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:39 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:40.782656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:40.784930 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:40.792116 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:40.792600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:40.793038 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:40.793757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:40.794218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:40.794646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:40.853921 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4b42ac29-924d-4715-a3d3-f7048df757a0 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action" status: 200 len: 37860 microversion: 2.1 time: 0.075465 Oct 29 22:01:40.854571 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3613/7319] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:01:40 2022] POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action => generated 37860 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 22:01:40.866614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:40.867180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:40.874140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:40.874649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:40.875111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:40.875833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:40.876318 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:40.876771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:40.942550 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7893eb61-556f-48fb-a125-f51090fa9268 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action" status: 202 len: 0 microversion: 2.1 time: 0.079678 Oct 29 22:01:40.943202 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3707/7320] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:01:40 2022] POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:01:40.952751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:40.953648 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:40.961163 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:40.962217 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:40.962698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:40.963537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:40.964053 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:40.964492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:41.105215 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:41.113857 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2414bb8d-7f1c-480e-93ea-1f66936cc053 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1680 microversion: 2.1 time: 0.165973 Oct 29 22:01:41.114436 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3614/7321] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:40 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:42.138968 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:42.139775 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:42.146833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:42.147336 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:42.147793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:42.148500 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:42.148970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:42.149415 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:42.290058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:42.299331 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e21006a-30e7-4ded-9638-4b35b4384fa8 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1680 microversion: 2.1 time: 0.164710 Oct 29 22:01:42.299900 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3708/7322] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:42 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:43.322996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:43.323620 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:43.331276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:43.331768 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:43.332218 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:43.332922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:43.333389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:43.333853 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:43.464288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:43.472571 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fa2c76cd-431d-4642-a7cf-dce4d6632ac6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1683 microversion: 2.1 time: 0.153554 Oct 29 22:01:43.473135 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3615/7323] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:43 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:43.572854 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:43.575135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:43.581997 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:43.582497 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:43.582956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:43.583668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:43.584142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:43.584589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:43.626321 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-94cdeb9b-e4e2-48ae-af43-4fc1084a164d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action" status: 200 len: 37860 microversion: 2.1 time: 0.057246 Oct 29 22:01:43.626987 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3709/7324] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:01:43 2022] POST /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043/action => generated 37860 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 22:01:44.623247 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:44.624318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:44.629031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0d6a77ce-fd94-481e-8804-91734b86f9e5 req-ab4d3aa4-052b-4c75-beb6-7af8450c5c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46604381-1730-4502-be9d-baeb044f9043", "tag": "471e849e-19eb-4443-9f27-38a660bb3ba6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:44.630809 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:44.631564 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:44.632227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:44.633172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:44.634209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:44.634861 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:44.639549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0d6a77ce-fd94-481e-8804-91734b86f9e5 req-ab4d3aa4-052b-4c75-beb6-7af8450c5c5e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:44.640055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0d6a77ce-fd94-481e-8804-91734b86f9e5 req-ab4d3aa4-052b-4c75-beb6-7af8450c5c5e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:44.640517 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0d6a77ce-fd94-481e-8804-91734b86f9e5 req-ab4d3aa4-052b-4c75-beb6-7af8450c5c5e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:44.652090 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0d6a77ce-fd94-481e-8804-91734b86f9e5 req-ab4d3aa4-052b-4c75-beb6-7af8450c5c5e service nova] Creating event network-changed:471e849e-19eb-4443-9f27-38a660bb3ba6 for instance 46604381-1730-4502-be9d-baeb044f9043 on nch2-master-1 Oct 29 22:01:44.657116 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0d6a77ce-fd94-481e-8804-91734b86f9e5 req-ab4d3aa4-052b-4c75-beb6-7af8450c5c5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035531 Oct 29 22:01:44.660882 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3710/7325] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:01:44.665318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Going to try to terminate instance {{(pid=138884) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 22:01:44.754645 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8770d584-3722-4204-b057-70e5475e4443 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 204 len: 0 microversion: 2.1 time: 0.136166 Oct 29 22:01:44.756106 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3616/7326] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 22:01:44 2022] DELETE /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 22:01:44.765340 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:44.766096 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:44.773825 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:44.774349 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:44.774817 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:44.775552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:44.776038 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:44.776495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:44.918313 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:44.927129 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-af3dd55d-5ec5-4f28-b158-dd66386affa6 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1689 microversion: 2.1 time: 0.166622 Oct 29 22:01:44.927719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3711/7327] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:44 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:45.953051 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:45.953705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:45.960506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:45.961001 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:45.961737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:45.962440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:45.962893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:45.963322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:46.096633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:46.104417 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-63ed1d8d-6a6b-48cf-a7c7-fcce0c5a212d tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1689 microversion: 2.1 time: 0.156373 Oct 29 22:01:46.104992 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3617/7328] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:45 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:47.075527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-557ad71d-cc88-4e1a-b11b-b6118be4472a req-189d9c53-696b-4d50-8610-ee4cba17454c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46604381-1730-4502-be9d-baeb044f9043", "name": "network-vif-deleted", "tag": "471e849e-19eb-4443-9f27-38a660bb3ba6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:01:47.088462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-557ad71d-cc88-4e1a-b11b-b6118be4472a req-189d9c53-696b-4d50-8610-ee4cba17454c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:47.089174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-557ad71d-cc88-4e1a-b11b-b6118be4472a req-189d9c53-696b-4d50-8610-ee4cba17454c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:47.089725 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-557ad71d-cc88-4e1a-b11b-b6118be4472a req-189d9c53-696b-4d50-8610-ee4cba17454c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:47.100785 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-557ad71d-cc88-4e1a-b11b-b6118be4472a req-189d9c53-696b-4d50-8610-ee4cba17454c service nova] Creating event network-vif-deleted:471e849e-19eb-4443-9f27-38a660bb3ba6 for instance 46604381-1730-4502-be9d-baeb044f9043 on nch2-master-1 Oct 29 22:01:47.105389 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-557ad71d-cc88-4e1a-b11b-b6118be4472a req-189d9c53-696b-4d50-8610-ee4cba17454c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097106 Oct 29 22:01:47.106189 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3712/7329] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:01:47.128240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:47.129182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:47.136288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:47.136788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:47.137241 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:47.137997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:47.138460 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:47.138901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:47.172132 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:47.172622 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:47.173066 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:47.173544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lazy-loading 'fault' on Instance uuid 46604381-1730-4502-be9d-baeb044f9043 {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 22:01:47.216969 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4974b30378694c8b9f92e5a36b5ea53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13935e9e808b461599903c800dfa1ded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:01:47.224807 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ca4226d4-4e7a-42fc-8dc7-ceb16a40f2cc tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 200 len: 1356 microversion: 2.1 time: 0.100568 Oct 29 22:01:47.225373 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3618/7330] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:47 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:01:48.249875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:48.250639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] [instance: 46604381-1730-4502-be9d-baeb044f9043] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:01:48.256935 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:48.257445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:48.257933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:48.258650 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:01:48.259130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:01:48.259581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:01:48.276042 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] HTTP exception thrown: Instance 46604381-1730-4502-be9d-baeb044f9043 could not be found. Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Request method failure captured: Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 HTTP/1.1 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXaCrjH68_3cWXO3KTmpsanXE7DrSGcFx2MBXqVLDFpo78gcJJ2WjIbzUDPONXYo-JIeg78oeiMDhXMEE3etuXmP7ndrZHCVNaJXQUulGzUbvL-0k3MHnBYBrMuQH5MaZG3fI4tMmcAX7gh951eue9dVO4yHkgQ533Rf4Y3A_OORT26A Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 13935e9e808b461599903c800dfa1ded Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13935e9e808b461599903c800dfa1ded"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13935e9e808b461599903c800dfa1ded"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13935e9e808b461599903c800dfa1ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 13935e9e808b461599903c800dfa1ded Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-789109704 Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 4974b30378694c8b9f92e5a36b5ea53b Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-789109704-project Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 46604381-1730-4502-be9d-baeb044f9043 could not be found. Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '46604381-1730-4502-be9d-baeb044f9043'} Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46604381-1730-4502-be9d-baeb044f9043 could not be found. Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46604381-1730-4502-be9d-baeb044f9043 could not be found. Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:01:48.277746 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46604381-1730-4502-be9d-baeb044f9043 could not be found. Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Returning 404 to user: Instance 46604381-1730-4502-be9d-baeb044f9043 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d531d342-3364-431d-bad6-241a7bab10b3 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043" status: 404 len: 111 microversion: 2.1 time: 0.034723 Oct 29 22:01:48.282075 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3713/7331] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:01:48 2022] GET /compute/v2.1/servers/46604381-1730-4502-be9d-baeb044f9043 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 22:01:51.631469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0ce87688-4702-41c1-a5e2-2d3bdad8c6c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] Calling method '.version_select at 0x7fa1720400d0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:01:51.657939 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0ce87688-4702-41c1-a5e2-2d3bdad8c6c4 tempest-TestNetworkAdvancedServerOps-789109704 tempest-TestNetworkAdvancedServerOps-789109704-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-500858476" status: 202 len: 0 microversion: 2.1 time: 0.029902 Oct 29 22:01:51.659231 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3619/7332] 10.222.0.36 () {58 vars in 1281 bytes} [Sat Oct 29 22:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-500858476 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:02:02.623089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=18 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:02.624552 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:02.909748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7c04ae77-15d5-47b1-82c7-c9dd1379caff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'create', calling method: .version_select at 0x7fa17125e5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-773682467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAeRBpeJnuvChkiaMinVsoyr/deDgskLeCmHBDGipLjYUxc6tSJfDIXw2SSmqZl8Cq0qYE2z76FqtUmu4EcP059BnRrT/m04LlsGA2bsI9Se3m41cHYr737jSql4RAI1A=="}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:02:02.928261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-7c04ae77-15d5-47b1-82c7-c9dd1379caff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for project acb94fdfb41a44379268b11c328f7d03. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:02:02.934345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-7c04ae77-15d5-47b1-82c7-c9dd1379caff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for user a7d227b3e85c4c5ca5cdb36bf28a8ca4 and project acb94fdfb41a44379268b11c328f7d03. Resources: {'key_pairs'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:02:02.965851 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7c04ae77-15d5-47b1-82c7-c9dd1379caff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.348272 Oct 29 22:02:02.966620 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3714/7333] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 22:02:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:02:03.994060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-513970126", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-773682467", "security_groups": [{"name": "tempest-secgroup-smoke-1757153636"}], "networks": [{"uuid": "98e1516b-784b-41c7-ac2a-2fe67b0c3bd3"}]}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:02:04.003970 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:04.004746 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:04.104197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.network.neutron [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] validate_networks() for [('98e1516b-784b-41c7-ac2a-2fe67b0c3bd3', None, None, None, None, None)] {{(pid=138884) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 22:02:04.495743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Flavor limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 22:02:04.496177 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Image limits 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 22:02:04.496662 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Flavor pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 22:02:04.497074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Image pref 0:0:0 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 22:02:04.497535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.virt.hardware [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 22:02:04.508794 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:04.509499 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:04.510255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:04.510996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:04.511458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:04.511895 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:04.532588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for project acb94fdfb41a44379268b11c328f7d03. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:02:04.539068 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for user a7d227b3e85c4c5ca5cdb36bf28a8ca4 and project acb94fdfb41a44379268b11c328f7d03. Resources: {'ram', 'cores', 'instances'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:02:04.563520 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Going to run 1 instances... {{(pid=138884) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 22:02:04.565972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 22:02:04.616754 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a11f102f-42c3-4d0d-bc7a-3c4a505a3ce5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.626794 Oct 29 22:02:04.617416 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3620/7334] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 22:02:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 22:02:04.629359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cdcb8aa6-43cc-4507-89a9-f0efc700bc00 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:04.630905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cdcb8aa6-43cc-4507-89a9-f0efc700bc00 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:04.697832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cdcb8aa6-43cc-4507-89a9-f0efc700bc00 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:04.706682 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cdcb8aa6-43cc-4507-89a9-f0efc700bc00 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1245 microversion: 2.1 time: 0.081182 Oct 29 22:02:04.723194 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3715/7335] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:04 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:05.730019 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-df4efe27-b42a-4e9f-9491-8ca35486a8d4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:05.730656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-df4efe27-b42a-4e9f-9491-8ca35486a8d4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:05.790052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-df4efe27-b42a-4e9f-9491-8ca35486a8d4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:05.797624 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-df4efe27-b42a-4e9f-9491-8ca35486a8d4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1245 microversion: 2.1 time: 0.071443 Oct 29 22:02:05.798203 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3621/7336] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:05 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:06.820093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-42e17007-4775-48bd-80e6-b0a5e533e73d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:06.820715 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-42e17007-4775-48bd-80e6-b0a5e533e73d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:06.879824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-42e17007-4775-48bd-80e6-b0a5e533e73d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:06.887070 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-42e17007-4775-48bd-80e6-b0a5e533e73d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1245 microversion: 2.1 time: 0.070864 Oct 29 22:02:06.889997 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3716/7337] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:06 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:07.910233 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:07.910864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:07.917776 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:07.918270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:07.918719 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:07.919425 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:07.919888 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:07.920323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:07.986410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:07.994265 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0257d51f-047f-418d-9577-3be0a1ed7377 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1249 microversion: 2.1 time: 0.087989 Oct 29 22:02:07.994841 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3622/7338] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:07 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:09.017480 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:09.018140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:09.025764 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:09.026281 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:09.026808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:09.027543 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:09.028022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:09.028476 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:09.099647 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:09.107491 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-6ac4dc05-7661-4c78-a09e-a34334292271 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1303 microversion: 2.1 time: 0.094493 Oct 29 22:02:09.108071 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3717/7339] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:09 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:10.130990 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:10.131726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:10.138757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:10.139767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:10.140199 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:10.140899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:10.141360 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:10.141821 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:10.339071 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:10.348067 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b5551004-e9d9-488e-b9d7-9b7697658ae8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1371 microversion: 2.1 time: 0.220983 Oct 29 22:02:10.348813 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3623/7340] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:10 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:10.663303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-fa39358a-f6cf-41e0-b330-7bdd06ecce95 req-16e7913c-0e08-4947-9c5e-9ad81128f6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:02:10.674597 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fa39358a-f6cf-41e0-b330-7bdd06ecce95 req-16e7913c-0e08-4947-9c5e-9ad81128f6a8 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:10.675171 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fa39358a-f6cf-41e0-b330-7bdd06ecce95 req-16e7913c-0e08-4947-9c5e-9ad81128f6a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:10.675804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-fa39358a-f6cf-41e0-b330-7bdd06ecce95 req-16e7913c-0e08-4947-9c5e-9ad81128f6a8 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:10.688371 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-fa39358a-f6cf-41e0-b330-7bdd06ecce95 req-16e7913c-0e08-4947-9c5e-9ad81128f6a8 service nova] Creating event network-changed:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch2-master-1 Oct 29 22:02:10.693269 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-fa39358a-f6cf-41e0-b330-7bdd06ecce95 req-16e7913c-0e08-4947-9c5e-9ad81128f6a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034166 Oct 29 22:02:10.693916 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3718/7341] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:02:11.371852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:11.372475 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:11.379549 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:11.380040 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:11.380483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:11.381188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:11.381673 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:11.382106 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:11.517281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:11.525046 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d960cb3b-4870-4223-89d0-5adf224bafe6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1371 microversion: 2.1 time: 0.157152 Oct 29 22:02:11.525651 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3624/7342] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:11 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:12.550585 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:12.551466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:12.558290 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:12.558804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:12.559274 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:12.560068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:12.560565 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:12.561021 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:12.695644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:12.704100 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9425d7da-d0e5-445a-8cec-b9fb0f3aca40 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1371 microversion: 2.1 time: 0.159448 Oct 29 22:02:12.704682 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3719/7343] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:12 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:13.726705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:13.727292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:13.734197 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:13.734683 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:13.735126 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:13.735822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:13.736281 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:13.736711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:13.868997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:13.877483 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-95bf8d7a-12d4-423a-96ff-b2a7a59d0731 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1371 microversion: 2.1 time: 0.154834 Oct 29 22:02:13.878074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3625/7344] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:13 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:14.900250 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:14.900896 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:14.908440 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:14.908943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:14.909403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:14.910144 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:14.910621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:14.911069 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:15.046185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:15.053858 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bcf00878-e8a4-436c-a3d2-ce3bc2a32476 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1371 microversion: 2.1 time: 0.157508 Oct 29 22:02:15.054441 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3720/7345] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:14 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:15.538234 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:15.600693 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-b16c6b53-ed6c-499d-bb5d-61c2c43fcfe6 req-976ba70b-1885-42a6-8c73-312cc043806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "name": "network-vif-plugged", "status": "completed", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:02:15.611149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b16c6b53-ed6c-499d-bb5d-61c2c43fcfe6 req-976ba70b-1885-42a6-8c73-312cc043806e service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:15.611641 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b16c6b53-ed6c-499d-bb5d-61c2c43fcfe6 req-976ba70b-1885-42a6-8c73-312cc043806e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:15.612085 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-b16c6b53-ed6c-499d-bb5d-61c2c43fcfe6 req-976ba70b-1885-42a6-8c73-312cc043806e service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:15.623482 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-b16c6b53-ed6c-499d-bb5d-61c2c43fcfe6 req-976ba70b-1885-42a6-8c73-312cc043806e service nova] Creating event network-vif-plugged:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch2-master-1 Oct 29 22:02:15.629065 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-b16c6b53-ed6c-499d-bb5d-61c2c43fcfe6 req-976ba70b-1885-42a6-8c73-312cc043806e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095416 Oct 29 22:02:15.629683 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3626/7346] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:02:16.076754 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:16.077396 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:16.084264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:16.084768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:16.085223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:16.085963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:16.086438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:16.087145 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:16.221012 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:16.228745 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ee8b214e-1849-4dc1-887e-8bc209263d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1371 microversion: 2.1 time: 0.155989 Oct 29 22:02:16.229323 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3721/7347] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:16 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:17.249846 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:17.254896 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:17.255607 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:17.262220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:17.262711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:17.263158 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:17.263856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:17.265014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:17.265467 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:17.397210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:17.405074 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f23db94c-933c-4bd2-a2f3-17cfd1a97cb4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1556 microversion: 2.1 time: 0.156748 Oct 29 22:02:17.405674 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3627/7348] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:17 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:17.427134 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:02:17.427774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:02:17.429794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:02:17.437066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:17.437598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:17.438057 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:17.438770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:17.439243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:17.439689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:17.577219 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:02:17.585146 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c82136bc-9a17-4f8e-a481-c8d5f1d14674 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1556 microversion: 2.1 time: 0.161888 Oct 29 22:02:17.585765 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3722/7349] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:02:17 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:02:19.242654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3082104f-a30e-444e-858d-77f96200002c req-fe3cde68-4faa-47c6-b40d-b2987f7cb8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:02:19.253029 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3082104f-a30e-444e-858d-77f96200002c req-fe3cde68-4faa-47c6-b40d-b2987f7cb8f0 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:02:19.253748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3082104f-a30e-444e-858d-77f96200002c req-fe3cde68-4faa-47c6-b40d-b2987f7cb8f0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:02:19.254194 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3082104f-a30e-444e-858d-77f96200002c req-fe3cde68-4faa-47c6-b40d-b2987f7cb8f0 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:02:19.266582 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3082104f-a30e-444e-858d-77f96200002c req-fe3cde68-4faa-47c6-b40d-b2987f7cb8f0 service nova] Creating event network-changed:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch2-master-1 Oct 29 22:02:19.272234 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3082104f-a30e-444e-858d-77f96200002c req-fe3cde68-4faa-47c6-b40d-b2987f7cb8f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Oct 29 22:02:19.272927 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3628/7350] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:04:16.732004 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:16.732853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=32 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:16.734219 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 29 22:04:16.734892 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 29 22:04:16.737628 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:04:16.737766 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6/action (ip 10.222.0.36) !!! Oct 29 22:04:16.743522 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:04:16.744074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:16.756676 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:16.757179 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:16.757666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:16.758378 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:16.758849 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:16.759293 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:16.784019 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lazy-loading 'flavor' on Instance uuid 5caee742-da26-4fc0-ad13-a64ab8fa33e6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 22:04:16.970498 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a55047fe-6176-47f0-8e56-3adab962249d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6/action" status: 202 len: 0 microversion: 2.1 time: 0.240209 Oct 29 22:04:16.971092 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3723/7351] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:04:16 2022] POST /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:04:16.979088 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 22:04:16.979831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:16.980646 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=36 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:16.982200 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 22:04:16.982407 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 (ip 10.222.0.36) !!! Oct 29 22:04:16.987833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:16.988546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:17.000816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:17.001305 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:17.001771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:17.002474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:17.002932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:17.003362 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:17.139951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:17.148281 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ffe2a982-31b3-4c60-89d0-f8f15ec20794 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.171779 Oct 29 22:04:17.148857 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3629/7352] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:16 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:18.173893 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:18.174652 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:18.182921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:18.183458 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:18.183921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:18.184629 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:18.185109 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:18.185584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:18.319873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:18.327788 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ccf56aa5-3523-49c0-a400-c1f77a236e70 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.159277 Oct 29 22:04:18.328368 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3724/7353] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:18 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:19.351406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:19.352036 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:19.360171 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:19.360660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:19.361104 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:19.361829 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:19.362293 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:19.362727 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:19.368596 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45678. Oct 29 22:04:19.497095 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:19.504993 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4737e6a6-0b7d-401f-b9ed-59ef7508346d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.157514 Oct 29 22:04:19.505586 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3630/7354] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:19 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:20.529577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:20.530216 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:20.537991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:20.538679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:20.539140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:20.539859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:20.540333 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:20.540781 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:20.674117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:20.682390 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fac2b171-0ae8-4cc6-a8ef-6f2c40d64200 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.157068 Oct 29 22:04:20.682971 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3725/7355] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:20 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:21.706514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:21.707130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:21.714273 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:21.714751 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:21.715191 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:21.715879 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:21.716335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:21.716762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:21.847092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:21.855336 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-012dbcc0-50f9-478f-bb27-e98d350bd3e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.152767 Oct 29 22:04:21.855916 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3631/7356] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:21 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:22.878976 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:22.879621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:22.886695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:22.887204 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:22.887663 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:22.888382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:22.888864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:22.889317 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:23.019393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:23.027672 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-22847994-fb52-41be-9744-c8c47ee60efb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.152786 Oct 29 22:04:23.028252 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3726/7357] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:22 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:24.126209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:24.126833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:24.133807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:24.134294 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:24.134760 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:24.135461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:24.135922 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:24.136353 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:24.270333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:24.278118 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b2543350-2553-4cd1-9a86-e11e93ea51b8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.155883 Oct 29 22:04:24.278723 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3632/7358] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:24 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:25.302618 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:25.303261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:25.310788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:25.311296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:25.311760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:25.312484 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:25.312960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:25.313408 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:25.442747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:25.451264 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f32778f2-b242-43f7-90f1-bfdde07fbff7 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.152703 Oct 29 22:04:25.451844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3727/7359] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:25 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:26.475283 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:26.475805 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:26.482377 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:26.482863 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:26.483309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:26.484002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:26.484458 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:26.484887 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:26.620263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:26.628114 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-9abca494-1127-4cca-bb4c-bb796862f9cb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.156984 Oct 29 22:04:26.628686 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3633/7360] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:26 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:27.652268 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:27.652912 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:27.659981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:27.660492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:27.660958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:27.661708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:27.662187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:27.662637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:27.796053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:27.804023 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ba6ba721-aea3-40eb-a1df-19f77e444398 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1702 microversion: 2.1 time: 0.155757 Oct 29 22:04:27.804619 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3728/7361] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:27 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:28.827769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:28.828414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:28.835462 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:28.835945 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:28.836387 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:28.837082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:28.837845 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:28.838279 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:28.968502 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:28.976297 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-36df5449-21fe-42d5-93a6-ab6432b10426 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1702 microversion: 2.1 time: 0.152530 Oct 29 22:04:28.976867 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3634/7362] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:28 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:30.001064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:30.001747 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:30.009245 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:30.009895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:30.010788 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:30.012244 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:30.012911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:30.013544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:30.166334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:30.174772 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20faa34e-eb9c-465d-a296-e611296d6383 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.177742 Oct 29 22:04:30.186186 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3729/7363] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:29 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:31.201556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:31.203017 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:31.215265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:31.215873 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:31.216436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:31.217264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:31.217841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:31.218357 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:31.369577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:31.377919 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-c9751409-647f-4566-a6f7-80f353e0ba18 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.181923 Oct 29 22:04:31.378855 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3635/7364] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:31 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:32.051895 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-657baa7e-aa1d-4b07-8862-2c5b52b8bb40 req-1e75a0f3-a04e-468d-a5e3-92c689a70ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "name": "network-vif-plugged", "status": "completed", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:04:32.067131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-657baa7e-aa1d-4b07-8862-2c5b52b8bb40 req-1e75a0f3-a04e-468d-a5e3-92c689a70ed6 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:32.068228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-657baa7e-aa1d-4b07-8862-2c5b52b8bb40 req-1e75a0f3-a04e-468d-a5e3-92c689a70ed6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:32.069135 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-657baa7e-aa1d-4b07-8862-2c5b52b8bb40 req-1e75a0f3-a04e-468d-a5e3-92c689a70ed6 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:32.083845 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-657baa7e-aa1d-4b07-8862-2c5b52b8bb40 req-1e75a0f3-a04e-468d-a5e3-92c689a70ed6 service nova] Creating event network-vif-plugged:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch2-master-1 Oct 29 22:04:32.094616 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-657baa7e-aa1d-4b07-8862-2c5b52b8bb40 req-1e75a0f3-a04e-468d-a5e3-92c689a70ed6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047363 Oct 29 22:04:32.096196 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3730/7365] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:04:32.404213 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:32.405570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:32.412881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:32.413546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:32.414261 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:32.415943 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:32.416780 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:32.417443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:32.580130 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:32.591637 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ad64bded-7150-4a2f-a24a-dceff5e179f9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.191412 Oct 29 22:04:32.592256 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3636/7366] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:32 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:33.621483 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:33.622903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:33.629613 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:33.630346 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:33.631002 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:33.632079 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:33.635215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:33.635685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:33.791404 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:33.799946 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ff4fa363-32c5-4c6a-add8-9fe032e6ee10 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.187302 Oct 29 22:04:33.817843 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3731/7367] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:33 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:34.829186 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:34.830659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:34.839109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:34.839636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:34.840093 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:34.840835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:34.841308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:34.841789 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:34.995905 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:35.004308 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-980cfcf3-c461-43a6-8c8c-e20a9a215d0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.179142 Oct 29 22:04:35.017797 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3637/7368] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:34 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:36.030544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:36.031199 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:36.039023 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:36.039559 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:36.040030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:36.040818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:36.041539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:36.042014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:36.201547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:36.205392 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eae278be-39c5-4d49-8ee3-76c7659e5f60 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.180274 Oct 29 22:04:36.219182 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3732/7369] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:36 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:37.230061 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:37.231440 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:37.242306 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:37.243419 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:37.243934 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:37.244724 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:37.245298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:37.245843 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:37.400363 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:37.408585 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-beb2a7e7-157c-4e9d-a482-9ea9920d4fb9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.182532 Oct 29 22:04:37.409443 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3638/7370] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:37 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:38.438058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:38.439495 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:38.447581 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:38.448312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:38.449041 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:38.450309 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:38.455139 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:38.456538 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:38.631165 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:38.640458 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d58be5ca-4df3-4649-bcc8-b96fd51a463f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1697 microversion: 2.1 time: 0.209644 Oct 29 22:04:38.651727 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3733/7371] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:38 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1697 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:39.663968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:39.664748 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:39.671656 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:39.672152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:39.672595 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:39.673290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:39.673777 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:39.674210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:39.893277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:39.901067 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-adda8059-321a-4d11-b054-16a7586f8a44 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1679 microversion: 2.1 time: 0.241024 Oct 29 22:04:39.901679 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3639/7372] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:39 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:40.925201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:40.925865 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:40.932890 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:40.933391 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:40.933881 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:40.934592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:40.935068 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:40.935518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:41.070508 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:41.078342 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e83d3240-461d-4421-8199-e9b3a8e11faa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1679 microversion: 2.1 time: 0.157096 Oct 29 22:04:41.078922 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3734/7373] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:40 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:42.107455 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:42.108406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:42.118232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:42.119380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:42.119828 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:42.120535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:42.120996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:42.121424 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:42.259137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:42.267274 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-86d25f06-cb64-40e1-8cfb-4468e0236852 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1682 microversion: 2.1 time: 0.167872 Oct 29 22:04:42.267841 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3640/7374] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:42 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:42.289975 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:04:42.291130 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:42.298074 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:42.298577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:42.299030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:42.299765 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:42.300237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:42.300679 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:42.402451 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138885) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 22:04:42.470224 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-329534a0-d6dc-4c7b-9006-8b686156f643 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6/action" status: 202 len: 0 microversion: 2.1 time: 0.184208 Oct 29 22:04:42.470852 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3735/7375] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:04:42 2022] POST /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:04:42.480263 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:42.481009 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:42.487389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:42.487991 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:42.488507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:42.489230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:42.489733 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:42.490176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:42.639320 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:42.648086 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-763d027c-da5f-40a8-a8dd-74f3b685fcc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1630 microversion: 2.1 time: 0.172314 Oct 29 22:04:42.648674 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3641/7376] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:42 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1630 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:43.673070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:43.673675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:43.679814 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:43.680330 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:43.680793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:43.681544 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:43.682062 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:43.682518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:43.818184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:43.826837 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bc3a4e29-d088-4d66-a911-fc8e8633e261 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.158639 Oct 29 22:04:43.827451 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3736/7377] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:43 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:44.038984 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-ced31703-172a-4ee5-93cc-d38fdbab9074 req-482a7fe9-17e7-4437-8b7c-01e2d0b7e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "name": "network-vif-unplugged", "status": "completed", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:04:44.054185 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ced31703-172a-4ee5-93cc-d38fdbab9074 req-482a7fe9-17e7-4437-8b7c-01e2d0b7e06b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:44.054745 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ced31703-172a-4ee5-93cc-d38fdbab9074 req-482a7fe9-17e7-4437-8b7c-01e2d0b7e06b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:44.055584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-ced31703-172a-4ee5-93cc-d38fdbab9074 req-482a7fe9-17e7-4437-8b7c-01e2d0b7e06b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:44.067803 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-ced31703-172a-4ee5-93cc-d38fdbab9074 req-482a7fe9-17e7-4437-8b7c-01e2d0b7e06b service nova] Creating event network-vif-unplugged:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch1-master-1 Oct 29 22:04:44.074313 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-ced31703-172a-4ee5-93cc-d38fdbab9074 req-482a7fe9-17e7-4437-8b7c-01e2d0b7e06b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039144 Oct 29 22:04:44.074997 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3642/7378] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:04:44.850872 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:44.851519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:44.859151 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:44.859656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:44.860112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:44.860830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:44.861305 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:44.861777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:44.866072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:45.003444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:45.012037 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ab4be63-5c1e-4eea-ab61-9a453340a298 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.165138 Oct 29 22:04:45.012624 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3737/7379] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:44 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:45.660272 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-57869827-7f1d-48fc-bb9d-dbc5106d3a30 req-29717efc-b367-4cf8-a33f-bf58d386ab9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:04:45.670111 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-57869827-7f1d-48fc-bb9d-dbc5106d3a30 req-29717efc-b367-4cf8-a33f-bf58d386ab9d service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:45.670626 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-57869827-7f1d-48fc-bb9d-dbc5106d3a30 req-29717efc-b367-4cf8-a33f-bf58d386ab9d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:45.671015 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-57869827-7f1d-48fc-bb9d-dbc5106d3a30 req-29717efc-b367-4cf8-a33f-bf58d386ab9d service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:45.686134 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-57869827-7f1d-48fc-bb9d-dbc5106d3a30 req-29717efc-b367-4cf8-a33f-bf58d386ab9d service nova] Creating event network-changed:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch1-master-1 Oct 29 22:04:45.691331 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-57869827-7f1d-48fc-bb9d-dbc5106d3a30 req-29717efc-b367-4cf8-a33f-bf58d386ab9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092370 Oct 29 22:04:45.692223 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3643/7380] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:04:46.036315 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:46.036953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:46.044478 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:46.044991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:46.045446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:46.046189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:46.046664 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:46.047110 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:46.180180 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:46.187955 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c23f17b0-30ac-42f1-98d6-3332d5d2dc85 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.155680 Oct 29 22:04:46.188533 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3738/7381] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:46 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:47.216469 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:47.217262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:47.219277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=31 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:47.224750 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:47.225500 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:47.226129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:47.227004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:47.227636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:47.228225 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:47.232379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=83 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:47.381554 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:47.389705 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-83bfb1f1-7444-4c1e-aa84-5b423b886583 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.180930 Oct 29 22:04:47.390297 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3644/7382] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:47 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:48.414322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:48.414967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:48.417845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:04:48.423383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:48.423923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:48.424388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:48.425195 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:48.425707 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:48.426159 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:48.574217 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:48.582453 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-93104dfc-bd37-4b60-a16c-ba4663d0b430 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.172046 Oct 29 22:04:48.583052 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3739/7383] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:48 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:49.606298 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:49.606933 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:49.617488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:49.617488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:49.617488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:49.617488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:49.617488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:49.617488 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:49.769996 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:49.779279 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00032dd4-1d26-44d2-90c6-f4a2c53da4fe tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.177085 Oct 29 22:04:49.779872 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3645/7384] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:49 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:50.803853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:50.804507 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:50.811520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:50.812031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:50.812493 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:50.813213 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:50.813720 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:50.814175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:50.970283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:50.982053 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-191dc6aa-b4d7-47f1-b368-eb919243aa72 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.182082 Oct 29 22:04:50.982835 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3740/7385] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:50 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:52.006119 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:52.006788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:52.014464 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:52.014978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:52.015422 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:52.016153 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:52.016630 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:52.017067 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:52.163767 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:52.173853 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-25d0bde8-c13a-4f23-aebe-2bed4c6f4dcc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.171762 Oct 29 22:04:52.174463 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3646/7386] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:52 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:53.202382 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:53.203006 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:53.210477 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:53.211324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:53.211466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:53.212173 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:53.212653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:53.213961 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:53.363166 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:53.373392 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-15325dc7-f474-4b9b-806e-0dd01a0a42a4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.174797 Oct 29 22:04:53.374233 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3741/7387] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:53 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:54.403645 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:54.404262 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:54.417764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:54.418238 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:54.418681 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:54.419381 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:54.419837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:54.420268 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:54.551917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:54.560379 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7da180a6-e894-4f1c-809e-6286ccc3bca4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.160743 Oct 29 22:04:54.560986 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3647/7388] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:54 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:55.584045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:55.584683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:55.592605 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:55.593112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:55.593608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:55.594327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:55.594804 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:55.595253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:55.730773 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:55.738527 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d55e88fd-fe52-4c4e-bf9f-3a48209adcc5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.158465 Oct 29 22:04:55.739099 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3742/7389] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:55 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:56.762730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:56.763285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:56.770176 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:56.770664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:56.771101 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:56.771793 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:56.772251 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:56.772678 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:56.904431 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:56.912226 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7e66eb39-a97d-4efc-a94c-8514a8186927 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.153504 Oct 29 22:04:56.912810 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3648/7390] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:56 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:57.936733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:57.937377 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:57.944044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:57.944554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:57.945016 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:57.945983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:57.946469 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:57.946921 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:58.082025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:58.091391 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-63764a73-aa65-49fd-850e-525d791a5680 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.159039 Oct 29 22:04:58.091984 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3743/7391] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:57 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:04:59.115556 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:04:59.116205 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:04:59.123586 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:59.124074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:59.124519 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:59.125219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:04:59.125709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:04:59.126144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:04:59.262570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:04:59.270438 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-d39c5522-a2e0-4d09-88bc-15955cb42d2f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.158863 Oct 29 22:04:59.271008 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3649/7392] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:04:59 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:05:00.294869 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:05:00.295519 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:05:00.304931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:00.305441 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:00.305925 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:00.306662 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:00.307140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:00.308154 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:00.442665 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:05:00.450561 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-87401690-ef67-45ba-8840-fe6e9a145469 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.160214 Oct 29 22:05:00.451137 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3744/7393] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:05:00 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:05:01.475506 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:05:01.476329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:05:01.483721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:01.484237 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:01.484677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:01.485372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:01.485852 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:01.486286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:01.628112 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:05:01.636059 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4f50b7fb-ecc1-4b0d-9b81-e4cf13986e7b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.164792 Oct 29 22:05:01.636690 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3650/7394] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:05:01 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:05:02.289187 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-8bb20a5c-e0be-434a-85dd-7e62bf864821 req-83686df8-46be-4355-8887-f5d6e174b414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "name": "network-vif-plugged", "status": "completed", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:05:02.299188 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8bb20a5c-e0be-434a-85dd-7e62bf864821 req-83686df8-46be-4355-8887-f5d6e174b414 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:02.299931 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8bb20a5c-e0be-434a-85dd-7e62bf864821 req-83686df8-46be-4355-8887-f5d6e174b414 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:02.300388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-8bb20a5c-e0be-434a-85dd-7e62bf864821 req-83686df8-46be-4355-8887-f5d6e174b414 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:02.311870 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-8bb20a5c-e0be-434a-85dd-7e62bf864821 req-83686df8-46be-4355-8887-f5d6e174b414 service nova] Creating event network-vif-plugged:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch1-master-1 Oct 29 22:05:02.317019 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-8bb20a5c-e0be-434a-85dd-7e62bf864821 req-83686df8-46be-4355-8887-f5d6e174b414 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031531 Oct 29 22:05:02.317737 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3745/7395] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:05:02.659703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:05:02.660396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:05:02.667914 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:02.668407 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:02.668857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:02.669600 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:02.670074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:02.670514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:02.801731 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:05:02.810091 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0fa81197-0fdb-4ffb-a46d-2ff76e2fc799 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.154331 Oct 29 22:05:02.810665 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3651/7396] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:05:02 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:05:03.835833 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:05:03.836472 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:05:03.843024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:03.843523 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:03.843977 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:03.844684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:03.845155 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:03.845749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:03.998210 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:05:04.007019 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-355d7fab-d0a7-4c2a-9688-3dc3d59adf95 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1688 microversion: 2.1 time: 0.176364 Oct 29 22:05:04.007594 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3746/7397] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:05:03 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:05:05.031972 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:05:05.032597 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:05:05.039514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:05.040002 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:05.040450 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:05.041144 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:05:05.042296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:05:05.042716 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:05:05.174588 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:05:05.182498 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0070aa8c-da99-4246-a182-7902171b5358 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1675 microversion: 2.1 time: 0.154863 Oct 29 22:05:05.183058 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3652/7398] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:05:05 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:06:50.267888 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 22:06:50.269314 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 22:06:50.269953 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=15 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:06:50.270791 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=54 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:06:50.272768 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 22:06:50.272900 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 (ip 10.222.0.36) !!! Oct 29 22:06:50.275348 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=17 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:06:50.276546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=53 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:06:50.278554 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:06:50.278684 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 29 22:06:50.292499 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:50.293767 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:50.301261 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:50.301829 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:50.302287 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:50.303022 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:50.303771 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:50.304264 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:50.338550 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 22:06:50.368372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-14835939-5e1c-47a6-8c70-132e2e4c125d req-6768300d-3c08-42c2-8bc2-1148b068f8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:06:50.385303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-14835939-5e1c-47a6-8c70-132e2e4c125d req-6768300d-3c08-42c2-8bc2-1148b068f8bd service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:50.386025 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-14835939-5e1c-47a6-8c70-132e2e4c125d req-6768300d-3c08-42c2-8bc2-1148b068f8bd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:50.386456 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-14835939-5e1c-47a6-8c70-132e2e4c125d req-6768300d-3c08-42c2-8bc2-1148b068f8bd service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:50.399363 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-14835939-5e1c-47a6-8c70-132e2e4c125d req-6768300d-3c08-42c2-8bc2-1148b068f8bd service nova] Creating event network-changed:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch1-master-1 Oct 29 22:06:50.406172 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-14835939-5e1c-47a6-8c70-132e2e4c125d req-6768300d-3c08-42c2-8bc2-1148b068f8bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137644 Oct 29 22:06:50.406451 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3653/7399] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:06:50.442610 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8007326c-d93a-42e8-99d7-33aae38cfbd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 204 len: 0 microversion: 2.1 time: 0.176581 Oct 29 22:06:50.443214 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3747/7400] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 22:06:50 2022] DELETE /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 22:06:50.452952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:50.454041 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:50.462020 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:50.462890 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:50.463591 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:50.477968 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:50.478593 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:50.479167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:50.683198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:06:50.691950 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-e1d1d15d-a15f-4a9f-a804-407b6d7846ff tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.243930 Oct 29 22:06:50.692568 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3654/7401] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:50 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:06:51.717289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:51.718053 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:51.726830 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:51.727350 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:51.727818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:51.728554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:51.729040 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:51.729529 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:51.754180 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45992. Oct 29 22:06:51.756223 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45990. Oct 29 22:06:51.924208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:06:51.932058 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7f4255f3-c2b1-4916-8231-95366d8530bd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1681 microversion: 2.1 time: 0.219544 Oct 29 22:06:51.932677 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3748/7402] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:51 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:06:52.676448 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-bc3c9b22-8066-4e89-8bd2-1d27e6006ba0 req-a4ac9873-d237-44bc-ad8f-c09feeff46b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5caee742-da26-4fc0-ad13-a64ab8fa33e6", "name": "network-vif-deleted", "tag": "74ac3d03-dbaa-4891-b07f-ae0705daaae7"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:06:52.687960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bc3c9b22-8066-4e89-8bd2-1d27e6006ba0 req-a4ac9873-d237-44bc-ad8f-c09feeff46b2 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:52.688461 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bc3c9b22-8066-4e89-8bd2-1d27e6006ba0 req-a4ac9873-d237-44bc-ad8f-c09feeff46b2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:52.688902 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-bc3c9b22-8066-4e89-8bd2-1d27e6006ba0 req-a4ac9873-d237-44bc-ad8f-c09feeff46b2 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:52.701296 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-bc3c9b22-8066-4e89-8bd2-1d27e6006ba0 req-a4ac9873-d237-44bc-ad8f-c09feeff46b2 service nova] Creating event network-vif-deleted:74ac3d03-dbaa-4891-b07f-ae0705daaae7 for instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 on nch1-master-1 Oct 29 22:06:52.706443 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-bc3c9b22-8066-4e89-8bd2-1d27e6006ba0 req-a4ac9873-d237-44bc-ad8f-c09feeff46b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033830 Oct 29 22:06:52.707050 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3655/7403] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:06:52.956785 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:52.957547 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:52.964945 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:52.965698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:52.966225 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:52.967027 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:52.967574 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:52.968024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:53.001474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:53.002001 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:53.002463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:53.002944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.objects.instance [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lazy-loading 'fault' on Instance uuid 5caee742-da26-4fc0-ad13-a64ab8fa33e6 {{(pid=138885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 22:06:53.044697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:06:53.052784 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4a8b995f-57ce-49bb-925a-a00283ce0f3f tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 200 len: 1335 microversion: 2.1 time: 0.099944 Oct 29 22:06:53.053368 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3749/7404] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:52 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:06:54.077822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:54.078533 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5caee742-da26-4fc0-ad13-a64ab8fa33e6] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:54.084856 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:54.085347 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:54.085814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:54.086518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:54.086977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:54.087413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:54.101775 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] HTTP exception thrown: Instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 could not be found. Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Request method failure captured: Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 HTTP/1.1 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXaLVZWuhY5-bMX_RdIGa_jOIjoQNU8_VtDvKjWDtjQOjgfH836pFIMl4mmVH2jI29rPRwOpY4xjhTHdKPq6GOIEIEE03qEiz2xiBOXBT8tujjYd5uy5fpy5Gh9CIp6wyi-TNF5nnNZHo0R8HrMMeqBUBOU0XNt4x9Bor_T5AK8k0dA8 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: acb94fdfb41a44379268b11c328f7d03 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestShelveInstance-1712606706 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestShelveInstance-1712606706 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: acb94fdfb41a44379268b11c328f7d03 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestShelveInstance-1712606706 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestShelveInstance-1712606706-project Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: a7d227b3e85c4c5ca5cdb36bf28a8ca4 Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestShelveInstance-1712606706-project Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 could not be found. Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '5caee742-da26-4fc0-ad13-a64ab8fa33e6'} Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 could not be found. Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 could not be found. Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:06:54.103397 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 could not be found. Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Returning 404 to user: Instance 5caee742-da26-4fc0-ad13-a64ab8fa33e6 could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d0fe49b-8012-40a0-8f93-38f1b588e2a8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6" status: 404 len: 111 microversion: 2.1 time: 0.032735 Oct 29 22:06:54.107796 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3656/7405] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:54 2022] GET /compute/v2.1/servers/5caee742-da26-4fc0-ad13-a64ab8fa33e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 22:06:54.267175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fcfe3758-671a-4f63-9e27-d6b8a4795cc8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '.version_select at 0x7fa17646a790>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:54.295471 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fcfe3758-671a-4f63-9e27-d6b8a4795cc8 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-773682467" status: 202 len: 0 microversion: 2.1 time: 0.032070 Oct 29 22:06:54.296547 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3750/7406] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 22:06:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-773682467 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 22:06:54.318376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43bf6bbd-993b-4204-bfba-ffa035f67267 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'create', calling method: .version_select at 0x7fa176228550>, body: {"keypair": {"name": "tempest-TestShelveInstance-912352387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJphrJBZRAFZbwHKk5GuopVQrr6UdnvcWaagh/RMgL3tqI2ND+E6igIPI10JmNa1nGyCSJMYdsGsCIvLGrWuTuj0EDzW1vhSl5q9PWGX/5esRwKThh71dKdw/EvrLmtQtw=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:06:54.334822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-43bf6bbd-993b-4204-bfba-ffa035f67267 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for project acb94fdfb41a44379268b11c328f7d03. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:06:54.344134 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-43bf6bbd-993b-4204-bfba-ffa035f67267 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for user a7d227b3e85c4c5ca5cdb36bf28a8ca4 and project acb94fdfb41a44379268b11c328f7d03. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:06:54.371821 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43bf6bbd-993b-4204-bfba-ffa035f67267 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.056954 Oct 29 22:06:54.372439 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3657/7407] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 22:06:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:06:56.801489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-680287158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-912352387", "security_groups": [{"name": "tempest-secgroup-smoke-580146820"}], "networks": [{"uuid": "98e1516b-784b-41c7-ac2a-2fe67b0c3bd3"}], "block_device_mapping_v2": [{"uuid": "10086bb1-c0f6-49c3-9b03-c394a4123d60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:06:56.913957 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] validate_networks() for [('98e1516b-784b-41c7-ac2a-2fe67b0c3bd3', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 22:06:57.286986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 22:06:57.287463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 22:06:57.287980 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 22:06:57.288433 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 22:06:57.288864 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 22:06:57.297702 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:57.298201 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:57.298657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:57.299427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:57.299899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:57.300342 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:57.318691 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for project acb94fdfb41a44379268b11c328f7d03. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:06:57.323907 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Getting quotas for user a7d227b3e85c4c5ca5cdb36bf28a8ca4 and project acb94fdfb41a44379268b11c328f7d03. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:06:57.381303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 22:06:57.383468 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10086bb1-c0f6-49c3-9b03-c394a4123d60',volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 22:06:57.510840 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4bf89a46-4c49-474f-bccd-1639db9c2e9d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714280 Oct 29 22:06:57.511491 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3751/7408] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 22:06:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 22:06:57.523286 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1f4183fa-f945-46b7-807f-d811040007bc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:57.523976 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1f4183fa-f945-46b7-807f-d811040007bc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:57.581841 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1f4183fa-f945-46b7-807f-d811040007bc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:06:57.589048 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1f4183fa-f945-46b7-807f-d811040007bc tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1087 microversion: 2.1 time: 0.069583 Oct 29 22:06:57.589646 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3658/7409] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:57 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:06:58.611646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-16968a3e-a823-4e56-a5b2-59b78c7a9264 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:58.612319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-16968a3e-a823-4e56-a5b2-59b78c7a9264 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:58.668034 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-16968a3e-a823-4e56-a5b2-59b78c7a9264 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:06:58.675262 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-16968a3e-a823-4e56-a5b2-59b78c7a9264 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1087 microversion: 2.1 time: 0.067394 Oct 29 22:06:58.675844 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3752/7410] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:58 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:06:59.698227 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:06:59.698858 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:06:59.706471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:59.706964 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:59.707410 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:59.708129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:06:59.708577 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:06:59.709012 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:06:59.770575 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:06:59.778920 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c424541-acb9-4027-a42e-e7dff33f3875 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1137 microversion: 2.1 time: 0.084104 Oct 29 22:06:59.779506 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3659/7411] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:06:59 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:00.802611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:00.803253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:00.810923 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:00.811436 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:00.811892 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:00.812615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:00.813091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:00.813687 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:00.887656 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:00.896258 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-515bff0c-f2df-4e57-9364-78384ed8f9ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1203 microversion: 2.1 time: 0.097539 Oct 29 22:07:00.901748 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3753/7412] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:00 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1203 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:01.920997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:01.921823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:01.929236 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:01.929759 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:01.930209 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:01.930949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:01.931531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:01.931834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:02.451558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:02.459412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-795b9393-fd60-4ef4-9067-4918e91b91b4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.543031 Oct 29 22:07:02.459998 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3660/7413] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:01 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:02.537741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-e0fd282a-e4d7-444e-9666-e4411896d096 req-e276ba60-ce81-44a1-b9e6-4a57dbf9b0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:07:02.548689 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0fd282a-e4d7-444e-9666-e4411896d096 req-e276ba60-ce81-44a1-b9e6-4a57dbf9b0b1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:02.549185 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0fd282a-e4d7-444e-9666-e4411896d096 req-e276ba60-ce81-44a1-b9e6-4a57dbf9b0b1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:02.549740 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-e0fd282a-e4d7-444e-9666-e4411896d096 req-e276ba60-ce81-44a1-b9e6-4a57dbf9b0b1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:02.562979 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-e0fd282a-e4d7-444e-9666-e4411896d096 req-e276ba60-ce81-44a1-b9e6-4a57dbf9b0b1 service nova] Creating event network-changed:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:07:02.568337 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-e0fd282a-e4d7-444e-9666-e4411896d096 req-e276ba60-ce81-44a1-b9e6-4a57dbf9b0b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035004 Oct 29 22:07:02.568957 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3754/7414] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:07:03.531868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:03.532570 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:03.538598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:03.539090 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:03.539535 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:03.540240 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:03.540705 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:03.541137 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:03.749420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:03.757376 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-aa8f5323-d2a3-4885-9d20-70dcf1590d26 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.278126 Oct 29 22:07:03.757986 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3661/7415] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:03 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:07:04.782132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:04.782859 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:04.789055 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:04.789589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:04.790048 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:04.790750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:04.791221 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:04.791668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:04.932018 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:04.940128 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-eafd8d80-005f-4110-8ac1-50bbe3931e0d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.163604 Oct 29 22:07:04.940925 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3755/7416] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:04 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:05.964092 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:05.964739 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:05.971756 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:05.972239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:05.972682 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:05.973400 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:05.973883 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:05.974315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:06.103524 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:06.111738 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-733808bc-0d6f-49c0-9b95-c2c2003de638 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.151878 Oct 29 22:07:06.112346 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3662/7417] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:05 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:07.135380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:07.136024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:07.143324 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:07.143840 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:07.144302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:07.145025 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:07.145527 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:07.145984 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:07.283635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:07.291429 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-51b4f9d9-2d62-45a9-9066-5d7fa6e22a35 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.160022 Oct 29 22:07:07.292010 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3756/7418] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:07 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:08.314975 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:08.315598 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:08.318420 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=6 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:07:08.324214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:08.324743 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:08.325193 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:08.325944 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:08.326414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:08.326855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:08.459326 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:08.468005 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8cb8097b-467f-4393-9a97-f54d834a77e6 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.156892 Oct 29 22:07:08.468519 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3663/7419] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:08 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:07:08.739460 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-3c8f2349-2dfd-44a1-b826-a2b3a3fc5516 req-b10b5ac3-5d82-4750-9473-7406a51dc390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "name": "network-vif-plugged", "status": "completed", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:07:08.744616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:07:08.746446 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=8 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:07:08.752683 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8f2349-2dfd-44a1-b826-a2b3a3fc5516 req-b10b5ac3-5d82-4750-9473-7406a51dc390 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:08.753230 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8f2349-2dfd-44a1-b826-a2b3a3fc5516 req-b10b5ac3-5d82-4750-9473-7406a51dc390 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:08.753748 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-3c8f2349-2dfd-44a1-b826-a2b3a3fc5516 req-b10b5ac3-5d82-4750-9473-7406a51dc390 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:08.764944 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-3c8f2349-2dfd-44a1-b826-a2b3a3fc5516 req-b10b5ac3-5d82-4750-9473-7406a51dc390 service nova] Creating event network-vif-plugged:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:07:08.770471 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-3c8f2349-2dfd-44a1-b826-a2b3a3fc5516 req-b10b5ac3-5d82-4750-9473-7406a51dc390 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034726 Oct 29 22:07:08.771086 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3757/7420] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:07:09.490738 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:09.491309 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:09.498764 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:09.499257 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:09.499704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:09.500406 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:09.500872 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:09.501312 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:09.639057 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:09.646947 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-db863bd7-4609-4cef-9942-34d06c6aee8c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1258 microversion: 2.1 time: 0.160276 Oct 29 22:07:09.647530 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3664/7421] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:09 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:10.671911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:10.672667 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:10.678986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:10.679486 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:10.679942 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:10.680645 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:10.681117 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:10.681596 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:10.811692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:10.819574 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-38e01ff2-f504-4ee1-b8de-e86ba61ee5bb tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1442 microversion: 2.1 time: 0.153065 Oct 29 22:07:10.820157 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3758/7422] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:10 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:10.842676 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:07:10.843330 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:07:10.850214 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:10.850703 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:10.851149 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:10.851855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:10.852318 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:10.852754 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:10.986216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:07:10.994092 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-16577484-08ee-42fb-bdc1-570550c37dd2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1442 microversion: 2.1 time: 0.155629 Oct 29 22:07:10.994675 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3665/7423] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:07:10 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:07:12.566644 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-bcd83512-5109-4ecf-9c4f-85603b2a1774 req-fd18c48e-df5e-4193-820d-97326b12d51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:07:12.577583 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bcd83512-5109-4ecf-9c4f-85603b2a1774 req-fd18c48e-df5e-4193-820d-97326b12d51b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:07:12.578095 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bcd83512-5109-4ecf-9c4f-85603b2a1774 req-fd18c48e-df5e-4193-820d-97326b12d51b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:07:12.578554 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-bcd83512-5109-4ecf-9c4f-85603b2a1774 req-fd18c48e-df5e-4193-820d-97326b12d51b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:07:12.589987 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-bcd83512-5109-4ecf-9c4f-85603b2a1774 req-fd18c48e-df5e-4193-820d-97326b12d51b service nova] Creating event network-changed:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:07:12.595872 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-bcd83512-5109-4ecf-9c4f-85603b2a1774 req-fd18c48e-df5e-4193-820d-97326b12d51b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032988 Oct 29 22:07:12.596639 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3759/7424] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:09:17.973302 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 22:09:17.974483 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:09:17.975259 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=54 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:09:17.976205 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 22:09:17.976353 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba/action (ip 10.222.0.36) !!! Oct 29 22:09:17.977476 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 22:09:17.977615 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba/action (ip 10.222.0.36) !!! Oct 29 22:09:17.983663 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:09:17.984210 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:17.993774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:17.994457 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:17.994810 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:17.995433 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:17.995893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:17.996333 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:18.020498 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.objects.instance [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lazy-loading 'flavor' on Instance uuid 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba {{(pid=138884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 22:09:18.093362 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba/action" status: 202 len: 0 microversion: 2.1 time: 0.121633 Oct 29 22:09:18.093980 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3666/7425] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:09:17 2022] POST /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:09:18.100754 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 22:09:18.102368 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 22:09:18.103911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:09:18.105167 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:09:18.106724 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 22:09:18.106869 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba (ip 10.222.0.36) !!! Oct 29 22:09:18.113091 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:18.114084 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:18.124296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:18.124793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:18.125231 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:18.125996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:18.126649 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:18.127101 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:18.269024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:18.277644 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-245b615f-d6aa-4329-8d86-9d14403d7db9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.179157 Oct 29 22:09:18.278229 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3760/7426] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:18 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:19.303569 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:19.304289 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:19.312335 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:19.312822 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:19.313270 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:19.314005 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:19.314468 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:19.314900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:19.319226 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46272. Oct 29 22:09:19.449180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:19.457089 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8d8050ed-44a0-4074-b301-40660897095d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.159447 Oct 29 22:09:19.457698 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3667/7427] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:19 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:20.481969 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:20.482512 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:20.491616 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:20.492122 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:20.492622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:20.493348 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:20.493861 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:20.494312 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:20.500511 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46276. Oct 29 22:09:20.512221 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46278. Oct 29 22:09:20.627797 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:20.635718 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-61d5dcb2-7d4d-4563-a321-f4528d7a7598 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.158080 Oct 29 22:09:20.636302 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3761/7428] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:20 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:21.659211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:21.659833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:21.667389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:21.667900 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:21.668340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:21.669035 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:21.669517 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:21.669949 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:21.798806 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:21.807781 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3b5d5759-0751-42f9-b7de-985eccedfa58 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.152560 Oct 29 22:09:21.808357 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3668/7429] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:21 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:22.832073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:22.832708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:22.839669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:22.840430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:22.840889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:22.841631 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:22.842104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:22.842546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:22.982743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:22.990604 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bdbe3815-0834-48b5-b122-a4b2acbcef99 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.162505 Oct 29 22:09:22.991188 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3762/7430] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:22 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:24.015055 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:24.015679 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:24.022816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:24.023307 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:24.023747 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:24.024444 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:24.024951 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:24.025426 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:24.154654 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:24.162422 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-2961c30c-9bd7-4f97-a8e7-c517b84b1ff5 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.151349 Oct 29 22:09:24.162993 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3669/7431] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:24 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:09:25.186947 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:25.187584 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:25.194474 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:25.194981 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:25.195444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:25.196161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:25.196635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:25.197621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:25.332763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:25.340859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-26db5c36-a00b-4b50-9abe-41edf3cbc1d3 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.157925 Oct 29 22:09:25.341436 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3763/7432] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:25 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:26.363636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:26.364266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:26.371239 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:26.371726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:26.372173 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:26.372878 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:26.373340 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:26.373807 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:26.505182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:26.513647 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-af5d0e49-a0b0-406e-89d9-3aaa23d69339 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.153958 Oct 29 22:09:26.514223 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3670/7433] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:26 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:27.537637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:27.538278 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:27.545845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:27.546345 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:27.546801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:27.547780 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:27.548254 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:27.548699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:27.683695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:27.691397 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2fa581e4-191d-4e37-99ce-2214100c3edd tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.157746 Oct 29 22:09:27.691973 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3764/7434] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:27 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:28.715637 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:28.716266 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:28.723269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:28.723699 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:28.724146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:28.724867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:28.725328 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:28.725787 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:28.932322 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:28.940382 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-fd101cad-2f51-42d3-b850-a5f2dae5adc4 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.229542 Oct 29 22:09:28.940961 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3671/7435] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:28 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:29.964028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:29.964673 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:29.972035 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:29.972545 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:29.973010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:29.973768 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:29.974251 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:29.974709 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:30.115387 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:30.123374 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a83a1e1c-59b7-4d62-8b83-3f3db5713a8d tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.164230 Oct 29 22:09:30.123954 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3765/7436] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:29 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:31.146627 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:31.147206 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:31.154167 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:31.154659 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:31.155105 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:31.155811 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:31.156304 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:31.156737 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:31.292308 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:31.300304 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-4d1accd1-b69a-4580-bd5e-f1de1c5ed960 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1567 microversion: 2.1 time: 0.157585 Oct 29 22:09:31.300886 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3672/7437] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:31 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:09:31.324010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:09:31.324639 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:31.332669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:31.333359 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:31.333905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:31.334638 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:31.335119 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:31.335603 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:31.367637 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=138885) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 22:09:31.438769 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "POST /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba/action" status: 202 len: 0 microversion: 2.1 time: 0.119125 Oct 29 22:09:31.439304 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3766/7438] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:09:31 2022] POST /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:09:31.448302 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:31.448917 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:31.455146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:31.455635 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:31.456073 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:31.456771 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:31.457231 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:31.457690 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:31.659864 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:31.668986 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cde25e2f-32ea-4bbd-ad59-536166a526e9 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1515 microversion: 2.1 time: 0.225221 Oct 29 22:09:31.669600 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3673/7439] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:31 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:09:32.693490 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:32.694138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:32.700853 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:32.701354 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:32.701848 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:32.702563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:32.703044 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:32.703492 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:32.836303 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:32.845077 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d2498ca1-099e-4cd0-917e-7d4bb1ff4a06 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1517 microversion: 2.1 time: 0.156714 Oct 29 22:09:32.845700 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3767/7440] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:32 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:33.447295 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-06741a6b-4493-4e8f-8b9b-6560488edb28 req-edc6e52a-f7bf-44ed-a150-c40f2cad7c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "name": "network-vif-unplugged", "status": "completed", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:09:33.457131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-06741a6b-4493-4e8f-8b9b-6560488edb28 req-edc6e52a-f7bf-44ed-a150-c40f2cad7c62 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:33.457672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-06741a6b-4493-4e8f-8b9b-6560488edb28 req-edc6e52a-f7bf-44ed-a150-c40f2cad7c62 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:33.458107 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-06741a6b-4493-4e8f-8b9b-6560488edb28 req-edc6e52a-f7bf-44ed-a150-c40f2cad7c62 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:33.469891 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-06741a6b-4493-4e8f-8b9b-6560488edb28 req-edc6e52a-f7bf-44ed-a150-c40f2cad7c62 service nova] Creating event network-vif-unplugged:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:09:33.474869 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-06741a6b-4493-4e8f-8b9b-6560488edb28 req-edc6e52a-f7bf-44ed-a150-c40f2cad7c62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081849 Oct 29 22:09:33.475474 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3674/7441] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:09:33.869982 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:33.870577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:33.877563 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:33.878078 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:33.878540 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:33.879269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:33.879745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:33.880194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:34.104943 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:34.113356 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f719ac4b-0a48-4676-8ea6-5075a7abee5b tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1573 microversion: 2.1 time: 0.247513 Oct 29 22:09:34.114138 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3768/7442] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:33 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:35.137850 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:35.138714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:35.144782 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:35.145277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:35.145761 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:35.146471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:35.146939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:35.147379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:35.292138 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:35.300066 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8b218fe0-bac1-4ea3-a8bc-925ddce0286c tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1573 microversion: 2.1 time: 0.167610 Oct 29 22:09:35.300643 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3675/7443] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:35 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:36.324142 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:36.324828 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:36.331739 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:36.332237 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:36.332692 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:36.333407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:36.333908 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:36.334353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:36.466263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:36.474249 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8303ddf3-3383-4e2e-8eba-5906c4e5a671 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1573 microversion: 2.1 time: 0.154095 Oct 29 22:09:36.474824 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3769/7444] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:36 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:37.499021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:37.499734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:37.506816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:37.507314 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:37.507763 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:37.508471 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:37.508938 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:37.510014 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:37.645324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:37.653208 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-8933493a-78e3-4bd9-862c-70f30ea47cb2 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1573 microversion: 2.1 time: 0.158198 Oct 29 22:09:37.653818 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3676/7445] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:37 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:09:38.676103 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:38.676745 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:38.684352 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:38.684858 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:38.685319 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:38.686073 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:38.686551 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:38.687005 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:38.816622 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:38.825538 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd681e48-db94-4876-8478-ede8149a2939 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1573 microversion: 2.1 time: 0.153380 Oct 29 22:09:38.826118 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3770/7446] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:38 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:39.492757 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d4fcfa88-1bbb-4b13-9ea0-f231e746d267 req-5d3371fe-d6bf-4061-bb19-ba5aae181b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "name": "network-vif-plugged", "status": "completed", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:09:39.504004 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d4fcfa88-1bbb-4b13-9ea0-f231e746d267 req-5d3371fe-d6bf-4061-bb19-ba5aae181b41 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:39.504501 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d4fcfa88-1bbb-4b13-9ea0-f231e746d267 req-5d3371fe-d6bf-4061-bb19-ba5aae181b41 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:39.504947 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d4fcfa88-1bbb-4b13-9ea0-f231e746d267 req-5d3371fe-d6bf-4061-bb19-ba5aae181b41 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:39.516404 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d4fcfa88-1bbb-4b13-9ea0-f231e746d267 req-5d3371fe-d6bf-4061-bb19-ba5aae181b41 service nova] Creating event network-vif-plugged:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:09:39.521518 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d4fcfa88-1bbb-4b13-9ea0-f231e746d267 req-5d3371fe-d6bf-4061-bb19-ba5aae181b41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Oct 29 22:09:39.522139 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3677/7447] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:09:39.849393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:39.850064 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:39.856899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:39.857399 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:39.857889 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:39.858600 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:39.859072 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:39.859518 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:39.992614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:40.000515 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-cd9bea53-97aa-4c99-aa7f-21854ca33455 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1573 microversion: 2.1 time: 0.155073 Oct 29 22:09:40.001104 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3771/7448] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:39 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:09:41.026640 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:09:41.027255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:09:41.033543 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:41.034046 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:41.034490 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:41.035212 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:09:41.035664 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:09:41.036103 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:09:41.171099 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:09:41.179041 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-f5e98629-d4d5-4fe0-9ef2-73127e5085ce tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1560 microversion: 2.1 time: 0.158297 Oct 29 22:09:41.179629 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3678/7449] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:09:41 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:05.264972 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:05.265918 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:05.266766 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:11:05.266932 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba (ip 10.222.0.36) !!! Oct 29 22:11:05.270338 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=26 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:05.271973 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:05.272925 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:11:05.273070 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 29 22:11:05.275665 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:11:05.275790 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:11:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba (ip 10.222.0.36) !!! Oct 29 22:11:05.281929 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-3d3471e8-13b1-48d3-939c-26e0328c8302 req-612b5605-c533-47d3-933b-f357c6cd1f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:05.292394 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:05.293024 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:05.298901 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3d3471e8-13b1-48d3-939c-26e0328c8302 req-612b5605-c533-47d3-933b-f357c6cd1f83 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:05.299414 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3d3471e8-13b1-48d3-939c-26e0328c8302 req-612b5605-c533-47d3-933b-f357c6cd1f83 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:05.299868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-3d3471e8-13b1-48d3-939c-26e0328c8302 req-612b5605-c533-47d3-933b-f357c6cd1f83 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:05.303695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:05.304496 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:05.305220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:05.306260 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:05.306811 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:05.307528 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:05.320161 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-3d3471e8-13b1-48d3-939c-26e0328c8302 req-612b5605-c533-47d3-933b-f357c6cd1f83 service nova] Creating event network-changed:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:11:05.325751 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-3d3471e8-13b1-48d3-939c-26e0328c8302 req-612b5605-c533-47d3-933b-f357c6cd1f83 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057242 Oct 29 22:11:05.326386 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3679/7450] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:11:05.340240 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 22:11:05.428982 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-521afc30-2574-477d-8dc2-7de627b11417 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 204 len: 0 microversion: 2.1 time: 0.165730 Oct 29 22:11:05.429804 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3772/7451] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 22:11:05 2022] DELETE /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 22:11:05.438997 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:05.439714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:05.449148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:05.449592 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:05.450039 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:05.450833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:05.451296 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:05.451762 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:05.606516 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:05.614453 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-b291ad13-eb2a-4d65-b9c9-f6584a906558 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.179975 Oct 29 22:11:05.615022 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3680/7452] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:05 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:06.639963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:06.640684 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:06.649116 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:06.649668 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:06.650236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:06.650963 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:06.651434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:06.652020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:06.809133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:06.817986 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-95248fed-6a02-4ba2-a27c-e37b489338aa tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1566 microversion: 2.1 time: 0.182365 Oct 29 22:11:06.819460 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3773/7453] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:06 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:07.693988 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-260bd047-bc0c-449e-81db-4ede9d1e2659 req-0a6bb3fd-a09e-4d10-a3c1-22ac25bf7b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e7f0685-27e2-4eee-9ded-ba403fbcb2ba", "name": "network-vif-deleted", "tag": "8367f32c-65fb-4135-8183-31a68f9b0e28"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:07.703438 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-260bd047-bc0c-449e-81db-4ede9d1e2659 req-0a6bb3fd-a09e-4d10-a3c1-22ac25bf7b15 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:07.703932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-260bd047-bc0c-449e-81db-4ede9d1e2659 req-0a6bb3fd-a09e-4d10-a3c1-22ac25bf7b15 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:07.704389 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-260bd047-bc0c-449e-81db-4ede9d1e2659 req-0a6bb3fd-a09e-4d10-a3c1-22ac25bf7b15 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:07.715932 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-260bd047-bc0c-449e-81db-4ede9d1e2659 req-0a6bb3fd-a09e-4d10-a3c1-22ac25bf7b15 service nova] Creating event network-vif-deleted:8367f32c-65fb-4135-8183-31a68f9b0e28 for instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba on nch2-master-1 Oct 29 22:11:07.720848 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-260bd047-bc0c-449e-81db-4ede9d1e2659 req-0a6bb3fd-a09e-4d10-a3c1-22ac25bf7b15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081786 Oct 29 22:11:07.721486 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3681/7454] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:11:07.842911 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:07.843549 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:07.851996 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:07.852582 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:07.853077 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:07.853962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:07.854626 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:07.855196 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:07.947010 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d227b3e85c4c5ca5cdb36bf28a8ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb94fdfb41a44379268b11c328f7d03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:07.959577 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-973c66d2-8820-4db7-a543-c2e7c1ce8bab tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 200 len: 1218 microversion: 2.1 time: 0.120209 Oct 29 22:11:07.969634 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3774/7455] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:07 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:08.986180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:08.986816 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] [instance: 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:08.993639 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:08.994127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:08.994572 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:08.995260 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:08.995717 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:08.996148 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:09.009525 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] HTTP exception thrown: Instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba could not be found. Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Request method failure captured: Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba HTTP/1.1 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXaLVZWuhY5-bMX_RdIGa_jOIjoQNU8_VtDvKjWDtjQOjgfH836pFIMl4mmVH2jI29rPRwOpY4xjhTHdKPq6GOIEIEE03qEiz2xiBOXBT8tujjYd5uy5fpy5Gh9CIp6wyi-TNF5nnNZHo0R8HrMMeqBUBOU0XNt4x9Bor_T5AK8k0dA8 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: acb94fdfb41a44379268b11c328f7d03 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestShelveInstance-1712606706 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/acb94fdfb41a44379268b11c328f7d03"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestShelveInstance-1712606706 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: acb94fdfb41a44379268b11c328f7d03 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestShelveInstance-1712606706 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestShelveInstance-1712606706-project Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: a7d227b3e85c4c5ca5cdb36bf28a8ca4 Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestShelveInstance-1712606706-project Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba could not be found. Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '5e7f0685-27e2-4eee-9ded-ba403fbcb2ba'} Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba could not be found. Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba could not be found. Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:11:09.011141 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba could not be found. Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Returning 404 to user: Instance 5e7f0685-27e2-4eee-9ded-ba403fbcb2ba could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-dd12ed5e-400b-4094-ba98-7257f2e73ede tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba" status: 404 len: 111 microversion: 2.1 time: 0.031590 Oct 29 22:11:09.015704 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3682/7456] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:08 2022] GET /compute/v2.1/servers/5e7f0685-27e2-4eee-9ded-ba403fbcb2ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 22:11:09.171548 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ac2ecca5-73df-4f6f-b373-98eac00c2252 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] Calling method '.version_select at 0x7fa1713751f0>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:09.200025 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ac2ecca5-73df-4f6f-b373-98eac00c2252 tempest-TestShelveInstance-1712606706 tempest-TestShelveInstance-1712606706-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-912352387" status: 202 len: 0 microversion: 2.1 time: 0.032484 Oct 29 22:11:09.212681 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3775/7457] 10.222.0.36 () {58 vars in 1251 bytes} [Sat Oct 29 22:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-912352387 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 22:11:26.489393 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:26.490337 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=12 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:26.676636 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-50dcad51-6a24-400b-a001-32be11874a35 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Action: 'create', calling method: .version_select at 0x7fa171951820>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-435038263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFNzexWZBU5FiIDn/qJBbpP9tQmeWj/d7AQj1k+6MBaIqOd3Vv7T5/ki8dT7kZU+8PmBnA6KdfjbpUYqow2HNP5wLf8LxW7g8cNub8gB8svOf5MEbeVPlScDo6khX7GXg=="}} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:26.696735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-50dcad51-6a24-400b-a001-32be11874a35 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Getting quotas for project 5a948f34a83e48b0866ffebda9a0870e. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:11:26.702848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.quota [None req-50dcad51-6a24-400b-a001-32be11874a35 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Getting quotas for user 50d8c2096975438b8cd09d9f51409916 and project 5a948f34a83e48b0866ffebda9a0870e. Resources: {'key_pairs'} {{(pid=138884) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:11:26.734575 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-50dcad51-6a24-400b-a001-32be11874a35 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.250409 Oct 29 22:11:26.735370 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3683/7458] 10.222.0.36 () {60 vars in 1159 bytes} [Sat Oct 29 22:11:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:11:27.763749 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:27.764546 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:27.768733 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1352028502", "imageRef": "1a2bec42-cf5e-436b-826e-51ea67e041f7", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-435038263", "security_groups": [{"name": "tempest-secgroup-smoke-1631424598"}], "networks": [{"uuid": "383f3792-7fae-47e5-8661-7928651eb67a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:27.880174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] validate_networks() for [('383f3792-7fae-47e5-8661-7928651eb67a', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 22:11:28.354470 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 22:11:28.354913 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 22:11:28.355430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 22:11:28.355856 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 22:11:28.356283 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 22:11:28.365406 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:28.365944 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:28.366407 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:28.367168 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:28.367646 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:28.368094 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:28.386577 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Getting quotas for project 5a948f34a83e48b0866ffebda9a0870e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:11:28.391986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Getting quotas for user 50d8c2096975438b8cd09d9f51409916 and project 5a948f34a83e48b0866ffebda9a0870e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:11:28.405685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 22:11:28.408136 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a2bec42-cf5e-436b-826e-51ea67e041f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 22:11:28.457031 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ec509b48-50d8-4d96-8d27-1e65922cbc47 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695244 Oct 29 22:11:28.457738 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3776/7459] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 22:11:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 22:11:28.470129 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75371340-9e86-4160-a23f-e12144a240ae tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:28.470672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75371340-9e86-4160-a23f-e12144a240ae tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:28.530180 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75371340-9e86-4160-a23f-e12144a240ae tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:28.537331 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75371340-9e86-4160-a23f-e12144a240ae tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1248 microversion: 2.1 time: 0.071756 Oct 29 22:11:28.538336 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3684/7460] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:28 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:11:29.561635 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-ef6047b1-ae86-4859-aa4f-d636e2b097b6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:29.562280 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-ef6047b1-ae86-4859-aa4f-d636e2b097b6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:29.623675 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-ef6047b1-ae86-4859-aa4f-d636e2b097b6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:29.631173 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-ef6047b1-ae86-4859-aa4f-d636e2b097b6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1248 microversion: 2.1 time: 0.074681 Oct 29 22:11:29.631755 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3777/7461] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:29 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:11:30.655291 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ed72ea34-c574-4726-ae23-e683524a947b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:30.656074 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ed72ea34-c574-4726-ae23-e683524a947b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:30.710373 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ed72ea34-c574-4726-ae23-e683524a947b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:30.718228 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ed72ea34-c574-4726-ae23-e683524a947b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1248 microversion: 2.1 time: 0.067430 Oct 29 22:11:30.718887 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3685/7462] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:30 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:31.744184 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-1f54e0d3-9cbf-487a-b094-9abd7b8eba9e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:31.744826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-1f54e0d3-9cbf-487a-b094-9abd7b8eba9e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:31.799263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-1f54e0d3-9cbf-487a-b094-9abd7b8eba9e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:31.806859 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-1f54e0d3-9cbf-487a-b094-9abd7b8eba9e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1248 microversion: 2.1 time: 0.066627 Oct 29 22:11:31.807445 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3778/7463] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:31 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:32.831276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:32.831899 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:32.839959 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:32.840446 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:32.841152 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:32.841928 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:32.842374 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:32.842814 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:32.908069 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:32.916811 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-1e19874a-fbe5-4ec8-b401-205ef13110ba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1252 microversion: 2.1 time: 0.089429 Oct 29 22:11:32.917574 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3686/7464] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:32 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1252 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:33.939777 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:33.940405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:33.948801 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:33.949321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:33.949794 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:33.950521 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:33.950994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:33.951438 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:34.022413 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:34.030645 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-da04b92e-d054-4ee9-b82e-cf71ec496b3f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1306 microversion: 2.1 time: 0.094781 Oct 29 22:11:34.031242 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3779/7465] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:33 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:35.059259 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:35.059877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-8532c005-df0c-4dfa-98e6-cc4dc27f3b7e req-03ad6b48-37f9-49fa-9d42-46b877a848da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:35.060252 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:35.072269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8532c005-df0c-4dfa-98e6-cc4dc27f3b7e req-03ad6b48-37f9-49fa-9d42-46b877a848da service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:35.073269 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8532c005-df0c-4dfa-98e6-cc4dc27f3b7e req-03ad6b48-37f9-49fa-9d42-46b877a848da service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:35.073834 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-8532c005-df0c-4dfa-98e6-cc4dc27f3b7e req-03ad6b48-37f9-49fa-9d42-46b877a848da service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:35.080156 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:35.080970 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:35.082298 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:35.084081 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:35.084808 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:35.085273 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:35.089123 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-8532c005-df0c-4dfa-98e6-cc4dc27f3b7e req-03ad6b48-37f9-49fa-9d42-46b877a848da service nova] Creating event network-changed:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:11:35.095083 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-8532c005-df0c-4dfa-98e6-cc4dc27f3b7e req-03ad6b48-37f9-49fa-9d42-46b877a848da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046125 Oct 29 22:11:35.096535 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3687/7466] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:11:35.226967 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:35.235510 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-20d2794d-a761-42d5-95a6-012f84d4deb3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.185374 Oct 29 22:11:35.236104 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3780/7467] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:35 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:36.258971 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:36.259715 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:36.266175 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:36.266672 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:36.267120 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:36.267823 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:36.268285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:36.268722 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:36.407795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:36.416286 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-0b04c652-2479-43bc-9387-6caf3ec0bda8 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.162472 Oct 29 22:11:36.416885 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3688/7468] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:36 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:37.439824 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:37.440461 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:37.447592 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:37.448104 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:37.448566 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:37.449285 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:37.449787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:37.450241 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:37.583405 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:37.591413 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-323e2c72-a057-4b40-9c55-c4cd2678c91c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.155340 Oct 29 22:11:37.591994 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3781/7469] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:37 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:38.614770 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:38.615396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:38.622734 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:38.623220 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:38.623668 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:38.624365 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:38.624824 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:38.625253 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:38.755671 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:38.763433 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-604c3deb-a908-4a7a-83d6-9846c538dad5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.152607 Oct 29 22:11:38.763999 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3689/7470] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:38 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:39.786020 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:39.787174 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:39.789093 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:39.795835 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:39.796334 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:39.796786 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:39.797520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:39.797994 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:39.798439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:39.937028 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:39.944911 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-d34c1813-29b1-4789-9e07-0d0c3417dc50 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.162790 Oct 29 22:11:39.945531 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3782/7471] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:39 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:40.968628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:40.969178 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:40.972052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=8 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:40.978048 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:40.978530 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:40.978967 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:40.979660 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:40.980113 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:40.980539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:41.110265 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:41.118140 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ff226971-4025-47af-9b24-e267bc856c82 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.153745 Oct 29 22:11:41.118731 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3690/7472] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:40 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:42.037014 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-31593fd8-cec6-42c6-b3d2-d6d3745a27ba req-bbb09902-c4e4-4727-a766-d9993a93717f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "name": "network-vif-plugged", "status": "completed", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:42.043883 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=10 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:11:42.050402 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-31593fd8-cec6-42c6-b3d2-d6d3745a27ba req-bbb09902-c4e4-4727-a766-d9993a93717f service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:42.050905 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-31593fd8-cec6-42c6-b3d2-d6d3745a27ba req-bbb09902-c4e4-4727-a766-d9993a93717f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:42.051385 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-31593fd8-cec6-42c6-b3d2-d6d3745a27ba req-bbb09902-c4e4-4727-a766-d9993a93717f service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:42.063571 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-31593fd8-cec6-42c6-b3d2-d6d3745a27ba req-bbb09902-c4e4-4727-a766-d9993a93717f service nova] Creating event network-vif-plugged:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:11:42.069002 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-31593fd8-cec6-42c6-b3d2-d6d3745a27ba req-bbb09902-c4e4-4727-a766-d9993a93717f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036409 Oct 29 22:11:42.069637 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3783/7473] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:11:42.141594 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:42.142146 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:42.149211 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:42.149721 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:42.150182 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:42.150904 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:42.151376 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:42.151831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:42.292232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:42.300036 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a0c388d6-6d3c-420a-8785-eae4e0862520 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.162595 Oct 29 22:11:42.300606 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3691/7474] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:42 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:43.325659 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:43.326416 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:43.332708 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:43.333236 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:43.333784 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:43.334491 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:43.334962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:43.335403 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:43.476730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:43.484484 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-f4491922-3ec8-490b-9c1f-de3cd7d88eac tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1374 microversion: 2.1 time: 0.163952 Oct 29 22:11:43.485065 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3784/7475] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:43 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:44.508795 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:44.509334 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:44.516396 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:44.516886 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:44.517331 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:44.518060 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:44.518526 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:44.518960 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:44.651370 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:44.659246 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7ef71eea-caed-4b07-b961-e136d5cf1c12 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1559 microversion: 2.1 time: 0.154990 Oct 29 22:11:44.659826 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3692/7476] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:44 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:44.682325 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:11:44.682965 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:11:44.689832 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:44.690328 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:44.690782 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:44.691489 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:44.691960 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:44.692962 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:44.821710 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:11:44.829563 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9f78ce64-7ea4-4242-b062-3da11201528c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1559 microversion: 2.1 time: 0.151155 Oct 29 22:11:44.830145 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3785/7477] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:11:44 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:11:46.723288 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-041af6fa-3fa1-4c7c-9579-f032fd9bd231 req-fa30e3f0-275f-4f40-9c10-f7e99ce3b263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:11:46.735264 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-041af6fa-3fa1-4c7c-9579-f032fd9bd231 req-fa30e3f0-275f-4f40-9c10-f7e99ce3b263 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:11:46.735758 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-041af6fa-3fa1-4c7c-9579-f032fd9bd231 req-fa30e3f0-275f-4f40-9c10-f7e99ce3b263 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:11:46.736195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-041af6fa-3fa1-4c7c-9579-f032fd9bd231 req-fa30e3f0-275f-4f40-9c10-f7e99ce3b263 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:11:46.748063 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-041af6fa-3fa1-4c7c-9579-f032fd9bd231 req-fa30e3f0-275f-4f40-9c10-f7e99ce3b263 service nova] Creating event network-changed:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:11:46.753236 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-041af6fa-3fa1-4c7c-9579-f032fd9bd231 req-fa30e3f0-275f-4f40-9c10-f7e99ce3b263 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Oct 29 22:11:46.753895 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3693/7478] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:13:43.935888 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 22:13:43.936828 ncdv-master-1 devstack@n-api.service[138885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 22:13:43.937698 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:13:43.938462 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=40 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:13:43.943755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-218510531"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:13:43.946133 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:13:43.953685 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:43.954192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:43.954653 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:43.955367 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:43.955873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:43.956321 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:44.267191 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a7ed725e-204d-4559-a826-1741f89d5a01 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "POST /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123/action" status: 202 len: 0 microversion: 2.1 time: 0.333036 Oct 29 22:13:44.267837 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3786/7479] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:13:43 2022] POST /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 22:13:50.579624 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 22:13:50.581628 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 22:13:50.583596 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:13:50.586603 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=40 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:13:50.595255 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-d98b5d6a-b17d-44ed-80fc-9c84c21f0e80 req-425f1a8f-d1b5-424c-901d-40539df27f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "name": "network-vif-plugged", "status": "completed", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:13:50.613151 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d98b5d6a-b17d-44ed-80fc-9c84c21f0e80 req-425f1a8f-d1b5-424c-901d-40539df27f0a service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:50.613779 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d98b5d6a-b17d-44ed-80fc-9c84c21f0e80 req-425f1a8f-d1b5-424c-901d-40539df27f0a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:50.614230 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-d98b5d6a-b17d-44ed-80fc-9c84c21f0e80 req-425f1a8f-d1b5-424c-901d-40539df27f0a service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:50.627738 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-d98b5d6a-b17d-44ed-80fc-9c84c21f0e80 req-425f1a8f-d1b5-424c-901d-40539df27f0a service nova] Creating event network-vif-plugged:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:13:50.634162 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-d98b5d6a-b17d-44ed-80fc-9c84c21f0e80 req-425f1a8f-d1b5-424c-901d-40539df27f0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057568 Oct 29 22:13:50.635086 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3694/7480] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:13:57.810070 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:13:57.810870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:13:57.817615 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-962624772", "imageRef": "14065662-015b-47cf-a2ff-8f9e16e347cf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-435038263", "security_groups": [{"name": "tempest-secgroup-smoke-1631424598"}], "networks": [{"uuid": "383f3792-7fae-47e5-8661-7928651eb67a"}]}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:13:57.843990 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bee7bc0-0901-455d-9f20-5dd99d7d47f0] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46856. Oct 29 22:13:57.844760 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] [2fe09394-d002-40b0-91a4-8092884a64bc] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46854. Oct 29 22:13:57.928308 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.network.neutron [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] validate_networks() for [('383f3792-7fae-47e5-8661-7928651eb67a', None, None, None, None, None)] {{(pid=138885) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 22:13:58.635991 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Flavor limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 22:13:58.636459 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Image limits 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 22:13:58.636956 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Flavor pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 22:13:58.637393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Image pref 0:0:0 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 22:13:58.637868 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.virt.hardware [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=138885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 22:13:58.646743 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:58.647248 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:58.647714 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:58.648466 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:58.648941 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:58.649388 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:58.666755 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Getting quotas for project 5a948f34a83e48b0866ffebda9a0870e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 22:13:58.672031 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.quota [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Getting quotas for user 50d8c2096975438b8cd09d9f51409916 and project 5a948f34a83e48b0866ffebda9a0870e. Resources: {'ram', 'cores', 'instances'} {{(pid=138885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 22:13:58.685258 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Going to run 1 instances... {{(pid=138885) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 22:13:58.687820 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='14065662-015b-47cf-a2ff-8f9e16e347cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=138885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 22:13:58.735632 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a9ed8a3b-e964-4d5c-8b6f-6f5308551b7a tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929562 Oct 29 22:13:58.736285 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3787/7481] 10.222.0.36 () {60 vars in 1147 bytes} [Sat Oct 29 22:13:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 22:13:58.748301 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-14f36fe8-e543-412c-8718-fd84db1325a3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:13:58.749183 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-14f36fe8-e543-412c-8718-fd84db1325a3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:13:58.777789 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46874. Oct 29 22:13:58.779336 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46872. Oct 29 22:13:58.870198 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-14f36fe8-e543-412c-8718-fd84db1325a3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:13:58.878548 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-14f36fe8-e543-412c-8718-fd84db1325a3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1247 microversion: 2.1 time: 0.134667 Oct 29 22:13:58.879341 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3695/7482] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:13:58 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1247 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:13:59.903208 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:13:59.903850 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:13:59.910971 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:59.912192 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:59.912819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:59.913580 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:13:59.914058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:13:59.914669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:13:59.985194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:13:59.994613 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-8ef13ec8-0d0a-419b-9a75-0343eb69f050 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1307 microversion: 2.1 time: 0.096165 Oct 29 22:13:59.995618 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3788/7483] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:13:59 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:01.022164 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:01.022774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:01.029323 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:14:01.036701 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:01.037207 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:01.037835 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:01.038584 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:01.039047 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:01.039477 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:01.195963 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:01.204879 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-55aeedad-704f-4793-a644-022125972f41 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.188294 Oct 29 22:14:01.209837 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3696/7484] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:01 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:02.230344 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:02.230986 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:02.238475 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:02.239148 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:02.240430 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:02.241175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:02.241730 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:02.242322 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:02.403774 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:02.412863 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c6f031b7-50a4-43fb-8ab8-d443ddbb4399 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.186392 Oct 29 22:14:02.413491 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3789/7485] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:02 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:02.596788 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-84878c6e-4a6c-4d03-b0c2-f7f1d36ad7cb req-401ed4c8-50e2-4368-9f26-53a6b2e005b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "name": "network-vif-unplugged", "status": "completed", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:14:02.611277 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-84878c6e-4a6c-4d03-b0c2-f7f1d36ad7cb req-401ed4c8-50e2-4368-9f26-53a6b2e005b1 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:02.611769 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-84878c6e-4a6c-4d03-b0c2-f7f1d36ad7cb req-401ed4c8-50e2-4368-9f26-53a6b2e005b1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:02.612201 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-84878c6e-4a6c-4d03-b0c2-f7f1d36ad7cb req-401ed4c8-50e2-4368-9f26-53a6b2e005b1 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:02.646177 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-84878c6e-4a6c-4d03-b0c2-f7f1d36ad7cb req-401ed4c8-50e2-4368-9f26-53a6b2e005b1 service nova] Creating event network-vif-unplugged:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:14:02.653488 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-84878c6e-4a6c-4d03-b0c2-f7f1d36ad7cb req-401ed4c8-50e2-4368-9f26-53a6b2e005b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062705 Oct 29 22:14:02.654645 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3697/7486] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:14:03.436228 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:03.436877 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:03.445140 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:03.445696 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:03.446161 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:03.446903 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:03.447383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:03.447836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:03.589380 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:03.599564 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-658f495c-403e-4eee-b4fa-8369ed4111ca tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.166751 Oct 29 22:14:03.600176 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3790/7487] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:03 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:04.624094 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:04.624867 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:04.632710 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:04.633204 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:04.633687 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:04.634403 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:04.634885 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:04.635315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:04.784726 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:04.793384 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-75db5da6-7a9b-4c5d-b18f-4fb1f82aab27 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.173704 Oct 29 22:14:04.794001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3698/7488] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:04 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:05.816607 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:05.818131 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:05.827189 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:05.827699 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:05.828608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:05.829395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:05.829978 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:05.830695 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:05.991666 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:06.000892 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-00d8ab15-7c65-47c1-a7b7-b158c0df7bd6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.187984 Oct 29 22:14:06.001848 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3791/7489] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:05 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:07.024855 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:07.026881 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:07.034698 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:07.035303 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:07.036531 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:07.037491 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:07.038088 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:07.038537 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:07.191187 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:07.201202 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-a2447238-630f-4407-9467-42ab35b6cd68 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.179457 Oct 29 22:14:07.205745 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3699/7490] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:07 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:08.226760 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:08.227812 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:08.235302 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:08.235818 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:08.236262 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:08.236973 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:08.237444 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:08.237914 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:08.372463 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:08.380686 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-e2140879-183e-47b4-9a27-f38738cb673d tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.158000 Oct 29 22:14:08.381257 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3792/7491] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:08 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:09.404195 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:09.404837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:09.407667 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell0:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:14:09.413413 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:09.413931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:09.414375 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:09.415077 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:09.415541 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:09.415978 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:09.546050 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:09.554447 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6be30a8e-4337-453f-b4c7-8d71107549b3 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.154195 Oct 29 22:14:09.555040 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3700/7492] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:09 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:10.450611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-473542a5-d51f-41e4-8c48-fddd79491ecc req-4dbf3ff9-1819-4d34-bc09-911851dd6c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24af88cd-b779-4286-a535-d0fe13c1ec0c", "tag": "49cf1cd4-145e-4721-bcbd-d37636f37fae"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:14:10.457520 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:14:10.458594 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell0:SELECT=6 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:14:10.468826 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-473542a5-d51f-41e4-8c48-fddd79491ecc req-4dbf3ff9-1819-4d34-bc09-911851dd6c62 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:10.469327 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-473542a5-d51f-41e4-8c48-fddd79491ecc req-4dbf3ff9-1819-4d34-bc09-911851dd6c62 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:10.469810 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-473542a5-d51f-41e4-8c48-fddd79491ecc req-4dbf3ff9-1819-4d34-bc09-911851dd6c62 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:10.481442 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-473542a5-d51f-41e4-8c48-fddd79491ecc req-4dbf3ff9-1819-4d34-bc09-911851dd6c62 service nova] Creating event network-changed:49cf1cd4-145e-4721-bcbd-d37636f37fae for instance 24af88cd-b779-4286-a535-d0fe13c1ec0c on nch1-master-1 Oct 29 22:14:10.488012 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-473542a5-d51f-41e4-8c48-fddd79491ecc req-4dbf3ff9-1819-4d34-bc09-911851dd6c62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042218 Oct 29 22:14:10.488628 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3793/7493] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:14:10.577276 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:10.577940 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:10.584857 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:10.585352 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:10.585833 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:10.586539 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:10.587037 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:10.587474 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:10.726168 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:10.733936 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3be11ed6-4fe4-4b9b-9e1b-fb41165f0946 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.160672 Oct 29 22:14:10.734523 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3701/7494] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:10 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:11.758533 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:11.759289 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:11.766395 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:11.766899 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:11.767353 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:11.768063 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:11.768536 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:11.768979 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:11.902958 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:11.910655 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c049040c-1e43-4cd9-ab15-e55b06ac5109 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.157055 Oct 29 22:14:11.911236 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3794/7495] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:11 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:12.934602 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:12.935216 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:12.942290 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:12.942774 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:12.943219 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:12.944514 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:12.944974 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:12.945434 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:13.078443 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:13.086243 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-43299552-8df9-429a-b562-a27c789de13f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.155634 Oct 29 22:14:13.086914 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3702/7496] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:12 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:14.110576 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:14.111220 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:14.118112 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:14.118611 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:14.119075 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:14.119787 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:14.120265 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:14.120716 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:14.256539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:14.264308 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-9e335961-662b-4390-87ff-0788636c03a7 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.157715 Oct 29 22:14:14.264889 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3795/7497] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:14 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:15.287877 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:15.288492 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:15.295470 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:15.295952 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:15.296390 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:15.297079 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:15.297558 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:15.297987 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:15.428532 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:15.436396 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-cd5c6bd5-6db8-45e1-8ceb-c6174bac3839 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.152486 Oct 29 22:14:15.437001 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3703/7498] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:15 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:16.460614 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:16.461253 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:16.468427 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:16.469046 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:16.469539 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:16.470263 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:16.470741 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:16.471194 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:16.605445 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:16.613239 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-21dfc0f4-f9f0-42ea-9ab2-ced70e242e1b tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.157195 Oct 29 22:14:16.613849 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3796/7499] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:16 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:17.045709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-7e2db80e-e00b-463d-8e5c-14221710dcd6 req-59e3c30a-367d-467f-a69f-4cb24c74b986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24af88cd-b779-4286-a535-d0fe13c1ec0c", "name": "network-vif-plugged", "status": "completed", "tag": "49cf1cd4-145e-4721-bcbd-d37636f37fae"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:14:17.058324 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7e2db80e-e00b-463d-8e5c-14221710dcd6 req-59e3c30a-367d-467f-a69f-4cb24c74b986 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:17.058815 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7e2db80e-e00b-463d-8e5c-14221710dcd6 req-59e3c30a-367d-467f-a69f-4cb24c74b986 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:17.059609 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-7e2db80e-e00b-463d-8e5c-14221710dcd6 req-59e3c30a-367d-467f-a69f-4cb24c74b986 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:17.080151 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-7e2db80e-e00b-463d-8e5c-14221710dcd6 req-59e3c30a-367d-467f-a69f-4cb24c74b986 service nova] Creating event network-vif-plugged:49cf1cd4-145e-4721-bcbd-d37636f37fae for instance 24af88cd-b779-4286-a535-d0fe13c1ec0c on nch1-master-1 Oct 29 22:14:17.087392 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-7e2db80e-e00b-463d-8e5c-14221710dcd6 req-59e3c30a-367d-467f-a69f-4cb24c74b986 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045281 Oct 29 22:14:17.088508 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3704/7500] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:14:17.636223 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:17.636870 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:17.643873 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:17.644383 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:17.644845 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:17.645598 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:17.646082 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:17.647089 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:17.776669 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:17.784570 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-14f9fa99-afc4-4ff8-842d-cff2d6e0dedd tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1373 microversion: 2.1 time: 0.152264 Oct 29 22:14:17.785167 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3797/7501] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:17 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:18.808267 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:18.808977 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:18.816062 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:18.816546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:18.816985 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:18.817709 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:18.818685 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:18.819097 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:18.955436 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:18.963495 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-00d9c2ce-a9d1-4ca6-a814-61de1a588556 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1558 microversion: 2.1 time: 0.159787 Oct 29 22:14:18.964074 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3705/7502] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:18 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:18.985937 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:14:18.986578 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:14:18.994106 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:18.994608 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:18.995066 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:18.995776 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:18.996249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:18.996697 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:19.128488 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:14:19.137039 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-a4847a4a-a827-4412-bcd4-dab4667fa741 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1558 microversion: 2.1 time: 0.155020 Oct 29 22:14:19.137660 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3798/7503] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:14:18 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:14:21.002812 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-1168bac1-93f5-4160-ab86-0212d236e1c2 req-413189ec-93ed-46b6-be7e-b4ed2c056ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24af88cd-b779-4286-a535-d0fe13c1ec0c", "tag": "49cf1cd4-145e-4721-bcbd-d37636f37fae"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:14:21.013292 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1168bac1-93f5-4160-ab86-0212d236e1c2 req-413189ec-93ed-46b6-be7e-b4ed2c056ed5 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:14:21.013898 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1168bac1-93f5-4160-ab86-0212d236e1c2 req-413189ec-93ed-46b6-be7e-b4ed2c056ed5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:14:21.014442 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-1168bac1-93f5-4160-ab86-0212d236e1c2 req-413189ec-93ed-46b6-be7e-b4ed2c056ed5 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:14:21.025907 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-1168bac1-93f5-4160-ab86-0212d236e1c2 req-413189ec-93ed-46b6-be7e-b4ed2c056ed5 service nova] Creating event network-changed:49cf1cd4-145e-4721-bcbd-d37636f37fae for instance 24af88cd-b779-4286-a535-d0fe13c1ec0c on nch1-master-1 Oct 29 22:14:21.031278 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-1168bac1-93f5-4160-ab86-0212d236e1c2 req-413189ec-93ed-46b6-be7e-b4ed2c056ed5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032299 Oct 29 22:14:21.032175 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3706/7504] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:16:19.987465 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:19.988227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=64 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:19.989253 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 22:16:19.989566 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c/action (ip 10.222.0.36) !!! Oct 29 22:16:19.990696 ncdv-master-1 devstack@n-api.service[138885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:16:19.990822 ncdv-master-1 devstack@n-api.service[138885]: Sat Oct 29 22:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c/action (ip 10.222.0.36) !!! Oct 29 22:16:19.996215 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1800142993"}} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:16:19.999224 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:20.010726 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:20.011227 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:20.011678 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:20.012393 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:20.012863 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:20.013339 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:20.219066 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-c67824a9-5b55-47c8-adeb-de7648fb518f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "POST /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c/action" status: 202 len: 0 microversion: 2.1 time: 0.233544 Oct 29 22:16:20.219719 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3799/7505] 10.222.0.36 () {60 vars in 1278 bytes} [Sat Oct 29 22:16:19 2022] POST /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 22:16:27.732309 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 22:16:27.746187 ncdv-master-1 devstack@n-api.service[138884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 22:16:27.746848 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=28 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:27.747631 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=54 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:27.748969 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:16:27.749153 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 29 22:16:27.750182 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 22:16:27.750312 ncdv-master-1 devstack@n-api.service[138884]: Sat Oct 29 22:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 29 22:16:27.845030 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-f0de40c9-bca7-4da9-8c67-40d831fb0a1a req-a7284557-f332-4116-a40d-9d5ccc668d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24af88cd-b779-4286-a535-d0fe13c1ec0c", "name": "network-vif-plugged", "status": "completed", "tag": "49cf1cd4-145e-4721-bcbd-d37636f37fae"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:16:27.855616 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f0de40c9-bca7-4da9-8c67-40d831fb0a1a req-a7284557-f332-4116-a40d-9d5ccc668d9c service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:27.856108 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f0de40c9-bca7-4da9-8c67-40d831fb0a1a req-a7284557-f332-4116-a40d-9d5ccc668d9c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:27.856547 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-f0de40c9-bca7-4da9-8c67-40d831fb0a1a req-a7284557-f332-4116-a40d-9d5ccc668d9c service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:27.867730 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-f0de40c9-bca7-4da9-8c67-40d831fb0a1a req-a7284557-f332-4116-a40d-9d5ccc668d9c service nova] Creating event network-vif-plugged:49cf1cd4-145e-4721-bcbd-d37636f37fae for instance 24af88cd-b779-4286-a535-d0fe13c1ec0c on nch1-master-1 Oct 29 22:16:27.872883 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-f0de40c9-bca7-4da9-8c67-40d831fb0a1a req-a7284557-f332-4116-a40d-9d5ccc668d9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143606 Oct 29 22:16:27.873507 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3707/7506] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:16:39.347067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_api:SELECT=2 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:39.347875 ncdv-master-1 devstack@n-api.service[138885]: DEBUG dbcounter [-] [138885] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=138885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:39.351697 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_api:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:39.352152 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:39.352590 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:39.352837 ncdv-master-1 devstack@n-api.service[138884]: DEBUG dbcounter [-] [138884] Writing DB stats nova_cell1:SELECT=2 {{(pid=138884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 22:16:39.369159 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [6fc1fc42-7ba2-4688-8adc-ad929101c6af] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47242. Oct 29 22:16:39.372914 ncdv-master-1 devstack@n-api.service[138884]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa9428e1-d9bd-4631-8e08-6b3439d99f35] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47244. Oct 29 22:16:39.373045 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:39.373431 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:39.373917 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:39.374651 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:39.375132 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:39.376030 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:39.409054 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 22:16:39.431677 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-682b76eb-b655-41e0-a4fd-aeff3274472f req-d45ab7e0-9557-41ad-b17e-2b689b885d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24af88cd-b779-4286-a535-d0fe13c1ec0c", "tag": "49cf1cd4-145e-4721-bcbd-d37636f37fae"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:16:39.442538 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-682b76eb-b655-41e0-a4fd-aeff3274472f req-d45ab7e0-9557-41ad-b17e-2b689b885d3b service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:39.443109 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-682b76eb-b655-41e0-a4fd-aeff3274472f req-d45ab7e0-9557-41ad-b17e-2b689b885d3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:39.443546 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-682b76eb-b655-41e0-a4fd-aeff3274472f req-d45ab7e0-9557-41ad-b17e-2b689b885d3b service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:39.456002 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-682b76eb-b655-41e0-a4fd-aeff3274472f req-d45ab7e0-9557-41ad-b17e-2b689b885d3b service nova] Creating event network-changed:49cf1cd4-145e-4721-bcbd-d37636f37fae for instance 24af88cd-b779-4286-a535-d0fe13c1ec0c on nch1-master-1 Oct 29 22:16:39.462199 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-682b76eb-b655-41e0-a4fd-aeff3274472f req-d45ab7e0-9557-41ad-b17e-2b689b885d3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114805 Oct 29 22:16:39.463309 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3708/7507] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:16:39.492590 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7a7fc7f1-df8a-4ce5-a7c0-22399ba3ee60 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 204 len: 0 microversion: 2.1 time: 0.147718 Oct 29 22:16:39.493199 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3800/7508] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 22:16:39 2022] DELETE /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 22:16:39.504354 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:39.505172 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:39.514315 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:39.515034 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:39.515545 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:39.517232 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:39.518932 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:39.519730 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:39.665228 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:16:39.673052 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7c2eef62-e196-4c98-83e5-abd2c4cabbba tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1682 microversion: 2.1 time: 0.174945 Oct 29 22:16:39.689301 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3709/7509] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:39 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:16:40.696836 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:40.697589 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:40.705058 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:40.705599 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:40.706060 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:40.706770 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:40.707243 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:40.707690 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:40.845337 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:16:40.853801 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-bf5d0cb7-cdeb-44c5-83a0-cd427f89328f tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1682 microversion: 2.1 time: 0.161113 Oct 29 22:16:40.854397 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3801/7510] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:40 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:16:41.879063 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:41.879571 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:41.887518 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:41.888052 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:41.888507 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:41.889394 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:41.889893 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:41.890329 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:41.967434 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [req-0afe575c-2f0c-410d-b2f4-12d8dfc75cf9 req-2be36c00-76b4-4d9f-83b1-c2662aa7a1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24af88cd-b779-4286-a535-d0fe13c1ec0c", "name": "network-vif-deleted", "tag": "49cf1cd4-145e-4721-bcbd-d37636f37fae"}]} {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:16:41.970831 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:16:41.978978 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-6d132e16-c132-4c79-afae-5203e3ed10c5 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 200 len: 1496 microversion: 2.1 time: 0.104695 Oct 29 22:16:41.979609 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3710/7511] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:41 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 1496 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:16:41.980955 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0afe575c-2f0c-410d-b2f4-12d8dfc75cf9 req-2be36c00-76b4-4d9f-83b1-c2662aa7a1c7 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:41.982426 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0afe575c-2f0c-410d-b2f4-12d8dfc75cf9 req-2be36c00-76b4-4d9f-83b1-c2662aa7a1c7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:41.983067 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [req-0afe575c-2f0c-410d-b2f4-12d8dfc75cf9 req-2be36c00-76b4-4d9f-83b1-c2662aa7a1c7 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:41.996479 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.compute.server_external_events [req-0afe575c-2f0c-410d-b2f4-12d8dfc75cf9 req-2be36c00-76b4-4d9f-83b1-c2662aa7a1c7 service nova] Creating event network-vif-deleted:49cf1cd4-145e-4721-bcbd-d37636f37fae for instance 24af88cd-b779-4286-a535-d0fe13c1ec0c on nch1-master-1 Oct 29 22:16:42.001661 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [req-0afe575c-2f0c-410d-b2f4-12d8dfc75cf9 req-2be36c00-76b4-4d9f-83b1-c2662aa7a1c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039181 Oct 29 22:16:42.002260 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3802/7512] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:16:43.003082 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:43.003735 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 24af88cd-b779-4286-a535-d0fe13c1ec0c] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:43.010633 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:43.011127 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:43.011634 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:43.012285 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:43.012749 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:43.013188 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:43.026577 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.wsgi [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] HTTP exception thrown: Instance 24af88cd-b779-4286-a535-d0fe13c1ec0c could not be found. Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Request method failure captured: Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: request: GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c HTTP/1.1 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Accept: application/json Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Accept-Encoding: identity Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Connection: close Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Content-Length: 0 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Content-Type: application/json Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Host: 10.222.0.36 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: Openstack-System-Scope: None Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: User-Agent: python-urllib3/1.26.12 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Auth-Token: gAAAAABjXaUJsExJElS8_240fk3t42UuoBKzMmc1-WJydwbt0_Bvxr2WA_N9UarfpA1LXNRmJlAoH5u4y9rqGUMa52ql83G6ZAAfHwp4K6lWwcvsjcg5cNT-FH5e-8rUuXjs0jvHQYvfRr2SxjQ_1tvvuqVLLXiQ3VxXeMvvTuSLdB3Q6bRrmzQ Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Id: None Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Domain-Name: None Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Identity-Status: Confirmed Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Is-Admin-Project: True Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Id: default Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Domain-Name: Default Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Id: 5a948f34a83e48b0866ffebda9a0870e Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Project-Name: tempest-TestSnapshotPattern-1854181652 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Role: reader,member Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Roles: reader,member Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant: tempest-TestSnapshotPattern-1854181652 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Id: 5a948f34a83e48b0866ffebda9a0870e Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-Tenant-Name: tempest-TestSnapshotPattern-1854181652 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-User: tempest-TestSnapshotPattern-1854181652-project Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Id: default Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-User-Domain-Name: Default Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-User-Id: 50d8c2096975438b8cd09d9f51409916 Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: X-User-Name: tempest-TestSnapshotPattern-1854181652-project Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: method: > Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: exception: Instance 24af88cd-b779-4286-a535-d0fe13c1ec0c could not be found. Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: action_args: {'id': '24af88cd-b779-4286-a535-d0fe13c1ec0c'} Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24af88cd-b779-4286-a535-d0fe13c1ec0c could not be found. Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24af88cd-b779-4286-a535-d0fe13c1ec0c could not be found. Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:16:43.028711 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24af88cd-b779-4286-a535-d0fe13c1ec0c could not be found. Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: ERROR nova.api.openstack.wsgi Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Returning 404 to user: Instance 24af88cd-b779-4286-a535-d0fe13c1ec0c could not be found. {{(pid=138884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-7bf264e5-6848-41a9-8d2c-01aa6ca4785c tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c" status: 404 len: 111 microversion: 2.1 time: 0.031007 Oct 29 22:16:43.033379 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3711/7513] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:42 2022] GET /compute/v2.1/servers/24af88cd-b779-4286-a535-d0fe13c1ec0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 22:16:44.349153 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:44.349792 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:44.351936 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-a2ba989b-d41f-40fa-b7a7-037ae0d3e371 req-15f72c4c-97b0-48a0-b913-cbb6bf547d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:16:44.358753 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:44.359269 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:44.359928 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:44.360819 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:44.361294 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:44.361793 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:44.368559 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a2ba989b-d41f-40fa-b7a7-037ae0d3e371 req-15f72c4c-97b0-48a0-b913-cbb6bf547d35 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:44.369131 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a2ba989b-d41f-40fa-b7a7-037ae0d3e371 req-15f72c4c-97b0-48a0-b913-cbb6bf547d35 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:44.369674 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-a2ba989b-d41f-40fa-b7a7-037ae0d3e371 req-15f72c4c-97b0-48a0-b913-cbb6bf547d35 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:44.381957 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-a2ba989b-d41f-40fa-b7a7-037ae0d3e371 req-15f72c4c-97b0-48a0-b913-cbb6bf547d35 service nova] Creating event network-changed:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:16:44.387412 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-a2ba989b-d41f-40fa-b7a7-037ae0d3e371 req-15f72c4c-97b0-48a0-b913-cbb6bf547d35 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039154 Oct 29 22:16:44.388111 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Going to try to terminate instance {{(pid=138885) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 22:16:44.388795 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3712/7514] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 22:16:44.473409 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-7afeb482-de18-410f-9a96-6a6351828bfc tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "DELETE /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 204 len: 0 microversion: 2.1 time: 0.127926 Oct 29 22:16:44.475215 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3803/7515] 10.222.0.36 () {58 vars in 1239 bytes} [Sat Oct 29 22:16:44 2022] DELETE /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 22:16:44.485689 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:44.486714 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.compute.api [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138884) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:44.493397 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:44.494008 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:44.494544 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:44.495321 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:44.495868 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:44.496372 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:44.640931 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.policy [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138884) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:16:44.648853 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-3abf4f5b-6ab9-47db-965b-36994384d20e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1684 microversion: 2.1 time: 0.168351 Oct 29 22:16:44.649431 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3713/7516] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:44 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 22:16:45.674249 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:45.674983 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:45.681933 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:45.682439 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:45.682897 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:45.683621 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:45.684100 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:45.685175 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:45.761763 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.policy [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d8c2096975438b8cd09d9f51409916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a948f34a83e48b0866ffebda9a0870e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=138885) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 22:16:45.761939 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [req-e6d92b4e-46bc-47f0-b25f-65825285c846 req-3d97cb73-3daa-49dc-b004-f2021bf53021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e0f843-b2ff-47ac-9222-5e45f5a52123", "name": "network-vif-deleted", "tag": "5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6"}]} {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 22:16:45.770048 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-4e611fd6-f3d8-4f18-94ab-e665e4082fde tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 200 len: 1497 microversion: 2.1 time: 0.100122 Oct 29 22:16:45.771188 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3804/7517] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:45 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 1497 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 22:16:45.783344 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e6d92b4e-46bc-47f0-b25f-65825285c846 req-3d97cb73-3daa-49dc-b004-f2021bf53021 service nova] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:45.784021 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e6d92b4e-46bc-47f0-b25f-65825285c846 req-3d97cb73-3daa-49dc-b004-f2021bf53021 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:45.784628 ncdv-master-1 devstack@n-api.service[138884]: DEBUG oslo_concurrency.lockutils [req-e6d92b4e-46bc-47f0-b25f-65825285c846 req-3d97cb73-3daa-49dc-b004-f2021bf53021 service nova] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=138884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:45.797756 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.compute.server_external_events [req-e6d92b4e-46bc-47f0-b25f-65825285c846 req-3d97cb73-3daa-49dc-b004-f2021bf53021 service nova] Creating event network-vif-deleted:5be2d3c4-dad0-43de-b1ce-a164e6f0f7b6 for instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 on nch2-master-1 Oct 29 22:16:45.802356 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [req-e6d92b4e-46bc-47f0-b25f-65825285c846 req-3d97cb73-3daa-49dc-b004-f2021bf53021 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106839 Oct 29 22:16:45.802955 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3714/7518] 10.222.0.36 () {64 vars in 1317 bytes} [Sat Oct 29 22:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 22:16:46.795105 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '>' {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:46.795750 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.compute.api [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] [instance: 82e0f843-b2ff-47ac-9222-5e45f5a52123] Fetching instance by UUID {{(pid=138885) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 22:16:46.802694 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:46.803198 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:46.803658 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:46.804373 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Acquiring lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 22:16:46.804847 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 22:16:46.805296 ncdv-master-1 devstack@n-api.service[138885]: DEBUG oslo_concurrency.lockutils [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Lock "cb6b48b8-5ec2-4df1-a1df-e17e28ba60d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=138885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 22:16:46.818464 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.wsgi [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] HTTP exception thrown: Instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 could not be found. Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Request method failure captured: Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: request: GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 HTTP/1.1 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Accept: application/json Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Accept-Encoding: identity Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Connection: close Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Content-Length: 0 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Content-Type: application/json Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Host: 10.222.0.36 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: Openstack-System-Scope: None Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: User-Agent: python-urllib3/1.26.12 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Auth-Token: gAAAAABjXaUJsExJElS8_240fk3t42UuoBKzMmc1-WJydwbt0_Bvxr2WA_N9UarfpA1LXNRmJlAoH5u4y9rqGUMa52ql83G6ZAAfHwp4K6lWwcvsjcg5cNT-FH5e-8rUuXjs0jvHQYvfRr2SxjQ_1tvvuqVLLXiQ3VxXeMvvTuSLdB3Q6bRrmzQ Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Id: None Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Domain-Name: None Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Identity-Status: Confirmed Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Is-Admin-Project: True Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Id: default Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Domain-Name: Default Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Id: 5a948f34a83e48b0866ffebda9a0870e Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Project-Name: tempest-TestSnapshotPattern-1854181652 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Role: reader,member Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Roles: reader,member Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a948f34a83e48b0866ffebda9a0870e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}] Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant: tempest-TestSnapshotPattern-1854181652 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Id: 5a948f34a83e48b0866ffebda9a0870e Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-Tenant-Name: tempest-TestSnapshotPattern-1854181652 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-User: tempest-TestSnapshotPattern-1854181652-project Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Id: default Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-User-Domain-Name: Default Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-User-Id: 50d8c2096975438b8cd09d9f51409916 Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: X-User-Name: tempest-TestSnapshotPattern-1854181652-project Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: method: > Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: exception: Instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 could not be found. Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: action_args: {'id': '82e0f843-b2ff-47ac-9222-5e45f5a52123'} Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: {{(pid=138885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 could not be found. Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 could not be found. Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 22:16:46.820138 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 could not be found. Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: ERROR nova.api.openstack.wsgi Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: DEBUG nova.api.openstack.wsgi [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Returning 404 to user: Instance 82e0f843-b2ff-47ac-9222-5e45f5a52123 could not be found. {{(pid=138885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: INFO nova.api.openstack.requestlog [None req-fda3be85-b0ae-4724-989e-f9bbf8df641e tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123" status: 404 len: 111 microversion: 2.1 time: 0.031071 Oct 29 22:16:46.824657 ncdv-master-1 devstack@n-api.service[138885]: [pid: 138885|app: 0|req: 3805/7519] 10.222.0.36 () {58 vars in 1236 bytes} [Sat Oct 29 22:16:46 2022] GET /compute/v2.1/servers/82e0f843-b2ff-47ac-9222-5e45f5a52123 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 22:16:46.988380 ncdv-master-1 devstack@n-api.service[138884]: DEBUG nova.api.openstack.wsgi [None req-ecee1b90-4f8a-4684-8cc4-4e01ec0438b6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] Calling method '.version_select at 0x7fa170f3faf0>' {{(pid=138884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 22:16:47.014094 ncdv-master-1 devstack@n-api.service[138884]: INFO nova.api.openstack.requestlog [None req-ecee1b90-4f8a-4684-8cc4-4e01ec0438b6 tempest-TestSnapshotPattern-1854181652 tempest-TestSnapshotPattern-1854181652-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-435038263" status: 202 len: 0 microversion: 2.1 time: 0.030791 Oct 29 22:16:47.014617 ncdv-master-1 devstack@n-api.service[138884]: [pid: 138884|app: 0|req: 3715/7520] 10.222.0.36 () {58 vars in 1254 bytes} [Sat Oct 29 22:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-435038263 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)